İçeriğe geç
Global sound
Born In Silicon Valley

Born In Silicon Valley

One Professor's $24M Bet

· 38 dk · Bölüm 255

Bölüm notları

Are soaring AI compute costs slowing down your startup scaling efforts? Join us as we sit down with Junchen Jiang, CEO of TensorMesh, to reveal how his groundbreaking KV cache optimization can slash your AI inference expenses by up to 80 percent.

In this highly technical and insightful episode of Born in Silicon Valley, we explore the rapidly evolving landscape of self-hosted large language models. Junchen explains the mechanics behind KV cache, why traditional GPU memory limitations bottleneck AI performance, and how offloading this data can dramatically improve efficiency for enterprise…

Web sitesi: borninsiliconvalley.podbean.com

★ Artist of the week The fastest riser on the radio this week
Your song here? From € 9 per week →
theradio.fmDinlemeye devam et