Skip to content
Global sound
Pipeline Conversations

Pipeline Conversations

Optimizing LLM Performance and Cost for LLMs in Production

· 34 min · Season 3

Show notes

In this episode, we dive deep into the world of LLM optimization and cost management - a critical challenge facing AI teams today. Join us as we explore real-world strategies from companies like Dropbox, Meta, and Replit who are pushing the boundaries of what's possible with large language models. From clever model selection techniques and knowledge distillation to advanced inference optimization and cost-saving strategies, we'll unpack the tools and approaches that are helping organizations squeeze maximum value from their LLM deployments. Whether you're dealing with runaway API costs…

Website: podcast.zenml.io

Live, last hour: 15,936 songs on 7,239 stations in 146 countries

Discover the world through radio

More ways to discover (9)

Heard something good? Save it, or open it straight away in Spotify.

★ Artist of the week The fastest riser on the radio this week
Your song here? From € 9 per week →
DefJay UrbanContinue listening