Skip to content
Global sound
The Cisco AI Insights Podcast

The Cisco AI Insights Podcast

EP. 2 - Unlocking Cost-Effective AI with Small Language Models

· 22 min · Episode 2

Show notes

In the latest episode of the Cisco AI Insights Podcast, hosts Rafael Herrera and Sónia Marques welcome Cisco AI operations engineer James Tidd for a discussion on the world of small language models (SLMs) and the evolution of efficient AI inference. Together, they unravel the complexities behind “Fast Inference from Transformers via Speculative Decoding,” a groundbreaking paper from Google that explores how smaller draft models can speed up large language model predictions while maintaining accuracy.

James shares his hands-on experience experimenting with the technique, leveraging knowledge…

Website: podcasters.spotify.com

Live, last hour: 7,440 songs on 2,938 stations in 128 countries

Discover the world through radio

More ways to discover (7)

Heard something good? Save it, or open it straight away in Spotify.

★ Artist of the week The fastest riser on the radio this week
Your song here? From € 9 per week →
WBJL RADIOContinue listening