Notas do episódio
Angelos Perivolaropoulos, a research engineer at ElevenLabs, on turning GPU scarcity into an inference-engineering problem: how to serve far more users on the same hardware, from batching to frontier architecture changes. Recorded at RAAIS 2026.
00:00 Introduction: ElevenLabs and the GPU squeeze
00:38 The question: how to scale when you can't add capacity
01:11 About Angelos: Scribe, speech-to-text and text-to-speech
01:56 GPU scarcity meets exponential demand
02:44 What a token actually costs: compute vs memory bandwidth
03:38 Prefill, decode and the KV cache
05:53 Batching and continuous…
Site: podcasters.spotify.com

