Ir para o conteúdo
Global sound
State of AI with Nathan Benaich

State of AI with Nathan Benaich

Compute scarcity is an engineering problem

· 8 min

Notas do episódio

Angelos Perivolaropoulos, a research engineer at ElevenLabs, on turning GPU scarcity into an inference-engineering problem: how to serve far more users on the same hardware, from batching to frontier architecture changes. Recorded at RAAIS 2026.
00:00 Introduction: ElevenLabs and the GPU squeeze
00:38 The question: how to scale when you can't add capacity
01:11 About Angelos: Scribe, speech-to-text and text-to-speech
01:56 GPU scarcity meets exponential demand
02:44 What a token actually costs: compute vs memory bandwidth
03:38 Prefill, decode and the KV cache
05:53 Batching and continuous…

Site: podcasters.spotify.com

Ao vivo, última hora: 15.234 músicas em 6.881 rádios de 143 países

Descubra o mundo pelo rádio

Mais formas de descobrir (9)

Ouviu algo legal? Salve ou abra direto no Spotify.

★ Artist of the week The fastest riser on the radio this week
Your song here? From € 9 per week →
Radio 538 luisteren - Live!Popular agora