Skip to content
Global sound
The Information Bottleneck

The Information Bottleneck

Text Diffusion Models with Brendan O'Donoghue (Google DeepMind)

· 1 h 9 min

Show notes

Brendan O'Donoghue, research director at Google DeepMind, makes the case for text diffusion as a real alternative to autoregressive generation. He walks through how discrete diffusion works, why diffusion samples are far more diverse and what that unlocks for RL, where the Gemma diffusion model actually stands against frontier models, and why the whole training and serving stack being hyper-optimized for autoregression is the main thing holding the approach back. The conversation also covers hardware trends favoring flops over bandwidth, AGI timelines and real-world bottlenecks, and why he…

Live, last hour: 10,166 songs on 5,723 stations in 143 countries

Discover the world through radio

More ways to discover (9)

Heard something good? Save it, or open it straight away in Spotify.

★ Artist of the week The fastest riser on the radio this week
Your song here? From € 9 per week →
KaribKonnectContinue listening