The Information Bottleneck
by Ravid Shwartz-Ziv & Allen Roush
Latest episode
Why Video Games Still Don’t Use Modern AI | Julian Togelius (NYU)
Why Video Games Still Don’t Use Modern AI | Julian Togelius (NYU)
About this podcast
Two AI Researchers - Ravid Shwartz Ziv, and Allen Roush, discuss the latest trends, news, and research within Generative AI, LLMs, GPUs, and Cloud Systems.
Episodes
The newest 20 of 77 episodes
- Why Video Games Still Don’t Use Modern AI | Julian Togelius (NYU) · 1 h 13 minJulian Togelius, an NYU professor and co-founder of modl.ai, is living the dream of every kid who grew up as a computer geek and gamer. He’s been doing AI research on video games…
- What’s Left for Mathematicians? | Daniel Litt · 1 h 18 minIn this episode, we talked with Daniel Litt, a mathematician at the University of Toronto. In March 2025, Daniel bet that AI would not be able to autonomously produce an Annals…
- The Political Economy of AI: Governance, Bias, and the Future | Andy Hall (Stanford/Anthropic) · 1 h 24 minIn this episode of the the information bottleneck podcast, we talked with Andy Hall, a Stanford professor and MTS at Anthropic. The conversation explores the political economy of…
- John Platt (Google): AI for Climate and Science · 1 h 12 minJohn Platt is a Google Fellow and leads the Applied Science team at Google Research, the group working on climate and science. He's also the person behind SMO and Platt scaling…
- Yuandong Tian on Recursive Self-Improvement · 58 minYuandong Tian spent many years at Meta FAIR and recently left to co-found Recursive Superintelligence, a company building AI that improves itself. In this episode, he tells us…
- Chris Manning: Language Is the Real Unlock for Intelligence · 56 minChris Manning is a legend in NLP. He's a professor of linguistics and computer science at Stanford and ran the Stanford AI Lab. His course CS224N, Natural Language Processing…
- Why AI Still Can't See wtih Andrew Dai · 58 minAndrew Dai spent over a decade at Google Brain and DeepMind, where he co-wrote the 2015 paper that introduced language model pre-training followed by fine-tuning, and later…
- Can AI Replace Doctors? Zachary Lipton on the Future of Healthcare and AI · 1 h 31 minZachary Lipton is an associate professor at Carnegie Mellon University and a co-founder of Abridge, a healthcare AI company (and a jazz saxophonist!). His research spans machine…
- Sara Hooker on the End of Static AI · 1 h 35 minWhat comes after scaling? We talk with Sara Hooker, co-founder and CEO of Adaptation Lab, about why the next generation of AI may look very different from today's static models…
- Tiny Recursive Models Beat the Giants - Alexia Jolicoeur-Martineau (Microsoft) · 52 minAlexia Jolicoeur-Martineau is a Principal Researcher at Microsoft and the author of "Less is More: Recursive Reasoning with Tiny Networks," the paper behind the Tiny Recursive…
- Continual Learning Is the Next Bottleneck | Rohan Anil (Core Automation ) · 1 h 11 minRohan Anil spent eleven and a half years at Google, where he went from writing memory allocators to large-scale linear solvers, then optimization at Google Brain, where he…
- World Models | John Langford (Microsoft AI Labs) · 1 h 5 minJohn Langford, one of the heads of Microsoft's AI Labs, the creator of Vowpal Wabbit, and a co-inventor of CAPTCHA, joins us to talk about world models. Transformers need orders…
- Which Tabular Model Should You Actually Use? | David Holzmüller (INRIA) · 56 minDescription Tabular data is still where most of machine learning actually happens in industry, and the field has changed a lot in the last few years. In this episode we talk with…
- Why You Can't Just Rent 1,000 GPUs | Charles Frye (Modal) · 1 h 3 minCharles Frye (Modal, ex-Weights & Biases, Berkeley PhD) joins Ravid and Allen to explain why modern AI research is bottlenecked by compute, and why simply buying more GPUs…
- Stella Biderman (EleutherAI) - Open Source, AI Safety, and Who We Can Trust · 1 h 6 minStella Biderman, Executive Director of EleutherAI, joins us the week an OpenAI model autonomously broke out of its sandbox and hacked Hugging Face. Stella calls it what she…
- Why Deep Learning Finally Works on Tables | Frank Hutter (Prior Labs) · 1 h 18 minIn this episode, Frank Hutter joins us to talk about TabPFN and why tabular data is suddenly the hottest problem in deep learning. Frank is a professor at the University of…
- Surya Ganguli: The Physics of Intelligence · 1 h 25 minSurya Ganguli is a professor at Stanford and VP at General Catalyst, working at the intersection of physics, neuroscience, and AI. He started in string theory, moved to…
- Text Diffusion Models with Brendan O'Donoghue (Google DeepMind) · 1 h 9 minBrendan O'Donoghue, research director at Google DeepMind, makes the case for text diffusion as a real alternative to autoregressive generation. He walks through how discrete…
- Nathan Lambert: Inside Post-Training and the Open Model Fight · 1 h 15 minNathan Lambert spent three years as post-training lead at Ai2, where he built the OLMo models, and he writes Interconnects, one of the most-read technical newsletters in AI. He…
- Daphne Koller - The Future of AI in Biology and Drug Discovery · 1 h 2 minDaphne Koller wrote the book that many of us learned probabilistic graphical models from, founded Coursera, and now runs insitro, which is trying to make drug discovery a…








