Show notes
What if everything you thought you knew about training large language models turned out to be… not quite right? 🤯
In this episode, we dive deep into a topic that could completely change the way we think about LLM training. We’re talking about batch size — yes, it sounds dry and technical, but new research shows that tiny batches, even as small as one, don’t just work — they can actually bring major advantages.
🔍 In this episode you’ll learn:
• Why the dogma of “huge batches for stability” came about in the first place.
• How LLM training is fundamentally different from classical…
Website: podcasters.spotify.com

