Skip to content
Global sound
10-Minute System Design

10-Minute System Design

How Meta Trains AI Models at Scale

· 15 min · Season 1 Episode 16

Show notes

In this episode, we'll take a look at Meta’s ambitious approach to scaling large language models. We'll explore the shift from handling many smaller models for recommendation engines to building colossal generative AI models, and the immense challenges that come with it. From hardware and software optimizations to managing power and dealing with inevitable hardware failures, we'll break down the critical pieces that make Meta's infrastructure tick. What does it take to run systems this large without breaking? Tune in to learn how Meta did it.

Website: podcasters.spotify.com

Live, last hour: 8,029 songs on 4,020 stations in 126 countries

Discover the world through radio

More ways to discover (7)

Heard something good? Save it, or open it straight away in Spotify.

★ Artist of the week The fastest riser on the radio this week
Your song here? From € 9 per week →
La Lupe 92.1 FM MazatlánContinue listening