Gå til indhold
Global sound
AI & LLM Primer

AI & LLM Primer

2-1-5. The Industrial Pipeline — Training Large Models

· 31 min.

Episodebeskrivelse

In this episode, we move from the theoretical blueprint of the Transformer to the operational reality of building a Large Language Model. We explore how an empty mathematical shell is transformed into a capable system through a massive, coordinated engineering process known as training.
Join us as we:
• Curate the Curriculum: We discuss why "more data" isn't always better, explaining the critical steps of deduplication, filtering, and balancing diverse sources like web text, books, and code.
• Minimize the Surprise: We break down the mathematical objective of Cross-Entropy Loss and the…

Website: podcasters.spotify.com

Live, seneste time: 10.120 sange på 4.350 stationer i 121 lande

Opdag verden gennem radioen

Flere måder at opdage på (7)

Hørt noget godt? Gem det, eller åbn det direkte i Spotify.

★ Artist of the week The fastest riser on the radio this week
Your song here? From € 9 per week →
Radio OsthofenFortsæt med at lytte