Skip to content
Global sound
Simons Foundation Lectures

Simons Foundation Lectures

Matthieu Wyart: How Much Data Is Required to Learn the Structure of Language? (September 25, 2026)

· 59 min

Show notes

Despite the fact that experimental neural scaling laws have substantially guided empirical progress in large-scale machine learning, no existing theory can quantitatively predict the exponents of these important laws for any modern LLM trained on natural languages. It is also unclear whether they can be beaten by training with other objectives. Matthieu Wyart will review the efforts of the collaboration in studying this phenomenon, including the first such theory in the case of data-limited scaling laws. Wyart will then introduce synthetic languages displaying a hidden hierarchy (a central…

Live, last hour: 9,685 songs on 5,299 stations in 143 countries

Discover the world through radio

More ways to discover (7)

Heard something good? Save it, or open it straight away in Spotify.

★ Artist of the week The fastest riser on the radio this week
Your song here? From € 9 per week →
DIRTY30 BLUESContinue listening