Salt la conținut
Global sound
CoRecursive: Coding Stories

CoRecursive: Coding Stories

The Pre-Training Wall and the Treadmill After It

· 56 min · Episodul 121

Note de episod

I've been confusing Don with frontier-lab links late at night for a bit.
Ilya Sutskever told a NeurIPS audience that pre-training as we know it would unquestionably end. There's only one internet, and the data isn't growing. The frontier labs call this the pre-training wall.
A leaked Google memo from 2023 argued they had no moat. R1 is on GitHub. Llama is on Hugging Face. OpenAI's secondary-market valuation has climbed past $850 billion.
Don was confused. So he came over and we made an episode about it.

• Episode Page
• Support The Show
• Subscribe To The Podcast
• Join The Newsletter

Site: corecursive.com

Live, ultima oră: 9.527 melodii pe 5.099 posturi din 146 țări

Descoperă lumea prin radio

Mai multe moduri de a descoperi (9)

Ai auzit ceva frumos? Salvează-l sau deschide-l direct în Spotify.

★ Artist of the week The fastest riser on the radio this week
Your song here? From € 9 per week →
Radio 538 luisteren - Live!Populare acum