Show notes
Benchmarks are the primary measure of AI capability. They involve testing the most advanced models and seeing what kinds of problems they can solve, or what kinds of human tasks they might be able to do.
And from late 2025 to mid-2026, most of the main benchmarks became saturated, meaning the models score so highly that the tests aren't meaningful anymore, both in terms of comparing different models' performance as well as their individual performance. That might suggest the models are just getting good at taking these tests. Or it might mean we're approaching the threshold of AGI.
In this…
Website: podcasters.spotify.com
