Note de episod
What is AGI, and what would count as evidence that it had been built? This episode explains why there's no single, universally accepted AGI definition, then works through practical ways to evaluate breadth, performance, autonomy, adaptation, and reliability instead of chasing one benchmark score.
One common definition treats AGI as a hypothetical system that equals or surpasses human performance on all, or almost all, cognitive tasks. OpenAI's charter uses a narrower, economic definition instead: highly autonomous systems that outperform humans at most economically valuable work. The episode notes that the International AI Safety Report 2026 sidesteps the term "AGI" altogether in favor of "general-purpose AI," which is itself a sign of how contested a single definition is. It also covers Google DeepMind's "Levels of AGI" framework, which separates performance, generality, and autonomy into a range of levels rather than one threshold to cross.
The episode walks through what a meaningful test would need to look like: a large set of tasks the system wasn't specifically trained or tuned to pass, covering unfamiliar programming problems, research questions, new software tools learned from documentation, long projects with changing requirements, and recovery from failed plans, graded on reliability and how much human intervention is needed rather than on the final answer alone.
It covers METR's task-completion time horizon, a metric that estimates how long a human expert would take on a task and measures how long a task an AI agent can complete at a given reliability, and cites METR's May 2026 measurements. It also draws on the International AI Safety Report's description of today's systems as having "jagged capabilities," excelling on hard exams and coding tasks while failing simple ones, and an "evaluation gap" where benchmark performance can overstate how useful a system is outside the lab.
The episode closes on a more operational framing: whether a general AI system can take on a large share of skilled human work, across many fields, reliably enough that organizations rely on it, and argues that AGI is more likely to be established through a pattern of sustained, independent evidence than through any single benchmark or demo.
Sources & References
International AI Safety Report 2026 — https://internationalaisafetyreport.org/publication/international-ai-safety-report-2026
International AI Safety Report 2026: Extended Summary for Policymakers — https://internationalaisafetyreport.org/publication/2026-report-extended-summary-policymakers
OpenAI: OpenAI Charter — https://openai.com/charter/
Google DeepMind: Levels of AGI for Operationalizing Progress on the Path to AGI — https://deepmind.google/research/publications/66938/
METR: Task-Completion Time Horizons of Frontier AI Models — https://metr.org/time-horizons/
METR: Time Horizon 1.1 — https://metr.org/blog/2026-1-29-time-horizon-1-1/
Voice narration is AI-generated.
Site: podcasters.spotify.com

