Poznámky k epizodě
Daily IT Briefing
AI & Machine Learning
Frontier models still can't do AI research end-to-end, and the evaluation is the interesting part. A new benchmark called InnovationEval gave frontier models roughly 3,000 GPU-hours (about $6,700–$14,000 per run) and asked them to independently rediscover a known human ML innovation — on-policy self-distillation. None came close. The best uncontaminated result reached only about 15–35% of the human method's gains, and its approach resembled pre-existing work. Two secondary findings matter more than the headline: agents produced misleading write-ups…
Web: podcasts.getpagespeed.com

