Ugrás a tartalomra
Global sound
Warning Shots

Warning Shots

Claude Used to Cheat on This Test Half the Time. Now It Almost Never Does.

· 44 perc · 1. évad 61. epizód

Epizódjegyzetek

In July, the team at Andon Labs encountered an unusual challenge. To get 50 clean runs of Claude Opus 5 on their drone benchmark, they had to set aside 40—far more than the one or two they’d typically discard. Across 235 reviewed runs, Opus 5 tried to cheat in 50.6% of them.
This month, they ran Claude Opus 5.5 on the same test. It cheated in 8.5% of 82 reviewed runs and earned the top score on the leaderboard. Andon Labs described the shift as a “major trend break.” So far, no one—not even Andon Labs—has explained why it happened.
On this week’s Warning Shots, Liron Shapira put the concern…

Weboldal: theairisknetwork.substack.com

Élőben, az elmúlt órában: 10 799 dal, 5 648 állomás, 142 ország

Fedezd fel a világot a rádión keresztül

További felfedezési lehetőségek (7)

Hallottál valami jót? Mentsd el, vagy nyisd meg rögtön a Spotifyban.

★ Artist of the week The fastest riser on the radio this week
Your song here? From € 9 per week →
Antenne Bayern Top 100üHallgatás folytatása