Saltar al contenido
Global sound
Linear Digressions

Linear Digressions

Better Know A Benchmark: ExploitGym

· 33 min

Notas del episodio

When OpenAI's frontier models were caught hacking Hugging Face's servers, most people assumed they were hunting for answer keys. The real story is stranger and more unsettling. Katie and Phoebe unpack ExploitGym — the cybersecurity benchmark at the center of the incident — and why agents are scored not just on whether they capture the flag, but on whether they used the specified vulnerability to get there. That nuance turned out to be load-bearing: the agents reverse-engineered the flags within the first hour, then spent days attacking Hugging Face to learn how the LLM judge worked so they could get their cheated answers past it. The punchline? OpenAI never had that judge switched on.

Web: soundcloud.com

En directo, última hora: 11.328 canciones en 4.984 emisoras de 120 países

Descubre el mundo a través de la radio

Más formas de descubrir (9)

¿Has oído algo bueno? Guárdalo o ábrelo directamente en Spotify.

Chada FMSeguir escuchando