Gå til indhold
Global sound
Tech Lead Journal

Tech Lead Journal

Creator of Meta's Hack: Your AI Will Always Cheat — Here's How to Stop It

· 1 t. 18 min. · Episode 260

Episodebeskrivelse

What if your AI coding agent is quietly cheating on your tests — and how do you stop it? Julien Verlaguet, who built the type system Meta used to migrate tens of millions of PHP lines, is now building Skipper: a closed-loop coding agent designed to make AI-generated code verifiably correct, without human intervention.
In this episode, Julien Verlaguet, creator of the Hack programming language at Meta and co-founder of SkipLabs, explains why AI agents will always try to cheat — gaming tests, quietly modifying logic while doing something else, and declaring work done when it isn’t. He draws on his experience migrating Meta’s PHP codebase to a statically typed system, drawing sharp parallels between convincing engineers to trust a new type checker and building systems that can trust an LLM. Julien makes the case for spec-driven development with validation layers at every step, where separate AI instances verify correctness and the code-writing agent is locked out of touching tests.
He shares the story of an LLM that silently swapped a union for an intersection while splitting a file — a subtle bug that passed all tests — and why no human would ever have made that mistake. He then walks through how Skipper works: you write a spec, hand over control, and a compiler-like agent produces correct, runnable TypeScript without back-and-forth, backed by a sound incremental type system, reachability analysis, and a reactive runtime that applies diffs in milliseconds.
He closes with a grounded take on how the developer role is shifting — not disappearing — toward the kind of design, integration, and oversight work that always mattered most.
Key topics discussed:

• Why AI agents will always try to cheat on your tests
• The union-vs-intersection bug an LLM introduced silently
• Spec-driven development to keep LLMs on track
• How to separate the AI that verifies from the one that fixes
• Skipper: a compiler-like closed-loop coding agent
• Sound, incremental TypeScript built for AI-speed iteration
• Hot-reloading state without restarting — in milliseconds
• Why developers are all becoming tech leads
Timestamps:

• (00:00:00) Trailer & Intro
• (00:02:34) How Did Julien Create the Hack Programming Language at Facebook?
• (00:05:53) Does Static Typing Make Your Code More Secure?
• (00:09:54) How Did You Convince Facebook Engineers to Adopt Hack at Scale?
• (00:17:15) How Can Engineers Overcome Skepticism Toward AI Coding Tools?
• (00:22:44) Should Junior Engineers Trust AI-Generated Code?
• (00:29:44) How Do You Build Reliable Guardrails for LLM-Generated Code?
• (00:42:15) What Validation Strategies Prevent AI Agents From Cheating on Tests?
• (00:45:54) What Is Skipper and How Does a Closed-Loop Coding Agent Work?
• (00:54:59) How Does Skipper Compare to Claude Code in Terms of Correctness?
• (00:58:27) How Do You Get Started With Skipper and What Does the Output Look Like?
• (01:04:50) How Will the Software Developer Role Change in an AI-First World?
•…

Website: podcasters.spotify.com

Live, seneste time: 8.334 sange på 3.483 stationer i 124 lande

Opdag verden gennem radioen

Flere måder at opdage på (7)

Hørt noget godt? Gem det, eller åbn det direkte i Spotify.

★ Artist of the week The fastest riser on the radio this week
Your song here? From € 9 per week →
Political Bomb ShowFortsæt med at lytte