Zum Inhalt springen
Global sound
The Board in the Machine

The Board in the Machine

The Headroom Argument: Why AI Efficiency Means More Compute, Not Less

· 12 Min.

Shownotes

A new AI architecture lands on 5 May. Subquadratic launches SubQ: a 12-million-token context window on a sub-quadratic sparse-attention architecture that reduces attention compute by roughly 1,000 times at full context. The interesting question is not whether AI is about to get cheaper. It is what efficiency news actually says about compute demand. The day after SubQ launched, Anthropic announced a partnership at SpaceX's Colossus 1 facility adding more than 300MW of new capacity and over 220,000 NVIDIA GPUs. Both kinds of news end in the same place: more inference, not less.

In this…

Website: mariothomas.com

Live, letzte Stunde: 7.640 Songs auf 3.191 Sendern in 127 Ländern

Entdecke die Welt über das Radio

Mehr zum Entdecken (7)

Etwas Schönes gehört? Speicher es oder öffne es direkt in Spotify.

★ Künstler der Woche Der schnellste Aufsteiger im Radio diese Woche
Dein Song hier? Ab € 9 pro Woche →
WDER 92.1 FMWeiterhören