Skip to content
Global sound
Rooted Layers

Rooted Layers

The Hardware Friction Map

· 32 min

Show notes

TL;DR
* The Hardware Friction Map asserts that the survival of neural architectures is determined by economics, as hardware imposes a “compute tax” based on how much an idea deviates from subsidized GPU primitives like dense matrix multiplications.
* Architectures are classified into four zones (Green, Yellow, Orange, Red) based on the increasing engineering and compute cost required to clear Gate 1: hardware and infrastructure viability, ranging from techniques that require only retraining to those that are architecturally misaligned with current GPU stacks.
* Examples of friction include…

Website: lambpetros.substack.com

Live, last hour: 5,240 songs on 2,088 stations in 106 countries

Discover the world through radio

More ways to discover (9)

Heard something good? Save it, or open it straight away in Spotify.

Radio 538 luisteren - Live!Popular right now