Show notes
TL;DR
* The Hardware Friction Map asserts that the survival of neural architectures is determined by economics, as hardware imposes a “compute tax” based on how much an idea deviates from subsidized GPU primitives like dense matrix multiplications.
* Architectures are classified into four zones (Green, Yellow, Orange, Red) based on the increasing engineering and compute cost required to clear Gate 1: hardware and infrastructure viability, ranging from techniques that require only retraining to those that are architecturally misaligned with current GPU stacks.
* Examples of friction include…
Website: lambpetros.substack.com
