Note dell’episodio
For years the canonical evidence suggested neural networks pack unrelated concepts into the same neurons, a tangled knot you have to unpick with a second model before you can study anything. Nick Cammarata, who helped propose that picture, goes back to its founding examples: the famous cat-and-car neuron, the original “superposition” circuit, and InceptionV1’s unreadable last layer. With better tools, modern models, and armies of automated scientists, he argues they were misread, that most of what looked like arbitrary packing is a fractal kind of generalization, and that a network’s own…
Sito web: askwhocastsai.substack.com

