Bölüm notları
Goodfire technical staff member Curt Tigges discusses research revealing that individual MLP neurons in modern language models are far more interpretable and functionally bounded than previously thought. Using an automated agent to test hypotheses across architectures like Qwen3.6-35B-A3B, Tigges explains how modern gated MLPs act as legible conjunctions and control signals capable of extensive dynamic sparsity without lasting benchmark loss. By showing that many internal representations can be directly enumerated, this work offers an alternative to complex external featurizers and provides practical avenues for behavior monitoring and persona steering.
For full show notes, links, and references, read the episode page:https://www.cognitiverevolution.ai/the-neuron-basis-goodfire-s-curt-tigges-on-agentic-interp-monosemanticity-reverse-engineering/
Sponsors:
Claude: Claude is the AI collaborator built for problem solvers, extending your thinking across coding, modeling, and strategic workflows. Get started and discover Claude Pro at https://claude.ai/tcr
OutSystems: OutSystems is the leading agentic systems platform that enables enterprises to engineer, orchestrate, and govern AI applications on a single unified platform. Learn more and see how it works at https://outsystems.com/tcr
Tasklet: Tasklet empowers your business with AI agents that connect to your tools and automate recurring workflows with no code required. Visit https://tasklet.ai and use code cog rev for $50 in free credits
CHAPTERS:
(00:00) About the Episode
(05:55) Rethinking individual neuron interpretability
(12:25) Understanding gated MLPs
(22:57) Sparsity and ablation experiments (Part 1)
(23:03) Sponsors: Claude | OutSystems
(26:20) Sparsity and ablation experiments (Part 2) (Part 1)
(39:07) Sponsor: Tasklet
(40:44) Sparsity and ablation experiments (Part 2) (Part 2)
(41:30) The neuron scientist agent
(55:10) Monosemanticity versus circuit mechanics
(01:09:37) Reverse engineering for alignment
(01:20:24) Factual recall and experts
(01:28:41) Designing interpretable architectures
(01:36:16) Restoring reasoning performance
(01:45:43) Future directions and wrap-up
(01:51:34) Episode Outro
(01:54:15) Outro
PRODUCED BY:
https://aipodcast.ing
SOCIAL LINKS:
Website: https://www.cognitiverevolution.ai
Twitter (Podcast): https://x.com/cogrev_podcast
Twitter (Nathan): https://x.com/labenz
LinkedIn: https://linkedin.com/in/nathanlabenz/
Youtube: https://youtube.com/@CognitiveRevolutionPodcast
Apple: https://podcasts.apple.com/de/podcast/the-cognitive-revolution-ai-builders-researchers-and/id1669813431
Spotify: https://open.spotify.com/show/6yHyok3M3BjqzR0VB5MSyk
Web sitesi: cognitiverevolution.ai

