Notas do episódio
This research paper explores the use of sparse autoencoders to extract interpretable features from Anthropic's Claude 3 Sonnet language model. The authors successfully scale this method to a large model, uncovering a diverse range of abstract features, including those related to safety concerns like bias, deception, and dangerous content. They investigate feature interpretability through examples and experiments, demonstrating that these features not only reflect but also causally influence model behavior. The study also examines the relationship between feature frequency and dictionary…
Site: podcasters.spotify.com

