Salt la conținut
Global sound
The Daily ML

The Daily ML

Ep42. The Geometry of Concepts: Sparse Autoencoder Feature Structure

· 14 min

Note de episod

This research paper investigates the structure of the concept universe represented by large language models (LLMs), specifically focusing on how sparse autoencoders (SAEs) can be used to discover and analyze concepts within these models. The authors explore this structure at three distinct scales: the “atomic” scale, where they look for geometric patterns representing semantic relationships between concepts; the “brain” scale, where they identify clusters of features that tend to fire together within a document and are spatially localized; and the "galaxy" scale, where they examine the…

Site: soundcloud.com

Live, ultima oră: 8.280 melodii pe 3.342 posturi din 130 țări

Descoperă lumea prin radio

Mai multe moduri de a descoperi (9)

Ai auzit ceva frumos? Salvează-l sau deschide-l direct în Spotify.

★ Artist of the week The fastest riser on the radio this week
Your song here? From € 9 per week →
Troy.fmContinuă să asculți