Show notes
How do modern neural networks evolve from randomly initialized weights toward a useful representation of the data? How does this proceed layerwise, and what role does the structure of attention play in the case of language models?Uploaded 06-11-26Collaboration progress on this central problem draws from diverse methods including dynamical mean field theory, spectral methods, tractable toy models, symmetry analysis, and stochastic dynamics. Eva Silverstein will review several inter-related results exhibiting explicitly how interpretable representations emerge. These encompass multiple stages…

