Saltar al contenido
Global sound
learning with yacine show

learning with yacine show

Pretrained LLMs Are Surrounded by Task Experts feat Yulu Gan from MIT

· 1 h 12 min

Notas del episodio

sometime there is an idea that just makes other weird research results make so much more sense and sort of cascade to explain a whole bunch of phenomenon.
neural thicket from the great yulu gan is one such paper that I absolutely loved from start to finish.
the old mental model I had for pre-trained neural networked was that the pre-training regime made them land on a single good set of weight that was optimal for many tasks.
but after going through the paper "Neural Thickets: Diverse Task Experts Are Dense Around Pretrained Weights" my view has been changed.
the better idea seems to be that…

Web: yacinemahdid.com

En directo, última hora: 8.182 canciones en 3.167 emisoras de 121 países

Descubre el mundo a través de la radio

Más formas de descubrir (7)

¿Has oído algo bueno? Guárdalo o ábrelo directamente en Spotify.

★ Artista de la semana El que más sube en la radio esta semana
¿Tu canción aquí? Desde € 9 por semana →
UFM 100.3 RadioSeguir escuchando