Ir para o conteúdo
Global sound
learning with yacine show

learning with yacine show

Why Self-Distillation Is Taking Over LLM Post-Training (w/ the Researchers Behind It)

· 1 h 31 min

Notas do episódio

I had an awesome time interviewing @IdanShenfeld and @jonashubotter from MIT and ETH Zurich about self-distillation.
this very promising post-training paradigm where the model acts as its own teacher by conditioning on environment feedback or demonstrations.
we cover the SDPO algo for reinforcement learning with rich feedback and SDFT for continual learning without forgetting along with many applications.
we dig into how it works, why it’s simpler and faster than GRPO, and where this is already showing up in production systems.
table of content:
0:00 - what is self distillation
2:50 - idan…

Site: yacinemahdid.com

Ao vivo, última hora: 7.917 músicas em 3.219 rádios de 124 países

Descubra o mundo pelo rádio

Mais formas de descobrir (7)

Ouviu algo legal? Salve ou abra direto no Spotify.

★ Artista da semana A maior subida na rádio esta semana
A tua música aqui? Desde € 9 por semana →
Voz EfikazContinuar ouvindo