Gå til indhold
Global sound
LessWrong (30+ Karma)

LessWrong (30+ Karma)

“Generalized belief states in transformers” by Artemy Kolchinsky

· 41 min.

Episodebeskrivelse

Audio note: this post contains a lot of mathematical notation. We narrate the simpler formulas and flag the complex ones, so you may want the original text to hand.
Many thanks to Xavier Poncini, Paul Riechers, Fernando Rosas, and Matt Smith for useful conversations.

1. Introduction

Despite the recent successes of transformers and other sequence models, there are still many open questions about their basic principles of operation. For example, what internal representations do these models use for prediction and generation? Can we decode, interpret, and manipulate such representations? Is…

Website: lesswrong.com

Live, seneste time: 12.788 sange på 6.422 stationer i 144 lande

Opdag verden gennem radioen

Flere måder at opdage på (7)

Hørt noget godt? Gem det, eller åbn det direkte i Spotify.

★ Artist of the week The fastest riser on the radio this week
Your song here? From € 9 per week →
95.1 WAPEFortsæt med at lytte