Hoppa till innehållet
Global sound
The AI Alignment Podcast

The AI Alignment Podcast

Do AI Models Know When They're Being Manipulated?

· 45 min · Säsong 1 Avsnitt 1

Avsnittsbeskrivning

In this episode, James is joined by AE alignment researcher Alex to discuss endogenous steering resistance (ESR), a newly studied phenomenon where large language models appear to notice when they’ve been pushed off track and then steer themselves back toward the original task.
They break down a concrete example from Alex’s research, where a model answering a simple probability question is continuously injected with unrelated internal signals about human body positions. Despite the distraction, the model sometimes catches the mismatch, says it made a mistake, and restarts with a much better…

Webbplats: podcasters.spotify.com

Live, senaste timmen: 10 430 låtar på 4 897 stationer i 138 länder

Upptäck världen genom radion

Fler sätt att upptäcka (7)

Hört något bra? Spara det, eller öppna det direkt i Spotify.

★ Artist of the week The fastest riser on the radio this week
Your song here? From € 9 per week →
PAPANGUE FMFortsätt lyssna