Hoppa till innehållet
Global sound
Redwood Research Blog

Redwood Research Blog

“Continual learning might make your blocking monitors nearly useless” by Alex Mallen

· 26 min

Avsnittsbeskrivning

Subtitle: When monitor evasion looks like legitimate learning to your continual learning system, it's hard to have one without the other.
Many control protocols work by intervening on an untrusted AI's actions during deployment. For example, you might set up a monitor that scores each action's suspiciousness and blocks actions above a threshold, replacing them with actions from a weaker “trusted” model (a defer-to-trusted protocol). Interventions like this cost usefulness: the protocol sometimes replaces good actions with worse ones.
Continual learning, by which I mean any mechanism that…

Webbplats: blog.redwoodresearch.org

Live, senaste timmen: 12 810 låtar på 5 498 stationer i 137 länder

Upptäck världen genom radion

Fler sätt att upptäcka (7)

Hört något bra? Spara det, eller öppna det direkt i Spotify.

★ Artist of the week The fastest riser on the radio this week
Your song here? From € 9 per week →
Radio Music Sambre (RMS)Fortsätt lyssna