Langsung ke konten
Global sound
LessWrong (Curated & Popular)

LessWrong (Curated & Popular)

"Models Can Communicate via Inference Servers Despite Being Sandboxed" by niranjandeshpande, David Africa

· 25 mnt

Catatan episode

TL;DR Two agents running on the same inference server can reliably communicate, even if they cannot send each other messages or access the same filesystem. They can do this by exploiting "side channels": mechanisms that let one model subtly affect another model's computation. Here, I discuss two communication protocols: Step Sizing and KV Cache Message Board. These both convey information through the way vLLM chooses kernels for particular engine steps.I show that these communication proto...

Live, satu jam terakhir: 5.729 lagu di 2.035 stasiun di 112 negara

Jelajahi dunia lewat radio

Cara lain untuk menjelajah (7)

Dengar sesuatu yang bagus? Simpan, atau langsung buka di Spotify.

★ Artist of the week The fastest riser on the radio this week
Your song here? From € 9 per week →
An Opera CelebrationLanjut mendengarkan