Ir para o conteúdo
Global sound
Risky Business Features

Risky Business Features

How private LLM inference actually works

· 1 h 23 min

Notas do episódio

In this podcast episode James Wilson chats with Tinfoil co-founder Tanya Verma about how you can run a powerful LLM in the cloud without the inference provider seeing your prompts.

Tanya talks James through how private inference works, from trusted execution environments and hardware attestation, to TLS termination and GPU isolation. Customers can verify the exact code and model processing their data, while Tinfoil and its infrastructure providers remain locked out.

That’s clever engineering… but who really needs it? Is private inference only useful if you’re doing something bad, or will…

Site: risky.biz

Ao vivo, última hora: 10.774 músicas em 4.267 rádios de 129 países

Descubra o mundo pelo rádio

Mais formas de descobrir (9)

Ouviu algo legal? Salve ou abra direto no Spotify.

★ Artist of the week The fastest riser on the radio this week
Your song here? From € 9 per week →
Rock Fm BalladsContinuar ouvindo