Zum Inhalt springen
Global sound
System Design on the Road

System Design on the Road

S2 E17 — Design an AI Chat Service: Streaming, Reconnection, and Cancellation

· 34 Min. · Staffel 2 Folge 17

Shownotes

An AI answer is still being generated when its browser connection breaks. Daniel and Maya design a chat service that resumes the existing answer rather than silently starting and charging for another generation.

Conversation branches, generation IDs, durable stream events, cursors, and worker ownership connect the interface to model execution. Cancellation has its own outcome; closing a socket is not enough. Admission, latency, and cost limits test which work the system accepts and how it handles a worker that keeps running.

Chapters
00:00:00 Welcome and an interrupted AI answer
00:03:08…

Website: podcasters.spotify.com

Live, letzte Stunde: 7.121 Songs auf 3.124 Sendern in 116 Ländern

Entdecke die Welt über das Radio

Mehr zum Entdecken (7)

Etwas Schönes gehört? Speicher es oder öffne es direkt in Spotify.

★ Künstler der Woche Der schnellste Aufsteiger im Radio diese Woche
Dein Song hier? Ab € 9 pro Woche →
REYFM - #Hip-HopWeiterhören