Przejdź do treści
Global sound
How Many CTOs

How Many CTOs

Token Maxxing and Local Inference: Navigating the Shift in AI Usage for Developers

· 1 godz. 0 min · Sezon 2 Odcinek 28

Notatki do odcinka

In this episode of "How Many CTOs Does It Take?" podcast, hosts Scott Porad and Brad Hefta-Gaub discuss token spending and the "token maxing" backlash, sparked by a GitHub Copilot budget issue and broader industry moves to optimize tokens. The hosts argues companies should focus on value and learning rather than premature token optimization, while still adding circuit breakers to prevent runaway costs. They explore shifting to local inference and open-weight/open-source models for cost, privacy, and control, citing concerns about vendor policy changes like Fable's retention and classifier…

Strona: howmanyctospod.com

Na żywo, ostatnia godzina: 8 020 utworów na 3 078 stacjach w 116 krajach

Odkrywaj świat przez radio

Więcej sposobów na odkrywanie (9)

Usłyszałeś coś fajnego? Zapisz to albo otwórz od razu w Spotify.

★ Artist of the week The fastest riser on the radio this week
Your song here? From € 9 per week →
Radio FRO 105.0Słuchaj dalej