Ir para o conteúdo
Global sound
Embedded AI Podcast

Embedded AI Podcast

E24 Practical Local LLMs: Hardware, Tools, and Trade-offs

· 55 min

Notas do episódio

We explore the resurgence of self-hosted LLMs and why they're worth considering despite the convenience of frontier models. From data privacy concerns to cost management and consistent performance, there are solid reasons to run your own models. We break down the hardware requirements (spoiler: it's all about memory bandwidth), compare different runtime environments from beginner-friendly LM Studio to production-ready VLLM, and discuss practical model choices. Luca shares his experience running dual RTX 3090s in his basement, while Ryan questions whether his 2004 Athlon is still viable (it…

Site: podcasters.spotify.com

Ao vivo, última hora: 9.711 músicas em 4.065 rádios de 127 países

Descubra o mundo pelo rádio

Mais formas de descobrir (9)

Ouviu algo legal? Salve ou abra direto no Spotify.

★ Artist of the week The fastest riser on the radio this week
Your song here? From € 9 per week →
RMFContinuar ouvindo