Skip to content
Global sound
Generative AI 101

Generative AI 101

Use Case Thursday: Should You Host Your Own AI Model?

· 14 min · Episode 321

Show notes

Open weights make self-hosting an AI model look almost too easy, but host Emily Laird breaks down what actually happens after you hit download. This episode walks through the infrastructure, staffing, security and compliance costs that separate a slick demo from a real institutional service, including GPU power draws, KV cache limits and FERPA obligations. It's a reality check on when owning your own model actually saves money, and when it just means insourcing a cloud provider without the cloud provider's scale. If you've ever heard someone ask "why are we paying Microsoft," this episode answers it.

🎯 JOIN THE AI WEEKLY MEETUPS
https://www.uwstout.edu/ai-weekly-meetup

📩 EMAIL REMINDERS FOR THE MEETUPS
https://app.e2ma.net/app2/audience/signup/2101263/1779703/

💬 CONNECT WITH EMILY LAIRD ON LINKEDIN
http://www.linkedin.com/in/meet-emily-laird

Website: generativeai101.podbean.com

Live, last hour: 11,009 songs on 5,478 stations in 145 countries

Discover the world through radio

More ways to discover (7)

Heard something good? Save it, or open it straight away in Spotify.

★ Artist of the week The fastest riser on the radio this week
Your song here? From € 9 per week →
RCS. Imbabura StereoContinue listening