Pipeline Conversations
by ZenML GmbH
Latest episode
Production LLM Security: Real-world Strategies from Industry Leaders 🔐
Production LLM Security: Real-world Strategies from Industry Leaders 🔐
About this podcast
Pipeline Conversations brings you interviews with platform engineers, ML practitioners, and technical leaders building production AI systems. We dig into the real challenges of MLOps and LLMOps: orchestrating complex workflows on Kubernetes, fine-tuning and evaluating models at scale, and shipping AI that actually works. From ZenML.
Episodes
The newest 20 of 34 episodes
- Production LLM Security: Real-world Strategies from Industry Leaders 🔐 · 52 min · Season 3Learn how leading companies like Dropbox, NVIDIA, and Slack tackle LLM security in production. This comprehensive guide covers practical strategies for preventing prompt…
- Optimizing LLM Performance and Cost for LLMs in Production · 34 min · Season 3In this episode, we dive deep into the world of LLM optimization and cost management - a critical challenge facing AI teams today. Join us as we explore real-world strategies…
- The Evaluation Playbook: Making LLMs Production-Ready 🧪📈 · 33 min · Season 3A comprehensive exploration of real-world lessons in LLM evaluation and quality assurance, examining how industry leaders tackle the challenges of assessing language models in…
- Prompt Engineering & Management in Production: Practical Lessons from the LLMOps Database · 30 min · Season 3Prompt engineering is the art and science of crafting instructions that unlock the potential of large language models (LLMs). It's a critical skill for anyone working with LLMs…
- LLM Agents in Production: Architectures, Challenges, and Best Practices · 33 min · Season 3An in-depth exploration of LLM agents in production environments, covering key architectures, practical challenges, and best practices. Drawing from real-world case studies, this…
- Building Advanced Search, Retrieval, and Recommendation Systems with LLMs · 13 min · Season 3Discover how embeddings power modern search and recommendation systems with LLMs, using case studies from the LLMOps Database. From RAG systems to personalized recommendations…
- Building LLM Applications that Know What They're Talking About 🔓🧠 · 21 min · Season 3Explore real-world applications of Retrieval Augmented Generation (RAG) through case studies from leading companies. Learn how RAG enhances LLM applications with external…
- Demystifying LLMOps: A Practical Database of Real-World Generative AI Implementations · 15 min · Season 3The LLMOps Database offers a curated collection of 300+ real-world generative AI implementations, providing technical teams with practical insights into successful LLM…
- ML at the British Library with Daniel van Strien · 57 min · Season 2This week I spoke with Daniel van Strien, a digital curator working at the British Library. Daniel has worked on a number of projects at the intersection of archives, libraries…
- Questioning MLOps with Lak Lakshmanan · 53 min · Season 2This week I spoke with Lak Lakhshmanan, who worked for years at Google on ML and AI projects and products at a senior level and he also brings years of experience working on…
- The Full Stack with Charles Frye · 57 min · Season 2This week I spoke with Charles Frye. Not only has Charles volunteered to be a judge on our Month of MLOps competition happening right now, he's part of the core team working on…
- Educating the next generation with Goku Mohandas · 1 h 8 min · Season 2In today's conversation, I'm speaking with Goku Mohandas, founder and creator of the amazing online resource MadeWithML. Goku has a bunch of practical experience, from working…
- ZenML MLOps Competition · 8 min · Season 2So excited to be able to announce our 🔥 AMAZING 🔥 external judges for the ZenML Month of MLOps competition! We have a stellar panel of ✨ ML and MLOps heroes ✨ to help select the…
- Data-centric Computer Vision with Eric Landau · 52 min · Season 2This week I spoke with Eric Landau, co-founder of Encord, a platform for data-centric computer vision. This podcast contains a lot of geekery about annotation, and even though…
- ML Abstractions with Phil Howes · 54 min · Season 2This week we dive into the abstractions that we're all trying to layer on top of the core ML processes and workflows. I spoke with Phil Howes, co-founder and chief scientist at…
- Building MLOps Tools with Outerbounds · 60 min · Season 2This week I spoke with Savin Goyal and Hugo Bowne-Anderson from Outerbounds. They both work on leading, building and helping people put models into production through Metaflow…
- Safe and Testable Computer Vision with Lakera · 58 min · Season 2This week I spoke with Mateo Rojas-Carulla, the CTO and a co-founder of Lakera and Matthias Kraft, also a co-founder and the CPO there. Lakera is an AI safety company that does a…
- Satellite Vision with Robin Cole · 48 min · Season 2This week I spoke with Robin Cole, a senior data scientist at Satellite Vu, a company that's about to launch a thermal imaging satellite into space in order to provide new ways…
- Autonomous Shipping with Captain AI · 1 h 0 min · Season 2This week on the podcast I spoke with Gerard Kruisheer, the CTO and co-founder of Captain AI, a company based in the Netherlands working on autonomous shipping out of the busy…
- ML Monitoring with Emeli Dral · 47 min · Season 2I'll be having some conversations with the people behind the tools that ZenML offers as integrations. We spoke with Ben Wilson a few weeks back, and today I'm pleased to publish…
