Agentic Conversations (formally mlops.community)
Multi-Cloud LLM Routing and Context-Aware Coding Agents
· 29 min
Show notes
In this episode, we sit down with Matt Carey and Scott Crooks, engineers at Cloudflare and Miro, to look at how two very different companies are building their own AI software factories, and what happens to engineering when the code mostly writes and reviews itself.
We start with the AI gateway: why a model call is no longer simple when the same model is served across multiple regions, multiple clouds, and direct from the provider, and how Miro pools rate limits and data residency rules (like EU-only models for German customers) into a single routing layer that also powers Miro’s Sidekicks. Matt walks through Cloudflare’s agent stack, from the AI gateway and Agents SDK to Flue, a JavaScript agent framework from the makers of Astro, and Cloudflare OS, an open source agent office suite he even runs at home for grocery shopping.
The heart of the conversation is code review. Matt describes what he calls the best AI code reviewer he’s ever used, built on Flue and powered by an internal engineering codex written only for agents. Scott breaks down Miro’s three-layer setup, including Easel, a bot that reads production logs overnight and opens fix PRs before anyone wakes up, and explains why only about half of those PRs get merged, and how that signal is fed back to teach the system what people care about.
Along the way, we cover agent experience as a new discipline, how open source maintainers are handling a flood of cheap AI pull requests, Astro reaching zero open issues, when companies should open source internal tools and how to retire them gracefully, plus a few hot takes on chocolate and nuts. We close on the rise of the “scholarly engineer,” and why understanding ideas may matter more than reading every line of code.
Demetrios Brinkmann: https://www.linkedin.com/in/dpbrinkmMatt Carey: https://www.linkedin.com/in/mattzcareyScott Crooks: https://www.linkedin.com/in/jshcrooks
Timestamps:[00:00] Cold open[01:03] Meet Matt and Scott[01:20] What an AI gateway really is[02:28] Multi-region, multi-cloud model routing[05:00] Cloudflare’s agent stack and Cloudflare OS[06:43] The Flue framework from the Astro team[07:32] The best AI code reviewer[09:29] An engineering codex written for agents[11:48] Agent experience and evals[12:44] Miro’s Easel bot and three layers of review[15:55] Software factories and Astro hitting zero issues[18:58] Companies open sourcing internal tools[22:59] Hot takes[25:03] The scholarly engineer[28:50] Wrap up
Website: podcasters.spotify.com
