Přejít k obsahu
Global sound
The AWS Developers Podcast

The AWS Developers Podcast

Why Your Agent Evaluations Will Fail You (and How to Fix Them Before Production)

· 44 min · Epizoda 211

Poznámky k epizodě

Anthropic deprecated Sonnet 3.5. Some of Xelix's pipelines migrated smoothly. Others broke — and customers noticed within hours. What separated the two? Evaluation. Paul Solomon and James Price Farr have spent 5+ years building AI systems that process millions of invoices for enterprise customers. In this episode, they share the evaluation-first framework that now saves them every time a model changes, an orchestration layer fails, or an agent picks the wrong tool. Key takeaways: • Evaluation-first, not evaluation-after — Retrofitting evaluation on an agent already in production is painful…

Web: developers.podcast.go-aws.com

Živě, poslední hodina: 11 379 skladeb na 4 993 stanicích v 123 zemích

Objevte svět prostřednictvím rádia

Další způsoby objevování (7)

Slyšeli jste něco pěkného? Uložte si to, nebo to otevřete rovnou ve Spotify.

★ Artist of the week The fastest riser on the radio this week
Your song here? From € 9 per week →
Хіт FM Сучасні хітиPokračovat v poslechu