Skip to content
Global sound
AI Intuition

AI Intuition

Google Agentic Architect - Subconcept 5.1: Pre-Production Continuous Evaluation Gates (CI/CD)

· 43 min · Season 5 Episode 13

Show notes

Detail how to construct automated pre-production evaluation pipelines for non-deterministic agents. Walk through building an evaluation harness (e.g., tests/eval_agent_trajectory.py using pytest and Cloud Build) executed against static "golden datasets." Contrast three evaluation types: Pointwise (single-turn metric checks), Pairwise (using gemini-2.5-pro as a Model-as-a-Judge), and Trajectory Evaluation (auditing tool invocation sequences using graph edit distance). Focus on the exact mathematical thresholds required to block releases in CI/CD: tool_call_accuracy >= 0.95…

Website: podcasters.spotify.com

Live, last hour: 7,957 songs on 3,151 stations in 123 countries

Discover the world through radio

More ways to discover (9)

Heard something good? Save it, or open it straight away in Spotify.

★ Artist of the week The fastest riser on the radio this week
Your song here? From € 9 per week →
AFRODREAD.FMContinue listening