Skip to content
Global sound
Generative AI 101

Generative AI 101

Why AI Evaluation Still Needs Human Experts

· 14 min · Episode 335

Show notes

The most dangerous AI output isn't the ridiculous one; it's the polished answer with one critical error hiding in plain sight. In this episode, host Emily Laird puts generative AI evaluation on trial, from OpenAI's GDPval and Anthropic's TASTE study to the uncomfortable fact that automated AI judges still can't match experienced human reviewers. She breaks down metamorphic testing (a terrible name for a very useful idea) and explains how every caught mistake can become a test your systems have to survive. If you can no longer evaluate your own work, you haven't bought a productivity tool; you've built a dependency.

🎯 JOIN THE AI WEEKLY MEETUPS
https://www.uwstout.edu/ai-weekly-meetup

📩 EMAIL REMINDERS FOR THE MEETUPS
https://app.e2ma.net/app2/audience/signup/2101263/1779703/

💬 CONNECT WITH EMILY LAIRD ON LINKEDIN
http://www.linkedin.com/in/meet-emily-laird

Website: generativeai101.podbean.com

Live, last hour: 2,715 songs on 7,706 stations in 142 countries

Discover the world through radio

More ways to discover (9)

Heard something good? Save it, or open it straight away in Spotify.

2bfm Continue listening