Skip to content
Global sound
The Cisco AI Insights Podcast

The Cisco AI Insights Podcast

EP. 3 - Rethinking AI Performance Metrics

· 27 min · Episode 3

Show notes

In the latest episode of the Cisco AI Insights podcast, hosts Rafael Herrera and Sonia Marques are joined by Dr. Catarina Carvalho, a Cisco leader in machine learning engineering. Together, they unpack the complex academic paper " Multi-Crit: Benchmarking Multimodal Judges on Pluralistic Criteria-Following," developed by researchers from the University of Maryland and the University of Waterloo.

As the industry moves toward more reliable multimodal models, traditional pass-or-fail evaluation is no longer sufficient. This paper introduces a hierarchical framework that uses "LLM-as-a-judge"…

Website: podcasters.spotify.com

Live, last hour: 8,312 songs on 4,009 stations in 107 countries

Discover the world through radio

More ways to discover (7)

Heard something good? Save it, or open it straight away in Spotify.

★ Artist of the week The fastest riser on the radio this week
Your song here? From € 9 per week →
VERT MUSIC RADIOContinue listening