Skip to content
Global sound
Deep Learning with PolyAI

Deep Learning with PolyAI

Is word error rate just a vanity metric?

· 29 min

Show notes

Voice AI vendors love to quote word error rate, usually somewhere around 2 to 3%, as proof their system understands customers. Oliver Shoulson, Agent Design & Engineering Lead at PolyAI, thinks it's one of the most misleading numbers in the business. He and Nikola Mrkšić go through a month of analysis across more than 100,000 real production call turns to explain why. Turns out not all words carry the same weight, most transcription errors are harmless, and task success barely moves...

Live, last hour: 7,993 songs on 3,923 stations in 132 countries

Discover the world through radio

More ways to discover (9)

Heard something good? Save it, or open it straight away in Spotify.

Balkan BoxContinue listening