Show notes
In this episode, we discuss how Netflix built an LLM-based evaluation framework for creative writing quality without losing the nuance that makes expert review valuable. They achieved this by creating a golden dataset calibrated by expert writers, splitting evaluation into specialized judges for each quality criterion, and applying targeted techniques—tiered reasoning, consensus sampling, and multi-agent verification—tailored to the unique needs of each criterion.
For more details, you can refer to their published tech blog, linked here for your reference…
Website: podcasters.spotify.com

