Vai al contenuto
Global sound
Software Engineering Institute (SEI) Podcast Series

Software Engineering Institute (SEI) Podcast Series

An LLM Evaluation Framework for High-Stakes AI

· 17 min

Note dell’episodio

Experimentation and validation of LLM performance is critical when building LLM-driven systems that must reliably deliver a service, from customer service chat bots to intelligence analysis tools. To help teams meet the need for rigorous evaluation methods, a research team in the SEI's AI Division led by Violet Turri has developed the Expanding Large Language Model Metrics (ELM) library, which is built on best practices for LLM evaluation and benchmarking. In the latest episode from the Carnegie Mellon University Software Engineering Institute Podcast Series, Turri sits down with Katie Robinson, a design researcher also in the SEI's AI division, to discuss the library, which turns evaluation from an ad-hoc process into a repeatable, extensible framework.

Sito web: cmu-sei-podcasts.libsyn.com

In diretta, ultima ora: 10.550 brani su 4.605 stazioni in 130 paesi

Scopri il mondo attraverso la radio

Altri modi per scoprire (9)

Hai sentito qualcosa di bello? Salvalo, o aprilo subito in Spotify.

★ Artist of the week The fastest riser on the radio this week
Your song here? From € 9 per week →
Rádio Saudade FM 99.7Continua ad ascoltare