Zum Inhalt springen
Global sound
Software Engineering Institute (SEI) Podcast Series

Software Engineering Institute (SEI) Podcast Series

From Data to Performance: Understanding and Improving Your AI Model

· 27 Min.

Shownotes

Modern data analytic methods and tools—including artificial intelligence (AI) and machine learning (ML) classifiers—are revolutionizing prediction capabilities and automation through their capacity to analyze and classify data. To produce such results, these methods depend on correlations. However, an overreliance on correlations can lead to prediction bias and reduced confidence in AI outputs.

Drift in data and concept, evolving edge cases, and emerging phenomena can undermine the correlations that AI classifiers rely on. As the U.S. government increases its use of AI classifiers and predictors, these issues multiply (or use increase again). Subsequently, users may grow to distrust results. To address inaccurate erroneous correlations and predictions, we need new methods for ongoing testing and evaluation of AI and ML accuracy. In this podcast from the Carnegie Mellon University Software Engineering Institute (SEI), Nicholas Testa, a senior data scientist in the SEI's Software Solutions Division (SSD), and Crisanne Nolan, and Agile transformation engineer, also in SSD, sit down with Linda Parker Gates, Principal Investigator for this research and initiative lead for Software Acquisition Pathways at the SEI, to discuss the AI Robustness (AIR) tool, which allows users to gauge AI and ML classifier performance with data-based confidence.

Website: cmu-sei-podcasts.libsyn.com

Live, letzte Stunde: 14.669 Songs auf 6.318 Sendern in 149 Ländern

Entdecke die Welt über das Radio

Mehr zum Entdecken (9)

Etwas Schönes gehört? Speicher es oder öffne es direkt in Spotify.

★ Artist of the week The fastest riser on the radio this week
Your song here? From € 9 per week →
Beat 102-103 Radio irelandWeiterhören