Aman Khan: Arize, Evaluating AI, Designing for Non-Determinism | Learning from Machine Learning #11

On this episode of Learning from Machine Learning, I had the privilege of speaking with Aman Khan, Head of Product at Arize AI. Aman shared how evaluating AI systems isn't just a step in the process—it's a machine learning challenge in of itself. Drawing powerful analogies between mechanical engineering and AI, he explained, "Instead of tolerances in manufacturing, you're designing for non-determinism," reminding us that complexity often breeds opportunity.
Aman's journey from self-driving cars to ML evaluation tools highlights the critical importance of robust systems that can handle…