Startup Project: Build the future
Why GPUs Aren't the Answer for Every AI Workload | Sid Sheth Founder and CEO of d-Matrix
· 48 min.
Episodebeskrivelse
Sid Sheth, co-founder and CEO of D-Matrix, joins Nataraj on Startup Project to talk about the future of AI inference, why GPUs may not be the answer for every workload, and what it takes to build a semiconductor startup.Key takeaways
• Training and inference are like education and a career. Sid's view is that inference is the much larger opportunity.
• D-Matrix focuses on ultra-low-latency inference using SRAM and in-memory compute, not on throughput.
• Customers now deploy racks and clusters, so D-Matrix moved from chip scale to rack scale.
• Raptor stacks custom DRAM on compute. Sid says…
Website: podcasters.spotify.com
