Gå til indhold
Global sound
Startup Project: Build the future

Startup Project: Build the future

Why GPUs Aren't the Answer for Every AI Workload | Sid Sheth Founder and CEO of d-Matrix

· 48 min.

Episodebeskrivelse

Sid Sheth, co-founder and CEO of D-Matrix, joins Nataraj on Startup Project to talk about the future of AI inference, why GPUs may not be the answer for every workload, and what it takes to build a semiconductor startup.Key takeaways

• Training and inference are like education and a career. Sid's view is that inference is the much larger opportunity.
• D-Matrix focuses on ultra-low-latency inference using SRAM and in-memory compute, not on throughput.
• Customers now deploy racks and clusters, so D-Matrix moved from chip scale to rack scale.
• Raptor stacks custom DRAM on compute. Sid says…

Website: podcasters.spotify.com

Live, seneste time: 7.125 sange på 2.742 stationer i 121 lande

Opdag verden gennem radioen

Flere måder at opdage på (9)

Hørt noget godt? Gem det, eller åbn det direkte i Spotify.

★ Artist of the week The fastest riser on the radio this week
Your song here? From € 9 per week →
Radio 538 luisteren - Live!Populært lige nu