İçeriğe geç
Global sound
Thinking On Paper

Thinking On Paper

The hidden cost of your AI subscription

· 41 dk

Bölüm notları

AI companies are splashing billions on more GPUs before they use the ones they already have. Many sit idle, others use a fraction of their potential.

For the hyperscalers, cloud providers and AI companies, buying more GPUs does not solve much if the GPUs already in the rack spend too much time waiting for the rest of the system.

The next battle in the AI infrastructure wars is efficiency: GPU utilization, NICs, memory movement, networking, CPUs and software that keeps expensive hardware doing useful work.
Moshe Tanach runs NeuReality AI, a company building infrastructure for AI inference…

Web sitesi: podcasters.spotify.com

★ Artist of the week The fastest riser on the radio this week
Your song here? From € 9 per week →
Radio Seabreeze 1395 AMDinlemeye devam et