Bölüm notları
AI companies are splashing billions on more GPUs before they use the ones they already have. Many sit idle, others use a fraction of their potential.
For the hyperscalers, cloud providers and AI companies, buying more GPUs does not solve much if the GPUs already in the rack spend too much time waiting for the rest of the system.
The next battle in the AI infrastructure wars is efficiency: GPU utilization, NICs, memory movement, networking, CPUs and software that keeps expensive hardware doing useful work.
Moshe Tanach runs NeuReality AI, a company building infrastructure for AI inference…
Web sitesi: podcasters.spotify.com

