İçeriğe geç
Global sound
David Bombal

David Bombal

#622: How NVIDIA Connects 72 GPUs in One Rack

· 29 dk · Sezon 1 Bölüm 1

Bölüm notları

NVIDIA CTO Michael Kagan joins David Bombal to explain AI networking, NVLink, and why GPUs alone are not enough to scale AI data centers.

How do you connect 72 GPUs in a rack? What is the difference between scale up, scale out, and scale across? And why do latency and network jitter matter when GPUs need to work together?

Michael explains how NVIDIA approaches these challenges using NVLink, InfiniBand, and Spectrum-X Ethernet. He also shares the story of co-founding Mellanox, joining NVIDIA, and building the networking behind increasingly large AI systems.

We discuss the path toward million-GPU systems, connecting AI factories across sites, and how simulation and shared experience could help robots learn. Michael finishes with advice for the next generation of engineers and founders.

If you're learning networking, working with data centers, or exploring AI infrastructure, this conversation will help you understand how the pieces fit together. What would you like Michael to explain next? Let us know in the comments.

Big thank you to @NVIDIA for sponsoring my trip to GTC Berlin 2026 and to them for sponsoring this video.

// Michael Kagan SOCIAL //
LinkedIn: / mikagan
Blog: https://blogs.nvidia.com/blog/author/...

// David's SOCIAL //
Discord: discord.com/invite/usKSyzb
Twitter: www.twitter.com/davidbombal
Instagram: www.instagram.com/davidbombal
LinkedIn: www.linkedin.com/in/davidbombal
Facebook: www.facebook.com/davidbombal.co
TikTok: tiktok.com/@davidbombal
YouTube: / @davidbombal
Spotify: open.spotify.com/show/3f6k6gE...
SoundCloud: / davidbombal
Apple Podcast: podcasts.apple.com/us/podcast...

// MY STUFF //
https://www.amazon.com/shop/davidbombal

// SPONSORS //
Interested in sponsoring my videos? Reach out to my team here: [email protected]

Please note that links listed may be affiliate links and provide me with a small percentage/kickback should you use them to purchase any of the items listed or recommended. Thank you for supporting me and this channel!

Disclaimer: This video is for educational purposes only.
#nvidia #nvidiagtc #networking

Web sitesi: podcasters.spotify.com

★ Artist of the week The fastest riser on the radio this week
Your song here? From € 9 per week →
WAJR-FMDinlemeye devam et