Gå til indhold
Global sound
Lifelong Learning With A. A. Khatana

Lifelong Learning With A. A. Khatana

13 Tracing a Single User Query Through Power Grids, Microscopic Elevators, and Memory Skyscrapers

· 25 min. · Sæson 13 Episode 34

Episodebeskrivelse

For decades, tech companies scaled software with virtually zero marginal cost because digital code required no physical factories. Today, the scaling laws of artificial intelligence have reversed that economic model, turning digital intelligence into a capital-intensive physical industry measured in megawatts and metric tons of hardware.
Think of the difference between searching the web and generating an answer as the difference between a librarian and a book writer. A librarian simply hands you a book that was already printed years ago, which is cheap, fast, and static. A writer sits down and composes every single word from scratch just for you, which requires immense labor. In the digital realm, that continuous writing process demands tens of thousands of processing cores working in tandem, drawing massive electrical loads, and radiating intense heat that must be pumped away using liquid coolant loops.

• Scaling laws converted artificial intelligence from an abstract computer science research problem into a predictable capital expenditure race where spending ten times more compute yields a measurably smarter model.
• Processing a prompt consists of two separate phases: prefill, which reads the entire input in parallel to build a working memory cache, and decode, which manufactures the final output one word at a time.
• To prevent ultra-expensive processing chips from idling, optical modules convert electrical signals into light pulses to connect thousands of GPUs across data center floors.
• Software serving engines significantly lower token production costs by batching hundreds of user requests together on shared processors and using lower-precision number quantization.
• A four-company investment loop recycles billions between chip designers, cloud providers, and AI research labs, while relying on end-user subscriptions as its ultimate financial exit.
When inspecting data center efficiency, modern liquid-cooled facilities can achieve power usage effectiveness scores near 1.1, compared to older air-cooled data centers that required one full watt of cooling for every watt of computing power.
If software capability is now directly proportional to capital expenditure and electrical capacity, how will smaller organizations compete against mega-corporations with multi-gigawatt energy budgets?

Website: rss.com

Live, seneste time: 8.460 sange på 3.734 stationer i 121 lande

Opdag verden gennem radioen

Flere måder at opdage på (7)

Hørt noget godt? Gem det, eller åbn det direkte i Spotify.

★ Artist of the week The fastest riser on the radio this week
Your song here? From € 9 per week →
Radio 538 luisteren - Live!Populært lige nu