Note dell’episodio
In this episode, we explore the voracious energy consumption of large language models (LLMs). These AI systems consume massive amounts of electricity during training and inference. A single training run for a model like GPT-3 uses around 1,287 MWh of electricity—equivalent to the carbon emissions from 550 round-trip flights between New York and San Francisco. Inference amplifies the problem, with ChatGPT's monthly energy usage ranging from 1 to 23 million kWh.
The energy appetite of LLMs mirrors the cryptocurrency mining crisis, consuming enormous power with questionable societal benefits…
Sito web: handyai.substack.com

