How The Massive Power Draw Of Generative AI Is Overtaxing Our Grid
There’s more than 8,000 data centers globally, but it’s not nearly enough to keep up with the power needs of generative AI. One ChatGPT query takes about 10 times as much energy as a typical Google search. Training one large language model can produce as much CO2 as the entire lifetime of five gas-powered cars and use as much water as a small country. Even if we generate enough power, our aging grid is increasingly unable to handle transmitting it to where it’s needed. That’s why data center companies like Vantage are building closer to where power is generated, while the industry invests in alternate energy source and creative ways to harden the grid.
Chapters:
1:58 Chasing Power
6:06 Hardening the Grid
8:45 Keeping it cool
11:56 More work per watt
Produced and Shot by: Katie Tarasov
Edited by: Evan Lee Miller
Supervising Producer: Jeniece Pettitt
Animation: Christina Locopo, Jason Reginato, Emily Rabbideau
Additional Camera: Andrew Evers
Production Support: Lisa Setyon
Additional Footage: Apple, Arm, Getty Images, Google, Helion, Meta, Microsoft, Nvidia, OpenAI, UC Riverside
Sun, 28 Jul 2024 16:00:23 GMT