Data centers explode: gw & tw power demands dwarf server counts
The relentless pursuit of artificial intelligence is reshaping the landscape of data centers—and the scale of their power consumption. Forget counting servers; the new metric is gigawatts (GW) and even terawatts (TW), reflecting a reality where electricity supply, heat dissipation, and network bandwidth are the true bottlenecks of these colossal installations.
The dawn of the multi-gigawatt campus
What was once a matter of racking and cabling has become a question of substations and regional power grids. A gigawatt, equating to a million watts, represents the electricity demand of a major city—a stark illustration of the sheer scale we’re dealing with. Building a data center now isn't about fitting more hardware; it’s about securing a dedicated power source, potentially requiring gas-fired power plants or tapping into entire regions' energy output.
Meta’s Hyperion, under construction in Louisiana, exemplifies this shift. The campus, sprawling across nearly 9 square kilometers (roughly a quarter of Manhattan’s surface area), will house 11 buildings and potentially reach 5 GW—a power draw equivalent to supplying over 4.2 million homes. It's envisioned to incorporate over 41,000 Nvidia GB200 NVL72 GPUs, each rack containing 72 GPUs, 36 CPUs, and around a dozen terabytes of memory. Each of these “soldier” racks weighs over 1.5 tons and consumes 120kW—a far cry from the modest server rooms of yesteryear.
Musk's terafab: a galactic ambition fueled by massive power
Elon Musk, never one to shy away from audacious goals, has unveiled Terafab, a $20 billion factory venture between Tesla, SpaceX, and xAI. Located in Austin, Texas, Terafab isn't just about chip production; it's a sprawling ecosystem encompassing automotive, robotics, satellite, and, crucially, an ambitious constellation of data centers—all powered by a staggering amount of electricity. Musk’s projections include hundreds of gigawatts for terrestrial operations and a full terawatt dedicated to his vision of “space-based processing.” SpaceX’s recent request to launch a million data center satellites into orbit further underscores this ambition, capitalizing on the principle that space offers a cold void for heat dissipation—a theory that, upon closer examination, reveals a number of complexities.
The challenges are significant. Heat doesn't dissipate well in a vacuum, and the logistics of launching, shielding, repairing, and transmitting data from a million satellites are daunting—a scenario that conjures images of astronauts performing emergency reboots in zero gravity. The fundamental question remains: where will all this energy come from?
Re-engineering construction and power delivery
These gargantuan data centers demand a complete rethinking of construction norms. Floors must withstand up to 3,000 kg per square meter, prefabricated concrete panels stretch over 23 meters, and construction timelines are compressing from years to mere months. The economic costs, while substantial, are secondary to the energy requirements. Hyperion, for instance, will require 2 GW, potentially escalating to 5 GW, necessitating the construction of three gas-fired power plants with a combined capacity of 2.2 GW. The associated carbon emissions could range from 4 to over 10 million tons annually—a significant environmental consequence.
The data center industry’s concrete footprint is also noteworthy. U.S. consumption alone reached 1 million tons in the last three years, representing roughly 1% of annual cement usage nationwide. The combined effect of these endeavors—massive structures, satellite constellations, and insatiable power demands—creates a surreal spectacle.
The shift is palpable: the industry has moved beyond simply training AI models to fundamentally reshaping global industrial and energy infrastructure to feed them. The prevailing ethos seems to be one of relentless scaling—spending more, building faster, and consistently expanding. Whether this trajectory is sustainable remains to be seen, but the next few years will offer a revealing glimpse into the future.