Full definition
GPUs (graphics processors) are AI’s hardware engine, capable of thousands of parallel calculations. A card such as NVIDIA H100 consumes around 700 W under load; an 8-GPU server 10 to 12 kW; a training cluster of 10,000 GPUs 10 to 15 MW, equivalent to a small town. This computing density, plus cooling, explains AI data centres’ energy footprint.
