Jensen Huang, the founder and boss of NVIDIA, this is what he...

Jensen Huang, the founder and boss of NVIDIA, this is what he said during the recent visit to China in January.

Let’s take the famous Nvidia H100 AI chip as an example. The peak power consumption of each chip has reached an astonishing 700 watts, which has exceeded the average power consumption of ordinary households in the United States. And this data is rising. It is expected that by the end of 2024, there will be 3.5 million H100s are deployed, the total annual power consumption of these chips will reach an incredible 130.91 kilowatt-hours, which has basically exceeded the annual power consumption of some small European countries!

It is worth mentioning that in addition to AI chips, there is another major power issue, which is NVIDIA’s AI accelerator. According to industry insiders’ predictions, NVIDIA’s latest AI accelerator consumes 1,000 watts of power, an increase of 42% compared to its predecessor. The GB200 chip has a design power of up to 1300 watts, an increase of 3% compared to the previous generation.

hopefully I am not the only one notice this part of speech, so, CHIPS, AI, sky rocketing ---- power missing???