AI Hype Will Drive Datacenter GPU Prices Sky High

Belgique Nouvelles Nouvelles

AI Hype Will Drive Datacenter GPU Prices Sky High
Belgique Dernières Nouvelles,Belgique Actualités
  • 📰 TheRegister
  • ⏱ Reading Time:
  • 59 sec. here
  • 2 min. at publisher
  • 📊 Quality Score:
  • News: 27%
  • Publisher: 61%

The datacenter GPU situation is worse than the used car market The hyperscalers and cloud builders are rationing access and we would not be surprised to see price increases for GPU capacity in the cloud. Full story by TDaytonPM at TheNextPlatform

, with the PCI-Express versions of the H100 GPUs perhaps worth somewhere from $15,000 to $24,000. At the time, the price of the A100 SXM4 had risen to around $15,000 because of rising demand. And only a few weeks ago,The situation is worse than the used car market here in the United States, and it is a kind of inflation that comes from too much demand and too little supply. A situation that vendors love when they know they can’t make enough units anyway.

What we can say for sure is that El Capitan is first in line for the MI300A compute engines, and to break through 2.1 exaflops peak at plain vanilla 64-bit double precision floating point will require 22,000 sockets, and in this case, a socket is a node. The current “Sierra” system, which is now approaching five years old because El Capitan is coming to market about a year later than planned has 4,320 nodes, each with two Power9 processors from IBM and four “Volta” V100 GPU accelerators from Nvidia. That is a total of 17,280 GPUs in Sierra, and if our guesses about MI300A’s FP64 performance are correct – and we are the first to admit that this is just a hunch – then that is only 27 percent more GPU sockets in El Capitan than were in Sierra.

In the past, we would actually figure out the list price of a GPU from the supercomputing deals by reversing the HPC national lab deep discount. With the Volta V100 accelerators used in Sierra, for instance, the GPUs listed for around $7,500 but sold to Lawrence Livermore and Oak Ridge for around $4,000 a pop. And so list price for the MI300A, if that old discount level prevailed, might be above $40,000.

Nous avons résumé cette actualité afin que vous puissiez la lire rapidement. Si l'actualité vous intéresse, vous pouvez lire le texte intégral ici. Lire la suite:

TheRegister /  🏆 67. in UK

Belgique Dernières Nouvelles, Belgique Actualités

Similar News:Vous pouvez également lire des articles d'actualité similaires à celui-ci que nous avons collectés auprès d'autres sources d'information.

Lazerus: Has the Connor Bedard hype train gone off the rails?Lazerus: Has the Connor Bedard hype train gone off the rails?What would Connor Bedard need to do in order to actually live up to the hype? Bedard will change the game itself, people say. Generational. Transformative. Unstoppable. Ineffable. 𝙒𝙝𝙤𝙖. Let's pump the brakes, writes MarkLazerus.
Lire la suite »

Man had Neo Nazi documents and discussed how to build homemade gunsMan had Neo Nazi documents and discussed how to build homemade gunsNicholas Street talked to extreme right wing groups about guns on Telegram and Snapchat
Lire la suite »

Plans submitted for more than 280 student flats in city centrePlans submitted for more than 280 student flats in city centrePLANS have been submitted to build more than 280 student flats in the city centre.
Lire la suite »

This one mobile accessory finally convinced me Xbox Cloud Gaming isn’t hopelessThis one mobile accessory finally convinced me Xbox Cloud Gaming isn’t hopelessThe Razer Kishi makes mobile gaming far more practical
Lire la suite »

Empty Glasgow city centre site could be used for almost 300 student flatsEmpty Glasgow city centre site could be used for almost 300 student flatsDevelopers want to build an 11-storey block including a gym and cinema on land near King Street car park.
Lire la suite »

Frog Bikes 47Frog Bikes 47Frog Bikes 47 reviewed by the cycling experts at Mother&aBaby - read our thoughts on this premium-build bike for 4 to 6-year-olds.
Lire la suite »



Render Time: 2025-02-26 01:51:06