OpenAI received the world's first DGX H200 supercomputer.
to advance artificial intelligence, computing, and human development.
The call for the release of GPT-5 is louder.
Steven Heidel, an employee in charge of model fine-tuning at OpenAI, joked: "Lao Huang signed a GPU with Buff, and the computing speed will be 20% faster." ”
This meeting is similar to eight years ago, when Lao Huang presented the world's first DGX 1 supercomputer to OpenAI in 2016.
- Co-founder Elon Musk, who parted ways with OpenAI
- 不知踪影的首席科学家Ilya Sutskever
At such a time, netizens who are keen on playing memes are naturally indispensable.
It only took 1 minute, and the developers of the online AI retouching tool Dingboard.com P the Ilya photo into the group photo without a sense of disobedience.
And sharp-eyed netizens pointed out that the device on the wall behind Brockman may be the strength training equipment of the home fitness brand Tonel.
DGX H200超算有多强?
Strangely, OpenAI President Brockman's tweet and signature on the machine are both "DGX H200", while the related product on NVIDIA's official website is only "DGX GH200".
It's unclear if the two refer to the same product, or if Nvidia has launched a special custom version for OpenAI, removing the Grace CPU from the DGX GH200 and leaving only the H200 GPU.
The features of the H200 GPU can be summed up in a word: 141GB of large memory, a direct increase of 76% compared to the 80GB of the H100.
作为首款搭载HBM3e内存的GPU,内存带宽也从3.35TB/s提升至4.8TB/s,提升43%。
In addition to memory upgrades, the H200 has the same specifications and peak computing power as the H100 in all other aspects, and one advantage is that it can be directly replaced into the existing H100 computer fleet without any adjustments.
ChatGPT's official account also revealed that more memory brings more KV cache, which can also run more ChatGPT.
Hinting that the new supercomputer may be used for ChatGPT's inference acceleration.
One More Thing
A few hours after taking a photo with Lao Huang, Ultraman was revealed to have appeared in the Nvidia auditorium of Stanford University to give a speech.
The auditorium, which can accommodate 342 people, is already full, and about 200 people are crowded outside.
According to Andrew Gao, a Stanford student, he then had the opportunity to attend a closed-door meeting of about 20 Ultraman.
He mentioned some big things, but I can't share them.
Another person who attended the closed-door meeting also did not disclose the specifics, but was excited about GPT-5 anyway.
Reference Links:
[1]https://x.com/gdb/status/1783234941842518414
[2]https://x.com/itsandrewgao/status/1783301236126847379