Musk, suddenly release the "super big move"!

National Business Daily

2024-05-27 11:07Published on the official account of Sichuan Daily Economic News

Edited by: Bi Luming

According to foreign media reports, Musk recently revealed to investors that xAI, an AI company he founded, plans to build a super computing power factory (Gigafactory of Compute) to provide computing power support for the next generation of AI chatbot Grok. The supercomputer is planned to connect 100,000 NVIDIA H100 GPUs.

Image source: Screenshot of the webpage

When completed, the supercomputer will be at least four times the size of the largest GPU clusters currently available, such as the one Meta built to train its large AI model, which consists of more than 6,000 A100 GPUs from Nvidia. Behind Musk's move, Nvidia may become the biggest winner. Nvidia also announced in its latest quarterly report that it will add nine new supercomputers with its Grace Hopper chip around the world.

Musk said he hopes to get the supercomputer up and running by the fall of 2025, adding that xAI could work with Oracle to develop the mainframe computer. xAI is Oracle's largest H100-chip server rental customer, having used more than 15,000 H100 chips.

Musk founded xAI in July last year to focus on the artificial intelligence business, aiming to challenge Microsoft-backed OpenAI and Google. In November last year, xAI launched its first AI large-scale chatbot, Grok, which can connect to its social media platform X in real time.

Currently, the latest version of Grok is Grok 1.5, which was released at the end of March, which implements long context understanding and advanced inference capabilities that can handle long context windows of 128K tokens. "Improving our multimodal understanding and generation capabilities is an important step for building AGI (Artificial General Intelligence) that can understand the world," said the xAI official blog. In the coming months, we expect to make significant improvements to both capabilities in multimodality such as image, audio, and video. ”

According to brokerage China, citing Bloomberg, people familiar with the matter said that Musk's artificial intelligence startup xAI plans to complete a round of funding in June, and the company could be valued at more than $24 billion, including its recent influx of cash. xAI was due to close a funding round of about $6 billion earlier in May, but the deal that has been underway since last year remains unfinished. Recently, the company has been seeking up to $6.5 billion in funding and plans to get closer to that goal in the coming weeks, the people said.

According to previous reports, xAI is a competitor to OpenAI, which has pitched to numerous Silicon Valley investors through a promotional material touting Musk's performance at Tesla Inc. and SpaceX. The promotional materials also state that xAI and its chatbot Grok will be able to leverage high-quality data from Musk's social platform X. Access to data is essential for building large language models, which are the technology that powers AI chatbots, and xAI aims to compete with other well-funded companies like OpenAI.

On May 23, local time, Musk talked about xAI's goal of "seeking the truth as much as possible" in a remote interview at the European Science and Technology Innovation Exhibition (Viva) held in Paris. He criticized other AI models developed by Google and OpenAI for "pandering" to political correctness. Another goal of xAI, he added, is to "strive to be the most interesting AI out there." Musk also said that xAI is a new company, so Grok still has a lot of work to do to have AI that can compete with Google's Deepmind and OpenAI, and maybe by the end of this year.

When asked about the reason for creating xAI, Musk expressed concern about the lack of pursuit of the maximum truth in current AI research, believing that "the safest thing for AI is to seek the truth to the maximum", and emphasized that xAI will be committed to this goal, striving to build an AI that is beneficial to humans and avoid training "super-intelligent liars", and he repeatedly emphasized that "honesty is the best policy". Musk also said that xAI is committed to this, promising to "always release a model that goes beyond the current open source model" to increase transparency and promote healthy competition.

National Business Daily, comprehensive brokerage China, public information

View original image 162K

•