[Intel releases a new generation of AI chips, or it may become a strong competitor of NVIDIA products]
Intel has made significant progress in the field of AI accelerators, and its subsidiary Habana Labs showcased the latest generation of high-performance AI accelerator Gaudi 3 at the Vision 2024 conference, claiming that its performance will surpass that of Nvidia H100 and will ship to customers in the third quarter of this year. Gaudi 3 has significant performance improvements, especially FP8 with 1835 TFLOPS of computing throughput, which is expected to take a share of the AI computing field.
The design of the Gaudi 3 partially outperformed Nvidia's H100 in internal benchmarks and had an advantage in energy consumption. Gaudi 3 has demonstrated excellent performance when handling critical tasks such as large language models, and is expected to train large language models such as GPT-3 40% faster than the NVIDIA H100 and 50% faster than the NVIDIA H100 on the inference end. In addition, the release of Gaudi 3 is also a reflection of the change in the positioning of Intel's AI accelerator products, and the Gaudi series has been upgraded to Intel's flagship AI accelerator.
The Gaudi 3 is a direct evolution of the Gaudi 2 hardware, using TSMC's more advanced 5nm process and expanding on the computing hardware. The Habana team revealed the total throughput of the Gaudi 3 chip's FP8 precision, which makes Gaudi 3 twice as powerful as Gaudi 2 when using 8-bit floating-point calculations, and quadruple as powerful as BFloat 16.
Intel also highlighted the advantages of the Gaudi 3 in terms of energy efficiency, which is expected to be 100% faster than the H220 on the Llama model and 230% faster on the Falcon model. The dual-core configuration of the Gaudi 3 chip, connected by a high-bandwidth link, provides a unified memory address space, similar to NVIDIA's Blackwell.
VeryKen Smart Review: The release of Gaudi 3 comes at a time when demand for AI accelerator cards is high, and its strong performance and scalability make it a strong competitor to Nvidia H100, which may open up new opportunities for Intel in the AI accelerator market. Intel CEO Pat Gelsinger showed off the performance of the Gaudi 3 at the conference and said that its performance will be comparable to the Nvidia H200, or even better in some areas. The launch of Gaudi 3 is not only an important technology showcase for Intel in the AI field, but also part of its strategy to build a broad AI ecosystem alliance and promote enterprise AI innovation. (Heart of the Machine, Qubits, The Paper)
