Supermicro's end-to-end liquid cooling solution leverages the NVIDIA Blackwell platform to advance the industry's transition to a sustainable AI data center
SAN JOSE, Calif., Oct. 17, 2024 /PRNewswire/ --
Supermicro, Inc.(纳斯达克:SMCI)is a total IT solutions provider for artificial intelligence (AI), cloud, storage, and 5G/Edge that is leveraging the NVIDIA Blackwell platform to accelerate the transition to liquid-cooled data centers, delivering new energy efficiency models for the rapidly growing energy needs of new AI infrastructure. Supermicro's industry-leading, end-to-end liquid cooling solution, powered by the NVIDIA GB200 NVL72 platform for exascale computing on a single rack, has begun sampling to select customers and will be in full production by the end of Q4. In addition, the recently announced Supermicro X14, H14 4U liquid cooling systems, and 10U air-cooled systems are ready for NVIDIA HGX B200 8-GPU systems.
Nvidia Blackwell AI end-to-end solutions
"We are driving the future of sustainable AI computing, and our liquid-cooled AI solutions are being adopted by some of the world's most ambitious AI infrastructure projects, with more than 2,000 liquid-cooled racks shipped since June 2024," said Charles Liang, President and CEO of Supermicro. "Supermicro's end-to-end liquid cooling solutions powered by the NVIDIA Blackwell platform unlock the computing power, cost-effectiveness, and power efficiency of next-generation GPUs, such as the NVIDIA GB200 NVL72, a hyperscale computer in a single rack. Supermicro's extensive experience in deploying liquid-cooled AI infrastructure, along with comprehensive field service, management software, and global manufacturing capabilities, provides customers with a distinct advantage in transforming their data centers with the most powerful and sustainable AI solutions. "
Supermicro's liquid-cooled supercluster for systems based on the NVIDIA GB200 NVL72 platform features new advanced in-rack or in-row coolant distribution units (CDUs) and custom cold plates for compute trays that hold two NVIDIA GB200 Grace Blackwell superchips in a 1U form factor. Supermicro's NVIDIA GB200 NVL72 leverages Supermicro's end-to-end liquid cooling solution to enable hyperscale AI computing power in a single rack. The rack solution, which integrates 72 NVIDIA Blackwell GPUs and 32 NVIDIA Grace CPUs, is interconnected via NVIDIA fifth-generation NVLink networking. NVIDIA NVLink switch systems that enhance the performance of artificial intelligence and high-performance computing (HPC) workloads by delivering 130 terabytes per second (TB/s) of total GPU traffic with extremely low latency. In addition, Supermicro supports the recently released NVIDIA GB200 NVL2 platform, a 2U air-cooled system with tightly coupled two NVIDIA Blackwell GPUs and two NVIDIA Grace CPUs, making it easy to deploy a wide range of workloads such as large LLM inference, retrieval enhanced generation (RAG), data processing, and high-performance computing (HPC) applications.
Supermicro's leading-edge 4U liquid-cooled system and new 10U air-cooled system are now available for NVIDIA HGX B200 8-GPU systems and are production-ready. Newly developed cold plates and a 250kW capacity in-rack coolant dispensing unit maximize the performance and efficiency of an 8-GPU system, delivering 64x 1000W NVIDIA Blackwell GPUs and 16x 500W CPUs in a single 48U rack. Up to 4 new 10U air-cooled systems can be installed and fully integrated into the rack at the same density as the previous generation, while delivering up to 15x more inference and 3x more training performance.
SuperCloud Composer software, Supermicro's comprehensive data center management platform, provides powerful tools for monitoring critical information about liquid cooling systems and racks, coolant dispensers, and cooling towers, including pressure, humidity, pump and valve conditions, and more. SuperCloud Composer's Liquid Cooling Consulting Module (LCCM) helps optimize operating costs and manage the integrity of liquid cooling data centers.
Supermicro 为数万亿参数的人工智能模型扩展基础架构,走在采用 InfiniBand 和以太网创新网络技术的前沿,包括 NVIDIA BlueField-3® SuperNIC 和 400Gb/s 的 NVIDIA ConnectX-7®、NVIDIA ConnectX-8®、Spectrum-4™ 和 NVIDIA Quantum-3 为 NVIDIA Blackwell 平台提供 800Gb/s 的网络连接。 NVIDIA Spectrum-X™ Ethernet 与超微公司的 4U 液冷和 8U 风冷 NVIDIA HGX H100 和 H200 系统集群配合使用,现在为迄今为止最大的 AI 部署之一提供动力。
Supermicro is a one-stop shop for all necessary technologies, liquid cooling, networking solutions, and on-site installation services, from proof of concept (PoC) to full-scale deployment. Supermicro offers a comprehensive, in-house designed liquid cooling ecosystem, including custom cold plates optimized for a wide range of GPUs, CPUs, and memory modules, as well as a variety of CDU form factors and capacities, manifolds, hoses, connectors, cooling towers, and monitoring and management software. This end-to-end solution integrates seamlessly into rack-level configurations, dramatically improving system efficiency and mitigating thermal throttling while reducing the total cost of ownership (TCO) and environmental impact of data center operations to embrace the era of AI.
Supermicro 参加 2024 OCP Global Summit- 采用 NVIDIA HGX B200 8-GPU 系统的全新 X14 4U 液冷系统
- Supermicro 的超级集群 NVIDIA GB200 NVL72 Platform 4
- H13 4U 液冷系统，采用 NVIDIA HGX H200 8-GPU 系统
- X14 JBOF system
- 采用 OCP DC-MHS 设计的 X14 1U CloudDC
Learn more at booth #21 at the OCP Global Summit in San Jose, CA, October 15-17, 2024.
关于 Super Micro Computer, Inc.Supermicro (NASDAQ: SMCI) is a global leader in total IT solutions for application optimization. Founded and operating in San Jose, California, Supermicro is committed to delivering innovation and first-to-market for enterprise, cloud computing, AI, and 5G telco/edge IT infrastructure. We are a total IT solutions provider that provides servers, artificial intelligence, storage, IoT, switch systems, software, and support services. Supermicro's expertise in motherboard, power, and chassis design drives our R&D and manufacturing, delivering next-generation innovations from the cloud to the edge to customers around the world. Our products are designed and manufactured in-house, including in the United States, Asia and the Netherlands, with global operations to achieve scale and efficiency to optimize total cost of ownership (TCO) and reduce environmental impact (through green computing). The award-winning Server Building Block Solutions® provides customers with a broad portfolio of optional systems to optimize their exact workloads and applications through our flexible and reusable building blocks. These building blocks support a full range of form factors, processors, memory, GPUs, storage, networking, power, and cooling solutions (air conditioning, free air cooling, or liquid cooling).
Supermicro、Server Building Block Solutions和We Keep IT Green是Super Micro Computer, Inc.的商标和/或注册商标。
All other brands, names and trademarks are the property of their respective owners.