NVIDIA GB200 Grace Blackwell Superchip Introduced

0
NVIDIA GB200 Grace Blackwell

NVIDIA introduces the latest DGX and Superchip platforms, featuring the Grace CPU as well as brand new Blackwell B200 GPUs announced. The NVIDIA GB200 Grace Blackwell Superchip connects two NVIDIA B200 Tensor Core GPUs to the NVIDIA Grace CPU over a 900 GB/s ultra-low-power NVLink chip-to-chip connection.

NVIDIA GB200 Grace Blackwell Features

For the highest AI performance, GB200-supported systems can connect to NVIDIA Quantum-X800 InfiniBand and Spectrum X800 Ethernet platforms, which provide advanced networking at speeds up to 800 Gb/s.

GB200 is a key component of the NVIDIA GB200 NVL72, a multi-node, liquid-cooled, rack-scale system for the most intensive computing loads. It integrates 36 Grace Blackwell Superchips containing 72 Blackwell GPUs and 36 Grace CPUs, connected by fifth-generation NVLink. Additionally, the GB200 NVL72 includes NVIDIA BlueField-3 data processing units to enable cloud network acceleration, composable storage, zero trust security, and GPU computing flexibility in hyperscale AI clouds. The GB200 NVL72 delivers up to 30x performance gains over the same number of NVIDIA H100 Tensor Core GPUs for LLM inference workloads and reduces cost and energy consumption by up to 25x.

The platform acts as a single GPU with 1.4 exaflops of AI performance and 30TB of fast memory, forming a building block for the latest DGX SuperPOD.

NVIDIA introduces the HGX B200, a server motherboard that connects eight B200 GPUs via NVLink to support x86-based generative AI platforms. The HGX B200 supports networking speeds of up to 400 Gb/s via NVIDIA Quantum-2 InfiniBand and Spectrum-X Ethernet networking platforms.

In terms of performance, the GB200 Grace Blackwell Superchip platform will offer a 30-fold increase in AI performance compared to the H200 Grace Hopper platform. NVIDIA Blackwell GB200 will be available on DGX Cloud later this year; Leading OEMs such as Dell, Cisco, HPE, Lenovo, Supermicro, Aivres, ASRock Rack, ASUS, Eviden, Foxconn, Gigabyte, Inventec, Pegatron, QCT, Wistron, Wiwynn & ZT Systems will also offer their own solutions in the future.

You may be interested.  GitHub Copilot Chat Officially Released on Android and iOS Platforms
Leave A Reply