RHOVAN. connect@rhovan.ai

NVIDIA DGX B300

Specifications

What is inside the chassis, how the eight GPUs share one NVLink domain, and how a single node joins a cluster. Every figure below is published by NVIDIA.

Anatomy

Schematic
Schematic front elevation of the 10U chassis, showing the GPU tray, drive bays, host tray, and power modules. 10U 01 02 03 04
Front elevation, schematic
  1. 01

    GPU tray

    Eight Blackwell Ultra SXM modules on one NVLink domain, carrying 2.1 TB of HBM3e.

  2. 02

    Drive bays

    Eight 3.84 TB E1.S NVMe, self-encrypting, alongside two M.2 for the operating system.

  3. 03

    Host tray

    Two Intel Xeon 6776P with 2 TB of system memory as standard, up to 4 TB.

  4. 04

    Power and cooling

    Roughly 14 kW at full draw. Plan the rack, the feed, and the heat before it lands.

Eight GPUs connected through two NVLink switch systems, 14.4 terabytes per second aggregate. GPU GPU GPU GPU NVLINK SWITCH SYSTEM 01 NVLINK SWITCH SYSTEM 02 GPU GPU GPU GPU
NVLink domain, 14.4 TB/s aggregate
Network topology per node: eight 800 gigabit compute fabric ports, two 400 gigabit storage and management ports, and one gigabit out of band port. DGX B300 8X 800 GB/S 2X 400 GB/S 1 GBE COMPUTE FABRIC STORAGE + MANAGEMENT OUT OF BAND
Network fabric, per node

Spec sheet

NVIDIA DGX B300
Compute
GPUs
8x NVIDIA Blackwell Ultra SXM
GPU memory
2.1 TB HBM3e
FP4 Tensor Core
144 PFLOPS sparse / 108 PFLOPS dense
FP8 Tensor Core
72 PFLOPS sparse
Interconnect
2x NVLink Switch System, 14.4 TB/s aggregate
Host
CPU
2x Intel Xeon 6776P
System memory
2 TB standard, up to 4 TB
Storage
Operating system
2x 1.9 TB NVMe M.2
Data cache
8x 3.84 TB NVMe E1.S, self-encrypting
Network
Compute fabric
8x OSFP, ConnectX-8, up to 800 Gb/s per port
InfiniBand or Ethernet
Storage and management
2x dual-port QSFP112 BlueField-3 DPU, up to 400 Gb/s
InfiniBand or Ethernet
Out of band
1 GbE management
Physical
Form factor
10U rack mounted
Maximum power
~14 kW
Support
3 years, hardware and software

Specifications per NVIDIA. Configuration options including system memory, fabric choice, and drive capacity are confirmed at quotation.

Included

Software and support
NVIDIA AI Enterprise Mission Control DGX OS RHEL / Rocky / Ubuntu NVLink Switch ConnectX-8 BlueField-3 3-Year Support