CARDINAL
EXACT VARIANT REFERENCE

H100 SXM5 80GB

Choose between SXM modules, standard PCIe cards and NVL cards before comparing offers

SPECIFICATIONS

Memory per accelerator80 GB HBM3
Memory bandwidth3350 GB/s
Form factorSXM5 module
Maximum accelerator power700 W

Manufacturer specifications describe the product, not the condition of an offered unit. Checked 2026-09-08

COMPUTE SPECIFICATIONS

Manufacturer peak arithmetic per accelerator. These values do not predict application throughput or latency.

PrecisionExecutionPeak rateSparsityReference
FP64Vector34 TFLOPSDenseSource ↗
Conditions

Manufacturer peak per GPU; not sustained workload performance

FP64Tensor67 TFLOPSDenseSource ↗
Conditions

Manufacturer peak per GPU; not sustained workload performance

FP32Vector67 TFLOPSDenseSource ↗
Conditions

Manufacturer peak per GPU; not sustained workload performance

TF32Tensor989 TFLOPSStructured sparseSource ↗
Conditions

Manufacturer specification marked with sparsity; full GPU, not an NVL pair or MIG slice

BF16Tensor1979 TFLOPSStructured sparseSource ↗
Conditions

Manufacturer specification marked with sparsity; full GPU, not an NVL pair or MIG slice

FP16Tensor1979 TFLOPSStructured sparseSource ↗
Conditions

Manufacturer specification marked with sparsity; full GPU, not an NVL pair or MIG slice

FP8Tensor3958 TFLOPSStructured sparseSource ↗
Conditions

Manufacturer specification marked with sparsity; full GPU, not an NVL pair or MIG slice

INT8Tensor3958 TOPSStructured sparseSource ↗
Conditions

Manufacturer peak per GPU; not sustained workload performance

  • Peak arithmetic rates are not token throughput, latency or a guarantee of application performance
  • Structured-sparse rates require eligible sparsity and supported kernels; do not compare them directly with dense rates
  • Dense low-precision tensor rates are not derived by halving sparse ratings

PLATFORM AND SOFTWARE

  • Requires a compatible SXM5 server baseboard and cooling assembly
  • An SXM module does not install in a conventional PCIe slot
  • Confirm CUDA, driver and framework compatibility against the intended server image
  • Ask whether any software subscription can transfer with the particular used offer

Manufacturer maximum accelerator rating; actual draw and supported limits depend on system

INTERCONNECT

NVLink

900 GB/s. Manufacturer aggregate bidirectional bandwidth; topology depends on platform

PCIe Gen5 x16

128 GB/s. Theoretical aggregate bidirectional interface bandwidth

MANUFACTURER SOURCES

NVIDIA H100 specifications ↗NVIDIA · Checked 2026-09-08NVIDIA Hopper architecture in depth ↗NVIDIA · Checked 2026-09-08NVIDIA H100 datasheet ↗NVIDIA · Checked 2026-09-08

HOW CARDINAL HELPS

Share your quantity, destination and server model, if known. We help turn those requirements into a clearly specified request.

  • Help confirm the exact configuration and platform requirements
  • Request supplier records for condition, unit identifiers and available testing evidence
  • Clarify included accessories, delivery and proposed warranty terms before you decide

Any additional testing or guarantees must be agreed in the written offer.