B200 vs H100 SXM
Manufacturer specifications of the B200 and the H100 SXM, side by side, per GPU. A value the manufacturer does not publish for the exact model is marked as such, never estimated.
NVIDIA B200 180GB
Blackwell
- GPU memory
- 180 GB
- Memory bandwidth
- Not published
Live price on EverXCloud · from $7.99 per GPU-hour
Suited workloads
NVIDIA H100 SXM 80GB
Hopper
- GPU memory
- 80 GB
- Memory bandwidth
- 3,350 GB/s
Live price on EverXCloud · from $2.88 per GPU-hour
Suited workloads
Key differences
- The B200 has 2.3× the GPU memory of the H100 SXM (180 GB vs 80 GB).
Specifications
| Specification | B200 | H100 SXM |
|---|---|---|
| GPU memory | 180 GB (higher) | 80 GB |
| Memory type | HBM3e | HBM3 |
| Memory bandwidth | Not published | 3,350 GB/s |
| FP16 tensor | Not published | 989 TFLOPS |
| BF16 tensor | Not published | 989 TFLOPS |
| FP8 tensor | Not published | 1,979 TFLOPS |
| Max power | Not published | 700 W |
| Architecture | Blackwell | Hopper |
| Interconnect | NVLink 5 (1.8 TB/s) | NVLink 4 (900 GB/s) · PCIe 5.0 |
The higher value of each measured row is shown in bold. Manufacturer specifications, per GPU. Tensor throughput is shown without sparsity. Values the manufacturer does not publish for this exact model are left out.
What fits in memory, on one GPU
| Workload | B200 | H100 SXM |
|---|---|---|
| LLM inference, 16-bit | ≈ 70B parameters | ≈ 30B parameters |
| LLM inference, 4-bit | ≈ 240B parameters | ≈ 100B parameters |
| Full training, mixed precision | ≈ 9B parameters | ≈ 4B parameters |
Cautious estimates counting 80% of memory for model weights; context length, batch size and framework change the real limit. Several GPUs together hold larger models.
B200 vs H100 SXM: frequently asked questions
Which has more memory, the B200 or the H100 SXM?
The B200 has 180 GB of GPU memory, against 80 GB for the H100 SXM.
Can I rent the B200 and the H100 SXM by the hour?
Yes, when sellers list them on the EverXCloud spot exchange: you buy GPU hours at the live price from a prepaid balance in euros, US dollars or pounds. Prices are shown excluding tax and EverXCloud is the merchant of record for every rental.
Be ready on launch day
Create your account now: you can top up your balance and rent the GPU that fits your workload as soon as the market opens.
Have GPU servers?
Businesses can join the EverXCloud Network and sell hours of their GPU servers on the spot exchange.