L40S vs H100 PCIe
Manufacturer specifications of the L40S and the H100 PCIe, side by side, per GPU. A value the manufacturer does not publish for the exact model is marked as such, never estimated.
NVIDIA L40S 48GB
Ada Lovelace
- GPU memory
- 48 GB
- Memory bandwidth
- 864 GB/s
Live price on EverXCloud · from $0.79 per GPU-hour
NVIDIA H100 PCIe 80GB
Hopper
- GPU memory
- 80 GB
- Memory bandwidth
- 2,000 GB/s
Live price on EverXCloud · from $2.89 per GPU-hour
Suited workloads
Key differences
- The H100 PCIe has 1.7× the GPU memory of the L40S (80 GB vs 48 GB).
- The H100 PCIe has 2.3× the memory bandwidth of the L40S (2,000 vs 864 GB/s), which usually sets the pace of LLM token generation.
- The H100 PCIe has 2.1× the dense BF16 tensor throughput of the L40S (756 vs 362 TFLOPS), the precision of most training runs.
- The H100 PCIe has 2.1× the dense FP8 tensor throughput of the L40S (1,513 vs 733 TFLOPS).
- The L40S has ray-tracing cores for 3D rendering; the H100 PCIe does not.
Specifications
| Specification | L40S | H100 PCIe |
|---|---|---|
| GPU memory | 48 GB | 80 GB (higher) |
| Memory type | GDDR6 | HBM2e |
| Memory bandwidth | 864 GB/s | 2,000 GB/s (higher) |
| FP16 tensor | 362 TFLOPS | 756 TFLOPS (higher) |
| BF16 tensor | 362 TFLOPS | 756 TFLOPS (higher) |
| FP8 tensor | 733 TFLOPS | 1,513 TFLOPS (higher) |
| Max power | 350 W | 350 W |
| Architecture | Ada Lovelace | Hopper |
| Interconnect | PCIe 4.0 | NVLink bridge (600 GB/s) · PCIe 5.0 |
The higher value of each measured row is shown in bold. Manufacturer specifications, per GPU. Tensor throughput is shown without sparsity. Values the manufacturer does not publish for this exact model are left out.
What fits in memory, on one GPU
| Workload | L40S | H100 PCIe |
|---|---|---|
| LLM inference, 16-bit | ≈ 15B parameters | ≈ 30B parameters |
| LLM inference, 4-bit | ≈ 60B parameters | ≈ 100B parameters |
| Full training, mixed precision | ≈ 2B parameters | ≈ 4B parameters |
Cautious estimates counting 80% of memory for model weights; context length, batch size and framework change the real limit. Several GPUs together hold larger models.
L40S vs H100 PCIe: frequently asked questions
Which has more memory, the L40S or the H100 PCIe?
The H100 PCIe has 80 GB of GPU memory, against 48 GB for the L40S.
Which is faster for LLM inference, the L40S or the H100 PCIe?
Generating tokens is usually bound by memory bandwidth, and the H100 PCIe has 2.3× the bandwidth of the L40S. Memory size then decides which models fit. Measure your own model before a large run.
Can I rent the L40S and the H100 PCIe by the hour?
Yes, when sellers list them on the EverXCloud spot exchange: you buy GPU hours at the live price from a prepaid balance in euros, US dollars or pounds. Prices are shown excluding tax and EverXCloud is the merchant of record for every rental.
Be ready on launch day
Create your account now: you can top up your balance and rent the GPU that fits your workload as soon as the market opens.
Have GPU servers?
Businesses can join the EverXCloud Network and sell hours of their GPU servers on the spot exchange.