A40 vs Tesla V100 SXM2 16 GB
The Tesla V100 SXM2 16 GB is about 4% faster, and the Tesla V100 SXM2 16 GB costs $2,805 less right now. For the money, the Tesla V100 SXM2 16 GB gives 1497% more performance per dollar. The A40 has more VRAM (48 GB against 16 GB), which matters most for local AI models.
Prices right now
Live on eBay| A40 | Tesla V100 SXM2 16 GB | |
|---|---|---|
| Lowest live price | $3,000 | $195.00 |
| Median ask | $5,000 | $319.02 |
| Live listings | 53 | 101 |
| Performance (vs GeForce RTX 3090) | 125% | 130% |
| Price per GeForce RTX 3090 of performance | $2,394 | $149.87 |
| Price per GB of VRAM | $62.50 | $12.19 |
Lowest and median of the live eBay listings, shipping included.
Specs
| A40 | Tesla V100 SXM2 16 GB | |
|---|---|---|
| VRAM | 48 GB GDDR6 | 16 GB HBM2 |
| Memory bandwidth | 696 GB/s | 900 GB/s |
| FP16 | 150 TFLOPS | 125 TFLOPS |
| FP32 | 37.4 TFLOPS | 15.7 TFLOPS |
| Power | 300 W | 300 W |
| Released | 2020 | 2017 |
| Launch price | $4,500 (est.) | — |
| Connector | PCIe 4.0 | SXM2 (PCIe 3.0) |
| Software | CUDA 11.1 and newer | CUDA 9.0 to 12.9 (not CUDA 13) |
Performance: the geometric mean of FP16 compute (FP32 where FP16 isn't listed) and memory bandwidth, against the GeForce RTX 3090. Real speed depends on the workload.
More comparisons
A40 vs GeForce RTX 5080 · A40 vs Radeon RX 7900 XTX · RTX A6000 vs Tesla V100 SXM2 16 GB · GeForce RTX 5080 vs Tesla V100 SXM2 16 GB · Radeon RX 7900 XTX vs Tesla V100 SXM2 16 GB