PerGB

A40 vs Tesla V100 SXM2 16 GB

The Tesla V100 SXM2 16 GB is about 4% faster, and the Tesla V100 SXM2 16 GB costs $2,805 less right now. For the money, the Tesla V100 SXM2 16 GB gives 1497% more performance per dollar. The A40 has more VRAM (48 GB against 16 GB), which matters most for local AI models.

Prices right now

Live on eBay
A40Tesla V100 SXM2 16 GB
Lowest live price$3,000$195.00
Median ask$5,000$319.02
Live listings53101
Performance (vs GeForce RTX 3090)125%130%
Price per GeForce RTX 3090 of performance$2,394$149.87
Price per GB of VRAM$62.50$12.19

Lowest and median of the live eBay listings, shipping included.

Specs

A40Tesla V100 SXM2 16 GB
VRAM48 GB GDDR616 GB HBM2
Memory bandwidth696 GB/s900 GB/s
FP16150 TFLOPS125 TFLOPS
FP3237.4 TFLOPS15.7 TFLOPS
Power300 W300 W
Released20202017
Launch price$4,500 (est.)—
ConnectorPCIe 4.0SXM2 (PCIe 3.0)
SoftwareCUDA 11.1 and newerCUDA 9.0 to 12.9 (not CUDA 13)

Performance: the geometric mean of FP16 compute (FP32 where FP16 isn't listed) and memory bandwidth, against the GeForce RTX 3090. Real speed depends on the workload.

More comparisons

A40 vs GeForce RTX 5080 · A40 vs Radeon RX 7900 XTX · RTX A6000 vs Tesla V100 SXM2 16 GB · GeForce RTX 5080 vs Tesla V100 SXM2 16 GB · Radeon RX 7900 XTX vs Tesla V100 SXM2 16 GB