NVIDIA A100 SXM4 40 GB
Live eBay prices, cheapest first. The best one right now is $2,195 (used).
Not a PCIe card. SXM module: needs an SXM-to-PCIe adapter board, its own cooling and power to run in a normal PC. The PCIe version: NVIDIA A100 PCIe 40 GB, from $5,588 → With its adapter board: NVIDIA A100 SXM4 40 GB mod kit, from $6,049 →
Specs
- VRAM
- 40 GB HBM2e
- Bandwidth
- 1,555 GB/s
- FP32
- 19.5 TFLOPS
- FP16
- 312 TFLOPS
- Power
- 400 W
- Connector
- SXM4 (PCIe 4.0)
- Released
- 2020
- CUDA compute
- 8.0
- Llama 3.1 8B at Q4 (est.)
- 160–240 tokens/s
Price right now
Live on eBayFrom the live listings below; shipping included.
Listings
Live on eBay| Listing | Condition | Price | Checked |
|---|---|---|---|
| Used | $2,195−31%shipping not listed | ||
| Used | $2,350−27%shipping not listed | ||
| Used | $2,499or best offer−22%free shipping | ||
| Used | $2,499or best offer−22%free shipping | ||
| Used | $2,769or best offer−13%free shipping | ||
| Used | $2,770or best offer−13%free shipping | ||
| Used | $2,800−12%free shipping | ||
| Used | $2,850or best offer−11%shipping not listed | ||
| Used | $2,889or best offer−10%free shipping | ||
| Used | $3,000or best offer−6%free shipping | ||
| Used | $3,000or best offer−6%shipping not listed | ||
| Used | $3,200or best offerfree shipping | ||
| Used | $3,349or best offerfree shipping | ||
12PCS Nvidia Tesla A100 40GB SXM4 GPU Accelarator graphics card deep learning AILot of 12, price each | Used | $5,247or best offerfree shipping | |
| Used | $5,248or best offerfree shipping | ||
8PCS Nvidia Tesla A100 40GB SXM4 GPU Accelarator graphics card deep learning AILot of 8, price each | Used | $5,248or best offerfree shipping | |
8pcs Nvidia Tesla A100 40GB SXM4 GPU Accelarator Graphics Card Deep LearningLot of 8, price each | Open box | $5,263free shipping | |
8pcs Nvidia Tesla A100 40GB SXM4 GPU Accelarator Graphics Card Deep LearningLot of 8, price each | Open box | $5,263free shipping | |
| Open box | $5,280or best offerfree shipping | ||
| Open box | $5,280or best offerfree shipping | ||
4PCS Nvidia Tesla A100 40GB SXM4 GPU Accelarator graphics card deep learning AILot of 4, price each | Used | $5,344or best offerfree shipping | |
2PCS Nvidia Tesla A100 40GB SXM4 GPU Accelarator graphics card deep learning AILot of 2, price each | Used | $5,345or best offerfree shipping | |
| Used | $8,641+$10.00 shipping |
Auctions ending soon
No auctions ending soon right now.
Prices include shipping and were read from eBay at the time shown. They can change: check the listing before you buy.
Owner reviews
No owner reviews yet. Own one? Tell others how it runs.
From signed-in owners, checked before they're published. PerGB doesn't pay for or edit reviews.
How it compares
Live on eBay- #1 of 26 GPUs with 40 GB or more for the money: $812.38 per GeForce RTX 3090 of performance.
- Software: CUDA 11.0 and newer.
Faster, for the least
- AMD Instinct MI250: $4,995, 422% of the GeForce RTX 3090, 128 GB
- NVIDIA RTX PRO 6000 Blackwell: $13,100, 367% of the GeForce RTX 3090, 96 GB
- NVIDIA H100 PCIe: $26,935, 477% of the GeForce RTX 3090, 80 GB
More VRAM, for not much more
- NVIDIA Quadro RTX 8000: $2,000, 115% of the GeForce RTX 3090, 48 GB
- Intel Arc Pro B60 48 GB: $2,049, 82% of the GeForce RTX 3090, 48 GB
- NVIDIA A16: $2,200, 93% of the GeForce RTX 3090, 64 GB
From the live listings of every GPU, shipping included; performance against the GeForce RTX 3090 (FP16 or FP32 compute and memory bandwidth). Updated with every build.
Local AI: what it runs
| Model (Q4, 8K context) | A100 SXM4 40 GB needed | Costs now | Speed (est.) |
|---|---|---|---|
| Llama 3.1 8B | 1 card | $2,195 | 160–240 tokens/s |
| Qwen3 14B | 1 card | $2,195 | 87–130 tokens/s |
| gpt-oss 20B | 1 card | $2,195 | 214–321 tokens/s |
| Gemma 3 27B | 1 card | $2,195 | 47–70 tokens/s |
| Qwen3 32B | 1 card | $2,195 | 39–59 tokens/s |
| Llama 3.3 70B | 2 cards | $4,545 | 18–27 tokens/s |
| gpt-oss 120B | 2 cards | $4,545 | 151–226 tokens/s |
| Qwen3 235B-A22B | 4 cards | $9,543 | 35–52 tokens/s |
| DeepSeek R1 / V3 671B | more than 8 | — | — |
Cost: that many of the cheapest live listings. Speed: an estimate from the memory bandwidth for one person chatting. Try other models, sizes and contexts.
Decision models
| Model (Q4, 8K context) | A100 SXM4 40 GB needed | Costs now | Per question (est.) |
|---|---|---|---|
| Julia-10.144B | 1 card | $2,195 | 2.9–6.1 ms |
| Laya0.421B | 1 card | $2,195 | 4.8–10 ms |
| Kev-4B4B | 1 card | $2,195 | 11–24 ms |
| lev4B | 1 card | $2,195 | 34–73 ms |
| OpenJev27B | 1 card | $2,195 | 41–88 ms |
| Clef27B | 1 card | $2,195 | 41–88 ms |
| Perplexity Decider v1.227B | 1 card | $2,195 | 41–88 ms |
| mammoth-127B | 1 card | $2,195 | 41–88 ms |
Decision models score the options you give them instead of writing text, so they're timed per question. The time is scaled from each model's reported speed on an RTX PRO 6000 by this card's compute and memory bandwidth, within about half either way. About the models.
Compare elsewhere
Search other shops for NVIDIA A100 SXM4 40 GB. These open the shop's own search; we don't show their prices here.




















