Best GPU for local AI under $500
Right now the top pick under $500 is the NVIDIA Tesla P40 at $270.00 (24 GB, 35% of the GeForce RTX 3090, CUDA 8.0 to 12.9 (not CUDA 13)). Ranked by VRAM first (what decides which models fit), then by price for the performance. PCIe cards only, so every one goes in a normal PC; each with at least 3 live listings.
The top cards right now
Live on eBay| # | GPU | VRAM | Lowest | Performance | $ per GeForce RTX 3090 | $ per GB VRAM | Listings |
|---|---|---|---|---|---|---|---|
| 1 | NVIDIA Tesla P40 | 24 GB | $270.00 | 35% | $771.34 | $11.25 | 216 |
| 2 | NVIDIA Tesla V100 PCIe 16 GB | 16 GB | $325.00 | 123% | $263.89 | $20.31 | 52 |
| 3 | NVIDIA Tesla P100 PCIe 16 GB | 16 GB | $170.00 | 45% | $374.58 | $10.62 | 111 |
| 4 | AMD Radeon VII | 16 GB | $249.00 | 65% | $381.82 | $15.56 | 69 |
| 5 | Intel Arc A770 16 GB | 16 GB | $431.00 | 108% | $399.68 | $26.94 | 22 |
| 6 | AMD Instinct MI50 16 GB | 16 GB | $266.00 | 64% | $413.93 | $16.62 | 21 |
| 7 | AMD Radeon Pro VII | 16 GB | $355.00 | 64% | $557.66 | $22.19 | 22 |
| 8 | NVIDIA Quadro RTX 5000 | 16 GB | $449.99 | 77% | $580.95 | $28.12 | 67 |
| 9 | AMD Radeon RX 6800 | 16 GB | $380.00 | 50% | $765.32 | $23.75 | 43 |
| 10 | AMD Radeon RX 6800 XT | 16 GB | $450.00 | 56% | $800.67 | $28.12 | 44 |
| 11 | AMD Radeon RX 6900 XT | 16 GB | $480.00 | 60% | $806.30 | $30.00 | 81 |
| 12 | NVIDIA Tesla T4 | 16 GB | $469.99 | 56% | $840.09 | $29.37 | 130 |
| 13 | AMD Radeon RX 7600 XT | 16 GB | $399.99 | 44% | $905.76 | $25.00 | 8 |
| 14 | NVIDIA A2 | 16 GB | $449.99 | 23% | $1,933 | $28.12 | 130 |
| 15 | NVIDIA Tesla V100 PCIe 12 GB | 12 GB | $261.00 | 123% | $211.92 | $21.75 | 4 |
Lowest live eBay price per card, shipping included; performance against the GeForce RTX 3090.