What's the cheapest way to run DeepSeek R1 or V3 (671B) at home?
A server with 512 GB of memory: DeepSeek takes about 408 GB at Q4, which would be 18 cards of 24 GB. The best value platform listed now is an AMD EPYC 7351P with 8 × 64 GB DDR4-2666 RDIMM, about 4 tokens/s for $2,663.
DeepSeek R1 and V3 have 671 billion parameters, but they're a mixture of experts: only 37 billion work on each token, so each token reads about 22 GB at Q4. With 12 DDR5 channels (an EPYC 9004 or 9005) that's 8-12 tokens a second; with 8 DDR4 channels (an EPYC 7002 / 7003) about 4-6. Holding the whole model on GPUs would take a rack of them.
The best value platforms right now
| CPU | Board | Memory | Bandwidth | Tokens/s | Total |
|---|---|---|---|---|---|
| AMD EPYC 7351P | Gigabyte MZ31-AR0 | 8 × 64 GB DDR4-2666 RDIMM | 171 GB/s | 3.6 | $2,663 |
| AMD EPYC 7551 | Gigabyte MZ31-AR0 | 8 × 64 GB DDR4-2666 RDIMM | 171 GB/s | 3.6 | $2,663 |
| AMD EPYC 7251 | Gigabyte MZ31-AR0 | 8 × 64 GB DDR4-2666 RDIMM | 171 GB/s | 3.6 | $2,668 |
| AMD EPYC 7281 | Gigabyte MZ31-AR0 | 8 × 64 GB DDR4-2666 RDIMM | 171 GB/s | 3.6 | $2,668 |
| AMD EPYC 7301 | Gigabyte MZ31-AR0 | 8 × 64 GB DDR4-2666 RDIMM | 171 GB/s | 3.6 | $2,668 |
| AMD EPYC 7451 | Gigabyte MZ31-AR0 | 8 × 64 GB DDR4-2666 RDIMM | 171 GB/s | 3.6 | $2,668 |
| AMD EPYC 7351 | Gigabyte MZ31-AR0 | 8 × 64 GB DDR4-2666 RDIMM | 171 GB/s | 3.6 | $2,670 |
| AMD EPYC 7401P | Gigabyte MZ31-AR0 | 8 × 64 GB DDR4-2666 RDIMM | 171 GB/s | 3.6 | $2,670 |
Chip, board and memory from live listings, ranked by tokens/s per dollar; speeds are estimates. Pick other amounts on the build page.
Prices and picks update every time the site does (live listings checked within the last few hours).