PerGB

What's the cheapest way to run DeepSeek R1 or V3 (671B) at home?

A server with 512 GB of memory: DeepSeek takes about 408 GB at Q4, which would be 18 cards of 24 GB. The best value platform listed now is an AMD EPYC 7351P with 8 × 64 GB DDR4-2666 RDIMM, about 4 tokens/s for $2,663.

DeepSeek R1 and V3 have 671 billion parameters, but they're a mixture of experts: only 37 billion work on each token, so each token reads about 22 GB at Q4. With 12 DDR5 channels (an EPYC 9004 or 9005) that's 8-12 tokens a second; with 8 DDR4 channels (an EPYC 7002 / 7003) about 4-6. Holding the whole model on GPUs would take a rack of them.

The best value platforms right now

CPUBoardMemoryBandwidthTokens/sTotal
AMD EPYC 7351PGigabyte MZ31-AR08 × 64 GB DDR4-2666 RDIMM171 GB/s3.6$2,663
AMD EPYC 7551Gigabyte MZ31-AR08 × 64 GB DDR4-2666 RDIMM171 GB/s3.6$2,663
AMD EPYC 7251Gigabyte MZ31-AR08 × 64 GB DDR4-2666 RDIMM171 GB/s3.6$2,668
AMD EPYC 7281Gigabyte MZ31-AR08 × 64 GB DDR4-2666 RDIMM171 GB/s3.6$2,668
AMD EPYC 7301Gigabyte MZ31-AR08 × 64 GB DDR4-2666 RDIMM171 GB/s3.6$2,668
AMD EPYC 7451Gigabyte MZ31-AR08 × 64 GB DDR4-2666 RDIMM171 GB/s3.6$2,668
AMD EPYC 7351Gigabyte MZ31-AR08 × 64 GB DDR4-2666 RDIMM171 GB/s3.6$2,670
AMD EPYC 7401PGigabyte MZ31-AR08 × 64 GB DDR4-2666 RDIMM171 GB/s3.6$2,670

Chip, board and memory from live listings, ranked by tokens/s per dollar; speeds are estimates. Pick other amounts on the build page.

Prices and picks update every time the site does (live listings checked within the last few hours).