PerGB

DDR4 or DDR5 for running AI models?

DDR5 gives about 50% more bandwidth per channel (DDR5-4800: 38.4 GB/s against DDR4-3200's 25.6), but the platform decides the channels, and that matters more: an 8-channel DDR4 server outruns a 2-channel DDR5 desktop by far.

Per channel: DDR4-3200 moves 25.6 GB/s, DDR5-4800 38.4, DDR5-6400 51.2. The CPU fixes both the type and the number of channels, so in practice you're choosing a platform: an EPYC 7002 (8 × DDR4, 205 GB/s) or an EPYC 9004 (12 × DDR5, 460 GB/s), a desktop (2 × DDR5, about 90 GB/s). Used DDR4 server memory is usually far cheaper per GB, which makes an EPYC 7002 / 7003 the low-cost way to a lot of memory and bandwidth.

What a GB costs now

MemoryLowest per GB
DDR4-3200 RDIMM, 32 GB$5.62/GB
DDR4-3200 RDIMM, 64 GB$5.61/GB
DDR5-4800+ RDIMM, 32 GB$13.44/GB
DDR5-4800+ RDIMM, 64 GB$23.44/GB
DDR4-3200 desktop, 32 GB$3.28/GB
DDR5-6000 desktop, 32 GB$8.98/GB

Live eBay listings. All of them: memory.

Prices and picks update every time the site does (live listings checked within the last few hours).