PerGB

Why do memory channels matter for AI, and how many does your CPU have?

Each memory channel adds bandwidth, and bandwidth sets how fast a CPU writes with a local AI model. Desktop chips have 2 channels (about 90 GB/s), Threadripper 4 or 8, EPYC 7002/7003 8, EPYC 9004/9005 12 (about 460-600 GB/s).

A channel only counts when it has a stick in it, so 8 channels with 4 sticks run at half the bandwidth. Speed comes from filling more channels; bigger sticks only add capacity. A second stick per channel adds capacity but no bandwidth, and often lowers the speed.

Every platform on the site

GenerationSocketChannelsMemoryBandwidth
Xeon 6900P (Granite Rapids)LGA752912DDR5-6400614.4 GB/s
EPYC 9005 (Turin)SP512DDR5-6000576 GB/s
EPYC 9004 (Genoa)SP512DDR5-4800460.8 GB/s
Threadripper PRO 9000sTR58DDR5-6400409.6 GB/s
Xeon 6700E (Sierra Forest)LGA47108DDR5-6400409.6 GB/s
Xeon 6700P (Granite Rapids)LGA47108DDR5-6400409.6 GB/s
Xeon 6500P (Granite Rapids)LGA47108DDR5-6400409.6 GB/s
Xeon Scalable 5th gen (Emerald Rapids)LGA46778DDR5-5600358.4 GB/s
Threadripper PRO 7000sTR58DDR5-5200332.8 GB/s
Xeon Scalable 4th gen (Sapphire Rapids)LGA46778DDR5-4800307.2 GB/s
Xeon W-3400 (Sapphire Rapids)LGA46778DDR5-4800307.2 GB/s
Xeon W-3500 (Sapphire Rapids refresh)LGA46778DDR5-4800307.2 GB/s
Xeon Max (Sapphire Rapids, 64 GB HBM)LGA46778DDR5-4800307.2 GB/s
EPYC 8004 (Siena)SP66DDR5-4800230.4 GB/s
EPYC 7003 (Milan)SP38DDR4-3200204.8 GB/s
EPYC 7002 (Rome)SP38DDR4-3200204.8 GB/s
Threadripper PRO 3000sWRX88DDR4-3200204.8 GB/s
Threadripper PRO 5000sWRX88DDR4-3200204.8 GB/s
Threadripper 9000sTR54DDR5-6400204.8 GB/s
Xeon Scalable 3rd gen (Ice Lake)LGA41898DDR4-3200204.8 GB/s
Xeon W-3300 (Ice Lake-W)LGA41898DDR4-3200204.8 GB/s
EPYC 7001 (Naples)SP38DDR4-2666170.6 GB/s
Threadripper 7000sTR54DDR5-5200166.4 GB/s
Xeon Scalable 3rd gen (Cooper Lake)LGA41896DDR4-3200153.6 GB/s
Xeon W-2400 (Sapphire Rapids)LGA46774DDR5-4800153.6 GB/s
Xeon W-2500 (Sapphire Rapids refresh)LGA46774DDR5-4800153.6 GB/s
Xeon W-3200 (Cascade Lake-W)LGA36476DDR4-2933140.8 GB/s
Xeon W-3100 (Skylake-W)LGA36476DDR4-2666128 GB/s
Threadripper 3000sTRX44DDR4-3200102.4 GB/s
Core Ultra 200S Plus (Arrow Lake refresh)LGA18512DDR5-6400102.4 GB/s
Core Ultra 200S (Arrow Lake)LGA18512DDR5-6400102.4 GB/s
Threadripper 2000TR44DDR4-293393.9 GB/s
Xeon W-2200 (Cascade Lake-W)LGA20664DDR4-293393.9 GB/s
EPYC 4005AM52DDR5-560089.6 GB/s
Ryzen 9000 (Zen 5)AM52DDR5-560089.6 GB/s
Core 13th gen (Raptor Lake)LGA17002DDR5-560089.6 GB/s
Core 14th gen (Raptor Lake refresh)LGA17002DDR5-560089.6 GB/s
Threadripper 1000TR44DDR4-266685.3 GB/s
Xeon W-2100 (Skylake-W)LGA20664DDR4-266685.3 GB/s
EPYC 4004AM52DDR5-520083.2 GB/s

Top supported speeds. Platforms priced with their memory: the build page.

Prices and picks update every time the site does (live listings checked within the last few hours).