PerGB

Does PCIe 3.0, 4.0 or 5.0 matter for GPUs and AI?

For one GPU running a model, hardly: the model loads once and then works inside the card. It matters for several GPUs splitting a model, for training, and for fast NVMe storage: there, lanes count as much as the generation.

Each PCIe generation doubles the bandwidth per lane: a 4.0 x16 slot moves about 32 GB/s, a 3.0 x16 about 16. A card's own memory is 30-60 times faster, so once a model is loaded, inference barely touches the slot. When a model is split across cards, every token passes between them, and x8 or 3.0 links start to show. Desktop chips have 20-28 lanes (one x16 slot at full speed); EPYC and Threadripper PRO have 128, enough for several cards at x16.

What each platform gives

GenerationPCIeLanes
EPYC 9004 (Genoa)5.0128
EPYC 9005 (Turin)5.0128
Threadripper PRO 70005.0128
Threadripper PRO 90005.0128
Xeon W-3400 (Sapphire Rapids)5.0112
Xeon W-3500 (Sapphire Rapids refresh)5.0112
EPYC 8004 (Siena)5.096
Xeon 6900P (Granite Rapids)5.096
Threadripper 70005.088
Threadripper 90005.088
Xeon 6700E (Sierra Forest)5.088
Xeon 6700P (Granite Rapids)5.088
Xeon 6500P (Granite Rapids)5.088
Xeon Scalable 4th gen (Sapphire Rapids)5.080
Xeon Scalable 5th gen (Emerald Rapids)5.080
Xeon Max (Sapphire Rapids, 64 GB HBM)5.080
Xeon W-2400 (Sapphire Rapids)5.064
Xeon W-2500 (Sapphire Rapids refresh)5.064
EPYC 40045.028
EPYC 40055.028
Ryzen 9000 (Zen 5)5.024
Ryzen 7000 (Zen 4)5.024
Core Ultra 200S Plus (Arrow Lake refresh)5.024
Core Ultra 200S (Arrow Lake)5.024
Xeon 6300 (entry)5.020
Core 12th gen (Alder Lake)5.020
Core 13th gen (Raptor Lake)5.020
Core 14th gen (Raptor Lake refresh)5.020
EPYC 7003 (Milan)4.0128
EPYC 7002 (Rome)4.0128
Threadripper PRO 30004.0128
Threadripper PRO 50004.0128
Threadripper 30004.064
Xeon Scalable 3rd gen (Ice Lake)4.064
Xeon W-3300 (Ice Lake-W)4.064
Ryzen 8000G (Zen 4)4.020
EPYC 7001 (Naples)3.0128
Threadripper 10003.064
Threadripper 20003.064
Xeon W-3200 (Cascade Lake-W)3.064

From the CPU itself. Filter builds by PCIe on the build page, or rank them by lanes and x16 slots in its GPU host mode. More: does the CPU matter for AI with GPUs?

Prices and picks update every time the site does (live listings checked within the last few hours).