PerGB

AMD Instinct MI100

Live eBay prices, cheapest first. The best one right now is $1,240 (used).

Specs

VRAM
32 GB HBM2
Bandwidth
1,229 GB/s
FP32
23.1 TFLOPS
FP16
185 TFLOPS
Power
300 W
Connector
PCIe 4.0
Released
2020
Launch price
$6,400 (est.)
Llama 3.1 8B at Q4 (est.)
89–152 tokens/s

Running it at home

Cooling
Passive: it has no fan. In a desktop it needs air pushed through it, front to back: a fan shroud on its end (3D-printed ones with a 40 mm blower or a 92 mm fan are sold for most of these cards) or a server chassis. Without one it overheats within minutes under load.
Power
Two 8-pin PCIe power inputs. Rated 300 W: allow that for each card on top of the rest of the PC.
Size
Full height, two slots.
Motherboard
Turn on "Above 4G decoding" in the BIOS: without it many boards won't start with a card with this much memory.

A server card: made for a rack server's airflow and power. With these sorted it works in a normal PC.

Price right now

Live on eBay
Lowest now$1,240
Median ask$1,699
Per GB VRAM$38.75
vs launch price81% under
Live listings13

From the live listings below; shipping included.

Listings

Live on eBay
ListingConditionPriceChecked
Used$1,240−27%free shipping
Used$1,299or best offer−24%free shipping
Used$1,490or best offer−12%free shipping
Used$1,494or best offer−12%free shipping
Used$1,495or best offer−12%free shipping
Used$1,498or best offer−12%free shipping
Used$1,699or best offerfree shipping
Used$1,750or best offerfree shipping
Used$1,940or best offerfree shipping
Used$1,940free shipping
Used$1,970or best offerfree shipping
Open box$2,448+$10.00 shipping
Used$3,560+$60.00 shipping

Auctions ending soon

No auctions ending soon right now.

Prices include shipping and were read from eBay at the time shown. They can change: check the listing before you buy.

Owner reviews

No owner reviews yet. Own one? Tell others how it runs.

From signed-in owners, checked before they're published. PerGB doesn't pay for or edit reviews.

How it compares

Live on eBay

Faster, for the least

From the live listings of every GPU, shipping included; performance against the GeForce RTX 3090 (FP16 or FP32 compute and memory bandwidth). Updated with every build.

Local AI: what it runs

Model (Q4, 8K context)Instinct MI100 neededCosts nowSpeed (est.)
Llama 3.1 8B1 card$1,24089–152 tokens/s
Qwen3 14B1 card$1,24048–82 tokens/s
gpt-oss 20B1 card$1,240118–203 tokens/s
Gemma 3 27B1 card$1,24026–44 tokens/s
Qwen3 32B1 card$1,24022–37 tokens/s
Llama 3.3 70B2 cards$2,53910–17 tokens/s
gpt-oss 120B3 cards$4,02983–143 tokens/s
Qwen3 235B-A22B5 cards$7,01819–33 tokens/s
DeepSeek R1 / V3 671Bmore than 8——

Cost: that many of the cheapest live listings. Speed: an estimate from the memory bandwidth for one person chatting. Try other models, sizes and contexts.

Decision models

Model (Q4, 8K context)Instinct MI100 neededCosts nowPer question (est.)
Julia-10.144B1 card$1,2405.5–12 ms
Laya0.421B1 card$1,2409.1–20 ms
Kev-4B4B1 card$1,24022–47 ms
lev4B1 card$1,24066–141 ms
OpenJev27B1 card$1,24079–168 ms
Clef27B1 card$1,24079–168 ms
Perplexity Decider v1.227B1 card$1,24079–168 ms
mammoth-127B1 card$1,24079–168 ms

Decision models score the options you give them instead of writing text, so they're timed per question. The time is scaled from each model's reported speed on an RTX PRO 6000 by this card's compute and memory bandwidth, within about half either way. About the models.

Compare elsewhere

Search other shops for AMD Instinct MI100. These open the shop's own search; we don't show their prices here.