Radeon Instinct MI300A holds 439 of the models in our catalogue and is, in practice, a IQ4_XS card — the largest it takes is DeepSeek V4 Flash Vision Exp at IQ4_XS.
Neighbours in memory rather than in price: memory decides whether a card can do the job at all, so two cards of the same size at different prices is the comparison you are making. Ordered by memory, then bandwidth — not by the value column, which is worked out from bandwidth and price alone and therefore rewards a cheap card whatever its software stack does to that bandwidth in practice. Read it as one input, not as a ranking.
AMD Radeon Instinct MI300A — 192 GB VRAM.
- Brand
- AMD
- VRAM
- 192 GB HBM3
- Bandwidth
- 10300 GB/s
- FP16 Compute
- 653.7 TFLOPS
- FP32 Compute
- 81.7 TFLOPS
- Stream Processors
- 19,456
- TDP
- 750 W
- Architecture
- CDNA 3.0
- MSRP
- $12000
With 192 GB VRAM and 10300 GB/s bandwidth, this GPU handles models up to 250.29B parameters.
Speed ≈ bandwidth / model_size × efficiency. A 7B model at Q4 runs at ~1177 tok/s.
| Model | Size | VRAM Q4 | tok/s | Avg |
|---|---|---|---|---|
| Solar Open 2 250B | 250.29B | 153.5 GB | 610 | 69.2 |
| DeepSeek V2 236B | 236B | 144.7 GB | 436 | 40.4 |
| DeepSeek-V2.5 236B | 236B | 144.7 GB | 436 | 64.0 |
| DeepSeek-Coder-V2 236B | 236B | 144.7 GB | 436 | 61.8 |
| Qwen3-235B-A22B | 235.1B | 144.2 GB | 416 | 181.9 |
| Qwen3-235B-A22B Instruct 2507 | 235.1B | 144.2 GB | 416 | 51.9 |
| Qwen3-VL 235B A22B Instruct | 235B | 144.1 GB | 416 | 44.3 |
| MiniMax-M2.7 | 230B | 141.1 GB | 916 | 52.5 |
| MiniMax-M2.5 228.7B | 228.7B | 140.3 GB | 436 | 144.9 |
| Command A+ | 218B | 133.7 GB | 366 | 37.8 |
| Step 3.7 Flash | 201.37B | 123.6 GB | 832 | 52.3 |
| Falcon 180B | 180B | 110.5 GB | 51 | 51.3 |
| Qwen3.8 Flash Next | 180B | 110.5 GB | 1526 | 66.3 |
| bloom 176.2B | 176.2B | 108.2 GB | 52 | 15.0 |
| dots.llm1 142B-A14B | 142.8B | 87.8 GB | 654 | 60.9 |
| WizardLM 2 8x22B | 141B | 86.7 GB | 235 | 42.4 |
| Mixtral-8x22B | 140.6B | 86.4 GB | 234 | 31.9 |
| DBRX 132B | 132B | 81.2 GB | 254 | 46.3 |
| Mistral Medium 3.5 | 128B | 78.7 GB | 72 | 44.5 |
| Ling 3.0 Flash | 127.49B | 78.4 GB | 1795 | 57.0 |