M3 Max (36GB) holds 352 of the models in our catalogue and is, in practice, a IQ4_XS card — the largest it takes is K2 Horizon MoVA 36B-A4B at IQ4_XS.
Neighbours in memory rather than in price: memory decides whether a card can do the job at all, so two cards of the same size at different prices is the comparison you are making. Ordered by memory, then bandwidth — not by the value column, which is worked out from bandwidth and price alone and therefore rewards a cheap card whatever its software stack does to that bandwidth in practice. Read it as one input, not as a ranking.
Apple M3 Max (36GB) — 36 GB unified, 27 GB usable.
- Brand
- Apple
- Unified memory
- 36 GB
- Usable by a model
- 27 GB
- Bandwidth
- 300 GB/s
- FP16 Compute
- 16.4 TFLOPS
- FP32 Compute
- 16.4 TFLOPS
- TDP
- 60 W
- Architecture
- M3 Max
- MSRP
- $2499
With 27 GB of its 36 GB reaching a model and 300 GB/s bandwidth, this machine handles models up to 34.78B parameters.
Speed ≈ bandwidth / model_size × efficiency. A 7B model at Q4 runs at ~34 tok/s.
| Model | Size | VRAM Q4 | tok/s | Avg |
|---|---|---|---|---|
| K2 Horizon 32B | 34.78B | 21.7 GB | 8 | 54.0 |
| Nous Capybara 34B | 34.4B | 21.5 GB | 8 | 42.0 |
| Yi-1.5 34B | 34.4B | 21.5 GB | 8 | 45.3 |
| Falcon-H1 34B | 34B | 21.3 GB | 8 | 58.6 |
| CodeLlama 34B | 34B | 21.3 GB | 8 | 25.4 |
| Nous Hermes 2 34B | 34B | 21.3 GB | 8 | 47.0 |
| Phind CodeLlama 34B | 34B | 21.3 GB | 8 | 68.1 |
| LLaVA-1.6 Yi 34B | 34B | 21.3 GB | 8 | 47.4 |
| WizardCoder Python 34B | 34B | 21.3 GB | 8 | 73.2 |
| Yi 34B | 34B | 21.3 GB | 8 | 33.4 |
| Qwen3-VL 32B Instruct | 33.36B | 20.9 GB | 8 | 44.6 |
| Nanbeige4.3 33B | 33.12B | 20.7 GB | 8 | 92.4 |
| DeepSeek Coder 33B | 33B | 20.7 GB | 8 | 26.0 |
| Vicuna 33B | 33B | 20.7 GB | 8 | 17.2 |
| LLaMA 1 30B | 33B | 20.7 GB | 8 | 17.8 |
| DeepSeek-R1-Distill-Qwen-32B | 32.8B | 20.5 GB | 8 | 46.9 |
| Qwen3 32B | 32.8B | 20.5 GB | 8 | 96.2 |
| Gemma 4 31B | 32.68B | 20.5 GB | 8 | 174.7 |
| Qwen2.5-32B | 32.5B | 20.4 GB | 8 | 54.3 |
| Qwen 2.5 Coder 32B | 32.5B | 20.4 GB | 8 | 48.0 |