Llama-4-Maverick-17B-128E — 400B MoE.
Run Llama-4-Maverick-17B-128E locally with Ollama — needs 245.0 GB VRAM at Q4_K_M:
ollama run llama4:128x17b| Quant | Bits | VRAM @ 16K | Quality |
|---|---|---|---|
| IQ2_XXS | 2.38 | 121.7 GB 119.5 + 2.3 KV | low |
| IQ2_M | 2.93 | 149.2 GB 147.0 + 2.3 KV | low |
| Q2_K | 3.16 | 160.7 GB 158.5 + 2.3 KV | low |
| IQ3_XXS | 3.25 | 165.2 GB 163.0 + 2.3 KV | low |
| IQ3_XS | 3.5 | 177.7 GB 175.5 + 2.3 KV | low |
| Q3_K_S | 3.64 | 184.7 GB 182.5 + 2.3 KV | low |
| IQ3_M | 3.76 | 190.7 GB 188.5 + 2.3 KV | low |
| Q3_K_M | 4 | 202.7 GB 200.5 + 2.3 KV | low |
| Q3_K_L | 4.3 | 217.7 GB 215.5 + 2.3 KV | moderate |
| IQ4_XS | 4.46 | 225.7 GB 223.5 + 2.3 KV | moderate |
| Q4_K_S | 4.67 | 236.2 GB 234.0 + 2.3 KV | moderate |
| Q4_K_M | 4.89 | 247.2 GB 245.0 + 2.3 KV | good |
| Q5_K_S | 5.57 | 281.2 GB 279.0 + 2.3 KV | good |
| Q5_K_M | 5.7 | 287.7 GB 285.5 + 2.3 KV | good |
| Q6_K | 6.56 | 330.7 GB 328.5 + 2.3 KV | excellent |
| Q8_0 | 8.5 | 427.7 GB 425.5 + 2.3 KV | lossless |
| FP16 | 16 | 802.7 GB 800.5 + 2.3 KV | lossless |
Select your GPU above to see speed estimates and compatibility for each quantization.
Rent a GPU and run Llama-4-Maverick-17B-128E now
Spin up an A100 / H100 / 4090 in ~60s. Pay by the second. Cancel anytime.
Detects your GPU, recommends the best model, downloads it, and starts chatting — zero config. Benchmarks your speed and contributes anonymous data to improve predictions.
At Q4_K_M quantization. Sorted by minimum VRAM.
Find the best GPU for Llama-4-Maverick-17B-128E
Build Hardware for Llama-4-Maverick-17B-128ELlama 4 Maverick — Meta's 400B MoE. 128 experts, frontier-class performance.
Run Llama-4-Maverick-17B-128E locally with Ollama — needs 245.0 GB VRAM at Q4_K_M:
ollama run llama4:128x17b