DBRX 132B — 132B MoE.
Run DBRX 132B locally with Ollama — needs 81.2 GB VRAM at Q4_K_M:
ollama run dbrx:132b| Quant | Bits | VRAM @ 16K | Quality |
|---|---|---|---|
| IQ2_XXS | 2.38 | 41.6 GB 39.8 + 1.9 KV | low |
| IQ2_M | 2.93 | 50.7 GB 48.8 + 1.9 KV | low |
| Q2_K | 3.16 | 54.5 GB 52.6 + 1.9 KV | low |
| IQ3_XXS | 3.25 | 56.0 GB 54.1 + 1.9 KV | low |
| IQ3_XS | 3.5 | 60.1 GB 58.2 + 1.9 KV | low |
| Q3_K_S | 3.64 | 62.4 GB 60.5 + 1.9 KV | low |
| IQ3_M | 3.76 | 64.4 GB 62.5 + 1.9 KV | low |
| Q3_K_M | 4 | 68.4 GB 66.5 + 1.9 KV | low |
| Q3_K_L | 4.3 | 73.3 GB 71.4 + 1.9 KV | moderate |
| IQ4_XS | 4.46 | 76.0 GB 74.1 + 1.9 KV | moderate |
| Q4_K_S | 4.67 | 79.4 GB 77.5 + 1.9 KV | moderate |
| Q4_K_M | 4.89 | 83.0 GB 81.2 + 1.9 KV | good |
| Q5_K_S | 5.57 | 94.3 GB 92.4 + 1.9 KV | good |
| Q5_K_M | 5.7 | 96.4 GB 94.5 + 1.9 KV | good |
| Q6_K | 6.56 | 110.6 GB 108.7 + 1.9 KV | excellent |
| Q8_0 | 8.5 | 142.6 GB 140.7 + 1.9 KV | lossless |
| FP16 | 16 | 266.4 GB 264.5 + 1.9 KV | lossless |
Select your GPU above to see speed estimates and compatibility for each quantization.
Rent a GPU and run DBRX 132B now
Spin up an A100 / H100 / 4090 in ~60s. Pay by the second. Cancel anytime.
Detects your GPU, recommends the best model, downloads it, and starts chatting — zero config. Benchmarks your speed and contributes anonymous data to improve predictions.
At Q4_K_M quantization. Sorted by minimum VRAM.
Find the best GPU for DBRX 132B
Build Hardware for DBRX 132BDatabricks DBRX — 132B MoE with 36B active params. Strong coding and general reasoning.
Run DBRX 132B locally with Ollama — needs 81.2 GB VRAM at Q4_K_M:
ollama run dbrx:132b