Spec sheet
Cogito v2 671B MoE — 671B MoE.
Benchmark scores
MMLU-PRO84.9
GPQA Diamond76.8
LiveCodeBench68.8
AIME72.7
HLE11.0
IFBench46.3
Terminal-Bench Hard16.7
SciCode41.0
AA Long Context21.7
| Quant | Bits | VRAM @ 16K | Quality |
|---|---|---|---|
| IQ2_XXS | 2.38 | 200.9 GB 200.1 + 0.8 KV | low |
| IQ2_M | 2.93 | 247.0 GB 246.2 + 0.8 KV | low |
| Q2_K | 3.16 | 266.3 GB 265.5 + 0.8 KV | low |
| IQ3_XXS | 3.25 | 273.9 GB 273.1 + 0.8 KV | low |
| IQ3_XS | 3.5 | 294.9 GB 294.1 + 0.8 KV | low |
| Q3_K_S | 3.64 | 306.6 GB 305.8 + 0.8 KV | low |
| IQ3_M | 3.76 | 316.7 GB 315.9 + 0.8 KV | low |
| Q3_K_M | 4 | 336.8 GB 336.0 + 0.8 KV | low |
| Q3_K_L | 4.3 | 362.0 GB 361.2 + 0.8 KV | moderate |
| IQ4_XS | 4.46 | 375.4 GB 374.6 + 0.8 KV | moderate |
| Q4_K_S | 4.67 | 393.0 GB 392.2 + 0.8 KV | moderate |
| Q4_K_M | 4.89 | 411.4 GB 410.6 + 0.8 KV | good |
| Q5_K_S | 5.57 | 468.5 GB 467.7 + 0.8 KV | good |
| Q5_K_M | 5.7 | 479.4 GB 478.6 + 0.8 KV | good |
| Q6_K | 6.56 | 551.5 GB 550.7 + 0.8 KV | excellent |
| Q8_0 | 8.5 | 714.2 GB 713.4 + 0.8 KV | lossless |
| FP16 | 16 | 1343.3 GB 1342.5 + 0.8 KV | lossless |
Select your GPU above to see speed estimates and compatibility for each quantization.
Rent a GPU and run Cogito v2 671B MoE now
Spin up an A100 / H100 / 4090 in ~60s. Pay by the second. Cancel anytime.
Detects your GPU, recommends the best model, downloads it, and starts chatting — zero config. Benchmarks your speed and contributes anonymous data to improve predictions.
Find the best GPU for Cogito v2 671B MoE
Build Hardware for Cogito v2 671B MoE