Spec sheet
Kimi K3 — 2779.93B MoE.
Benchmark scores
GPQA Diamond93.5
HLE46.9
AA Intelligence59.7
AA Coding76.2
SciCode58.7
AA Long Context82.7
MMMU Pro81.6
Terminal-Bench 2.185.0
Terminal-Bench 412.6
EQ-Bench Creative Writing v32083
| Quant | Bits | VRAM @ 16K | Quality |
|---|---|---|---|
| IQ2_XXS | 2.38 | 827.8 GB 827.5 + 0.3 KV | low |
| IQ2_M | 2.93 | 1018.9 GB 1018.6 + 0.3 KV | low |
| Q2_K | 3.16 | 1098.9 GB 1098.6 + 0.3 KV | low |
| IQ3_XXS | 3.25 | 1130.1 GB 1129.8 + 0.3 KV | low |
| IQ3_XS | 3.5 | 1217.0 GB 1216.7 + 0.3 KV | low |
| Q3_K_S | 3.64 | 1265.7 GB 1265.4 + 0.3 KV | low |
| IQ3_M | 3.76 | 1307.4 GB 1307.1 + 0.3 KV | low |
| Q3_K_M | 4 | 1390.8 GB 1390.5 + 0.3 KV | low |
| Q3_K_L | 4.3 | 1495.0 GB 1494.7 + 0.3 KV | moderate |
| IQ4_XS | 4.46 | 1550.6 GB 1550.3 + 0.3 KV | moderate |
| Q4_K_S | 4.67 | 1623.6 GB 1623.3 + 0.3 KV | moderate |
| Q4_K_M | 4.89 | 1700.0 GB 1699.7 + 0.3 KV | good |
| Q5_K_S | 5.57 | 1936.3 GB 1936.0 + 0.3 KV | good |
| Q5_K_M | 5.7 | 1981.5 GB 1981.2 + 0.3 KV | good |
| Q6_K | 6.56 | 2280.3 GB 2280.0 + 0.3 KV | excellent |
| Q8_0 | 8.5 | 2954.5 GB 2954.2 + 0.3 KV | lossless |
| FP16 | 16 | 5560.7 GB 5560.3 + 0.3 KV | lossless |
Select your GPU above to see speed estimates and compatibility for each quantization.
Rent a GPU and run Kimi K3 now
Spin up an A100 / H100 / 4090 in ~60s. Pay by the second. Cancel anytime.
Detects your GPU, recommends the best model, downloads it, and starts chatting — zero config. Benchmarks your speed and contributes anonymous data to improve predictions.
Find the best GPU for Kimi K3
Build Hardware for Kimi K3