Spec sheet
Hunyuan-Large — 389B MoE.
Benchmark scores
HumanEval90.0
MMLU-PRO60.2
MATH77.4
IFEval85.0
BBH89.5
MBPP72.6
GPQA Diamond42.4
| Quant | Bits | VRAM @ 16K | Quality |
|---|---|---|---|
| IQ2_XXS | 2.38 | 119.2 GB 116.2 + 3.0 KV | low |
| IQ2_M | 2.93 | 146.0 GB 143.0 + 3.0 KV | low |
| Q2_K | 3.16 | 157.1 GB 154.1 + 3.0 KV | low |
| IQ3_XXS | 3.25 | 161.5 GB 158.5 + 3.0 KV | low |
| IQ3_XS | 3.5 | 173.7 GB 170.7 + 3.0 KV | low |
| Q3_K_S | 3.64 | 180.5 GB 177.5 + 3.0 KV | low |
| IQ3_M | 3.76 | 186.3 GB 183.3 + 3.0 KV | low |
| Q3_K_M | 4 | 198.0 GB 195.0 + 3.0 KV | low |
| Q3_K_L | 4.3 | 212.6 GB 209.6 + 3.0 KV | moderate |
| IQ4_XS | 4.46 | 220.4 GB 217.4 + 3.0 KV | moderate |
| Q4_K_S | 4.67 | 230.6 GB 227.6 + 3.0 KV | moderate |
| Q4_K_M | 4.89 | 241.3 GB 238.3 + 3.0 KV | good |
| Q5_K_S | 5.57 | 274.3 GB 271.3 + 3.0 KV | good |
| Q5_K_M | 5.7 | 280.7 GB 277.7 + 3.0 KV | good |
| Q6_K | 6.56 | 322.5 GB 319.5 + 3.0 KV | excellent |
| Q8_0 | 8.5 | 416.8 GB 413.8 + 3.0 KV | lossless |
| FP16 | 16 | 781.5 GB 778.5 + 3.0 KV | lossless |
Select your GPU above to see speed estimates and compatibility for each quantization.
Rent a GPU and run Hunyuan-Large now
Spin up an A100 / H100 / 4090 in ~60s. Pay by the second. Cancel anytime.
Detects your GPU, recommends the best model, downloads it, and starts chatting — zero config. Benchmarks your speed and contributes anonymous data to improve predictions.
At Q4_K_M quantization. Sorted by minimum VRAM.
Find the best GPU for Hunyuan-Large
Build Hardware for Hunyuan-Large