Spec sheet
GLM-5 744B — 744B MoE.
Benchmark scores
SWE-bench77.8
AIME92.7
GPQA Diamond86.0
HLE30.5
EQ-Bench Creative Writing v31601
EQ-Bench 31495
| Quant | Bits | VRAM @ 16K | Quality |
|---|---|---|---|
| IQ2_XXS | 2.38 | 222.9 GB 221.8 + 1.0 KV | low |
| IQ2_M | 2.93 | 274.0 GB 273.0 + 1.0 KV | low |
| Q2_K | 3.16 | 295.4 GB 294.4 + 1.0 KV | low |
| IQ3_XXS | 3.25 | 303.8 GB 302.7 + 1.0 KV | low |
| IQ3_XS | 3.5 | 327.0 GB 326.0 + 1.0 KV | low |
| Q3_K_S | 3.64 | 340.0 GB 339.0 + 1.0 KV | low |
| IQ3_M | 3.76 | 351.2 GB 350.2 + 1.0 KV | low |
| Q3_K_M | 4 | 373.5 GB 372.5 + 1.0 KV | low |
| Q3_K_L | 4.3 | 401.4 GB 400.4 + 1.0 KV | moderate |
| IQ4_XS | 4.46 | 416.3 GB 415.3 + 1.0 KV | moderate |
| Q4_K_S | 4.67 | 435.8 GB 434.8 + 1.0 KV | moderate |
| Q4_K_M | 4.89 | 456.3 GB 455.3 + 1.0 KV | good |
| Q5_K_S | 5.57 | 519.5 GB 518.5 + 1.0 KV | good |
| Q5_K_M | 5.7 | 531.6 GB 530.6 + 1.0 KV | good |
| Q6_K | 6.56 | 611.6 GB 610.6 + 1.0 KV | excellent |
| Q8_0 | 8.5 | 792.0 GB 791.0 + 1.0 KV | lossless |
| FP16 | 16 | 1489.5 GB 1488.5 + 1.0 KV | lossless |
Select your GPU above to see speed estimates and compatibility for each quantization.
Rent a GPU and run GLM-5 744B now
Spin up an A100 / H100 / 4090 in ~60s. Pay by the second. Cancel anytime.
Detects your GPU, recommends the best model, downloads it, and starts chatting — zero config. Benchmarks your speed and contributes anonymous data to improve predictions.
Find the best GPU for GLM-5 744B
Build Hardware for GLM-5 744B