FitMyLLM
Zhipu AI/Mixture of Experts

Zhipu AIGLM-5 744B

Zhipu flagship MoE. 744B total, 40B active. 200K context. Trained on Huawei Ascend.

chatcodingreasoningmultilingual
744B
Parameters (40B active)
198K
Context length
6
Benchmarks
17
Quantizations
136K
HF downloads
Architecture
MoE
Released
2026-02-01
Layers
78
KV Heads
64
Head Dim
64
Family
glm

Quantization Options

Context length:
QuantBitsVRAM @ 16KQuality
IQ2_XXS2.38
222.9 GB
221.8 + 1.0 KV
low
IQ2_M2.93
274.0 GB
273.0 + 1.0 KV
low
Q2_K3.16
295.4 GB
294.4 + 1.0 KV
low
IQ3_XXS3.25
303.8 GB
302.7 + 1.0 KV
low
IQ3_XS3.5
327.0 GB
326.0 + 1.0 KV
low
Q3_K_S3.64
340.0 GB
339.0 + 1.0 KV
low
IQ3_M3.76
351.2 GB
350.2 + 1.0 KV
low
Q3_K_M4
373.5 GB
372.5 + 1.0 KV
low
Q3_K_L4.3
401.4 GB
400.4 + 1.0 KV
moderate
IQ4_XS4.46
416.3 GB
415.3 + 1.0 KV
moderate
Q4_K_S4.67
435.8 GB
434.8 + 1.0 KV
moderate
Q4_K_M4.89
456.3 GB
455.3 + 1.0 KV
good
Q5_K_S5.57
519.5 GB
518.5 + 1.0 KV
good
Q5_K_M5.7
531.6 GB
530.6 + 1.0 KV
good
Q6_K6.56
611.6 GB
610.6 + 1.0 KV
excellent
Q8_08.5
792.0 GB
791.0 + 1.0 KV
lossless
FP1616
1489.5 GB
1488.5 + 1.0 KV
lossless

Select your GPU above to see speed estimates and compatibility for each quantization.

Too big for a single GPU — plan a multi-GPU deployment
Even the lightest quant needs ~223 GB. Size GPUs, replicas, TCO and scaling for a production setup. Open in Enterprise →
Ready to run this?Rent by the hour

Rent a GPU and run GLM-5 744B now

Spin up an A100 / H100 / 4090 in ~60s. Pay by the second. Cancel anytime.

Community Ratings

Loading ratings...

Benchmarks (6)

Run this model

Easiest way to get started·Beginners
Docs ↗
curl -fsSL https://ollama.com/install.sh | sh
$ollama run hf.co/unsloth/GLM-5-GGUF:Q4_K_M

Not in Ollama's library: Ollama pulls the GGUF from Hugging Face (unsloth/GLM-5-GGUF). If Q4_K_M is not in that repo, pick a file listed there.

Setup guide
>_

Auto-setup with fitmyllm CLI

Detects your GPU, recommends the best model, downloads it, and starts chatting — zero config. Benchmarks your speed and contributes anonymous data to improve predictions.

pip install fitmyllmthen run fitmyllmLearn more
Auto-detect GPULive tok/s in chatSpeed benchmarks9 inference engines

Find the best GPU for GLM-5 744B

Build Hardware for GLM-5 744B
Spec sheet

GLM-5 744B — 744B MoE.

Specifications
Parameters
744B (40B active)
Architecture
Mixture of Experts
Context Length
198K tokens
Capabilities
chat, coding, reasoning, multilingual
Release Date
2026-02-01
Provider
Zhipu AI
Family
glm
VRAM requirements
QuantBPWVRAMQuality
IQ2_XXS2.38221.8 GB65%
IQ2_M2.93273.0 GB75%
Q2_K3.16294.4 GB78%
IQ3_XXS3.25302.7 GB82%
IQ3_XS3.5326.0 GB84%
Q3_K_S3.64339.0 GB85%
IQ3_M3.76350.2 GB86%
Q3_K_M4372.5 GB88%
Q3_K_L4.3400.4 GB90%
IQ4_XS4.46415.3 GB92%
Q4_K_S4.67434.8 GB93%
Q4_K_M4.89455.3 GB94%
Q5_K_S5.57518.5 GB96%
Q5_K_M5.7530.6 GB96%
Q6_K6.56610.6 GB97%
Q8_08.5791.0 GB100%
FP16161488.5 GB100%
Benchmark scores
SWE-bench77.8
AIME92.7
GPQA Diamond86.0
HLE30.5
EQ-Bench Creative Writing v31601
EQ-Bench 31495