Spec sheet
QwQ-32B — 32.5B Dense.
Benchmark scores
HumanEval87.2
MMLU-PRO51.1
MATH53.2
IFEval57.8
BBH53.0
GPQA14.9
MUSR19.5
MBPP77.0
BigCodeBench44.6
Arena Elo1332
GPQA Diamond59.3
LiveCodeBench63.1
AIME29.0
MATH-50095.7
HLE8.2
AA Intelligence19.7
AA Math29.0
IFBench38.8
SciCode3.8
AA Long Context25.0
EQ-Bench Creative Writing v31258
EQ-Bench 31185
Run command
Run QwQ-32B locally with Ollama — needs 20.4 GB VRAM at Q4_K_M:
$
ollama run qwq:32bCompatible GPUs
30 @ Q4_K_MNVIDIA RTX 4090
24 GB · 1008 GB/s
NVIDIA RTX 3090 Ti
24 GB · 1008 GB/s
NVIDIA RTX 3090
24 GB · 936 GB/s
AMD RX 7900 XTX
24 GB · 960 GB/s
Apple M4 Pro (24GB)
24 GB · 273 GB/s
NVIDIA L4 24GB
24 GB · 300 GB/s
NVIDIA A10 24GB
24 GB · 600 GB/s
Apple M2 (24GB)
24 GB · 100 GB/s
Apple M3 (24GB)
24 GB · 100 GB/s
Apple M4 (24GB)
24 GB · 120 GB/s
NVIDIA Tesla M40 24 GB
24 GB · 288 GB/s
NVIDIA Tesla P10
24 GB · 694 GB/s
NVIDIA Tesla P40
24 GB · 347 GB/s
NVIDIA Quadro RTX 6000
24 GB · 672 GB/s
NVIDIA Quadro RTX 6000 Passive
24 GB · 624 GB/s