Spec sheet
Qwen2 Math 72B — 72B Dense.
Benchmark scores
HumanEval59.1
MMLU-PRO51.4
MATH59.8
IFEval86.4
BBH61.9
GPQA16.7
MUSR11.7
MBPP61.6
BigCodeBench38.5
Run command
Run Qwen2 Math 72B locally with Ollama — needs 44.5 GB VRAM at Q4_K_M:
$
ollama run qwen2-math:72bCompatible GPUs
30 @ Q4_K_MApple M3 Max (48GB)
48 GB · 400 GB/s
Apple M4 Pro (48GB)
48 GB · 273 GB/s
Apple M4 Max (48GB)
48 GB · 546 GB/s
NVIDIA L40S 48GB
48 GB · 864 GB/s
NVIDIA L40 48GB
48 GB · 864 GB/s
NVIDIA RTX 6000 Ada 48GB
48 GB · 960 GB/s
NVIDIA A40 48GB
48 GB · 696 GB/s
NVIDIA RTX A6000 48GB
48 GB · 768 GB/s
NVIDIA Quadro RTX 8000
48 GB · 672 GB/s
NVIDIA Quadro RTX 8000 Passive
48 GB · 624 GB/s
NVIDIA A40 PCIe
48 GB · 696 GB/s
NVIDIA RTX 6000 Ada Generation
48 GB · 960 GB/s
NVIDIA L20
48 GB · 864 GB/s
AMD Radeon PRO W7800 48 GB
48 GB · 864 GB/s
AMD Radeon PRO W7900
48 GB · 864 GB/s