Spec sheet
Devstral 2 123B — 123B Dense.
Benchmark scores
MMLU-PRO50.7
MATH49.5
IFEval84.0
BBH52.7
GPQA24.9
MUSR17.2
LiveCodeBench44.8
SWE-bench72.2
AIME36.7
GPQA Diamond59.4
HLE3.6
AA Intelligence22.0
AA Coding23.7
AA Math36.7
IFBench38.1
Terminal-Bench Hard18.9
τ²-Bench24.9
SciCode33.1
AA Long Context30.0
Terminal-Bench 2.130.3
Terminal-Bench 40.0
Run command
Run Devstral 2 123B locally with Ollama — needs 75.7 GB VRAM at Q4_K_M:
$
ollama run devstral-2:123bCompatible GPUs
30 @ Q4_K_MNVIDIA H100 SXM5 80GB
80 GB · 3350 GB/s
NVIDIA H100 PCIe 80GB
80 GB · 2000 GB/s
NVIDIA A100 SXM 80GB
80 GB · 2039 GB/s
NVIDIA A100 PCIe 80GB
80 GB · 1935 GB/s
NVIDIA A100 SXM4 80 GB
80 GB · 2040 GB/s
NVIDIA A100 PCIe 80 GB
80 GB · 1940 GB/s
NVIDIA A100X
80 GB · 2040 GB/s
NVIDIA H100 PCIe 80 GB
80 GB · 2040 GB/s
NVIDIA H100 SXM5 80 GB
80 GB · 3360 GB/s
NVIDIA H100 CNX
80 GB · 2040 GB/s
NVIDIA A800 PCIe 80 GB
80 GB · 1940 GB/s
NVIDIA A800 SXM4 80 GB
80 GB · 2040 GB/s
NVIDIA H800 PCIe 80 GB
80 GB · 2040 GB/s
NVIDIA H800 SXM5
80 GB · 3360 GB/s
NVIDIA RTX 6000D
84 GB · 1570 GB/s