Spec sheet
Devstral Small 2 24B — 24B Dense.
Benchmark scores
MMLU-PRO49.4
MATH35.6
IFEval65.7
BBH52.8
GPQA18.6
MUSR17.1
BigCodeBench36.1
LiveCodeBench34.8
SWE-bench68.0
AIME34.3
GPQA Diamond53.2
HLE3.4
AA Intelligence19.5
AA Coding20.7
AA Math34.3
IFBench31.2
Terminal-Bench Hard16.7
τ²-Bench23.4
SciCode28.8
AA Long Context24.0
Terminal-Bench 2.129.6
Terminal-Bench 40.0
Run command
Run Devstral Small 2 24B locally with Ollama — needs 15.2 GB VRAM at Q4_K_M:
$
ollama run devstral-small-2:24bCompatible GPUs
30 @ Q4_K_MNVIDIA RTX 5080
16 GB · 960 GB/s
NVIDIA RTX 5070 Ti
16 GB · 896 GB/s
NVIDIA RTX 4080 SUPER
16 GB · 736 GB/s
NVIDIA RTX 4080
16 GB · 717 GB/s
NVIDIA RTX 4070 Ti SUPER
16 GB · 672 GB/s
NVIDIA RTX 4060 Ti 16GB
16 GB · 288 GB/s
AMD RX 7900 GRE
16 GB · 576 GB/s
AMD RX 7800 XT
16 GB · 624 GB/s
AMD RX 7600 XT
16 GB · 288 GB/s
AMD RX 6950 XT
16 GB · 576 GB/s
AMD RX 6900 XT
16 GB · 512 GB/s
AMD RX 6800 XT
16 GB · 512 GB/s
AMD RX 6800
16 GB · 512 GB/s
Intel Arc A770 16GB
16 GB · 560 GB/s
Apple M1 Pro (16GB)
16 GB · 200 GB/s