Spec sheet
Mistral Small 22B — 22.2B Dense.
Benchmark scores
HumanEval68.0
MMLU-PRO48.0
MATH35.6
IFEval72.0
BBH64.0
GPQA18.6
MUSR17.1
BigCodeBench36.1
LiveCodeBench14.1
AIME6.3
GPQA Diamond38.1
HLE4.3
Run command
Run Mistral Small 22B locally with Ollama — needs 14.1 GB VRAM at Q4_K_M:
$
ollama run mistral-small:22bCompatible GPUs
30 @ Q4_K_MNVIDIA RTX 5080
16 GB · 960 GB/s
NVIDIA RTX 5070 Ti
16 GB · 896 GB/s
NVIDIA RTX 4080 SUPER
16 GB · 736 GB/s
NVIDIA RTX 4080
16 GB · 717 GB/s
NVIDIA RTX 4070 Ti SUPER
16 GB · 672 GB/s
NVIDIA RTX 4060 Ti 16GB
16 GB · 288 GB/s
AMD RX 7900 GRE
16 GB · 576 GB/s
AMD RX 7800 XT
16 GB · 624 GB/s
AMD RX 7600 XT
16 GB · 288 GB/s
AMD RX 6950 XT
16 GB · 576 GB/s
AMD RX 6900 XT
16 GB · 512 GB/s
AMD RX 6800 XT
16 GB · 512 GB/s
AMD RX 6800
16 GB · 512 GB/s
Intel Arc A770 16GB
16 GB · 560 GB/s
Apple M1 Pro (16GB)
16 GB · 200 GB/s