Spec sheet
MathStral 7B — 7.25B Dense.
Benchmark scores
HumanEval64.0
MMLU-PRO28.9
MATH56.7
IFEval62.4
BBH31.1
GPQA10.4
MUSR5.6
MBPP42.1
BigCodeBench19.5
Run command
Run MathStral 7B locally with Ollama — needs 4.9 GB VRAM at Q4_K_M:
$
ollama run mathstral:7bCompatible GPUs
30 @ Q4_K_MNVIDIA Tesla K20c
5 GB · 208 GB/s
NVIDIA Tesla K20m
5 GB · 208 GB/s
NVIDIA Tesla K20s
5 GB · 208 GB/s
NVIDIA GeForce GTX 1060 5 GB
5 GB · 160 GB/s
NVIDIA P102-100
5 GB · 440 GB/s
NVIDIA Quadro P2000
5 GB · 140.2 GB/s
NVIDIA Quadro P2200
5 GB · 200.2 GB/s
NVIDIA RTX 3050 6GB
6 GB · 168 GB/s
Intel Arc A380
6 GB · 186 GB/s
NVIDIA RTX 2060 6GB
6 GB · 336 GB/s
NVIDIA GTX 1660 SUPER
6 GB · 336 GB/s
NVIDIA GTX 1660 Ti
6 GB · 288 GB/s
NVIDIA GTX 1060 6GB
6 GB · 192 GB/s
NVIDIA Tesla C2070
6 GB · 143 GB/s
NVIDIA Tesla C2075
6 GB · 150 GB/s