Spec sheet
StarCoder2 15B — 15.96B Dense.
Benchmark scores
HumanEval60.4
MMLU-PRO15.0
MATH6.0
IFEval27.8
BBH20.4
GPQA3.1
MUSR2.9
MBPP65.1
BigCodeBench37.6
Run command
Run StarCoder2 15B locally with Ollama — needs 10.2 GB VRAM at Q4_K_M:
$
ollama run starcoder2:15bCompatible GPUs
30 @ Q4_K_MNVIDIA RTX 2080 Ti
11 GB · 616 GB/s
NVIDIA GTX 1080 Ti
11 GB · 484 GB/s
NVIDIA GeForce GTX 1080 Ti
11 GB · 484 GB/s
NVIDIA GeForce RTX 2080 Ti
11 GB · 616 GB/s
NVIDIA RTX 5070
12 GB · 672 GB/s
NVIDIA RTX 4070 Ti
12 GB · 504 GB/s
NVIDIA RTX 4070 SUPER
12 GB · 504 GB/s
NVIDIA RTX 4070
12 GB · 504 GB/s
NVIDIA RTX 3080 Ti
12 GB · 912 GB/s
NVIDIA RTX 3080 12GB
12 GB · 912 GB/s
NVIDIA RTX 3060 12GB
12 GB · 360 GB/s
AMD RX 7700 XT
12 GB · 432 GB/s
AMD RX 6700 XT
12 GB · 384 GB/s
AMD RX 6750 XT
12 GB · 432 GB/s
Intel Arc B580
12 GB · 456 GB/s