Spec sheet
StarCoder2 3B — 3B Dense.
Benchmark scores
HumanEval27.4
MMLU-PRO7.1
MATH1.5
IFEval20.4
BBH8.9
GPQA0.0
MUSR1.4
Run command
Run StarCoder2 3B locally with Ollama — needs 2.3 GB VRAM at Q4_K_M:
$
ollama run starcoder2:3bCompatible GPUs
30 @ Q4_K_MNVIDIA Quadro 5000
3 GB · 120 GB/s
NVIDIA Quadro 5000 SDI
3 GB · 120 GB/s
NVIDIA Tesla C2050
3 GB · 144 GB/s
NVIDIA Tesla M2050
3 GB · 148 GB/s
NVIDIA Tesla S2050
3 GB · 148 GB/s
NVIDIA GeForce GTX 670MX
3 GB · 67 GB/s
AMD Radeon HD 7950
3 GB · 240 GB/s
AMD Radeon HD 7950 Boost
3 GB · 240 GB/s
AMD Radeon HD 7950 Monica BIOS 1
3 GB · 240 GB/s
AMD Radeon HD 7950 Monica BIOS 2
3 GB · 240 GB/s
AMD Radeon HD 7970
3 GB · 264 GB/s
AMD Radeon HD 7970 GHz Edition
3 GB · 288 GB/s
AMD Radeon HD 7970 X2
3 GB · 264 GB/s
NVIDIA GeForce GTX 770M
3 GB · 96 GB/s
NVIDIA GeForce GTX 780
3 GB · 288 GB/s