BigCode/Dense

StarCoder 15B

Name: StarCoder 15B
Author: BigCode

Original StarCoder 15B. Trained on permissively licensed code only.

coding

15.5B

Parameters

Context length

Benchmarks

Quantizations

300K

HF downloads

Architecture

Dense

Released

2023-05-09

Layers

KV Heads

Head Dim

128

Family

starcoder

Quantization Options

Context length:

Quant	Bits	VRAM @ 8K	Quality
Q3_K_M	4	11.4 GB 8.2 + 3.1 KV	low
Q3_K_L	4.3	11.9 GB 8.8 + 3.1 KV	moderate
IQ4_XS	4.46	12.3 GB 9.1 + 3.1 KV	moderate
Q4_K_S	4.67	12.7 GB 9.5 + 3.1 KV	moderate
Q4_K_M	4.89	13.1 GB 10.0 + 3.1 KV	good
Q5_K_S	5.57	14.4 GB 11.3 + 3.1 KV	good
Q5_K_M	5.7	14.7 GB 11.5 + 3.1 KV	good
Q6_K	6.56	16.3 GB 13.2 + 3.1 KV	excellent
Q8_0	8.5	20.1 GB 17.0 + 3.1 KV	lossless
FP16	16	34.6 GB 31.5 + 3.1 KV	lossless

Select your GPU above to see speed estimates and compatibility for each quantization.

Deploying for a team or in production? Size GPUs, cost & scaling in Enterprise →

▸ READY TO RUN THIS?RENT BY THE HOUR

RENT A GPU AND RUN STARCODER 15B NOW

Rent on Vast.ai →Or RunPod →

Spin up an A100 / H100 / 4090 in ~60s. Pay by the second. Cancel anytime.

Community Ratings

Loading ratings...

Benchmarks (9)

MBPP43.0

BigCodeBench37.6

HumanEval33.6

IFEval27.8

BBH20.4

MMLU-PRO15.0

MATH6.0

GPQA3.1

MUSR2.9

Run this model

▸Easiest way to get started·Beginners

DOCS ↗

curl -fsSL https://ollama.com/install.sh | sh

$ollama run starcoder:16b-q4_K_M

Tag may need adjustment — check ollama.com/library/starcoder for available tags.

▸ SETUP GUIDE

Auto-setup with fitmyllm CLI

Detects your GPU, recommends the best model, downloads it, and starts chatting — zero config. Benchmarks your speed and contributes anonymous data to improve predictions.

pip install fitmyllmthen run fitmyllmLearn more

Auto-detect GPULive tok/s in chatSpeed benchmarks9 inference engines

HuggingFace GGUF Downloads Build Hardware

GPUs that can run this model

At Q4_K_M quantization. Sorted by minimum VRAM.

NVIDIA RTX 3080 10GB

10 GB VRAM • 760 GB/s

NVIDIA

$429

Amazon Newegg eBay PCPartPicker Rent on RunPod Rent on Vast.ai

Intel Arc B570

10 GB VRAM • 456 GB/s

INTEL

$219

Amazon Newegg eBay PCPartPicker Rent on RunPod Rent on Vast.ai

NVIDIA GeForce RTX 3080

10 GB VRAM • 760 GB/s

NVIDIA

$699

Amazon Newegg eBay PCPartPicker Rent on RunPod Rent on Vast.ai

AMD Radeon RX 6700

10 GB VRAM • 320 GB/s

AMD

$299

Amazon Newegg eBay PCPartPicker Rent on RunPod Rent on Vast.ai

AMD Radeon RX 6700M

10 GB VRAM • 320 GB/s

AMD

Amazon Newegg eBay PCPartPicker Rent on RunPod Rent on Vast.ai

AMD Radeon RX 6750 GRE 10 GB

10 GB VRAM • 320 GB/s

AMD

$229

Amazon Newegg eBay PCPartPicker Rent on RunPod Rent on Vast.ai

NVIDIA P102-101

10 GB VRAM • 320 GB/s

NVIDIA

Amazon Newegg eBay PCPartPicker Rent on RunPod Rent on Vast.ai

AMD Xbox Series X GPU

10 GB VRAM • 560 GB/s

AMD

Amazon Newegg eBay PCPartPicker Rent on RunPod Rent on Vast.ai

NVIDIA CMP 170HX 10 GB

10 GB VRAM • 1560 GB/s

NVIDIA

NVIDIA CMP 50HX

10 GB VRAM • 560 GB/s

NVIDIA

NVIDIA CMP 90HX

10 GB VRAM • 760 GB/s

NVIDIA

AMD Xbox Series X 6nm GPU

10 GB VRAM • 560 GB/s

AMD

Amazon Newegg eBay PCPartPicker Rent on RunPod Rent on Vast.ai

NVIDIA RTX 2080 Ti

11 GB VRAM • 616 GB/s

NVIDIA

$350

Amazon Newegg eBay PCPartPicker Rent on RunPod Rent on Vast.ai

NVIDIA GTX 1080 Ti

11 GB VRAM • 484 GB/s

NVIDIA

$200

Amazon Newegg eBay PCPartPicker Rent on RunPod Rent on Vast.ai

NVIDIA GeForce GTX 1080 Ti

11 GB VRAM • 484 GB/s

NVIDIA

Amazon Newegg eBay PCPartPicker Rent on RunPod Rent on Vast.ai

NVIDIA GeForce RTX 2080 Ti

11 GB VRAM • 616 GB/s

NVIDIA

$225

Amazon Newegg eBay PCPartPicker Rent on RunPod Rent on Vast.ai

NVIDIA RTX 5070

12 GB VRAM • 672 GB/s

NVIDIA

$549

Amazon Newegg eBay PCPartPicker Rent on RunPod Rent on Vast.ai

NVIDIA RTX 4070 Ti

12 GB VRAM • 504 GB/s

NVIDIA

$799

Amazon Newegg eBay PCPartPicker Rent on RunPod Rent on Vast.ai

NVIDIA RTX 4070 SUPER

12 GB VRAM • 504 GB/s

NVIDIA

$599

Amazon Newegg eBay PCPartPicker Rent on RunPod Rent on Vast.ai

NVIDIA RTX 4070

12 GB VRAM • 504 GB/s

NVIDIA

$549

Amazon Newegg eBay PCPartPicker Rent on RunPod Rent on Vast.ai

NVIDIA RTX 3080 Ti

12 GB VRAM • 912 GB/s

NVIDIA

$550

Amazon Newegg eBay PCPartPicker Rent on RunPod Rent on Vast.ai

NVIDIA RTX 3080 12GB

12 GB VRAM • 912 GB/s

NVIDIA

$599

Amazon Newegg eBay PCPartPicker Rent on RunPod Rent on Vast.ai

NVIDIA RTX 3060 12GB

12 GB VRAM • 360 GB/s

NVIDIA

$329

Amazon Newegg eBay PCPartPicker Rent on RunPod Rent on Vast.ai

AMD RX 7700 XT

12 GB VRAM • 432 GB/s

AMD

$449

Amazon Newegg eBay PCPartPicker Rent on RunPod Rent on Vast.ai

AMD RX 6700 XT

12 GB VRAM • 384 GB/s

AMD

$344

Amazon Newegg eBay PCPartPicker Rent on RunPod Rent on Vast.ai

AMD RX 6750 XT

12 GB VRAM • 432 GB/s

AMD

$299

Amazon Newegg eBay PCPartPicker Rent on RunPod Rent on Vast.ai

Intel Arc B580

12 GB VRAM • 456 GB/s

INTEL

$249

Amazon Newegg eBay PCPartPicker Rent on RunPod Rent on Vast.ai

NVIDIA Tesla K40c

12 GB VRAM • 288 GB/s

NVIDIA

NVIDIA Tesla K40d

12 GB VRAM • 288 GB/s

NVIDIA

NVIDIA Tesla K40m

12 GB VRAM • 288 GB/s

NVIDIA

Find the best GPU for StarCoder 15B

Build Hardware for StarCoder 15B

Model Card

View on HuggingFace

Original StarCoder 15B. Trained on permissively licensed code only.

QUANT	BPW	VRAM	QUALITY
Q3_K_M	4	8.2 GB	88%
Q3_K_L	4.3	8.8 GB	90%
IQ4_XS	4.46	9.1 GB	92%
Q4_K_S	4.67	9.5 GB	93%
Q4_K_M	4.89	10.0 GB	94%
Q5_K_S	5.57	11.3 GB	96%
Q5_K_M	5.7	11.5 GB	96%
Q6_K	6.56	13.2 GB	97%
Q8_0	8.5	17.0 GB	100%
FP16	16	31.5 GB	100%

StarCoder 15B

Quantization Options

Community Ratings

Benchmarks (9)

Run this model

Auto-setup with fitmyllm CLI

GPUs that can run this model

Model Card

StarCoder 15B — 15.5B Dense.