Alibaba/Dense

Qwen2.5-Coder-14B

Name: Qwen2.5-Coder-14B
Author: Alibaba

Qwen2.5-Coder is the latest series of Code-Specific Qwen large language models (formerly known as CodeQwen).

chattool_usecoding

14.8B

Parameters

32K

Context length

Benchmarks

Quantizations

620K

HF downloads

Architecture

Dense

Released

2024-11-06

Layers

KV Heads

Head Dim

128

Family

qwen

Quantization Options

Context length:

Quant	Bits	VRAM @ 16K	Quality
Q3_K_M	4	10.1 GB 7.9 + 2.3 KV	low
Q3_K_L	4.3	10.7 GB 8.4 + 2.3 KV	moderate
IQ4_XS	4.46	11.0 GB 8.7 + 2.3 KV	moderate
Q4_K_S	4.67	11.4 GB 9.1 + 2.3 KV	moderate
Q4_K_M	4.89	11.8 GB 9.5 + 2.3 KV	good
Q5_K_S	5.57	13.0 GB 10.8 + 2.3 KV	good
Q5_K_M	5.7	13.3 GB 11.0 + 2.3 KV	good
Q6_K	6.56	14.9 GB 12.6 + 2.3 KV	excellent
Q8_0	8.5	18.5 GB 16.2 + 2.3 KV	lossless
FP16	16	32.3 GB 30.1 + 2.3 KV	lossless

Select your GPU above to see speed estimates and compatibility for each quantization.

Deploying for a team or in production? Size GPUs, cost & scaling in Enterprise →

▸ READY TO RUN THIS?RENT BY THE HOUR

RENT A GPU AND RUN QWEN2.5-CODER-14B NOW

Rent on Vast.ai →Or RunPod →

Spin up an A100 / H100 / 4090 in ~60s. Pay by the second. Cancel anytime.

Community Ratings

Loading ratings...

Benchmarks (7)

IFEval84.1

MATH53.0

BBH45.7

MMLU-PRO42.8

BigCodeBench39.8

GPQA12.4

MUSR11.4

Run this model

▸Easiest way to get started·Beginners

DOCS ↗

curl -fsSL https://ollama.com/install.sh | sh

$ollama run qwen2.5-coder:14.8b

Tag may need adjustment — check ollama.com/library/qwen2.5-coder for available tags.

▸ SETUP GUIDE

Auto-setup with fitmyllm CLI

Detects your GPU, recommends the best model, downloads it, and starts chatting — zero config. Benchmarks your speed and contributes anonymous data to improve predictions.

pip install fitmyllmthen run fitmyllmLearn more

Auto-detect GPULive tok/s in chatSpeed benchmarks9 inference engines

HuggingFace Ollama Library GGUF Downloads Build Hardware

GPUs that can run this model

At Q4_K_M quantization. Sorted by minimum VRAM.

NVIDIA RTX 3080 10GB

10 GB VRAM • 760 GB/s

NVIDIA

$429

Amazon Newegg eBay PCPartPicker Rent on RunPod Rent on Vast.ai

Intel Arc B570

10 GB VRAM • 456 GB/s

INTEL

$219

Amazon Newegg eBay PCPartPicker Rent on RunPod Rent on Vast.ai

NVIDIA GeForce RTX 3080

10 GB VRAM • 760 GB/s

NVIDIA

$699

Amazon Newegg eBay PCPartPicker Rent on RunPod Rent on Vast.ai

AMD Radeon RX 6700

10 GB VRAM • 320 GB/s

AMD

$299

Amazon Newegg eBay PCPartPicker Rent on RunPod Rent on Vast.ai

AMD Radeon RX 6700M

10 GB VRAM • 320 GB/s

AMD

Amazon Newegg eBay PCPartPicker Rent on RunPod Rent on Vast.ai

AMD Radeon RX 6750 GRE 10 GB

10 GB VRAM • 320 GB/s

AMD

$229

Amazon Newegg eBay PCPartPicker Rent on RunPod Rent on Vast.ai

NVIDIA P102-101

10 GB VRAM • 320 GB/s

NVIDIA

Amazon Newegg eBay PCPartPicker Rent on RunPod Rent on Vast.ai

AMD Xbox Series X GPU

10 GB VRAM • 560 GB/s

AMD

Amazon Newegg eBay PCPartPicker Rent on RunPod Rent on Vast.ai

NVIDIA CMP 170HX 10 GB

10 GB VRAM • 1560 GB/s

NVIDIA

NVIDIA CMP 50HX

10 GB VRAM • 560 GB/s

NVIDIA

NVIDIA CMP 90HX

10 GB VRAM • 760 GB/s

NVIDIA

AMD Xbox Series X 6nm GPU

10 GB VRAM • 560 GB/s

AMD

Amazon Newegg eBay PCPartPicker Rent on RunPod Rent on Vast.ai

NVIDIA RTX 2080 Ti

11 GB VRAM • 616 GB/s

NVIDIA

$350

Amazon Newegg eBay PCPartPicker Rent on RunPod Rent on Vast.ai

NVIDIA GTX 1080 Ti

11 GB VRAM • 484 GB/s

NVIDIA

$200

Amazon Newegg eBay PCPartPicker Rent on RunPod Rent on Vast.ai

NVIDIA GeForce GTX 1080 Ti

11 GB VRAM • 484 GB/s

NVIDIA

Amazon Newegg eBay PCPartPicker Rent on RunPod Rent on Vast.ai

NVIDIA GeForce RTX 2080 Ti

11 GB VRAM • 616 GB/s

NVIDIA

$225

Amazon Newegg eBay PCPartPicker Rent on RunPod Rent on Vast.ai

NVIDIA RTX 5070

12 GB VRAM • 672 GB/s

NVIDIA

$549

Amazon Newegg eBay PCPartPicker Rent on RunPod Rent on Vast.ai

NVIDIA RTX 4070 Ti

12 GB VRAM • 504 GB/s

NVIDIA

$799

Amazon Newegg eBay PCPartPicker Rent on RunPod Rent on Vast.ai

NVIDIA RTX 4070 SUPER

12 GB VRAM • 504 GB/s

NVIDIA

$599

Amazon Newegg eBay PCPartPicker Rent on RunPod Rent on Vast.ai

NVIDIA RTX 4070

12 GB VRAM • 504 GB/s

NVIDIA

$549

Amazon Newegg eBay PCPartPicker Rent on RunPod Rent on Vast.ai

NVIDIA RTX 3080 Ti

12 GB VRAM • 912 GB/s

NVIDIA

$550

Amazon Newegg eBay PCPartPicker Rent on RunPod Rent on Vast.ai

NVIDIA RTX 3080 12GB

12 GB VRAM • 912 GB/s

NVIDIA

$599

Amazon Newegg eBay PCPartPicker Rent on RunPod Rent on Vast.ai

NVIDIA RTX 3060 12GB

12 GB VRAM • 360 GB/s

NVIDIA

$329

Amazon Newegg eBay PCPartPicker Rent on RunPod Rent on Vast.ai

AMD RX 7700 XT

12 GB VRAM • 432 GB/s

AMD

$449

Amazon Newegg eBay PCPartPicker Rent on RunPod Rent on Vast.ai

AMD RX 6700 XT

12 GB VRAM • 384 GB/s

AMD

$344

Amazon Newegg eBay PCPartPicker Rent on RunPod Rent on Vast.ai

AMD RX 6750 XT

12 GB VRAM • 432 GB/s

AMD

$299

Amazon Newegg eBay PCPartPicker Rent on RunPod Rent on Vast.ai

Intel Arc B580

12 GB VRAM • 456 GB/s

INTEL

$249

Amazon Newegg eBay PCPartPicker Rent on RunPod Rent on Vast.ai

NVIDIA Tesla K40c

12 GB VRAM • 288 GB/s

NVIDIA

NVIDIA Tesla K40d

12 GB VRAM • 288 GB/s

NVIDIA

NVIDIA Tesla K40m

12 GB VRAM • 288 GB/s

NVIDIA

Find the best GPU for Qwen2.5-Coder-14B

Build Hardware for Qwen2.5-Coder-14B

Model Card

View on HuggingFace

Qwen2.5-Coder is the latest series of Code-Specific Qwen large language models (formerly known as CodeQwen).

QUANT	BPW	VRAM	QUALITY
Q3_K_M	4	7.9 GB	88%
Q3_K_L	4.3	8.4 GB	90%
IQ4_XS	4.46	8.7 GB	92%
Q4_K_S	4.67	9.1 GB	93%
Q4_K_M	4.89	9.5 GB	94%
Q5_K_S	5.57	10.8 GB	96%
Q5_K_M	5.7	11.0 GB	96%
Q6_K	6.56	12.6 GB	97%
Q8_0	8.5	16.2 GB	100%
FP16	16	30.1 GB	100%

Qwen2.5-Coder-14B

Quantization Options

Community Ratings

Benchmarks (7)

Run this model

Auto-setup with fitmyllm CLI

GPUs that can run this model

Model Card

Qwen2.5-Coder-14B — 14.8B Dense.