Mistral AI/Dense

Pixtral 12B

Name: Pixtral 12B
Author: Mistral AI

Pixtral 12B — Mistral's first vision model. Understands images and code.

visionchatcodingThinking

12B

Parameters

128K

Context length

Benchmarks

Quantizations

380K

HF downloads

Architecture

Dense

Released

2024-09-17

Layers

KV Heads

Head Dim

128

Family

mistral

Quantization Options

Context length:

Quant	Bits	VRAM @ 16K	Quality
Q3_K_M	4	8.4 GB 6.5 + 1.9 KV	low
Q3_K_L	4.3	8.8 GB 6.9 + 1.9 KV	moderate
IQ4_XS	4.46	9.1 GB 7.2 + 1.9 KV	moderate
Q4_K_S	4.67	9.4 GB 7.5 + 1.9 KV	moderate
Q4_K_M	4.89	9.7 GB 7.8 + 1.9 KV	good
Q5_K_S	5.57	10.7 GB 8.8 + 1.9 KV	good
Q5_K_M	5.7	10.9 GB 9.0 + 1.9 KV	good
Q6_K	6.56	12.2 GB 10.3 + 1.9 KV	excellent
Q8_0	8.5	15.1 GB 13.2 + 1.9 KV	lossless
FP16	16	26.4 GB 24.5 + 1.9 KV	lossless

Select your GPU above to see speed estimates and compatibility for each quantization.

Deploying for a team or in production? Size GPUs, cost & scaling in Enterprise →

▸ READY TO RUN THIS?RENT BY THE HOUR

RENT A GPU AND RUN PIXTRAL 12B NOW

Rent on Vast.ai →Or RunPod →

Spin up an A100 / H100 / 4090 in ~60s. Pay by the second. Cancel anytime.

Community Ratings

Loading ratings...

Benchmarks (9)

MMBench78.0

IFEval72.0

MMLU-PRO58.0

BBH58.0

MMMU52.5

HumanEval52.0

MATH42.0

GPQA38.0

MUSR18.0

Run this model

▸Easiest way to get started·Beginners

DOCS ↗

curl -fsSL https://ollama.com/install.sh | sh

$ollama run mistral:12b-q4_K_M

Tag may need adjustment — check ollama.com/library/mistral for available tags.

▸ SETUP GUIDE

Auto-setup with fitmyllm CLI

Detects your GPU, recommends the best model, downloads it, and starts chatting — zero config. Benchmarks your speed and contributes anonymous data to improve predictions.

pip install fitmyllmthen run fitmyllmLearn more

Auto-detect GPULive tok/s in chatSpeed benchmarks9 inference engines

HuggingFace Ollama Library GGUF Downloads Build Hardware

GPUs that can run this model

At Q4_K_M quantization. Sorted by minimum VRAM.

NVIDIA RTX 4060 Ti 8GB

8 GB VRAM • 288 GB/s

NVIDIA

$399

Amazon Newegg eBay PCPartPicker Rent on RunPod Rent on Vast.ai

NVIDIA RTX 4060

8 GB VRAM • 272 GB/s

NVIDIA

$299

Amazon Newegg eBay PCPartPicker Rent on RunPod Rent on Vast.ai

NVIDIA RTX 3070 Ti

8 GB VRAM • 608 GB/s

NVIDIA

$499

Amazon Newegg eBay PCPartPicker Rent on RunPod Rent on Vast.ai

NVIDIA RTX 3070

8 GB VRAM • 448 GB/s

NVIDIA

$325

Amazon Newegg eBay PCPartPicker Rent on RunPod Rent on Vast.ai

NVIDIA RTX 3060 Ti

8 GB VRAM • 448 GB/s

NVIDIA

$250

Amazon Newegg eBay PCPartPicker Rent on RunPod Rent on Vast.ai

NVIDIA RTX 3050 8GB

8 GB VRAM • 224 GB/s

NVIDIA

$249

Amazon Newegg eBay PCPartPicker Rent on RunPod Rent on Vast.ai

AMD RX 7600

8 GB VRAM • 288 GB/s

AMD

$269

Amazon Newegg eBay PCPartPicker Rent on RunPod Rent on Vast.ai

AMD RX 6650 XT

8 GB VRAM • 280 GB/s

AMD

$399

Amazon Newegg eBay PCPartPicker Rent on RunPod Rent on Vast.ai

Intel Arc A750

8 GB VRAM • 512 GB/s

INTEL

$199

Amazon Newegg eBay PCPartPicker Rent on RunPod Rent on Vast.ai

Apple M1 (8GB)

8 GB VRAM • 68 GB/s

APPLE

$499

Apple M2 (8GB)

8 GB VRAM • 100 GB/s

APPLE

$599

Apple M3 (8GB)

8 GB VRAM • 100 GB/s

APPLE

$599

NVIDIA RTX 2080 SUPER

8 GB VRAM • 496 GB/s

NVIDIA

$280

Amazon Newegg eBay PCPartPicker Rent on RunPod Rent on Vast.ai

NVIDIA RTX 2080

8 GB VRAM • 448 GB/s

NVIDIA

$260

Amazon Newegg eBay PCPartPicker Rent on RunPod Rent on Vast.ai

NVIDIA RTX 2070 SUPER

8 GB VRAM • 448 GB/s

NVIDIA

$240

Amazon Newegg eBay PCPartPicker Rent on RunPod Rent on Vast.ai

NVIDIA RTX 2070

8 GB VRAM • 448 GB/s

NVIDIA

$200

Amazon Newegg eBay PCPartPicker Rent on RunPod Rent on Vast.ai

NVIDIA RTX 2060 SUPER

8 GB VRAM • 448 GB/s

NVIDIA

$180

Amazon Newegg eBay PCPartPicker Rent on RunPod Rent on Vast.ai

NVIDIA GTX 1080

8 GB VRAM • 320 GB/s

NVIDIA

$130

Amazon Newegg eBay PCPartPicker Rent on RunPod Rent on Vast.ai

NVIDIA GTX 1070 Ti

8 GB VRAM • 256 GB/s

NVIDIA

$120

Amazon Newegg eBay PCPartPicker Rent on RunPod Rent on Vast.ai

NVIDIA GTX 1070

8 GB VRAM • 256 GB/s

NVIDIA

$100

Amazon Newegg eBay PCPartPicker Rent on RunPod Rent on Vast.ai

NVIDIA RTX 3060 8GB

8 GB VRAM • 224 GB/s

NVIDIA

$280

Amazon Newegg eBay PCPartPicker Rent on RunPod Rent on Vast.ai

AMD RX 6600 XT

8 GB VRAM • 256 GB/s

AMD

$200

Amazon Newegg eBay PCPartPicker Rent on RunPod Rent on Vast.ai

AMD RX 6600

8 GB VRAM • 224 GB/s

AMD

$165

Amazon Newegg eBay PCPartPicker Rent on RunPod Rent on Vast.ai

AMD RX 5700 XT

8 GB VRAM • 448 GB/s

AMD

$150

Amazon Newegg eBay PCPartPicker Rent on RunPod Rent on Vast.ai

AMD RX 5700

8 GB VRAM • 448 GB/s

AMD

$130

Amazon Newegg eBay PCPartPicker Rent on RunPod Rent on Vast.ai

Intel Arc A580

8 GB VRAM • 512 GB/s

INTEL

$179

Amazon Newegg eBay PCPartPicker Rent on RunPod Rent on Vast.ai

NVIDIA RTX 5060 Ti 8GB

8 GB VRAM • 448 GB/s

NVIDIA

$379

Amazon Newegg eBay PCPartPicker Rent on RunPod Rent on Vast.ai

NVIDIA RTX 5060

8 GB VRAM • 448 GB/s

NVIDIA

$299

Amazon Newegg eBay PCPartPicker Rent on RunPod Rent on Vast.ai

NVIDIA Tesla K8

8 GB VRAM • 160 GB/s

NVIDIA

NVIDIA Tesla M60

8 GB VRAM • 160 GB/s

NVIDIA

Find the best GPU for Pixtral 12B

Build Hardware for Pixtral 12B

Model Card

View on HuggingFace

Pixtral 12B — Mistral's first vision model. Understands images and code.

QUANT	BPW	VRAM	QUALITY
Q3_K_M	4	6.5 GB	88%
Q3_K_L	4.3	6.9 GB	90%
IQ4_XS	4.46	7.2 GB	92%
Q4_K_S	4.67	7.5 GB	93%
Q4_K_M	4.89	7.8 GB	94%
Q5_K_S	5.57	8.8 GB	96%
Q5_K_M	5.7	9.0 GB	96%
Q6_K	6.56	10.3 GB	97%
Q8_0	8.5	13.2 GB	100%
FP16	16	24.5 GB	100%

Pixtral 12B

Quantization Options

Community Ratings

Benchmarks (9)

Run this model

Auto-setup with fitmyllm CLI

GPUs that can run this model

Model Card

Pixtral 12B — 12B Dense.