Meta/Dense

Llama-3.2-11B-Vision-Instruct

Name: Llama-3.2-11B-Vision-Instruct
Author: Meta

Llama 3.2 11B Vision Instruct — instruction-tuned for visual Q&A tasks.

visionchatThinkingDistilled

11B

Parameters

128K

Context length

Benchmarks

Quantizations

1.5M

HF downloads

Architecture

Dense

Released

2024-09-25

Layers

KV Heads

Head Dim

128

Family

llama

Quantization Options

Context length:

Quant	Bits	VRAM @ 16K	Quality
Q3_K_M	4	7.5 GB 6.0 + 1.5 KV	low
Q3_K_L	4.3	7.9 GB 6.4 + 1.5 KV	moderate
IQ4_XS	4.46	8.1 GB 6.6 + 1.5 KV	moderate
Q4_K_S	4.67	8.4 GB 6.9 + 1.5 KV	moderate
Q4_K_M	4.89	8.7 GB 7.2 + 1.5 KV	good
Q5_K_S	5.57	9.6 GB 8.1 + 1.5 KV	good
Q5_K_M	5.7	9.8 GB 8.3 + 1.5 KV	good
Q6_K	6.56	11.0 GB 9.5 + 1.5 KV	excellent
Q8_0	8.5	13.7 GB 12.2 + 1.5 KV	lossless
FP16	16	24.0 GB 22.5 + 1.5 KV	lossless

Select your GPU above to see speed estimates and compatibility for each quantization.

Deploying for a team or in production? Size GPUs, cost & scaling in Enterprise →

▸ READY TO RUN THIS?RENT BY THE HOUR

RENT A GPU AND RUN LLAMA-3.2-11B-VISION-INSTRUCT NOW

Rent on Vast.ai →Or RunPod →

Spin up an A100 / H100 / 4090 in ~60s. Pay by the second. Cancel anytime.

Community Ratings

Loading ratings...

Benchmarks (14)

MMBench76.8

IFEval70.0

MMLU-PRO55.0

BBH55.0

MMMU50.7

HumanEval45.0

MATH35.0

GPQA35.0

GPQA Diamond22.1

MUSR18.0

LiveCodeBench11.0

HLE5.2

AIME1.7

MATH-5001.7

Run this model

▸Easiest way to get started·Beginners

DOCS ↗

curl -fsSL https://ollama.com/install.sh | sh

$ollama run llama3.2-vision:11b-instruct-q4_K_M

Downloads and runs automatically. Add --verbose for speed stats.

▸ SETUP GUIDE

Auto-setup with fitmyllm CLI

Detects your GPU, recommends the best model, downloads it, and starts chatting — zero config. Benchmarks your speed and contributes anonymous data to improve predictions.

pip install fitmyllmthen run fitmyllmLearn more

Auto-detect GPULive tok/s in chatSpeed benchmarks9 inference engines

HuggingFace Ollama Library GGUF Downloads Build Hardware

GPUs that can run this model

At Q4_K_M quantization. Sorted by minimum VRAM.

NVIDIA RTX 4060 Ti 8GB

8 GB VRAM • 288 GB/s

NVIDIA

$399

Amazon Newegg eBay PCPartPicker Rent on RunPod Rent on Vast.ai

NVIDIA RTX 4060

8 GB VRAM • 272 GB/s

NVIDIA

$299

Amazon Newegg eBay PCPartPicker Rent on RunPod Rent on Vast.ai

NVIDIA RTX 3070 Ti

8 GB VRAM • 608 GB/s

NVIDIA

$499

Amazon Newegg eBay PCPartPicker Rent on RunPod Rent on Vast.ai

NVIDIA RTX 3070

8 GB VRAM • 448 GB/s

NVIDIA

$325

Amazon Newegg eBay PCPartPicker Rent on RunPod Rent on Vast.ai

NVIDIA RTX 3060 Ti

8 GB VRAM • 448 GB/s

NVIDIA

$250

Amazon Newegg eBay PCPartPicker Rent on RunPod Rent on Vast.ai

NVIDIA RTX 3050 8GB

8 GB VRAM • 224 GB/s

NVIDIA

$249

Amazon Newegg eBay PCPartPicker Rent on RunPod Rent on Vast.ai

AMD RX 7600

8 GB VRAM • 288 GB/s

AMD

$269

Amazon Newegg eBay PCPartPicker Rent on RunPod Rent on Vast.ai

AMD RX 6650 XT

8 GB VRAM • 280 GB/s

AMD

$399

Amazon Newegg eBay PCPartPicker Rent on RunPod Rent on Vast.ai

Intel Arc A750

8 GB VRAM • 512 GB/s

INTEL

$199

Amazon Newegg eBay PCPartPicker Rent on RunPod Rent on Vast.ai

Apple M1 (8GB)

8 GB VRAM • 68 GB/s

APPLE

$499

Apple M2 (8GB)

8 GB VRAM • 100 GB/s

APPLE

$599

Apple M3 (8GB)

8 GB VRAM • 100 GB/s

APPLE

$599

NVIDIA RTX 2080 SUPER

8 GB VRAM • 496 GB/s

NVIDIA

$280

Amazon Newegg eBay PCPartPicker Rent on RunPod Rent on Vast.ai

NVIDIA RTX 2080

8 GB VRAM • 448 GB/s

NVIDIA

$260

Amazon Newegg eBay PCPartPicker Rent on RunPod Rent on Vast.ai

NVIDIA RTX 2070 SUPER

8 GB VRAM • 448 GB/s

NVIDIA

$240

Amazon Newegg eBay PCPartPicker Rent on RunPod Rent on Vast.ai

NVIDIA RTX 2070

8 GB VRAM • 448 GB/s

NVIDIA

$200

Amazon Newegg eBay PCPartPicker Rent on RunPod Rent on Vast.ai

NVIDIA RTX 2060 SUPER

8 GB VRAM • 448 GB/s

NVIDIA

$180

Amazon Newegg eBay PCPartPicker Rent on RunPod Rent on Vast.ai

NVIDIA GTX 1080

8 GB VRAM • 320 GB/s

NVIDIA

$130

Amazon Newegg eBay PCPartPicker Rent on RunPod Rent on Vast.ai

NVIDIA GTX 1070 Ti

8 GB VRAM • 256 GB/s

NVIDIA

$120

Amazon Newegg eBay PCPartPicker Rent on RunPod Rent on Vast.ai

NVIDIA GTX 1070

8 GB VRAM • 256 GB/s

NVIDIA

$100

Amazon Newegg eBay PCPartPicker Rent on RunPod Rent on Vast.ai

NVIDIA RTX 3060 8GB

8 GB VRAM • 224 GB/s

NVIDIA

$280

Amazon Newegg eBay PCPartPicker Rent on RunPod Rent on Vast.ai

AMD RX 6600 XT

8 GB VRAM • 256 GB/s

AMD

$200

Amazon Newegg eBay PCPartPicker Rent on RunPod Rent on Vast.ai

AMD RX 6600

8 GB VRAM • 224 GB/s

AMD

$165

Amazon Newegg eBay PCPartPicker Rent on RunPod Rent on Vast.ai

AMD RX 5700 XT

8 GB VRAM • 448 GB/s

AMD

$150

Amazon Newegg eBay PCPartPicker Rent on RunPod Rent on Vast.ai

AMD RX 5700

8 GB VRAM • 448 GB/s

AMD

$130

Amazon Newegg eBay PCPartPicker Rent on RunPod Rent on Vast.ai

Intel Arc A580

8 GB VRAM • 512 GB/s

INTEL

$179

Amazon Newegg eBay PCPartPicker Rent on RunPod Rent on Vast.ai

NVIDIA RTX 5060 Ti 8GB

8 GB VRAM • 448 GB/s

NVIDIA

$379

Amazon Newegg eBay PCPartPicker Rent on RunPod Rent on Vast.ai

NVIDIA RTX 5060

8 GB VRAM • 448 GB/s

NVIDIA

$299

Amazon Newegg eBay PCPartPicker Rent on RunPod Rent on Vast.ai

NVIDIA Tesla K8

8 GB VRAM • 160 GB/s

NVIDIA

NVIDIA Tesla M60

8 GB VRAM • 160 GB/s

NVIDIA

Find the best GPU for Llama-3.2-11B-Vision-Instruct

Build Hardware for Llama-3.2-11B-Vision-Instruct

Model Card

View on HuggingFace

Llama 3.2 11B Vision Instruct — instruction-tuned for visual Q&A tasks.

QUANT	BPW	VRAM	QUALITY
Q3_K_M	4	6.0 GB	88%
Q3_K_L	4.3	6.4 GB	90%
IQ4_XS	4.46	6.6 GB	92%
Q4_K_S	4.67	6.9 GB	93%
Q4_K_M	4.89	7.2 GB	94%
Q5_K_S	5.57	8.1 GB	96%
Q5_K_M	5.7	8.3 GB	96%
Q6_K	6.56	9.5 GB	97%
Q8_0	8.5	12.2 GB	100%
FP16	16	22.5 GB	100%

Llama-3.2-11B-Vision-Instruct

Quantization Options

Community Ratings

Benchmarks (14)

Run this model

Auto-setup with fitmyllm CLI

GPUs that can run this model

Model Card

Llama-3.2-11B-Vision-Instruct — 11B Dense.