Llama-3.2-11B-Vision-Instruct — 11B Dense.
Run Llama-3.2-11B-Vision-Instruct locally with Ollama — needs 7.2 GB VRAM at Q4_K_M:
ollama run llama3.2-vision:11b| Quant | Bits | VRAM @ 16K | Quality |
|---|---|---|---|
| Q3_K_M | 4 | 7.5 GB 6.0 + 1.5 KV | low |
| Q3_K_L | 4.3 | 7.9 GB 6.4 + 1.5 KV | moderate |
| IQ4_XS | 4.46 | 8.1 GB 6.6 + 1.5 KV | moderate |
| Q4_K_S | 4.67 | 8.4 GB 6.9 + 1.5 KV | moderate |
| Q4_K_M | 4.89 | 8.7 GB 7.2 + 1.5 KV | good |
| Q5_K_S | 5.57 | 9.6 GB 8.1 + 1.5 KV | good |
| Q5_K_M | 5.7 | 9.8 GB 8.3 + 1.5 KV | good |
| Q6_K | 6.56 | 11.0 GB 9.5 + 1.5 KV | excellent |
| Q8_0 | 8.5 | 13.7 GB 12.2 + 1.5 KV | lossless |
| FP16 | 16 | 24.0 GB 22.5 + 1.5 KV | lossless |
Select your GPU above to see speed estimates and compatibility for each quantization.
Rent a GPU and run Llama-3.2-11B-Vision-Instruct now
Spin up an A100 / H100 / 4090 in ~60s. Pay by the second. Cancel anytime.
Detects your GPU, recommends the best model, downloads it, and starts chatting — zero config. Benchmarks your speed and contributes anonymous data to improve predictions.
At Q4_K_M quantization. Sorted by minimum VRAM.
Find the best GPU for Llama-3.2-11B-Vision-Instruct
Build Hardware for Llama-3.2-11B-Vision-InstructLlama 3.2 11B Vision Instruct — instruction-tuned for visual Q&A tasks.
Run Llama-3.2-11B-Vision-Instruct locally with Ollama — needs 7.2 GB VRAM at Q4_K_M:
ollama run llama3.2-vision:11b