Nemotron 3 Nano 4B — 3.97B Dense.
Run Nemotron 3 Nano 4B locally with Ollama — needs 2.9 GB VRAM at Q4_K_M:
ollama run nemotron-3-nano:4b| Quant | Bits | VRAM @ 16K | Quality |
|---|---|---|---|
| Q4_K_M | 4.89 | 3.1 GB 2.9 + 0.2 KV | good |
| Q5_K_S | 5.57 | 3.4 GB 3.3 + 0.2 KV | good |
| Q5_K_M | 5.7 | 3.5 GB 3.3 + 0.2 KV | good |
| Q6_K | 6.56 | 3.9 GB 3.7 + 0.2 KV | excellent |
| Q8_0 | 8.5 | 4.9 GB 4.7 + 0.2 KV | lossless |
| FP16 | 16 | 8.6 GB 8.4 + 0.2 KV | lossless |
Select your GPU above to see speed estimates and compatibility for each quantization.
Rent a GPU and run Nemotron 3 Nano 4B now
Spin up an A100 / H100 / 4090 in ~60s. Pay by the second. Cancel anytime.
Detects your GPU, recommends the best model, downloads it, and starts chatting — zero config. Benchmarks your speed and contributes anonymous data to improve predictions.
At Q4_K_M quantization. Sorted by minimum VRAM.
Find the best GPU for Nemotron 3 Nano 4B
Build Hardware for Nemotron 3 Nano 4BNemotron 3 Nano — compact model with tool use and function calling.
Run Nemotron 3 Nano 4B locally with Ollama — needs 2.9 GB VRAM at Q4_K_M:
ollama run nemotron-3-nano:4b