▸ DEVICE UNDER TEST
NVIDIA Quadro RTX 3000 Mobile Refresh — 6 GB VRAM.
▸ QUADRO RTX 3000 MOBILE REFRESH SPEC
- BRAND
- NVIDIA
- VRAM
- 6 GB GDDR6
- BANDWIDTH
- 336 GB/s
- FP16 COMPUTE
- 10.6 TFLOPS
- FP32 COMPUTE
- 5.3 TFLOPS
- CUDA CORES
- 1,920
- TENSOR CORES
- 240
- TDP
- 80 W
- ARCHITECTURE
- Turing
▸ AI CAPABILITY
142/ 331 models @ Q4
With 6 GB VRAM and 336 GB/s bandwidth, this GPU handles models up to 8B parameters.
Speed ≈ bandwidth / model_size × efficiency. A 7B model at Q4 runs at ~38 tok/s.
§ 01TOP MODELS FOR QUADRO RTX 3000 MOBILE REFRESH
142 FIT · SHOWING 20| MODEL | SIZE | VRAM Q4 | TOK/S | AVG |
|---|---|---|---|---|
| Aya Expanse 8B | 8B | 5.4 GB | 34 | 27.8 |
| Cogito 8B | 8B | 5.4 GB | 34 | 17.2 |
| DeepSeek R1 Distill Llama 8B | 8B | 5.4 GB | 34 | 36.2 |
| Gemma 3n E4B | 8B | 5.4 GB | 34 | 28.8 |
| Granite 3.3 8B | 8B | 5.4 GB | 34 | 24.6 |
| Llama-3.1-8B | 8B | 5.4 GB | 34 | 23.5 |
| Dolphin Llama 3 8B | 8B | 5.4 GB | 34 | 23.8 |
| Llama 3 8B | 8B | 5.4 GB | 34 | 37.3 |
| Tulu 3 8B | 8B | 5.4 GB | 34 | 31.5 |
| Ministral-8B | 8B | 5.4 GB | 34 | 19.3 |
| Nemotron-H 8B | 8B | 5.4 GB | 34 | 78.4 |
| Granite 8B | 8B | 5.4 GB | 34 | 26.1 |
| InternVL2 8B | 8B | 5.4 GB | 34 | 44.6 |
| MiniCPM-V 2.6 8B | 8B | 5.4 GB | 34 | 40.8 |
| RNJ-1 8B | 8B | 5.4 GB | 34 | 53.5 |
| Gemma 4 E4B | 8B | 5.4 GB | 34 | 32.1 |
| EXAONE Deep 7.8B | 7.8B | 5.3 GB | 34 | 41.4 |
| InternLM2.5 7B | 7.74B | 5.2 GB | 35 | 44.8 |
| Qwen2.5-7B | 7.6B | 5.1 GB | 35 | 35.2 |
| Qwen2.5-Coder-7B | 7.6B | 5.1 GB | 35 | 31.0 |