▸ DEVICE UNDER TEST
NVIDIA GeForce RTX 3050 Max-Q Refresh 6 GB — 6 GB VRAM.
▸ GEFORCE RTX 3050 MAX-Q REFRESH 6 GB SPEC
- BRAND
- NVIDIA
- VRAM
- 6 GB GDDR6
- BANDWIDTH
- 132 GB/s
- FP16 COMPUTE
- 5.1 TFLOPS
- FP32 COMPUTE
- 5.1 TFLOPS
- CUDA CORES
- 2,560
- TENSOR CORES
- 80
- TDP
- 35 W
- ARCHITECTURE
- Ampere
▸ AI CAPABILITY
142/ 331 models @ Q4
With 6 GB VRAM and 132 GB/s bandwidth, this GPU handles models up to 8B parameters.
Speed ≈ bandwidth / model_size × efficiency. A 7B model at Q4 runs at ~15 tok/s.
§ 01TOP MODELS FOR GEFORCE RTX 3050 MAX-Q REFRESH 6 GB
142 FIT · SHOWING 20| MODEL | SIZE | VRAM Q4 | TOK/S | AVG |
|---|---|---|---|---|
| Aya Expanse 8B | 8B | 5.4 GB | 13 | 27.8 |
| Cogito 8B | 8B | 5.4 GB | 13 | 17.2 |
| DeepSeek R1 Distill Llama 8B | 8B | 5.4 GB | 13 | 36.2 |
| Gemma 3n E4B | 8B | 5.4 GB | 13 | 28.8 |
| Granite 3.3 8B | 8B | 5.4 GB | 13 | 24.6 |
| Llama-3.1-8B | 8B | 5.4 GB | 13 | 23.5 |
| Dolphin Llama 3 8B | 8B | 5.4 GB | 13 | 23.8 |
| Llama 3 8B | 8B | 5.4 GB | 13 | 37.3 |
| Tulu 3 8B | 8B | 5.4 GB | 13 | 31.5 |
| Ministral-8B | 8B | 5.4 GB | 13 | 19.3 |
| Nemotron-H 8B | 8B | 5.4 GB | 13 | 78.4 |
| Granite 8B | 8B | 5.4 GB | 13 | 26.1 |
| InternVL2 8B | 8B | 5.4 GB | 13 | 44.6 |
| MiniCPM-V 2.6 8B | 8B | 5.4 GB | 13 | 40.8 |
| RNJ-1 8B | 8B | 5.4 GB | 13 | 53.5 |
| Gemma 4 E4B | 8B | 5.4 GB | 13 | 32.1 |
| EXAONE Deep 7.8B | 7.8B | 5.3 GB | 14 | 41.4 |
| InternLM2.5 7B | 7.74B | 5.2 GB | 14 | 44.8 |
| Qwen2.5-7B | 7.6B | 5.1 GB | 14 | 35.2 |
| Qwen2.5-Coder-7B | 7.6B | 5.1 GB | 14 | 31.0 |