▸ DEVICE UNDER TEST
NVIDIA GeForce GTX 1060 6 GB — 6 GB VRAM.
▸ GEFORCE GTX 1060 6 GB SPEC
- BRAND
- NVIDIA
- VRAM
- 6 GB GDDR5
- BANDWIDTH
- 192 GB/s
- FP16 COMPUTE
- 0.1 TFLOPS
- FP32 COMPUTE
- 4.4 TFLOPS
- CUDA CORES
- 1,280
- TDP
- 120 W
- ARCHITECTURE
- Pascal
▸ AI CAPABILITY
142/ 331 models @ Q4
With 6 GB VRAM and 192 GB/s bandwidth, this GPU handles models up to 8B parameters.
Speed ≈ bandwidth / model_size × efficiency. A 7B model at Q4 runs at ~22 tok/s.
§ 01TOP MODELS FOR GEFORCE GTX 1060 6 GB
142 FIT · SHOWING 20| MODEL | SIZE | VRAM Q4 | TOK/S | AVG |
|---|---|---|---|---|
| Aya Expanse 8B | 8B | 5.4 GB | 19 | 27.8 |
| Cogito 8B | 8B | 5.4 GB | 19 | 17.2 |
| DeepSeek R1 Distill Llama 8B | 8B | 5.4 GB | 19 | 36.2 |
| Gemma 3n E4B | 8B | 5.4 GB | 19 | 28.8 |
| Granite 3.3 8B | 8B | 5.4 GB | 19 | 24.6 |
| Llama-3.1-8B | 8B | 5.4 GB | 19 | 23.5 |
| Dolphin Llama 3 8B | 8B | 5.4 GB | 19 | 23.8 |
| Llama 3 8B | 8B | 5.4 GB | 19 | 37.3 |
| Tulu 3 8B | 8B | 5.4 GB | 19 | 31.5 |
| Ministral-8B | 8B | 5.4 GB | 19 | 19.3 |
| Nemotron-H 8B | 8B | 5.4 GB | 19 | 78.4 |
| Granite 8B | 8B | 5.4 GB | 19 | 26.1 |
| InternVL2 8B | 8B | 5.4 GB | 19 | 44.6 |
| MiniCPM-V 2.6 8B | 8B | 5.4 GB | 19 | 40.8 |
| RNJ-1 8B | 8B | 5.4 GB | 19 | 53.5 |
| Gemma 4 E4B | 8B | 5.4 GB | 19 | 32.1 |
| EXAONE Deep 7.8B | 7.8B | 5.3 GB | 20 | 41.4 |
| InternLM2.5 7B | 7.74B | 5.2 GB | 20 | 44.8 |
| Qwen2.5-7B | 7.6B | 5.1 GB | 20 | 35.2 |
| Qwen2.5-Coder-7B | 7.6B | 5.1 GB | 20 | 31.0 |