WHAT THIS CARD IS WORTH
RTX 3060 Ti GDDR6X holds 201 of the models in our catalogue and is, in practice, a IQ4_XS card — the largest it takes is Falcon3-10B at IQ4_XS.
TOKENS/SEC PER $100
15.8
8B at Q4_K_M, so cards compare like for like
VRAM PER $100
2.01 GB
what memory costs on this card
THE BIGGEST IT TAKES
AGAINST CARDS OF SIMILAR MEMORY
RTX 3060 Ti GDDR6X8 GB$39915.8 tok/s per $100
Neighbours in memory rather than in price: memory decides whether a card can do the job at all, so two cards of the same size at different prices is the comparison you are making. Ordered by memory, then bandwidth — not by the value column, which is worked out from bandwidth and price alone and therefore rewards a cheap card whatever its software stack does to that bandwidth in practice. Read it as one input, not as a ranking.
▸ DEVICE UNDER TEST
NVIDIA GeForce RTX 3060 Ti GDDR6X — 8 GB VRAM.
▸ GEFORCE RTX 3060 TI GDDR6X SPEC
- BRAND
- NVIDIA
- VRAM
- 8 GB GDDR6X
- BANDWIDTH
- 608 GB/s
- FP16 COMPUTE
- 16.2 TFLOPS
- FP32 COMPUTE
- 16.2 TFLOPS
- CUDA CORES
- 4,864
- TENSOR CORES
- 152
- TDP
- 225 W
- ARCHITECTURE
- Ampere
- MSRP
- $399
▸ AI CAPABILITY
201/ 449 models @ Q4
With 8 GB VRAM and 608 GB/s bandwidth, this GPU handles models up to 9.63B parameters.
Speed ≈ bandwidth / model_size × efficiency. A 7B model at Q4 runs at ~69 tok/s.
RENT IT — LIVE PRICES
Checking what the clouds are charging…
§ 01TOP MODELS FOR GEFORCE RTX 3060 TI GDDR6X
201 FIT · SHOWING 20| MODEL | SIZE | VRAM Q4 | TOK/S | AVG |
|---|---|---|---|---|
| RecurrentGemma 9B | 9.63B | 6.4 GB | 51 | 35.0 |
| glm-4-9b | 9.4B | 6.2 GB | 52 | 20.5 |
| gemma-2-9b | 9.2B | 6.1 GB | 53 | 30.2 |
| Yi 1.5 9B | 9B | 6.0 GB | 54 | 30.3 |
| Yi Coder 9B | 9B | 6.0 GB | 54 | 35.8 |
| Ministral 3 8B | 8.92B | 5.9 GB | 55 | 25.7 |
| Ministral 3 8B Reasoning | 8.92B | 5.9 GB | 55 | — |
| NVIDIA-Nemotron-Nano-9B-v2 | 8.9B | 5.9 GB | 55 | 44.2 |
| InternLM3 8B Instruct | 8.8B | 5.9 GB | 55 | 38.7 |
| Gemma 1 7B | 8.54B | 5.7 GB | 57 | 24.7 |
| CodeGemma 7B | 8.54B | 5.7 GB | 57 | 40.2 |
| LFM2 8B A1B | 8.3B | 5.6 GB | 324 | 24.3 |
| Seed-Coder 8B Instruct | 8.25B | 5.5 GB | 59 | 34.1 |
| Seed-Coder 8B Reasoning | 8.25B | 5.5 GB | 59 | 32.9 |
| DeepSeek R1-0528 Qwen3 8B | 8.2B | 5.5 GB | 59 | 36.3 |
| Qwen3-8B | 8.2B | 5.5 GB | 59 | 43.3 |
| Granite 3.0 8B | 8.17B | 5.5 GB | 60 | 36.4 |
| Granite 3.1 8B | 8.17B | 5.5 GB | 60 | 38.6 |
| Command-R7B | 8.03B | 5.4 GB | 61 | 35.3 |
| Aya Expanse 8B | 8B | 5.4 GB | 61 | 27.8 |