WHAT THIS CARD IS WORTH
RTX 3060 Max-Q holds 130 of the models in our catalogue and is, in practice, a Q4_K_M card — the largest it takes is Falcon-H1 7B at Q4_K_M.
TOKENS/SEC PER $100
—
8B at Q4_K_M, so cards compare like for like
VRAM PER $100
—
what memory costs on this card
THE BIGGEST IT TAKES
AGAINST CARDS OF SIMILAR MEMORY
RTX 3060 Max-Q6 GB——
Neighbours in memory rather than in price: memory decides whether a card can do the job at all, so two cards of the same size at different prices is the comparison you are making. Ordered by memory, then bandwidth — not by the value column, which is worked out from bandwidth and price alone and therefore rewards a cheap card whatever its software stack does to that bandwidth in practice. Read it as one input, not as a ranking.
▸ DEVICE UNDER TEST
NVIDIA GeForce RTX 3060 Max-Q — 6 GB VRAM.
▸ GEFORCE RTX 3060 MAX-Q SPEC
- BRAND
- NVIDIA
- VRAM
- 6 GB GDDR6
- BANDWIDTH
- 288 GB/s
- FP16 COMPUTE
- 9.8 TFLOPS
- FP32 COMPUTE
- 9.8 TFLOPS
- CUDA CORES
- 3,840
- TENSOR CORES
- 120
- TDP
- 60 W
- ARCHITECTURE
- Ampere
▸ AI CAPABILITY
130/ 449 models @ Q4
With 6 GB VRAM and 288 GB/s bandwidth, this GPU handles models up to 7B parameters.
Speed ≈ bandwidth / model_size × efficiency. A 7B model at Q4 runs at ~33 tok/s.
RENT IT — LIVE PRICES
Checking what the clouds are charging…
§ 01TOP MODELS FOR GEFORCE RTX 3060 MAX-Q
130 FIT · SHOWING 20| MODEL | SIZE | VRAM Q4 | TOK/S | AVG |
|---|---|---|---|---|
| Alpaca 7B | 7B | 4.8 GB | 33 | 27.7 |
| Baichuan2 7B | 7B | 4.8 GB | 33 | 21.5 |
| Vicuna 7B | 7B | 4.8 GB | 33 | 22.0 |
| MPT-7B | 7B | 4.8 GB | 33 | 7.8 |
| Orca 2 7B | 7B | 4.8 GB | 33 | 26.1 |
| WizardLM 2 7B | 7B | 4.8 GB | 33 | 26.1 |
| StarCoder2 7B | 7B | 4.8 GB | 33 | 17.0 |
| WizardCoder Python 7B | 7B | 4.8 GB | 33 | 53.7 |
| WizardLM 7B | 7B | 4.8 GB | 33 | 15.5 |
| OLMo 3.1 RLZero 7B Code | 7B | 4.8 GB | 33 | 21.8 |
| OLMo 3.1 RLZero 7B Math | 7B | 4.8 GB | 33 | 21.8 |
| Dolly v2 7B | 6.9B | 4.7 GB | 33 | 7.0 |
| granite-4.0-h-tiny 6.9B | 6.9B | 4.7 GB | 154 | 49.2 |
| Llama 2 7B | 6.74B | 4.6 GB | 34 | 21.1 |
| CodeLlama 7B | 6.74B | 4.6 GB | 34 | 28.1 |
| LLaMA 1 7B | 6.74B | 4.6 GB | 34 | 30.8 |
| DeepSeek Coder 6.7B | 6.7B | 4.6 GB | 34 | 23.6 |
| OPT 6.7B | 6.7B | 4.6 GB | 34 | 18.5 |
| ChatGLM2 6B | 6.24B | 4.3 GB | 37 | 20.7 |
| ChatGLM3 6B | 6.24B | 4.3 GB | 37 | 42.7 |