▸ MEASURED RIG REPORT$9LIGHT · 9 MODELS

1x RTX 3060 12GB

9 models measured12 GB VRAMllama.cpp 91f8c9c2026-08-291.0 h on the machine

Before you spend $329 on this card, find out if it does what you need.

9 models loaded and timed on this machine, in one session, on one llama.cpp build. Read a whole one first if you like: the RTX 4090 and RTX 3090 reports are open in full.

One payment for this report, not a subscription. It stays yours, and it does not expire. You will be asked to sign in first, so the report stays attached to your account.

§ WHAT THIS REPORT SETTLES

Does Qwen3 14B run on it?: It did, at Q4_K_M — 8.9 GB of 12 GB at peak
And how fast, model by model?: Decode, prefill and TTFT p50/p95 on 9 models
Which quantisation is worth running?: 1 model run across several rungs; Q4_K_M, Q3_K_M, Q5_K_M, Q6_K measured on this card
How long a prompt before it slows down, or stops fitting?: Decode and peak VRAM at 4K → 32K, on 6 models
And when a model is bigger than the card?: tok/s at each resident fraction, 6 models spilled into system RAM
How many people can use it at once?: 1 → 16 streams: aggregate tok/s, per-stream tok/s and TTFT p95
Does the quantisation cost answers?: Probed at temperature 0 on 9 models, scored per category
What does it cost to keep running?: Watts at the card, and dollars per million tokens, single stream and batched

§ PREVIEW · THE FASTEST 5MEASURED, NOT ESTIMATED

Qwen3 4B Instruct 2507 · Q4_K_M98.1

Llama 3.1 8B Instruct · Q4_K_M64.2

Qwen3 8B · Q4_K_M62.2

Qwen3.5 9B · Q4_K_M55.5

Qwen3 8B (Q5_K_M)55.3

DECODE TOK/S, SINGLE STREAM

Decode only, single stream, for the fastest 5. The remaining 4 models, and every other measurement, are listed below.

What is in this report

MODELS RUN ON THIS MACHINE9 MEASURED

· Qwen3 4B Instruct 2507 · Q4_K_M
· Llama 3.1 8B Instruct · Q4_K_M
· Qwen3 8B · Q4_K_M
· Qwen3.5 9B · Q4_K_M
· Qwen3 8B (Q3_K_M)
· Qwen3 8B (Q5_K_M)
· Qwen3 8B (Q6_K)
· Gemma 3 12B Instruct · Q4_K_M
· Qwen3 14B · Q4_K_M

EVERY FIELD, MEASUREMENT BY MEASUREMENT

FOR EVERY MODEL

· Decode, single stream, tok/s
· Prefill, tok/s
· TTFT p50 and p95, ms
· Peak VRAM reported by the driver
· Weight size on disk, and load time

QUANTISATION

· Rungs measured: Q4_K_M, Q3_K_M, Q5_K_M, Q6_K
· 1 model run across several rungs on this card

CONTEXT DEPTH

· Decode measured with the cache filled to 4K, 8K, 16K, 32K
· 6 models swept, with peak VRAM at each depth

OFFLOAD TO SYSTEM RAM

· 6 models run at several resident fractions
· tok/s at each fraction, against the fully resident rate

CONCURRENCY

· Streams: 1, 2, 4, 8, 16
· Aggregate tok/s, per-stream tok/s and TTFT p95 at each level
· 9 models load-tested

ACCURACY AFTER QUANTISATION

· 9 models probed at temperature 0
· Score per category, and a separate looping check

POWER AND COST

· Watts sampled at the card for 9 models
· Cost per million tokens, single stream and batched

FITTED ACROSS THE RUN

· The card's decode constants: fixed ms per token, and implied bandwidth
· Fixed VRAM overhead before the weights — the intercept a fit calculator assumes is zero
· TTFT p95 against concurrent streams
· Each with its n and its correlation; a weak fit is quoted without a line

PROVENANCE

· GPU: NVIDIA GeForce RTX 3060
· llama.cpp build 91f8c9c5fb038c086e13e9cd823c29b33b07ba54
· Driver 595.84
· Run finished 2026-08-29
· 1.0 hours on the machine

WHAT YOU GET

· This page, in full, at this URL
· A PDF with the same tables and charts
· The underlying JSON, through the API, once the report is yours
· No expiry, and no subscription to keep reading it

Measured on a rented machine, not estimated and not supplied by a vendor. How the runs are taken, and what each figure does and does not cover, is on the methodology page.