FitMyLLM
NVIDIA/ Ada Lovelace

NVIDIA GeForce RTX 4060 AD106

8 GB
VRAM (Entry-level)
272 GB/s
Memory Bandwidth
147 / 290
Models fit at Q4 (51%)
~31 tok/s
7B Q4 speed (Fast)
Model coverage at Q451% of all models

Specifications

VRAM
8 GB
Bandwidth
272 GB/s
FP16 Compute
15.1 TFLOPS
TDP
115W
Memory
GDDR6
Architecture
Ada Lovelace
CUDA Cores
3,072
Tensor Cores
96
PCIe
Gen 4 x8
MSRP
$299
110
Fast models (>30 tok/s)
Real-time chat speed
147
Usable models (>10 tok/s)
Comfortable for all tasks
147
Total compatible
Fit in VRAM at Q4

Where to Buy

AmazonNeweggBest Buy

MSRP: $299

Compatible Models(147)

S
GPT-2 124M0.124B
gpt21K ctxchat
1755
tok/s
5% VRAM
S
SmolLM2 135M0.135B
smollm2K ctxchat
1612
tok/s
5% VRAM
S
Nomic Embed Text v1.50.137B
embedding8K ctxembedding
1588
tok/s
3% VRAM
S
mxbai-embed-large-v10.335B
embedding1K ctxembedding
650
tok/s
5% VRAM
S
Snowflake Arctic Embed L0.335B
embedding1K ctxembedding
650
tok/s
5% VRAM
S
GPT-2 Medium 345M0.345B
gpt21K ctxchat
631
tok/s
6% VRAM
S
SmolLM2 360M0.36B
smollm8K ctxchat
604
tok/s
6% VRAM
S
Qwen 1.5 0.5B0.5B
qwen32K ctxchat
435
tok/s
10% VRAM
S
Qwen 2.5 0.5B0.5B
qwen32K ctxchat
435
tok/s
10% VRAM
S
BGE-M30.568B
embedding8K ctxembedding
383
tok/s
8% VRAM
S
Qwen3 0.6B0.6B
qwen32K ctxchatreasoning
363
tok/s
8% VRAM
S
GPT-2 Large 774M0.774B
gpt21K ctxchat
281
tok/s
9% VRAM
S
Qwen3-0.6B0.8B
qwen40K ctxchat
272
tok/s
12% VRAM
S
Qwen3.5-0.8B0.9B
qwen256K ctxchat
242
tok/s
12% VRAM
S
Falcon3-1B1B
falcon32K ctxchat
218
tok/s
13% VRAM
S
InternLM2 1B1B
internlm32K ctxchat
218
tok/s
13% VRAM
S
TinyLlama-1.1B1.1B
llama2K ctxchat
198
tok/s
14% VRAM
S
TinyLlama 1.1B1.1B
llama2K ctxchat
198
tok/s
14% VRAM
S
Llama-3.2-1B1.2B
llama4K ctxchat
181
tok/s
15% VRAM
S
LFM2.5-1.2B-Thinking1.2B
lfm122K ctxchatreasoningtool_use
181
tok/s
9% VRAM
S
DeepSeek Coder 1.3B1.3B
deepseek16K ctxcoding
167
tok/s
15% VRAM
S
OPT 1.3B1.3B
opt2K ctxchat
167
tok/s
15% VRAM
S
Phi-1 1.3B1.3B
phi2K ctxcoding
167
tok/s
15% VRAM
S
Phi-1.5 1.3B1.3B
phi2K ctxchatcoding
167
tok/s
15% VRAM
S
GPT-2 XL 1.5B1.5B
gpt21K ctxchat
145
tok/s
16% VRAM
S
Qwen2.5-Coder-1.5B1.5B
qwen32K ctxcodingchat
145
tok/s
17% VRAM
S
Qwen2 Math 1.5B1.5B
qwen4K ctxreasoning
145
tok/s
17% VRAM
S
Qwen 2.5 1.5B1.5B
qwen32K ctxchatcoding
145
tok/s
17% VRAM
S
Yi Coder 1.5B1.5B
yi125K ctxcoding
145
tok/s
17% VRAM
S
stablelm-2-1_6b1.6B
stablelm4K ctxchat
136
tok/s
17% VRAM
S
Qwen3 1.7B1.7B
qwen32K ctxchatreasoning
128
tok/s
17% VRAM
S
SmolLM2 1.7B1.71B
smollm8K ctxchat
127
tok/s
18% VRAM
S
Qwen 1.5 1.8B1.8B
qwen32K ctxchat
121
tok/s
19% VRAM
S
Moondream2 1.9B1.9B
other2K ctxvisionchat
115
tok/s
17% VRAM
S
Granite 4.0 Tiny7BMoE
granite125K ctxchatcodingmultilingual
109
tok/s
55% VRAM
S
Gemma 1 2B2B
gemma8K ctxchat
109
tok/s
20% VRAM
S
Granite 3.0 2B2B
granite128K ctxchatcoding
109
tok/s
20% VRAM
S
Granite 3.1 2B2B
granite128K ctxchatcoding
109
tok/s
20% VRAM
S
Qwen2-VL 2B2.21B
qwen32K ctxchatvision
98
tok/s
21% VRAM
S
Qwen3.5-2B2.3B
qwen256K ctxchat
95
tok/s
22% VRAM

Get personalized recommendations

See ranked models with benchmark scores, run commands, and precise speed estimates for your GeForce RTX 4060 AD106.

Find Models for GeForce RTX 4060 AD106Compare with other GPUs