FitMyLLM
NVIDIA/ Ada Lovelace

NVIDIA RTX 6000 Ada Generation

48 GB
VRAM (Flagship)
960 GB/s
Memory Bandwidth
253 / 290
Models fit at Q4 (87%)
~110 tok/s
7B Q4 speed (Blazing)
Model coverage at Q487% of all models

Specifications

VRAM
48 GB
Bandwidth
960 GB/s
FP16 Compute
91.1 TFLOPS
TDP
300W
Memory
GDDR6
Architecture
Ada Lovelace
CUDA Cores
18,176
Tensor Cores
568
PCIe
Gen 4 x16
203
Fast models (>30 tok/s)
Real-time chat speed
253
Usable models (>10 tok/s)
Comfortable for all tasks
253
Total compatible
Fit in VRAM at Q4

Compatible Models(253)

S
GPT-2 124M0.124B
gpt21K ctxchat
6194
tok/s
1% VRAM
S
SmolLM2 135M0.135B
smollm2K ctxchat
5689
tok/s
1% VRAM
S
Nomic Embed Text v1.50.137B
embedding8K ctxembedding
5606
tok/s
1% VRAM
S
mxbai-embed-large-v10.335B
embedding1K ctxembedding
2293
tok/s
1% VRAM
S
Snowflake Arctic Embed L0.335B
embedding1K ctxembedding
2293
tok/s
1% VRAM
S
GPT-2 Medium 345M0.345B
gpt21K ctxchat
2226
tok/s
1% VRAM
S
SmolLM2 360M0.36B
smollm8K ctxchat
2133
tok/s
1% VRAM
S
Qwen 1.5 0.5B0.5B
qwen32K ctxchat
1536
tok/s
2% VRAM
S
Qwen 2.5 0.5B0.5B
qwen32K ctxchat
1536
tok/s
2% VRAM
S
BGE-M30.568B
embedding8K ctxembedding
1352
tok/s
1% VRAM
S
Qwen3 0.6B0.6B
qwen32K ctxchatreasoning
1280
tok/s
1% VRAM
S
GPT-2 Large 774M0.774B
gpt21K ctxchat
992
tok/s
2% VRAM
S
Qwen3-0.6B0.8B
qwen40K ctxchat
960
tok/s
2% VRAM
S
Qwen3.5-0.8B0.9B
qwen256K ctxchat
853
tok/s
2% VRAM
S
Falcon3-1B1B
falcon32K ctxchat
768
tok/s
2% VRAM
S
InternLM2 1B1B
internlm32K ctxchat
768
tok/s
2% VRAM
S
TinyLlama-1.1B1.1B
llama2K ctxchat
698
tok/s
2% VRAM
S
TinyLlama 1.1B1.1B
llama2K ctxchat
698
tok/s
2% VRAM
S
Llama-3.2-1B1.2B
llama4K ctxchat
640
tok/s
2% VRAM
S
LFM2.5-1.2B-Thinking1.2B
lfm122K ctxchatreasoningtool_use
640
tok/s
1% VRAM
S
DeepSeek Coder 1.3B1.3B
deepseek16K ctxcoding
591
tok/s
3% VRAM
S
OPT 1.3B1.3B
opt2K ctxchat
591
tok/s
2% VRAM
S
Phi-1 1.3B1.3B
phi2K ctxcoding
591
tok/s
3% VRAM
S
Phi-1.5 1.3B1.3B
phi2K ctxchatcoding
591
tok/s
3% VRAM
S
GPT-2 XL 1.5B1.5B
gpt21K ctxchat
512
tok/s
3% VRAM
S
Qwen2.5-Coder-1.5B1.5B
qwen32K ctxcodingchat
512
tok/s
3% VRAM
S
Qwen2 Math 1.5B1.5B
qwen4K ctxreasoning
512
tok/s
3% VRAM
S
Qwen 2.5 1.5B1.5B
qwen32K ctxchatcoding
512
tok/s
3% VRAM
S
Yi Coder 1.5B1.5B
yi125K ctxcoding
512
tok/s
3% VRAM
S
stablelm-2-1_6b1.6B
stablelm4K ctxchat
480
tok/s
3% VRAM
S
Qwen3 1.7B1.7B
qwen32K ctxchatreasoning
452
tok/s
3% VRAM
S
SmolLM2 1.7B1.71B
smollm8K ctxchat
449
tok/s
3% VRAM
S
Qwen 1.5 1.8B1.8B
qwen32K ctxchat
427
tok/s
3% VRAM
S
Moondream2 1.9B1.9B
other2K ctxvisionchat
404
tok/s
3% VRAM
S
Granite 4.0 Tiny7BMoE
granite125K ctxchatcodingmultilingual
384
tok/s
9% VRAM
S
Gemma 1 2B2B
gemma8K ctxchat
384
tok/s
3% VRAM
S
Granite 3.0 2B2B
granite128K ctxchatcoding
384
tok/s
3% VRAM
S
Granite 3.1 2B2B
granite128K ctxchatcoding
384
tok/s
3% VRAM
S
Qwen2-VL 2B2.21B
qwen32K ctxchatvision
348
tok/s
4% VRAM
S
Qwen3.5-2B2.3B
qwen256K ctxchat
334
tok/s
4% VRAM

Get personalized recommendations

See ranked models with benchmark scores, run commands, and precise speed estimates for your RTX 6000 Ada Generation.

Find Models for RTX 6000 Ada GenerationCompare with other GPUs