▸ NVIDIA· BLACKWELL 2.0

NVIDIA RTX 6000D

VRAM

84 GB

FLAGSHIP

BANDWIDTH

1570

GB/S

MODELS Q4

292/331

88%

7B Q4 SPEED

~179

BLAZING

▸ MODEL COVERAGE @ Q488% OF ALL

▸ ESTIMATED SPEED· BY MODEL SIZE @ Q4

Average speeds at Q4 quantization. Actual performance varies by model architecture and context length.

3B

~419

TOK/S

7B

~179

TOK/S

14B

~90

TOK/S

32B

~39

TOK/S

70B

~18

TOK/S

▸ SPECIFICATIONS

VRAM

84 GB

BANDWIDTH

1570 GB/s

FP16 COMPUTE

97 TFLOPS

TDP

600W

MEMORY

GDDR7

ARCHITECTURE

Blackwell 2.0

CUDA CORES

19,968

TENSOR CORES

624

PCIE

Gen 5 x16

MSRP

$7,500

269

FAST MODELS · >30 TOK/S

Real-time chat speed

292

USABLE · >10 TOK/S

Comfortable for all tasks

292

TOTAL COMPATIBLE

Fit in VRAM at Q4

▸ RENT IT IN THE CLOUD

Buying RTX 6000D costs $15–$40k and isn’t practical for most teams. Spin one up by the hour instead:

Rent on RunPod →Or Vast.ai →

Spin up in ~60s. Pay by the second. Cancel anytime.

Some links are affiliate links — we may earn a small commission at no extra cost to you. This helps keep FitMyLLM free and independent.

▸ COMPATIBLE MODELS· 292

nomic-embed-text-v1.5 100M0.1B

EMBEDDING·8K CTX· CHAT

TOK/S · 1% VRAM

GPT-2 124M0.124B

GPT2·1K CTX· CHAT

TOK/S · 1% VRAM

SmolLM2 135M0.135B

SMOLLM·2K CTX· CHAT

TOK/S · 1% VRAM

bge-large-en-v1.5 335M0.335B

EMBEDDING·1K CTX· CHAT

TOK/S · 1% VRAM

mxbai-embed-large-v10.335B

EMBEDDING·1K CTX· EMBEDDING

TOK/S · 1% VRAM

Snowflake Arctic Embed L0.335B

EMBEDDING·1K CTX· EMBEDDING

TOK/S · 1% VRAM

GPT-2 Medium 345M0.345B

GPT2·1K CTX· CHAT

TOK/S · 1% VRAM

SmolLM2 360M0.36B

SMOLLM·8K CTX· CHAT

TOK/S · 1% VRAM

Falcon-H1 0.5B0.5B

FALCON·128K CTX· CHAT

TOK/S · 1% VRAM

Qwen 1.5 0.5B0.5B

QWEN·32K CTX· CHAT

TOK/S · 1% VRAM

Qwen 2.5 0.5B0.5B

QWEN·32K CTX· CHAT

TOK/S · 1% VRAM

EMBEDDING·8K CTX· EMBEDDING

TOK/S · 1% VRAM

QWEN·32K CTX· CHAT· REASONING

TOK/S · 1% VRAM

GPT-2 Large 774M0.774B

GPT2·1K CTX· CHAT

TOK/S · 1% VRAM

Qwen 3.5 0.8B0.8B

QWEN·256K CTX· CHAT· CODING· MULTILINGUAL

TOK/S · 1% VRAM

Qwen3.5-0.8B0.9B

QWEN·256K CTX· CHAT

TOK/S · 1% VRAM

FALCON·32K CTX· CHAT

TOK/S · 1% VRAM

INTERNLM·32K CTX· CHAT

TOK/S · 1% VRAM

TinyLlama 1.1B1.1B

LLAMA·2K CTX· CHAT

TOK/S · 1% VRAM

LFM2.5-1.2B-Thinking1.2B

LFM·122K CTX· CHAT· REASONING· TOOL_USE

TOK/S · 1% VRAM

Llama-3.2-1B1.2B

LLAMA·4K CTX· CHAT

TOK/S · 1% VRAM

DeepSeek Coder 1.3B1.3B

DEEPSEEK·16K CTX· CODING

TOK/S · 2% VRAM

EXAONE-4.0-1.2B1.3B

EXAONE·64K CTX· CHAT

TOK/S · 2% VRAM

OPT·2K CTX· CHAT

TOK/S · 2% VRAM

PHI·2K CTX· CODING

TOK/S · 2% VRAM

Phi-1.5 1.3B1.3B

PHI·2K CTX· CHAT· CODING

TOK/S · 2% VRAM

granite-4.0-h-tiny 6.9B6.9BMoE

GRANITE·128K CTX· CHAT

TOK/S · 6% VRAM

Falcon-H1 1.5B1.5B

FALCON·128K CTX· CHAT· CODING

TOK/S · 2% VRAM

GPT-2 XL 1.5B1.5B

GPT2·1K CTX· CHAT

TOK/S · 2% VRAM

Qwen2.5-Coder-1.5B1.5B

QWEN·32K CTX· CHAT· TOOL_USE· CODING

TOK/S · 2% VRAM

Qwen2 Math 1.5B1.5B

QWEN·4K CTX· REASONING

TOK/S · 2% VRAM

Qwen 2.5 1.5B1.5B

QWEN·32K CTX· CHAT· CODING

TOK/S · 2% VRAM

Yi Coder 1.5B1.5B

YI·125K CTX· CODING

TOK/S · 2% VRAM

stablelm-2-1_6b1.6B

STABLELM·4K CTX· CHAT

TOK/S · 2% VRAM

QWEN·32K CTX· CHAT· REASONING

TOK/S · 2% VRAM

SmolLM2 1.7B1.71B

SMOLLM·8K CTX· CHAT

TOK/S · 2% VRAM

Qwen 1.5 1.8B1.8B

QWEN·32K CTX· CHAT

TOK/S · 2% VRAM

Moondream2 1.9B1.9B

OTHER·2K CTX· VISION· CHAT

TOK/S · 2% VRAM

GEMMA·8K CTX· CHAT

TOK/S · 2% VRAM

Granite 3.0 2B2B

GRANITE·128K CTX· CHAT· CODING

TOK/S · 2% VRAM

▸ NEXT STEP

Get personalized recommendations.

See ranked models with benchmark scores, run commands, and precise speed estimates for your RTX 6000D.

▸Find models for RTX 6000D Compare with other GPUs

▸ DEVICE UNDER TEST

NVIDIA RTX 6000D — 84 GB VRAM.

▸ RTX 6000D SPEC

BRAND: NVIDIA
VRAM: 84 GB GDDR7
BANDWIDTH: 1570 GB/s
FP16 COMPUTE: 97 TFLOPS
FP32 COMPUTE: 97 TFLOPS
CUDA CORES: 19,968
TENSOR CORES: 624
TDP: 600 W
ARCHITECTURE: Blackwell 2.0
MSRP: $7500

▸ AI CAPABILITY

292/ 331 models @ Q4

With 84 GB VRAM and 1570 GB/s bandwidth, this GPU handles models up to 122B parameters.

Speed ≈ bandwidth / model_size × efficiency. A 7B model at Q4 runs at ~179 tok/s.

§ 01TOP MODELS FOR RTX 6000D

292 FIT · SHOWING 20

MODEL	SIZE	VRAM Q4	TOK/S	AVG
Qwen 3.5 122B A10B	122B	75.1 GB	126	56.8
Nemotron 3 Super 120B	120B	73.8 GB	105	57.3
Nemotron 3 Super 120B-A12B	120B	73.8 GB	105	53.2
Mistral Small 4 119B	119B	73.2 GB	193	50.2
GPT-OSS 120B	117B	72.0 GB	246	54.1
Command A 111B	111B	68.3 GB	11	27.6
GLM 4.5 Air	110B	67.7 GB	105	51.0
Qwen 1.5 110B	110B	67.7 GB	11	33.4
Llama 4 Scout 17B-16E	109B	67.1 GB	74	33.9
Sarvam 105B	105B	64.7 GB	12	48.0
Command-R+ 104B	104B	64.1 GB	12	52.7
Llama-3.2-90B-Vision-Instruct	90B	55.5 GB	14	48.5
Hunyuan A13B	80B	49.4 GB	97	81.1
Qwen3-Coder-Next	80B	49.4 GB	419	43.0
Qwen2.5-72B	72.7B	44.9 GB	17	39.7
Qwen2-VL 72B	72.7B	44.9 GB	17	55.5
Qwen 1.5 72B	72B	44.5 GB	17	49.7
Qwen2 Math 72B	72B	44.5 GB	17	49.7
DeepSeek R1 Distill Llama 70B	70.6B	43.6 GB	18	42.4
Llama 3.3 70B	70.6B	43.6 GB	18	44.8