FitMyLLM
NVIDIA/ Volta

NVIDIA Tesla V100 SXM3 32 GB

32 GB
VRAM (High-end)
981 GB/s
Memory Bandwidth
236 / 290
Models fit at Q4 (81%)
~112 tok/s
7B Q4 speed (Blazing)
Model coverage at Q481% of all models

Specifications

VRAM
32 GB
Bandwidth
981 GB/s
FP16 Compute
32.7 TFLOPS
TDP
250W
Memory
HBM2
Architecture
Volta
CUDA Cores
5,120
Tensor Cores
640
PCIe
Gen 3 x16
202
Fast models (>30 tok/s)
Real-time chat speed
236
Usable models (>10 tok/s)
Comfortable for all tasks
236
Total compatible
Fit in VRAM at Q4

Compatible Models(236)

S
GPT-2 124M0.124B
gpt21K ctxchat
6329
tok/s
1% VRAM
S
SmolLM2 135M0.135B
smollm2K ctxchat
5813
tok/s
1% VRAM
S
Nomic Embed Text v1.50.137B
embedding8K ctxembedding
5728
tok/s
1% VRAM
S
mxbai-embed-large-v10.335B
embedding1K ctxembedding
2343
tok/s
1% VRAM
S
Snowflake Arctic Embed L0.335B
embedding1K ctxembedding
2343
tok/s
1% VRAM
S
GPT-2 Medium 345M0.345B
gpt21K ctxchat
2275
tok/s
2% VRAM
S
SmolLM2 360M0.36B
smollm8K ctxchat
2180
tok/s
2% VRAM
S
Qwen 1.5 0.5B0.5B
qwen32K ctxchat
1570
tok/s
2% VRAM
S
Qwen 2.5 0.5B0.5B
qwen32K ctxchat
1570
tok/s
2% VRAM
S
BGE-M30.568B
embedding8K ctxembedding
1382
tok/s
2% VRAM
S
Qwen3 0.6B0.6B
qwen32K ctxchatreasoning
1308
tok/s
2% VRAM
S
GPT-2 Large 774M0.774B
gpt21K ctxchat
1014
tok/s
2% VRAM
S
Qwen3-0.6B0.8B
qwen40K ctxchat
981
tok/s
3% VRAM
S
Qwen3.5-0.8B0.9B
qwen256K ctxchat
872
tok/s
3% VRAM
S
Falcon3-1B1B
falcon32K ctxchat
785
tok/s
3% VRAM
S
InternLM2 1B1B
internlm32K ctxchat
785
tok/s
3% VRAM
S
TinyLlama-1.1B1.1B
llama2K ctxchat
713
tok/s
3% VRAM
S
TinyLlama 1.1B1.1B
llama2K ctxchat
713
tok/s
3% VRAM
S
Llama-3.2-1B1.2B
llama4K ctxchat
654
tok/s
4% VRAM
S
LFM2.5-1.2B-Thinking1.2B
lfm122K ctxchatreasoningtool_use
654
tok/s
2% VRAM
S
DeepSeek Coder 1.3B1.3B
deepseek16K ctxcoding
604
tok/s
4% VRAM
S
OPT 1.3B1.3B
opt2K ctxchat
604
tok/s
4% VRAM
S
Phi-1 1.3B1.3B
phi2K ctxcoding
604
tok/s
4% VRAM
S
Phi-1.5 1.3B1.3B
phi2K ctxchatcoding
604
tok/s
4% VRAM
S
GPT-2 XL 1.5B1.5B
gpt21K ctxchat
523
tok/s
4% VRAM
S
Qwen2.5-Coder-1.5B1.5B
qwen32K ctxcodingchat
523
tok/s
4% VRAM
S
Qwen2 Math 1.5B1.5B
qwen4K ctxreasoning
523
tok/s
4% VRAM
S
Qwen 2.5 1.5B1.5B
qwen32K ctxchatcoding
523
tok/s
4% VRAM
S
Yi Coder 1.5B1.5B
yi125K ctxcoding
523
tok/s
4% VRAM
S
stablelm-2-1_6b1.6B
stablelm4K ctxchat
491
tok/s
4% VRAM
S
Qwen3 1.7B1.7B
qwen32K ctxchatreasoning
462
tok/s
4% VRAM
S
SmolLM2 1.7B1.71B
smollm8K ctxchat
459
tok/s
4% VRAM
S
Qwen 1.5 1.8B1.8B
qwen32K ctxchat
436
tok/s
5% VRAM
S
Moondream2 1.9B1.9B
other2K ctxvisionchat
413
tok/s
4% VRAM
S
Granite 4.0 Tiny7BMoE
granite125K ctxchatcodingmultilingual
392
tok/s
14% VRAM
S
Gemma 1 2B2B
gemma8K ctxchat
392
tok/s
5% VRAM
S
Granite 3.0 2B2B
granite128K ctxchatcoding
392
tok/s
5% VRAM
S
Granite 3.1 2B2B
granite128K ctxchatcoding
392
tok/s
5% VRAM
S
Qwen2-VL 2B2.21B
qwen32K ctxchatvision
355
tok/s
5% VRAM
S
Qwen3.5-2B2.3B
qwen256K ctxchat
341
tok/s
6% VRAM

Get personalized recommendations

See ranked models with benchmark scores, run commands, and precise speed estimates for your Tesla V100 SXM3 32 GB.

Find Models for Tesla V100 SXM3 32 GBCompare with other GPUs