FitMyLLM
HuggingFace/Dense

HuggingFaceSmolVLM 500M

SmolVLM-500M is a tiny multimodal model, member of the SmolVLM family. It accepts arbitrary sequences of image and text inputs to produce text outputs. It's designed for efficiency.

chatvision
0.5B
Parameters
8K
Context length
0
Benchmarks
6
Quantizations
0
Architecture
Dense
Released
2024-11-26
Layers
32
KV Heads
5
Head Dim
64
Family
smollm

Quantization Options

Context length:
QuantBitsVRAM @ 8KQuality
Q4_K_M4.89
1.0 GB
0.8 + 0.2 KV
good
Q5_K_S5.57
1.0 GB
0.8 + 0.2 KV
good
Q5_K_M5.7
1.0 GB
0.8 + 0.2 KV
good
Q6_K6.56
1.1 GB
0.9 + 0.2 KV
excellent
Q8_08.5
1.2 GB
1.0 + 0.2 KV
lossless
FP1616
1.6 GB
1.5 + 0.2 KV
lossless

Select your GPU above to see speed estimates and compatibility for each quantization.

Deploying for a team or in production? Size GPUs, cost & scaling in Enterprise →
▸ READY TO RUN THIS?RENT BY THE HOUR

RENT A GPU AND RUN SMOLVLM 500M NOW

Rent on Vast.ai →Or RunPod →

Spin up an A100 / H100 / 4090 in ~60s. Pay by the second. Cancel anytime.

Community Ratings

Loading ratings...

Run this model

▸Easiest way to get started·Beginners
DOCS ↗
curl -fsSL https://ollama.com/install.sh | sh
$ollama run smollm:0.5b-q4_K_M

Tag may need adjustment — check ollama.com/library/smollm for available tags.

▸ SETUP GUIDE
>_

Auto-setup with fitmyllm CLI

Detects your GPU, recommends the best model, downloads it, and starts chatting — zero config. Benchmarks your speed and contributes anonymous data to improve predictions.

pip install fitmyllmthen run fitmyllmLearn more
Auto-detect GPULive tok/s in chatSpeed benchmarks9 inference engines
HuggingFaceGGUF DownloadsBuild Hardware

GPUs that can run this model

At Q4_K_M quantization. Sorted by minimum VRAM.

AMD FireGL V7350
1 GB VRAM • 41.6 GB/s
AMD
AmazonNeweggeBayPCPartPickerRent on RunPodRent on Vast.ai
NVIDIA Quadro FX 5500
1 GB VRAM • 32.3 GB/s
NVIDIA
AmazonNeweggeBayPCPartPickerRent on RunPodRent on Vast.ai
NVIDIA Quadro FX 5500 SDI
1 GB VRAM • 32.3 GB/s
NVIDIA
AmazonNeweggeBayPCPartPickerRent on RunPodRent on Vast.ai
AMD Stream Processor
1 GB VRAM • 41.5 GB/s
AMD
AmazonNeweggeBayPCPartPickerRent on RunPodRent on Vast.ai
AMD FireGL V8600
1 GB VRAM • 111.1 GB/s
AMD
AmazonNeweggeBayPCPartPickerRent on RunPodRent on Vast.ai
NVIDIA
AmazonNeweggeBayPCPartPickerRent on RunPodRent on Vast.ai
NVIDIA GeForce 9600M GS
1 GB VRAM • 25.6 GB/s
NVIDIA
AmazonNeweggeBayPCPartPickerRent on RunPodRent on Vast.ai
NVIDIA GeForce 9650M GT
1 GB VRAM • 25.6 GB/s
NVIDIA
AmazonNeweggeBayPCPartPickerRent on RunPodRent on Vast.ai
NVIDIA GeForce 9800M GTS
1 GB VRAM • 51.2 GB/s
NVIDIA
AmazonNeweggeBayPCPartPickerRent on RunPodRent on Vast.ai
NVIDIA GeForce 9800M GTX
1 GB VRAM • 51.2 GB/s
NVIDIA
AmazonNeweggeBayPCPartPickerRent on RunPodRent on Vast.ai
NVIDIA GeForce GTX 280
1 GB VRAM • 141.7 GB/s
NVIDIA
AmazonNeweggeBayPCPartPickerRent on RunPodRent on Vast.ai
NVIDIA GeForce GTX 285
1 GB VRAM • 159 GB/s
NVIDIA
AmazonNeweggeBayPCPartPickerRent on RunPodRent on Vast.ai
NVIDIA Quadro FX 3700M
1 GB VRAM • 51.2 GB/s
NVIDIA
AmazonNeweggeBayPCPartPickerRent on RunPodRent on Vast.ai
NVIDIA Quadro FX 3800M
1 GB VRAM • 64 GB/s
NVIDIA
AmazonNeweggeBayPCPartPickerRent on RunPodRent on Vast.ai
NVIDIA Quadro FX 4700 X2
1 GB VRAM • 51.2 GB/s
NVIDIA
AmazonNeweggeBayPCPartPickerRent on RunPodRent on Vast.ai
AMD FireStream 9250
1 GB VRAM • 63.5 GB/s
AMD
AmazonNeweggeBayPCPartPickerRent on RunPodRent on Vast.ai
AMD FirePro V8700
1 GB VRAM • 108.8 GB/s
AMD
AmazonNeweggeBayPCPartPickerRent on RunPodRent on Vast.ai
AMD Radeon HD 4570
1 GB VRAM • 8 GB/s
AMD
AmazonNeweggeBayPCPartPickerRent on RunPodRent on Vast.ai
AMD Radeon HD 4710
1 GB VRAM • 25.6 GB/s
AMD
AmazonNeweggeBayPCPartPickerRent on RunPodRent on Vast.ai
AMD Radeon HD 4730 OEM
1 GB VRAM • 25.3 GB/s
AMD
AmazonNeweggeBayPCPartPickerRent on RunPodRent on Vast.ai
AMD Radeon HD 4870 X2
1 GB VRAM • 115.2 GB/s
AMD
AmazonNeweggeBayPCPartPickerRent on RunPodRent on Vast.ai
NVIDIA GeForce 210 OEM
1 GB VRAM • 6.4 GB/s
NVIDIA
AmazonNeweggeBayPCPartPickerRent on RunPodRent on Vast.ai
NVIDIA GeForce 210 Rev. 2
1 GB VRAM • 6.4 GB/s
NVIDIA
AmazonNeweggeBayPCPartPickerRent on RunPodRent on Vast.ai
NVIDIA GeForce G110M
1 GB VRAM • 11.2 GB/s
NVIDIA
AmazonNeweggeBayPCPartPickerRent on RunPodRent on Vast.ai
NVIDIA GeForce GT 120M
1 GB VRAM • 16 GB/s
NVIDIA
AmazonNeweggeBayPCPartPickerRent on RunPodRent on Vast.ai
NVIDIA GeForce GT 130M
1 GB VRAM • 25.6 GB/s
NVIDIA
AmazonNeweggeBayPCPartPickerRent on RunPodRent on Vast.ai
NVIDIA GeForce GT 140 OEM
1 GB VRAM • 57.6 GB/s
NVIDIA
AmazonNeweggeBayPCPartPickerRent on RunPodRent on Vast.ai
NVIDIA GeForce GT 220
1 GB VRAM • 22.4 GB/s
NVIDIA
AmazonNeweggeBayPCPartPickerRent on RunPodRent on Vast.ai
NVIDIA GeForce GT 220M
1 GB VRAM • 16 GB/s
NVIDIA
AmazonNeweggeBayPCPartPickerRent on RunPodRent on Vast.ai
NVIDIA GeForce GT 230M
1 GB VRAM • 25.3 GB/s
NVIDIA
AmazonNeweggeBayPCPartPickerRent on RunPodRent on Vast.ai

Find the best GPU for SmolVLM 500M

Build Hardware for SmolVLM 500M
▸ SPEC SHEET

SmolVLM 500M — 0.5B Dense.

▸ SPECIFICATIONS
PARAMETERS
0.5B
ARCHITECTURE
Dense Transformer
CONTEXT LENGTH
8K tokens
CAPABILITIES
chat, vision
RELEASE DATE
2024-11-26
PROVIDER
HuggingFace
FAMILY
smollm
▸ VRAM REQUIREMENTS
QUANTBPWVRAMQUALITY
Q4_K_M4.890.8 GB94%
Q5_K_S5.570.8 GB96%
Q5_K_M5.70.8 GB96%
Q6_K6.560.9 GB97%
Q8_08.51.0 GB100%
FP16161.5 GB100%
§ 03COMPATIBLE GPUs
30 @ Q4_K_M
AMD FireGL V7350
1 GB · 41.6 GB/s
NVIDIA Quadro FX 5500
1 GB · 32.3 GB/s
NVIDIA Quadro FX 5500 SDI
1 GB · 32.3 GB/s
AMD Stream Processor
1 GB · 41.5 GB/s
AMD FireGL V8600
1 GB · 111.1 GB/s
NVIDIA GeForce 9600 GT Mac Edition
1 GB · 17 GB/s
NVIDIA GeForce 9600M GS
1 GB · 25.6 GB/s
NVIDIA GeForce 9650M GT
1 GB · 25.6 GB/s
NVIDIA GeForce 9800M GTS
1 GB · 51.2 GB/s
NVIDIA GeForce 9800M GTX
1 GB · 51.2 GB/s
NVIDIA GeForce GTX 280
1 GB · 141.7 GB/s
NVIDIA GeForce GTX 285
1 GB · 159 GB/s
NVIDIA Quadro FX 3700M
1 GB · 51.2 GB/s
NVIDIA Quadro FX 3800M
1 GB · 64 GB/s
NVIDIA Quadro FX 4700 X2
1 GB · 51.2 GB/s