FitMyLLM
Alibaba/Dense

AlibabaQwen 1.5 0.5B

Alibaba's tiny Qwen. Fast for basic tasks on minimal hardware.

chat
0.5B
Parameters
32K
Context length
7
Benchmarks
6
Quantizations
0
Architecture
Dense
Released
2024-02-04
Layers
24
KV Heads
16
Head Dim
64
Family
qwen

Quantization Options

QuantBitsVRAMQuality
Q4_K_M4.890.8 GBgood
Q5_K_S5.570.8 GBgood
Q5_K_M5.70.8 GBgood
Q6_K6.560.9 GBexcellent
Q8_08.51.0 GBlossless
FP16161.5 GBlossless

Select your GPU above to see speed estimates and compatibility for each quantization.

▸ READY TO RUN THIS?RENT BY THE HOUR

RENT A GPU AND RUN QWEN 1.5 0.5B NOW

Rent on RunPod →Or Vast.ai →

Spin up an A100 / H100 / 4090 in ~60s. Pay by the second. Cancel anytime.

Community Ratings

Loading ratings...

Benchmarks (7)

IFEval31.5
MATH10.3
BigCodeBench8.8
BBH8.2
MMLU-PRO8.0
MUSR1.4
GPQA1.2

Run this model

▸Easiest way to get started·Beginners
DOCS ↗
curl -fsSL https://ollama.com/install.sh | sh
$ollama run qwen:0.5b-q4_K_M

Downloads and runs automatically. Add --verbose for speed stats.

▸ SETUP GUIDE
>_

Auto-setup with fitmyllm CLI

Detects your GPU, recommends the best model, downloads it, and starts chatting — zero config. Benchmarks your speed and contributes anonymous data to improve predictions.

pip install fitmyllmthen run fitmyllmLearn more
Auto-detect GPULive tok/s in chatSpeed benchmarks9 inference engines
HuggingFaceOllama LibraryGGUF DownloadsBuild Hardware

GPUs that can run this model

At Q4_K_M quantization. Sorted by minimum VRAM.

AMD FireGL V7350
1 GB VRAM • 41.6 GB/s
AMD
AmazonNeweggeBayPCPartPicker
NVIDIA Quadro FX 5500
1 GB VRAM • 32.3 GB/s
NVIDIA
AmazonNeweggeBayPCPartPicker
NVIDIA Quadro FX 5500 SDI
1 GB VRAM • 32.3 GB/s
NVIDIA
AmazonNeweggeBayPCPartPicker
AMD Stream Processor
1 GB VRAM • 41.5 GB/s
AMD
AmazonNeweggeBayPCPartPicker
AMD FireGL V8600
1 GB VRAM • 111.1 GB/s
AMD
AmazonNeweggeBayPCPartPicker
NVIDIA
AmazonNeweggeBayPCPartPicker
NVIDIA GeForce 9600M GS
1 GB VRAM • 25.6 GB/s
NVIDIA
AmazonNeweggeBayPCPartPicker
NVIDIA GeForce 9650M GT
1 GB VRAM • 25.6 GB/s
NVIDIA
AmazonNeweggeBayPCPartPicker
NVIDIA GeForce 9800M GTS
1 GB VRAM • 51.2 GB/s
NVIDIA
AmazonNeweggeBayPCPartPicker
NVIDIA GeForce 9800M GTX
1 GB VRAM • 51.2 GB/s
NVIDIA
AmazonNeweggeBayPCPartPicker
NVIDIA GeForce GTX 280
1 GB VRAM • 141.7 GB/s
NVIDIA
AmazonNeweggeBayPCPartPicker
NVIDIA GeForce GTX 285
1 GB VRAM • 159 GB/s
NVIDIA
AmazonNeweggeBayPCPartPicker
NVIDIA Quadro FX 3700M
1 GB VRAM • 51.2 GB/s
NVIDIA
AmazonNeweggeBayPCPartPicker
NVIDIA Quadro FX 3800M
1 GB VRAM • 64 GB/s
NVIDIA
AmazonNeweggeBayPCPartPicker
NVIDIA Quadro FX 4700 X2
1 GB VRAM • 51.2 GB/s
NVIDIA
AmazonNeweggeBayPCPartPicker
AMD FireStream 9250
1 GB VRAM • 63.5 GB/s
AMD
AmazonNeweggeBayPCPartPicker
AMD FirePro V8700
1 GB VRAM • 108.8 GB/s
AMD
AmazonNeweggeBayPCPartPicker
AMD Radeon HD 4570
1 GB VRAM • 8 GB/s
AMD
AmazonNeweggeBayPCPartPicker
AMD Radeon HD 4710
1 GB VRAM • 25.6 GB/s
AMD
AmazonNeweggeBayPCPartPicker
AMD Radeon HD 4730 OEM
1 GB VRAM • 25.3 GB/s
AMD
AmazonNeweggeBayPCPartPicker
AMD Radeon HD 4870 X2
1 GB VRAM • 115.2 GB/s
AMD
AmazonNeweggeBayPCPartPicker
NVIDIA GeForce 210 OEM
1 GB VRAM • 6.4 GB/s
NVIDIA
AmazonNeweggeBayPCPartPicker
NVIDIA GeForce 210 Rev. 2
1 GB VRAM • 6.4 GB/s
NVIDIA
AmazonNeweggeBayPCPartPicker
NVIDIA GeForce G110M
1 GB VRAM • 11.2 GB/s
NVIDIA
AmazonNeweggeBayPCPartPicker
NVIDIA GeForce GT 120M
1 GB VRAM • 16 GB/s
NVIDIA
AmazonNeweggeBayPCPartPicker
NVIDIA GeForce GT 130M
1 GB VRAM • 25.6 GB/s
NVIDIA
AmazonNeweggeBayPCPartPicker
NVIDIA GeForce GT 140 OEM
1 GB VRAM • 57.6 GB/s
NVIDIA
AmazonNeweggeBayPCPartPicker
NVIDIA GeForce GT 220
1 GB VRAM • 22.4 GB/s
NVIDIA
AmazonNeweggeBayPCPartPicker
NVIDIA GeForce GT 220M
1 GB VRAM • 16 GB/s
NVIDIA
AmazonNeweggeBayPCPartPicker
NVIDIA GeForce GT 230M
1 GB VRAM • 25.3 GB/s
NVIDIA
AmazonNeweggeBayPCPartPicker

Find the best GPU for Qwen 1.5 0.5B

Build Hardware for Qwen 1.5 0.5B

Model Card

View on HuggingFace

Alibaba's tiny Qwen. Fast for basic tasks on minimal hardware.

▸ SPEC SHEET

Qwen 1.5 0.5B — 0.5B Dense.

▸ SPECIFICATIONS
PARAMETERS
0.5B
ARCHITECTURE
Dense Transformer
CONTEXT LENGTH
32K tokens
CAPABILITIES
chat
RELEASE DATE
2024-02-04
PROVIDER
Alibaba
FAMILY
qwen
▸ VRAM REQUIREMENTS
QUANTBPWVRAMQUALITY
Q4_K_M4.890.8 GB94%
Q5_K_S5.570.8 GB96%
Q5_K_M5.70.8 GB96%
Q6_K6.560.9 GB97%
Q8_08.51.0 GB100%
FP16161.5 GB100%
§ 01BENCHMARK SCORES
MMLU-PRO8.0
MATH10.3
IFEval31.5
BBH8.2
GPQA1.2
MUSR1.4
BigCodeBench8.8
§ 02RUN COMMAND

Run Qwen 1.5 0.5B locally with Ollama — needs 0.8 GB VRAM at Q4_K_M:

$ollama run qwen:0.5b
§ 03COMPATIBLE GPUs
30 @ Q4_K_M
AMD FireGL V7350
1 GB · 41.6 GB/s
NVIDIA Quadro FX 5500
1 GB · 32.3 GB/s
NVIDIA Quadro FX 5500 SDI
1 GB · 32.3 GB/s
AMD Stream Processor
1 GB · 41.5 GB/s
AMD FireGL V8600
1 GB · 111.1 GB/s
NVIDIA GeForce 9600 GT Mac Edition
1 GB · 17 GB/s
NVIDIA GeForce 9600M GS
1 GB · 25.6 GB/s
NVIDIA GeForce 9650M GT
1 GB · 25.6 GB/s
NVIDIA GeForce 9800M GTS
1 GB · 51.2 GB/s
NVIDIA GeForce 9800M GTX
1 GB · 51.2 GB/s
NVIDIA GeForce GTX 280
1 GB · 141.7 GB/s
NVIDIA GeForce GTX 285
1 GB · 159 GB/s
NVIDIA Quadro FX 3700M
1 GB · 51.2 GB/s
NVIDIA Quadro FX 3800M
1 GB · 64 GB/s
NVIDIA Quadro FX 4700 X2
1 GB · 51.2 GB/s