▸ SPEC SHEET
Qwen 1.5 0.5B — 0.62B Dense.
▸ SPECIFICATIONS
- PARAMETERS
- 0.62B
- ARCHITECTURE
- Dense Transformer
- CONTEXT LENGTH
- 32K tokens
- CAPABILITIES
- chat
- RELEASE DATE
- 2024-02-04
- PROVIDER
- Alibaba
- FAMILY
- qwen
▸ VRAM REQUIREMENTS
| QUANT | BPW | VRAM | QUALITY |
|---|---|---|---|
| Q4_K_M | 4.89 | 0.9 GB | 94% |
| Q5_K_S | 5.57 | 0.9 GB | 96% |
| Q5_K_M | 5.7 | 0.9 GB | 96% |
| Q6_K | 6.56 | 1.0 GB | 97% |
| Q8_0 | 8.5 | 1.1 GB | 100% |
| FP16 | 16 | 1.7 GB | 100% |
§ 01BENCHMARK SCORES
MMLU-PRO8.0
MATH10.3
IFEval31.5
BBH8.2
GPQA1.2
MUSR1.4
BigCodeBench8.8
§ 02RUN COMMAND
Run Qwen 1.5 0.5B locally with Ollama — needs 0.9 GB VRAM at Q4_K_M:
$
ollama run qwen:0.5b§ 03COMPATIBLE GPUs
30 @ Q4_K_MAMD FireGL V7350
1 GB · 41.6 GB/s
NVIDIA Quadro FX 5500
1 GB · 32.3 GB/s
NVIDIA Quadro FX 5500 SDI
1 GB · 32.3 GB/s
AMD Stream Processor
1 GB · 41.5 GB/s
AMD FireGL V8600
1 GB · 111.1 GB/s
NVIDIA GeForce 9600 GT Mac Edition
1 GB · 17 GB/s
NVIDIA GeForce 9600M GS
1 GB · 25.6 GB/s
NVIDIA GeForce 9650M GT
1 GB · 25.6 GB/s
NVIDIA GeForce 9800M GTS
1 GB · 51.2 GB/s
NVIDIA GeForce 9800M GTX
1 GB · 51.2 GB/s
NVIDIA GeForce GTX 280
1 GB · 141.7 GB/s
NVIDIA GeForce GTX 285
1 GB · 159 GB/s
NVIDIA Quadro FX 3700M
1 GB · 51.2 GB/s
NVIDIA Quadro FX 3800M
1 GB · 64 GB/s
NVIDIA Quadro FX 4700 X2
1 GB · 51.2 GB/s