▸ SPEC SHEET
DeepSeek Coder 1.3B — 1.3B Dense.
▸ SPECIFICATIONS
- PARAMETERS
- 1.3B
- ARCHITECTURE
- Dense Transformer
- CONTEXT LENGTH
- 16K tokens
- CAPABILITIES
- coding
- RELEASE DATE
- 2023-11-02
- PROVIDER
- DeepSeek
- FAMILY
- deepseek
▸ VRAM REQUIREMENTS
| QUANT | BPW | VRAM | QUALITY |
|---|---|---|---|
| Q4_K_M | 4.89 | 1.3 GB | 94% |
| Q5_K_S | 5.57 | 1.4 GB | 96% |
| Q5_K_M | 5.7 | 1.4 GB | 96% |
| Q6_K | 6.56 | 1.6 GB | 97% |
| Q8_0 | 8.5 | 1.9 GB | 100% |
| FP16 | 16 | 3.1 GB | 100% |
§ 01BENCHMARK SCORES
HumanEval25.6
MMLU-PRO1.4
MATH0.0
IFEval17.5
BBH40.0
GPQA0.0
MUSR2.2
MBPP47.9
§ 02RUN COMMAND
Run DeepSeek Coder 1.3B locally with Ollama — needs 1.3 GB VRAM at Q4_K_M:
$
ollama run deepseek-coder:1.3b§ 03COMPATIBLE GPUs
30 @ Q4_K_MNVIDIA Quadro FX 5600
2 GB · 76.8 GB/s
NVIDIA Quadro FX 5600 Mac Edition
2 GB · 76.8 GB/s
NVIDIA Tesla C870
2 GB · 76.8 GB/s
NVIDIA Tesla D870
2 GB · 76.8 GB/s
NVIDIA Tesla S870
2 GB · 76.8 GB/s
NVIDIA Quadro CX
2 GB · 76.8 GB/s
NVIDIA Quadro FX 4800
2 GB · 76.8 GB/s
NVIDIA GeForce GT 230 OEM
2 GB · 24 GB/s
NVIDIA GeForce GT 440 OEM
2 GB · 43.2 GB/s
NVIDIA GeForce GTX 460M
2 GB · 60 GB/s
NVIDIA GeForce GTX 470M
2 GB · 72 GB/s
NVIDIA GeForce GTX 480
2 GB · 177.4 GB/s
NVIDIA GeForce GTX 580
2 GB · 192.4 GB/s
NVIDIA GeForce GT 545
2 GB · 38.4 GB/s
NVIDIA GeForce GTX 560M
2 GB · 60 GB/s