Spec sheet
DeepSeek V2 Lite 16B — 16B MoE.
Benchmark scores
MMLU-PRO40.7
MATH57.0
IFEval43.8
BBH40.7
GPQA18.3
MUSR28.7
BigCodeBench36.8
Run command
Run DeepSeek V2 Lite 16B locally with Ollama — needs 10.3 GB VRAM at Q4_K_M:
$
ollama run deepseek-v2:16bCompatible GPUs
30 @ Q4_K_MNVIDIA RTX 2080 Ti
11 GB · 616 GB/s
NVIDIA GTX 1080 Ti
11 GB · 484 GB/s
NVIDIA GeForce GTX 1080 Ti
11 GB · 484 GB/s
NVIDIA GeForce RTX 2080 Ti
11 GB · 616 GB/s
NVIDIA RTX 5070
12 GB · 672 GB/s
NVIDIA RTX 4070 Ti
12 GB · 504 GB/s
NVIDIA RTX 4070 SUPER
12 GB · 504 GB/s
NVIDIA RTX 4070
12 GB · 504 GB/s
NVIDIA RTX 3080 Ti
12 GB · 912 GB/s
NVIDIA RTX 3080 12GB
12 GB · 912 GB/s
NVIDIA RTX 3060 12GB
12 GB · 360 GB/s
AMD RX 7700 XT
12 GB · 432 GB/s
AMD RX 6700 XT
12 GB · 384 GB/s
AMD RX 6750 XT
12 GB · 432 GB/s
Intel Arc B580
12 GB · 456 GB/s