Spec sheet
DeepSeek-Coder-V2 236B — 236B MoE.
Benchmark scores
HumanEval90.2
MATH75.7
BBH83.9
MBPP76.2
BigCodeBench40.4
LiveCodeBench43.4
MATH-50074.3
AA Intelligence10.6
Run command
Run DeepSeek-Coder-V2 236B locally with Ollama — needs 144.7 GB VRAM at Q4_K_M:
$
ollama run deepseek-coder-v2:236bCompatible GPUs
13 @ Q4_K_MAMD Instinct MI300X
192 GB · 5300 GB/s
Apple M2 Ultra (192GB)
192 GB · 800 GB/s
Apple M3 Ultra (192GB)
192 GB · 800 GB/s
Apple M4 Ultra (192GB)
192 GB · 1092 GB/s
AMD Radeon Instinct MI300A
192 GB · 10300 GB/s
AMD Radeon Instinct MI300X
192 GB · 10300 GB/s
AMD Radeon Instinct MI308X
192 GB · 10300 GB/s
Apple M5 Ultra (192GB)
192 GB · 1228 GB/s
AMD Radeon Instinct MI325X
288 GB · 10300 GB/s
AMD Radeon Instinct MI350X
288 GB · 8190 GB/s
AMD Radeon Instinct MI355X
288 GB · 8190 GB/s
Apple M4 Ultra (384GB)
384 GB · 1092 GB/s
Apple M5 Ultra (384GB)
384 GB · 1228 GB/s