Spec sheet
InternLM2 20B — 19.8B Dense.
Benchmark scores
HumanEval57.6
MMLU-PRO45.0
MATH52.0
IFEval72.0
BBH62.8
GPQA9.5
MUSR16.7
Run command
Run InternLM2 20B locally with Ollama — needs 12.6 GB VRAM at Q4_K_M:
$
ollama run internlm2:20bCompatible GPUs
30 @ Q4_K_MNVIDIA RTX 5080
16 GB · 960 GB/s
NVIDIA RTX 5070 Ti
16 GB · 896 GB/s
NVIDIA RTX 4080 SUPER
16 GB · 736 GB/s
NVIDIA RTX 4080
16 GB · 717 GB/s
NVIDIA RTX 4070 Ti SUPER
16 GB · 672 GB/s
NVIDIA RTX 4060 Ti 16GB
16 GB · 288 GB/s
AMD RX 7900 GRE
16 GB · 576 GB/s
AMD RX 7800 XT
16 GB · 624 GB/s
AMD RX 7600 XT
16 GB · 288 GB/s
AMD RX 6950 XT
16 GB · 576 GB/s
AMD RX 6900 XT
16 GB · 512 GB/s
AMD RX 6800 XT
16 GB · 512 GB/s
AMD RX 6800
16 GB · 512 GB/s
Intel Arc A770 16GB
16 GB · 560 GB/s
Apple M1 Pro (16GB)
16 GB · 200 GB/s