Spec sheet
Nemotron 3 Super 120B-A12B — 123.61B MoE.
Benchmark scores
GPQA Diamond79.2
MMLU-PRO83.7
IFEval72.6
HLE18.3
IFBench71.5
Terminal-Bench Hard28.8
τ²-Bench67.8
SciCode36.0
AA Long Context60.0
LiveCodeBench81.2
SWE-bench60.5
AIME90.2
AA Intelligence36.0
AA Coding31.2
Terminal-Bench 2.138.6
Terminal-Bench 40.0
Run command
Run Nemotron 3 Super 120B-A12B locally with Ollama — needs 76.0 GB VRAM at Q4_K_M:
$
ollama run nemotron-3-super:120bCompatible GPUs
30 @ Q4_K_MNVIDIA H100 SXM5 80GB
80 GB · 3350 GB/s
NVIDIA H100 PCIe 80GB
80 GB · 2000 GB/s
NVIDIA A100 SXM 80GB
80 GB · 2039 GB/s
NVIDIA A100 PCIe 80GB
80 GB · 1935 GB/s
NVIDIA A100 SXM4 80 GB
80 GB · 2040 GB/s
NVIDIA A100 PCIe 80 GB
80 GB · 1940 GB/s
NVIDIA A100X
80 GB · 2040 GB/s
NVIDIA H100 PCIe 80 GB
80 GB · 2040 GB/s
NVIDIA H100 SXM5 80 GB
80 GB · 3360 GB/s
NVIDIA H100 CNX
80 GB · 2040 GB/s
NVIDIA A800 PCIe 80 GB
80 GB · 1940 GB/s
NVIDIA A800 SXM4 80 GB
80 GB · 2040 GB/s
NVIDIA H800 PCIe 80 GB
80 GB · 2040 GB/s
NVIDIA H800 SXM5
80 GB · 3360 GB/s
NVIDIA RTX 6000D
84 GB · 1570 GB/s