Spec sheet
Nemotron 3 Super 120B — 120B MoE.
Benchmark scores
MMLU-PRO83.7
LiveCodeBench81.2
SWE-bench60.5
AIME90.2
GPQA Diamond79.2
HLE19.2
AA Intelligence36.0
AA Coding31.2
IFBench71.5
Terminal-Bench Hard28.8
τ²-Bench67.8
SciCode36.0
AA Long Context60.0
Terminal-Bench 2.138.6
Terminal-Bench 40.0
Run command
Run Nemotron 3 Super 120B locally with Ollama — needs 73.8 GB VRAM at Q4_K_M:
$
ollama run nemotron-3-super:120bCompatible GPUs
30 @ Q4_K_MNVIDIA H100 SXM5 80GB
80 GB · 3350 GB/s
NVIDIA H100 PCIe 80GB
80 GB · 2000 GB/s
NVIDIA A100 SXM 80GB
80 GB · 2039 GB/s
NVIDIA A100 PCIe 80GB
80 GB · 1935 GB/s
NVIDIA A100 SXM4 80 GB
80 GB · 2040 GB/s
NVIDIA A100 PCIe 80 GB
80 GB · 1940 GB/s
NVIDIA A100X
80 GB · 2040 GB/s
NVIDIA H100 PCIe 80 GB
80 GB · 2040 GB/s
NVIDIA H100 SXM5 80 GB
80 GB · 3360 GB/s
NVIDIA H100 CNX
80 GB · 2040 GB/s
NVIDIA A800 PCIe 80 GB
80 GB · 1940 GB/s
NVIDIA A800 SXM4 80 GB
80 GB · 2040 GB/s
NVIDIA H800 PCIe 80 GB
80 GB · 2040 GB/s
NVIDIA H800 SXM5
80 GB · 3360 GB/s
NVIDIA RTX 6000D
84 GB · 1570 GB/s