Spec sheet
Falcon 180B — 180B Dense.
Benchmark scores
HumanEval54.0
MMLU-PRO45.0
IFEval41.0
BBH65.0
Arena Elo1049
Run command
Run Falcon 180B locally with Ollama — needs 110.5 GB VRAM at Q4_K_M:
$
ollama run falcon:180bCompatible GPUs
30 @ Q4_K_MAMD Instinct MI300A
120 GB · 5300 GB/s
Apple M4 Max (128GB)
128 GB · 546 GB/s
AMD Instinct MI250X
128 GB · 3277 GB/s
Apple M1 Ultra (128GB)
128 GB · 800 GB/s
Apple M2 Ultra (128GB)
128 GB · 800 GB/s
AMD Radeon Instinct MI250
128 GB · 3280 GB/s
AMD Radeon Instinct MI250X
128 GB · 3280 GB/s
AMD Radeon Instinct MI300
128 GB · 6550 GB/s
Intel Data Center GPU Max 1550
128 GB · 3280 GB/s
Intel Data Center GPU Max Subsystem
128 GB · 3210 GB/s
NVIDIA GB10
128 GB · 273 GB/s
NVIDIA Jetson T5000
128 GB · 273 GB/s
Apple M5 Max (128GB)
128 GB · 614 GB/s
NVIDIA H200 SXM 141GB
140 GB · 4800 GB/s
NVIDIA H200 NVL
141 GB · 4890 GB/s