Spec sheet
Falcon-H1R 7B — 7.59B Dense.
Benchmark scores
MMLU-PRO72.1
MATH97.4
IFEval76.1
BBH37.9
GPQA8.1
MUSR21.2
LiveCodeBench72.4
AIME83.1
GPQA Diamond61.3
HLE10.8
AA Intelligence15.8
AA Coding9.8
AA Math80.0
IFBench54.4
Terminal-Bench Hard2.3
τ²-Bench27.8
SciCode24.9
AA Long Context8.7
Run command
Run Falcon-H1R 7B locally with Ollama — needs 5.1 GB VRAM at Q4_K_M:
$
ollama run falcon:7bCompatible GPUs
30 @ Q4_K_MNVIDIA RTX 3050 6GB
6 GB · 168 GB/s
Intel Arc A380
6 GB · 186 GB/s
NVIDIA RTX 2060 6GB
6 GB · 336 GB/s
NVIDIA GTX 1660 SUPER
6 GB · 336 GB/s
NVIDIA GTX 1660 Ti
6 GB · 288 GB/s
NVIDIA GTX 1060 6GB
6 GB · 192 GB/s
NVIDIA Tesla C2070
6 GB · 143 GB/s
NVIDIA Tesla C2075
6 GB · 150 GB/s
NVIDIA Tesla C2090
6 GB · 177 GB/s
NVIDIA Tesla M2070
6 GB · 150 GB/s
NVIDIA Tesla M2070-Q
6 GB · 150 GB/s
NVIDIA Tesla M2075
6 GB · 150 GB/s
NVIDIA Tesla M2090
6 GB · 177 GB/s
NVIDIA Tesla X2070
6 GB · 177 GB/s
NVIDIA Tesla X2090
6 GB · 177 GB/s