Spec sheet
Falcon3-10B — 10.3B Dense.
Benchmark scores
HumanEval62.0
MMLU-PRO40.0
MATH27.5
IFEval68.0
BBH45.1
GPQA10.6
MUSR14.2
Run command
Run Falcon3-10B locally with Ollama — needs 6.8 GB VRAM at Q4_K_M:
$
ollama run falcon3:10bCompatible GPUs
30 @ Q4_K_MNVIDIA RTX 4060 Ti 8GB
8 GB · 288 GB/s
NVIDIA RTX 4060
8 GB · 272 GB/s
NVIDIA RTX 3070 Ti
8 GB · 608 GB/s
NVIDIA RTX 3070
8 GB · 448 GB/s
NVIDIA RTX 3060 Ti
8 GB · 448 GB/s
NVIDIA RTX 3050 8GB
8 GB · 224 GB/s
AMD RX 7600
8 GB · 288 GB/s
AMD RX 6650 XT
8 GB · 280 GB/s
Intel Arc A750
8 GB · 512 GB/s
Apple M1 (8GB)
8 GB · 68 GB/s
Apple M2 (8GB)
8 GB · 100 GB/s
Apple M3 (8GB)
8 GB · 100 GB/s
NVIDIA RTX 2080 SUPER
8 GB · 496 GB/s
NVIDIA RTX 2080
8 GB · 448 GB/s
NVIDIA RTX 2070 SUPER
8 GB · 448 GB/s