TII/Dense

Falcon3-10B

Name: Falcon3-10B
Author: TII

Falcon3 10B — strong mid-range model from TII with good multilingual support.

chatThinkingTool Use

10.3B

Parameters

32K

Context length

Benchmarks

Quantizations

60K

HF downloads

Architecture

Dense

Released

2024-11-29

Layers

KV Heads

Head Dim

256

Family

falcon

Quantization Options

Context length:

Quant	Bits	VRAM @ 16K	Quality
Q3_K_M	4	7.5 GB 5.6 + 1.9 KV	low
Q3_K_L	4.3	7.9 GB 6.0 + 1.9 KV	moderate
IQ4_XS	4.46	8.1 GB 6.2 + 1.9 KV	moderate
Q4_K_S	4.67	8.4 GB 6.5 + 1.9 KV	moderate
Q4_K_M	4.89	8.7 GB 6.8 + 1.9 KV	good
Q5_K_S	5.57	9.5 GB 7.7 + 1.9 KV	good
Q5_K_M	5.7	9.7 GB 7.8 + 1.9 KV	good
Q6_K	6.56	10.8 GB 8.9 + 1.9 KV	excellent
Q8_0	8.5	13.3 GB 11.4 + 1.9 KV	lossless
FP16	16	23.0 GB 21.1 + 1.9 KV	lossless

Select your GPU above to see speed estimates and compatibility for each quantization.

Deploying for a team or in production? Size GPUs, cost & scaling in Enterprise →

▸ READY TO RUN THIS?RENT BY THE HOUR

RENT A GPU AND RUN FALCON3-10B NOW

Rent on Vast.ai →Or RunPod →

Spin up an A100 / H100 / 4090 in ~60s. Pay by the second. Cancel anytime.

Community Ratings

Loading ratings...

Benchmarks (7)

IFEval68.0

HumanEval62.0

BBH45.1

MMLU-PRO40.0

MATH27.5

MUSR14.2

GPQA10.6

Run this model

▸Easiest way to get started·Beginners

DOCS ↗

curl -fsSL https://ollama.com/install.sh | sh

$ollama run falcon3:10b-instruct-q4_K_M

Downloads and runs automatically. Add --verbose for speed stats.

▸ SETUP GUIDE

Auto-setup with fitmyllm CLI

Detects your GPU, recommends the best model, downloads it, and starts chatting — zero config. Benchmarks your speed and contributes anonymous data to improve predictions.

pip install fitmyllmthen run fitmyllmLearn more

Auto-detect GPULive tok/s in chatSpeed benchmarks9 inference engines

HuggingFace Ollama Library GGUF Downloads Build Hardware

GPUs that can run this model

At Q4_K_M quantization. Sorted by minimum VRAM.

NVIDIA RTX 4060 Ti 8GB

8 GB VRAM • 288 GB/s

NVIDIA

$399

Amazon Newegg eBay PCPartPicker Rent on RunPod Rent on Vast.ai

NVIDIA RTX 4060

8 GB VRAM • 272 GB/s

NVIDIA

$299

Amazon Newegg eBay PCPartPicker Rent on RunPod Rent on Vast.ai

NVIDIA RTX 3070 Ti

8 GB VRAM • 608 GB/s

NVIDIA

$499

Amazon Newegg eBay PCPartPicker Rent on RunPod Rent on Vast.ai

NVIDIA RTX 3070

8 GB VRAM • 448 GB/s

NVIDIA

$325

Amazon Newegg eBay PCPartPicker Rent on RunPod Rent on Vast.ai

NVIDIA RTX 3060 Ti

8 GB VRAM • 448 GB/s

NVIDIA

$250

Amazon Newegg eBay PCPartPicker Rent on RunPod Rent on Vast.ai

NVIDIA RTX 3050 8GB

8 GB VRAM • 224 GB/s

NVIDIA

$249

Amazon Newegg eBay PCPartPicker Rent on RunPod Rent on Vast.ai

AMD RX 7600

8 GB VRAM • 288 GB/s

AMD

$269

Amazon Newegg eBay PCPartPicker Rent on RunPod Rent on Vast.ai

AMD RX 6650 XT

8 GB VRAM • 280 GB/s

AMD

$399

Amazon Newegg eBay PCPartPicker Rent on RunPod Rent on Vast.ai

Intel Arc A750

8 GB VRAM • 512 GB/s

INTEL

$199

Amazon Newegg eBay PCPartPicker Rent on RunPod Rent on Vast.ai

Apple M1 (8GB)

8 GB VRAM • 68 GB/s

APPLE

$499

Apple M2 (8GB)

8 GB VRAM • 100 GB/s

APPLE

$599

Apple M3 (8GB)

8 GB VRAM • 100 GB/s

APPLE

$599

NVIDIA RTX 2080 SUPER

8 GB VRAM • 496 GB/s

NVIDIA

$280

Amazon Newegg eBay PCPartPicker Rent on RunPod Rent on Vast.ai

NVIDIA RTX 2080

8 GB VRAM • 448 GB/s

NVIDIA

$260

Amazon Newegg eBay PCPartPicker Rent on RunPod Rent on Vast.ai

NVIDIA RTX 2070 SUPER

8 GB VRAM • 448 GB/s

NVIDIA

$240

Amazon Newegg eBay PCPartPicker Rent on RunPod Rent on Vast.ai

NVIDIA RTX 2070

8 GB VRAM • 448 GB/s

NVIDIA

$200

Amazon Newegg eBay PCPartPicker Rent on RunPod Rent on Vast.ai

NVIDIA RTX 2060 SUPER

8 GB VRAM • 448 GB/s

NVIDIA

$180

Amazon Newegg eBay PCPartPicker Rent on RunPod Rent on Vast.ai

NVIDIA GTX 1080

8 GB VRAM • 320 GB/s

NVIDIA

$130

Amazon Newegg eBay PCPartPicker Rent on RunPod Rent on Vast.ai

NVIDIA GTX 1070 Ti

8 GB VRAM • 256 GB/s

NVIDIA

$120

Amazon Newegg eBay PCPartPicker Rent on RunPod Rent on Vast.ai

NVIDIA GTX 1070

8 GB VRAM • 256 GB/s

NVIDIA

$100

Amazon Newegg eBay PCPartPicker Rent on RunPod Rent on Vast.ai

NVIDIA RTX 3060 8GB

8 GB VRAM • 224 GB/s

NVIDIA

$280

Amazon Newegg eBay PCPartPicker Rent on RunPod Rent on Vast.ai

AMD RX 6600 XT

8 GB VRAM • 256 GB/s

AMD

$200

Amazon Newegg eBay PCPartPicker Rent on RunPod Rent on Vast.ai

AMD RX 6600

8 GB VRAM • 224 GB/s

AMD

$165

Amazon Newegg eBay PCPartPicker Rent on RunPod Rent on Vast.ai

AMD RX 5700 XT

8 GB VRAM • 448 GB/s

AMD

$150

Amazon Newegg eBay PCPartPicker Rent on RunPod Rent on Vast.ai

AMD RX 5700

8 GB VRAM • 448 GB/s

AMD

$130

Amazon Newegg eBay PCPartPicker Rent on RunPod Rent on Vast.ai

Intel Arc A580

8 GB VRAM • 512 GB/s

INTEL

$179

Amazon Newegg eBay PCPartPicker Rent on RunPod Rent on Vast.ai

NVIDIA RTX 5060 Ti 8GB

8 GB VRAM • 448 GB/s

NVIDIA

$379

Amazon Newegg eBay PCPartPicker Rent on RunPod Rent on Vast.ai

NVIDIA RTX 5060

8 GB VRAM • 448 GB/s

NVIDIA

$299

Amazon Newegg eBay PCPartPicker Rent on RunPod Rent on Vast.ai

NVIDIA Tesla K8

8 GB VRAM • 160 GB/s

NVIDIA

NVIDIA Tesla M60

8 GB VRAM • 160 GB/s

NVIDIA

Find the best GPU for Falcon3-10B

Build Hardware for Falcon3-10B

Model Card

View on HuggingFace

Falcon3 10B — strong mid-range model from TII with good multilingual support.

QUANT	BPW	VRAM	QUALITY
Q3_K_M	4	5.6 GB	88%
Q3_K_L	4.3	6.0 GB	90%
IQ4_XS	4.46	6.2 GB	92%
Q4_K_S	4.67	6.5 GB	93%
Q4_K_M	4.89	6.8 GB	94%
Q5_K_S	5.57	7.7 GB	96%
Q5_K_M	5.7	7.8 GB	96%
Q6_K	6.56	8.9 GB	97%
Q8_0	8.5	11.4 GB	100%
FP16	16	21.1 GB	100%

Falcon3-10B

Quantization Options

Community Ratings

Benchmarks (7)

Run this model

Auto-setup with fitmyllm CLI

GPUs that can run this model

Model Card

Falcon3-10B — 10.3B Dense.