▸ NVIDIA· AMPERE

NVIDIA A10M

VRAM

20 GB

MID-RANGE

BANDWIDTH

500

GB/S

MODELS Q4

274/428

64%

7B Q4 SPEED

~57

BLAZING

▸ MODEL COVERAGE @ Q464% OF ALL

▸ ESTIMATED SPEED· BY MODEL SIZE @ Q4

Average speeds at Q4 quantization. Actual performance varies by model architecture and context length.

3B

~133

TOK/S

7B

~57

TOK/S

14B

~29

TOK/S

32B

~13

TOK/S

70B

—

39.4GB NEEDED

▸ SPECIFICATIONS

VRAM

20 GB

BANDWIDTH

500 GB/s

FP16 COMPUTE

23.4 TFLOPS

TDP

150W

MEMORY

GDDR6

ARCHITECTURE

Ampere

CUDA CORES

7,168

TENSOR CORES

224

PCIE

Gen 4 x16

241

FAST MODELS · >30 TOK/S

Real-time chat speed

274

USABLE · >10 TOK/S

Comfortable for all tasks

274

TOTAL COMPATIBLE

Fit in VRAM at Q4

▸ DON’T WANT TO BUY?

Test A10M (or anything bigger) without committing. Pay by the second, cancel anytime.

Rent on RunPod →Or Vast.ai →

Spin up in ~60s. Pay by the second. Cancel anytime.

Some links are affiliate links — we may earn a small commission at no extra cost to you. This helps keep FitMyLLM free and independent.

▸ COMPATIBLE MODELS· 274

Falcon-H1R Tiny 90M0.09B

FALCON·256K CTX· CHAT· REASONING

TOK/S · 3% VRAM

nomic-embed-text-v1.5 100M0.1B

EMBEDDING·8K CTX· CHAT

TOK/S · 3% VRAM

GPT-2 124M0.124B

GPT2·1K CTX· CHAT

TOK/S · 3% VRAM

SmolLM2 135M0.135B

SMOLLM·2K CTX· CHAT

TOK/S · 3% VRAM

SmolVLM 256M0.256B

SMOLLM·8K CTX· CHAT· VISION

TOK/S · 3% VRAM

Gemma 3 270M0.27B

GEMMA·32K CTX· CHAT

TOK/S · 3% VRAM

Snowflake Arctic Embed M v2.00.305B

EMBEDDING·8K CTX· EMBEDDING· MULTILINGUAL

TOK/S · 3% VRAM

bge-large-en-v1.5 335M0.335B

EMBEDDING·1K CTX· CHAT

TOK/S · 3% VRAM

mxbai-embed-large-v10.335B

EMBEDDING·1K CTX· EMBEDDING

TOK/S · 3% VRAM

Snowflake Arctic Embed L0.335B

EMBEDDING·1K CTX· EMBEDDING

TOK/S · 3% VRAM

GPT-2 Medium 345M0.345B

GPT2·1K CTX· CHAT

TOK/S · 3% VRAM

LFM·125K CTX· CHAT· TOOL_USE

TOK/S · 4% VRAM

SmolLM2 360M0.36B

SMOLLM·8K CTX· CHAT

TOK/S · 4% VRAM

Falcon-H1 0.5B0.5B

FALCON·128K CTX· CHAT

TOK/S · 4% VRAM

Qwen 1.5 0.5B0.5B

QWEN·32K CTX· CHAT

TOK/S · 4% VRAM

Qwen 2.5 0.5B0.5B

QWEN·32K CTX· CHAT

TOK/S · 4% VRAM

SmolVLM 500M0.5B

SMOLLM·8K CTX· CHAT· VISION

TOK/S · 4% VRAM

EMBEDDING·8K CTX· EMBEDDING

TOK/S · 4% VRAM

Snowflake Arctic Embed L v2.00.568B

EMBEDDING·8K CTX· EMBEDDING· MULTILINGUAL

TOK/S · 4% VRAM

QWEN·32K CTX· CHAT· REASONING

TOK/S · 4% VRAM

Qwen3-Embedding 0.6B0.6B

EMBEDDING·32K CTX· EMBEDDING· MULTILINGUAL

TOK/S · 4% VRAM

Falcon-H1R Tiny 0.6B0.6B

FALCON·32K CTX· CHAT· REASONING

TOK/S · 4% VRAM

Falcon Perception 0.6B0.6B

FALCON·4K CTX· VISION

TOK/S · 4% VRAM

LFM·125K CTX· CHAT· TOOL_USE

TOK/S · 5% VRAM

GPT-2 Large 774M0.774B

GPT2·1K CTX· CHAT

TOK/S · 5% VRAM

Qwen 3.5 0.8B0.8B

QWEN·256K CTX· CHAT· CODING· MULTILINGUAL

TOK/S · 5% VRAM

Qwen3.5-0.8B0.9B

QWEN·256K CTX· CHAT

TOK/S · 5% VRAM

FALCON·32K CTX· CHAT

TOK/S · 5% VRAM

INTERNLM·32K CTX· CHAT

TOK/S · 5% VRAM

OTHER·32K CTX· CHAT· VISION

TOK/S · 5% VRAM

TinyLlama 1.1B1.1B

LLAMA·2K CTX· CHAT

TOK/S · 6% VRAM

LFM2.5-1.2B-Thinking1.2B

LFM·122K CTX· CHAT· REASONING· TOOL_USE

TOK/S · 6% VRAM

Llama-3.2-1B1.2B

LLAMA·4K CTX· CHAT

TOK/S · 6% VRAM

LFM·125K CTX· CHAT· TOOL_USE· MULTILINGUAL

TOK/S · 6% VRAM

Zamba2 1.2B1.2B

OTHER·4K CTX· CHAT

TOK/S · 6% VRAM

DeepSeek Coder 1.3B1.3B

DEEPSEEK·16K CTX· CODING

TOK/S · 6% VRAM

EXAONE-4.0-1.2B1.3B

EXAONE·64K CTX· CHAT

TOK/S · 6% VRAM

OPT·2K CTX· CHAT

TOK/S · 6% VRAM

PHI·2K CTX· CODING

TOK/S · 6% VRAM

Phi-1.5 1.3B1.3B

PHI·2K CTX· CHAT· CODING

TOK/S · 6% VRAM

▸ NEXT STEP

Get personalized recommendations.

See ranked models with benchmark scores, run commands, and precise speed estimates for your A10M.

▸Find models for A10M Compare with other GPUs

▸ DEVICE UNDER TEST

NVIDIA A10M — 20 GB VRAM.

▸ A10M SPEC

BRAND: NVIDIA
VRAM: 20 GB GDDR6
BANDWIDTH: 500 GB/s
FP16 COMPUTE: 23.4 TFLOPS
FP32 COMPUTE: 23.4 TFLOPS
CUDA CORES: 7,168
TENSOR CORES: 224
TDP: 150 W
ARCHITECTURE: Ampere

▸ AI CAPABILITY

274/ 428 models @ Q4

With 20 GB VRAM and 500 GB/s bandwidth, this GPU handles models up to 28B parameters.

Speed ≈ bandwidth / model_size × efficiency. A 7B model at Q4 runs at ~57 tok/s.

§ 01TOP MODELS FOR A10M

274 FIT · SHOWING 20

MODEL	SIZE	VRAM Q4	TOK/S	AVG
PaliGemma 2 28B	28B	17.6 GB	14	38.6
ERNIE 4.5 VL 28B A3B Thinking	28B	17.6 GB	133	—
Qwen3.5-27B	27.8B	17.5 GB	14	59.4
gemma-3-27b	27.4B	17.2 GB	15	27.2
gemma-2-27b	27.2B	17.1 GB	15	34.6
TranslateGemma 27B	27B	17.0 GB	15	38.6
Qwen 3.6 27B	27B	17.0 GB	15	41.1
Gemma 4 26B A4B	26B	16.4 GB	100	47.9
Aria 25B A3.9B	25.3B	16.0 GB	103	64.8
Mistral-Small-24B	24B	15.2 GB	17	25.0
Mistral-Small-3.1-24B	24B	15.2 GB	17	28.8
Magistral Small 24B	24B	15.2 GB	17	47.0
Devstral Small 2 24B	24B	15.2 GB	17	33.4
LFM2 24B A2B	24B	15.2 GB	200	19.1
Codestral 22B	22.2B	14.1 GB	18	50.1
Devstral Small 22B	22.2B	14.1 GB	18	35.5
Mistral Small 22B	22.2B	14.1 GB	18	35.2
SOLAR-Pro 22B	22.1B	14.0 GB	18	44.2
ERNIE 4.5 21B A3B	21B	13.3 GB	133	—
GPT-OSS 20B	21B	13.3 GB	111	52.9