Spec sheet
Aya Expanse 32B — 32B Dense.
Benchmark scores
HumanEval62.0
MMLU-PRO46.0
MATH15.3
IFEval73.0
BBH38.7
GPQA10.1
MUSR6.4
Arena Elo1224
Run command
Run Aya Expanse 32B locally with Ollama — needs 20.0 GB VRAM at Q4_K_M:
$
ollama run aya-expanse:32bCompatible GPUs
30 @ Q4_K_MNVIDIA RTX 4090
24 GB · 1008 GB/s
NVIDIA RTX 3090 Ti
24 GB · 1008 GB/s
NVIDIA RTX 3090
24 GB · 936 GB/s
AMD RX 7900 XTX
24 GB · 960 GB/s
Apple M4 Pro (24GB)
24 GB · 273 GB/s
NVIDIA L4 24GB
24 GB · 300 GB/s
NVIDIA A10 24GB
24 GB · 600 GB/s
Apple M2 (24GB)
24 GB · 100 GB/s
Apple M3 (24GB)
24 GB · 100 GB/s
Apple M4 (24GB)
24 GB · 120 GB/s
NVIDIA Tesla M40 24 GB
24 GB · 288 GB/s
NVIDIA Tesla P10
24 GB · 694 GB/s
NVIDIA Tesla P40
24 GB · 347 GB/s
NVIDIA Quadro RTX 6000
24 GB · 672 GB/s
NVIDIA Quadro RTX 6000 Passive
24 GB · 624 GB/s