Spec sheet
Sarvam 30B — 32.15B Dense.
Benchmark scores
HumanEval92.1
MMLU-PRO80.0
MATH97.0
MBPP92.7
SWE-bench34.0
AIME80.0
GPQA Diamond66.5
HLE7.0
AA Intelligence12.3
AA Coding7.9
IFBench26.5
Terminal-Bench Hard2.3
τ²-Bench34.5
SciCode19.2
Compatible GPUs
30 @ Q4_K_MNVIDIA RTX 4090
24 GB · 1008 GB/s
NVIDIA RTX 3090 Ti
24 GB · 1008 GB/s
NVIDIA RTX 3090
24 GB · 936 GB/s
AMD RX 7900 XTX
24 GB · 960 GB/s
Apple M4 Pro (24GB)
24 GB · 273 GB/s
NVIDIA L4 24GB
24 GB · 300 GB/s
NVIDIA A10 24GB
24 GB · 600 GB/s
Apple M2 (24GB)
24 GB · 100 GB/s
Apple M3 (24GB)
24 GB · 100 GB/s
Apple M4 (24GB)
24 GB · 120 GB/s
NVIDIA Tesla M40 24 GB
24 GB · 288 GB/s
NVIDIA Tesla P10
24 GB · 694 GB/s
NVIDIA Tesla P40
24 GB · 347 GB/s
NVIDIA Quadro RTX 6000
24 GB · 672 GB/s
NVIDIA Quadro RTX 6000 Passive
24 GB · 624 GB/s