Spec sheet
Vicuna 13B — 13B Dense.
Benchmark scores
HumanEval15.9
MMLU-PRO10.3
MATH1.4
IFEval39.8
BBH7.2
GPQA0.0
MUSR8.2
Arena Elo1057
Run command
Run Vicuna 13B locally with Ollama — needs 8.4 GB VRAM at Q4_K_M:
$
ollama run vicuna:13bCompatible GPUs
30 @ Q4_K_MNVIDIA RTX 3080 10GB
10 GB · 760 GB/s
Intel Arc B570
10 GB · 456 GB/s
NVIDIA GeForce RTX 3080
10 GB · 760 GB/s
AMD Radeon RX 6700
10 GB · 320 GB/s
AMD Radeon RX 6700M
10 GB · 320 GB/s
AMD Radeon RX 6750 GRE 10 GB
10 GB · 320 GB/s
NVIDIA P102-101
10 GB · 320 GB/s
AMD Xbox Series X GPU
10 GB · 560 GB/s
NVIDIA CMP 170HX 10 GB
10 GB · 1560 GB/s
NVIDIA CMP 50HX
10 GB · 560 GB/s
NVIDIA CMP 90HX
10 GB · 760 GB/s
AMD Xbox Series X 6nm GPU
10 GB · 560 GB/s
NVIDIA RTX 2080 Ti
11 GB · 616 GB/s
NVIDIA GTX 1080 Ti
11 GB · 484 GB/s
NVIDIA GeForce GTX 1080 Ti
11 GB · 484 GB/s