Databricks/Dense

Dolly v2 3B

chat
2.8B
Parameters
2K
Context length
6
Benchmarks
4
Quantizations
100K
HF downloads
Architecture
Dense
Released
2023-04-12
Layers
32
KV Heads
16
Head Dim
80
Family
dolly

Quantizations & VRAM

Q4_K_M4.5 bpw
2.0 GB
VRAM required
94%
Quality
Q6_K6.5 bpw
2.7 GB
VRAM required
97%
Quality
Q8_08 bpw
3.2 GB
VRAM required
100%
Quality
FP1616 bpw
6.0 GB
VRAM required
100%
Quality

Benchmarks (6)

IFEval22.5
BBH3.3
MUSR3.2
MMLU-PRO1.6
MATH1.5
GPQA1.5

GPUs that can run this model

At Q4_K_M quantization. Sorted by minimum VRAM.

Find the best GPU for Dolly v2 3B

Build Hardware for Dolly v2 3B