Meta/Dense
LLaMA 1 13B
chat
13B
Parameters
2K
Context length
8
Benchmarks
4
Quantizations
200K
HF downloads
Architecture
Dense
Released
2023-02-24
Layers
40
KV Heads
40
Head Dim
128
Family
llama
Model Card
View on HuggingFaceThis contains the weights for the LLaMA-13b model. This model is under a non-commercial license (see the LICENSE file). You should only use this repository if you have been granted access to the model by filling out this form but either lost your copy of the weights or got some trouble converting them to the Transformers format.
Quantizations & VRAM
Q4_K_M4.5 bpw
7.8 GB
VRAM required
94%
Quality
Q6_K6.5 bpw
11.1 GB
VRAM required
97%
Quality
Q8_08 bpw
13.5 GB
VRAM required
100%
Quality
FP1616 bpw
26.5 GB
VRAM required
100%
Quality
Benchmarks (8)
IFEval63.1
MBPP52.6
BBH43.3
MMLU-PRO40.8
MATH25.4
HumanEval15.8
MUSR11.5
GPQA11.1
GPUs that can run this model
At Q4_K_M quantization. Sorted by minimum VRAM.
NVIDIA RTX 4060 Ti 8GB
8 GB VRAM • 288 GB/s
NVIDIA
$399
NVIDIA RTX 4060
8 GB VRAM • 272 GB/s
NVIDIA
$299
NVIDIA RTX 3070 Ti
8 GB VRAM • 608 GB/s
NVIDIA
$499
NVIDIA RTX 3070
8 GB VRAM • 448 GB/s
NVIDIA
$325
NVIDIA RTX 3060 Ti
8 GB VRAM • 448 GB/s
NVIDIA
$250
NVIDIA RTX 3050 8GB
8 GB VRAM • 224 GB/s
NVIDIA
$249
AMD RX 7600
8 GB VRAM • 288 GB/s
AMD
$269
AMD RX 6650 XT
8 GB VRAM • 280 GB/s
AMD
$399
Intel Arc A750
8 GB VRAM • 512 GB/s
INTEL
$199
Apple M1 (8GB)
8 GB VRAM • 68 GB/s
APPLE
$499
Apple M2 (8GB)
8 GB VRAM • 100 GB/s
APPLE
$599
Apple M3 (8GB)
8 GB VRAM • 100 GB/s
APPLE
$599
NVIDIA RTX 2080 SUPER
8 GB VRAM • 496 GB/s
NVIDIA
$280
NVIDIA RTX 2080
8 GB VRAM • 448 GB/s
NVIDIA
$260
NVIDIA RTX 2070 SUPER
8 GB VRAM • 448 GB/s
NVIDIA
$240
NVIDIA RTX 2070
8 GB VRAM • 448 GB/s
NVIDIA
$200
NVIDIA RTX 2060 SUPER
8 GB VRAM • 448 GB/s
NVIDIA
$180
NVIDIA GTX 1080
8 GB VRAM • 320 GB/s
NVIDIA
$130
NVIDIA GTX 1070 Ti
8 GB VRAM • 256 GB/s
NVIDIA
$120
NVIDIA GTX 1070
8 GB VRAM • 256 GB/s
NVIDIA
$100
NVIDIA RTX 3060 8GB
8 GB VRAM • 224 GB/s
NVIDIA
$280
AMD RX 6600 XT
8 GB VRAM • 256 GB/s
AMD
$200
AMD RX 6600
8 GB VRAM • 224 GB/s
AMD
$165
AMD RX 5700 XT
8 GB VRAM • 448 GB/s
AMD
$150
AMD RX 5700
8 GB VRAM • 448 GB/s
AMD
$130
Intel Arc A580
8 GB VRAM • 512 GB/s
INTEL
$179
NVIDIA RTX 5060 Ti 8GB
8 GB VRAM • 448 GB/s
NVIDIA
$379
NVIDIA RTX 5060
8 GB VRAM • 448 GB/s
NVIDIA
$299
NVIDIA Tesla K8
8 GB VRAM • 160 GB/s
NVIDIA
NVIDIA Tesla M60
8 GB VRAM • 160 GB/s
NVIDIA
Find the best GPU for LLaMA 1 13B
Build Hardware for LLaMA 1 13B