Stability AI/Dense

stablelm-2-1_6b

Name: stablelm-2-1_6b
Author: Stability AI

Stable LM 2 Chat 1.6B is a 1.6 billion parameter instruction tuned language model inspired by HugginFaceH4's Zephyr 7B training pipeline.

chat

1.6B

Parameters

Context length

Benchmarks

Quantizations

HF downloads

Architecture

Dense

Released

2024-04-08

Layers

KV Heads

Head Dim

Family

stablelm

Quantization Options

Quant	Bits	VRAM @ 4K	Quality
Q4_K_M	4.89	1.5 GB	good
Q5_K_S	5.57	1.6 GB	good
Q5_K_M	5.7	1.6 GB	good
Q6_K	6.56	1.8 GB	excellent
Q8_0	8.5	2.2 GB	lossless
FP16	16	3.7 GB	lossless

Select your GPU above to see speed estimates and compatibility for each quantization.

Deploying for a team or in production? Size GPUs, cost & scaling in Enterprise →

▸ READY TO RUN THIS?RENT BY THE HOUR

RENT A GPU AND RUN STABLELM-2-1_6B NOW

Rent on Vast.ai →Or RunPod →

Spin up an A100 / H100 / 4090 in ~60s. Pay by the second. Cancel anytime.

Community Ratings

Loading ratings...

Benchmarks (6)

IFEval32.8

MMLU-PRO7.9

BBH6.7

MUSR6.0

MATH3.3

GPQA0.0

Run this model

▸Easiest way to get started·Beginners

DOCS ↗

curl -fsSL https://ollama.com/install.sh | sh

$ollama run stablelm2:1.6b-q4_K_M

Downloads and runs automatically. Add --verbose for speed stats.

▸ SETUP GUIDE

Auto-setup with fitmyllm CLI

Detects your GPU, recommends the best model, downloads it, and starts chatting — zero config. Benchmarks your speed and contributes anonymous data to improve predictions.

pip install fitmyllmthen run fitmyllmLearn more

Auto-detect GPULive tok/s in chatSpeed benchmarks9 inference engines

HuggingFace Ollama Library GGUF Downloads Build Hardware

GPUs that can run this model

At Q4_K_M quantization. Sorted by minimum VRAM.

NVIDIA Quadro FX 5600

2 GB VRAM • 76.8 GB/s

NVIDIA

Amazon Newegg eBay PCPartPicker Rent on RunPod Rent on Vast.ai

NVIDIA Quadro FX 5600 Mac Edition

2 GB VRAM • 76.8 GB/s

NVIDIA

Amazon Newegg eBay PCPartPicker Rent on RunPod Rent on Vast.ai

NVIDIA Tesla C870

2 GB VRAM • 76.8 GB/s

NVIDIA

NVIDIA Tesla D870

2 GB VRAM • 76.8 GB/s

NVIDIA

NVIDIA Tesla S870

2 GB VRAM • 76.8 GB/s

NVIDIA

NVIDIA Quadro CX

2 GB VRAM • 76.8 GB/s

NVIDIA

Amazon Newegg eBay PCPartPicker Rent on RunPod Rent on Vast.ai

NVIDIA Quadro FX 4800

2 GB VRAM • 76.8 GB/s

NVIDIA

Amazon Newegg eBay PCPartPicker Rent on RunPod Rent on Vast.ai

NVIDIA GeForce GT 230 OEM

2 GB VRAM • 24 GB/s

NVIDIA

Amazon Newegg eBay PCPartPicker Rent on RunPod Rent on Vast.ai

NVIDIA GeForce GT 440 OEM

2 GB VRAM • 43.2 GB/s

NVIDIA

Amazon Newegg eBay PCPartPicker Rent on RunPod Rent on Vast.ai

NVIDIA GeForce GTX 460M

2 GB VRAM • 60 GB/s

NVIDIA

Amazon Newegg eBay PCPartPicker Rent on RunPod Rent on Vast.ai

NVIDIA GeForce GTX 470M

2 GB VRAM • 72 GB/s

NVIDIA

Amazon Newegg eBay PCPartPicker Rent on RunPod Rent on Vast.ai

NVIDIA GeForce GTX 480

2 GB VRAM • 177.4 GB/s

NVIDIA

Amazon Newegg eBay PCPartPicker Rent on RunPod Rent on Vast.ai

NVIDIA GeForce GTX 580

2 GB VRAM • 192.4 GB/s

NVIDIA

Amazon Newegg eBay PCPartPicker Rent on RunPod Rent on Vast.ai

NVIDIA GeForce GT 545

2 GB VRAM • 38.4 GB/s

NVIDIA

Amazon Newegg eBay PCPartPicker Rent on RunPod Rent on Vast.ai

NVIDIA GeForce GTX 560M

2 GB VRAM • 60 GB/s

NVIDIA

Amazon Newegg eBay PCPartPicker Rent on RunPod Rent on Vast.ai

NVIDIA GeForce GTX 570M

2 GB VRAM • 72 GB/s

NVIDIA

Amazon Newegg eBay PCPartPicker Rent on RunPod Rent on Vast.ai

NVIDIA GeForce GTX 580 Rev. 2

2 GB VRAM • 192.4 GB/s

NVIDIA

Amazon Newegg eBay PCPartPicker Rent on RunPod Rent on Vast.ai

NVIDIA GeForce GTX 590

2 GB VRAM • 164 GB/s

NVIDIA

Amazon Newegg eBay PCPartPicker Rent on RunPod Rent on Vast.ai

NVIDIA GeForce GT 640 OEM Rebrand

2 GB VRAM • 38.4 GB/s

NVIDIA

Amazon Newegg eBay PCPartPicker Rent on RunPod Rent on Vast.ai

NVIDIA GeForce GTX 670M

2 GB VRAM • 72 GB/s

NVIDIA

Amazon Newegg eBay PCPartPicker Rent on RunPod Rent on Vast.ai

NVIDIA GeForce GTX 760 OEM Rebrand

2 GB VRAM • 179.2 GB/s

NVIDIA

Amazon Newegg eBay PCPartPicker Rent on RunPod Rent on Vast.ai

NVIDIA GeForce GTX 260 OEM

2 GB VRAM • 112.9 GB/s

NVIDIA

Amazon Newegg eBay PCPartPicker Rent on RunPod Rent on Vast.ai

NVIDIA Quadro 4000 Mac Edition

2 GB VRAM • 89.9 GB/s

NVIDIA

Amazon Newegg eBay PCPartPicker Rent on RunPod Rent on Vast.ai

AMD FireGL V8650

2 GB VRAM • 111 GB/s

AMD

Amazon Newegg eBay PCPartPicker Rent on RunPod Rent on Vast.ai

NVIDIA GeForce GTX 285 X2

2 GB VRAM • 148 GB/s

NVIDIA

Amazon Newegg eBay PCPartPicker Rent on RunPod Rent on Vast.ai

NVIDIA GeForce GTX 480M

2 GB VRAM • 77 GB/s

NVIDIA

Amazon Newegg eBay PCPartPicker Rent on RunPod Rent on Vast.ai

NVIDIA Quadro 5000M

2 GB VRAM • 77 GB/s

NVIDIA

Amazon Newegg eBay PCPartPicker Rent on RunPod Rent on Vast.ai

AMD Radeon HD 6950

2 GB VRAM • 160 GB/s

AMD

Amazon Newegg eBay PCPartPicker Rent on RunPod Rent on Vast.ai

AMD Radeon HD 6970

2 GB VRAM • 176 GB/s

AMD

Amazon Newegg eBay PCPartPicker Rent on RunPod Rent on Vast.ai

Intel Aubrey Isle

2 GB VRAM • 154 GB/s

INTEL

Amazon Newegg eBay PCPartPicker Rent on RunPod Rent on Vast.ai

Find the best GPU for stablelm-2-1_6b

Build Hardware for stablelm-2-1_6b

Model Card

View on HuggingFace

Stable LM 2 Chat 1.6B is a 1.6 billion parameter instruction tuned language model inspired by HugginFaceH4's Zephyr 7B training pipeline.

stablelm-2-1_6b

Quantization Options

Community Ratings

Benchmarks (6)

Run this model

Auto-setup with fitmyllm CLI

GPUs that can run this model

Model Card

stablelm-2-1_6b — 1.6B Dense.