Shanghai AI Lab/Dense

InternLM2 5B

Name: InternLM2 5B
Author: Shanghai AI Lab

InternLM2 5B — solid mid-range Chinese-English model.

chat

4.5B

Parameters

32K

Context length

Benchmarks

Quantizations

40K

HF downloads

Architecture

Dense

Released

2024-01-17

Layers

KV Heads

Head Dim

128

Family

internlm

Quantization Options

Quant	Bits	VRAM	Quality
Q4_K_M	4.89	3.2 GB	good
Q5_K_S	5.57	3.6 GB	good
Q5_K_M	5.7	3.7 GB	good
Q6_K	6.56	4.2 GB	excellent
Q8_0	8.5	5.3 GB	lossless
FP16	16	9.5 GB	lossless

Select your GPU above to see speed estimates and compatibility for each quantization.

▸ READY TO RUN THIS?RENT BY THE HOUR

RENT A GPU AND RUN INTERNLM2 5B NOW

Rent on RunPod →Or Vast.ai →

Spin up an A100 / H100 / 4090 in ~60s. Pay by the second. Cancel anytime.

Community Ratings

Loading ratings...

Benchmarks (1)

HumanEval47.6

Run this model

▸Easiest way to get started·Beginners

DOCS ↗

curl -fsSL https://ollama.com/install.sh | sh

$ollama run internlm:5b-q4_K_M

Tag may need adjustment — check ollama.com/library/internlm for available tags.

▸ SETUP GUIDE

Auto-setup with fitmyllm CLI

Detects your GPU, recommends the best model, downloads it, and starts chatting — zero config. Benchmarks your speed and contributes anonymous data to improve predictions.

pip install fitmyllmthen run fitmyllmLearn more

Auto-detect GPULive tok/s in chatSpeed benchmarks9 inference engines

HuggingFace GGUF Downloads Build Hardware

GPUs that can run this model

At Q4_K_M quantization. Sorted by minimum VRAM.

NVIDIA Tesla C1080

4 GB VRAM • 102 GB/s

NVIDIA

NVIDIA Tesla K10

4 GB VRAM • 160 GB/s

NVIDIA

NVIDIA Tesla M4

4 GB VRAM • 88 GB/s

NVIDIA

NVIDIA GeForce GTX 1050 Ti

4 GB VRAM • 112 GB/s

NVIDIA

Amazon Newegg eBay PCPartPicker

AMD Radeon Instinct MI8

4 GB VRAM • 512 GB/s

AMD

NVIDIA GeForce GTX 1650

4 GB VRAM • 128 GB/s

NVIDIA

Amazon Newegg eBay PCPartPicker

NVIDIA GeForce GTX 1650 SUPER

4 GB VRAM • 192 GB/s

NVIDIA

Amazon Newegg eBay PCPartPicker

AMD Radeon RX 5300 XT OEM

4 GB VRAM • 112 GB/s

AMD

Amazon Newegg eBay PCPartPicker

AMD Radeon RX 5500 OEM

4 GB VRAM • 224 GB/s

AMD

Amazon Newegg eBay PCPartPicker

AMD Radeon RX 5500 XT

4 GB VRAM • 224 GB/s

AMD

Amazon Newegg eBay PCPartPicker

AMD Radeon RX 5500M

4 GB VRAM • 224 GB/s

AMD

Amazon Newegg eBay PCPartPicker

NVIDIA GeForce GTX 1650 GDDR6

4 GB VRAM • 192 GB/s

NVIDIA

Amazon Newegg eBay PCPartPicker

NVIDIA GeForce GTX 1650 TU106

4 GB VRAM • 192 GB/s

NVIDIA

Amazon Newegg eBay PCPartPicker

NVIDIA GeForce GTX 1650 TU116

4 GB VRAM • 192 GB/s

NVIDIA

Amazon Newegg eBay PCPartPicker

NVIDIA GeForce GTX 1630

4 GB VRAM • 96 GB/s

NVIDIA

Amazon Newegg eBay PCPartPicker

NVIDIA GeForce RTX 3050 4 GB

4 GB VRAM • 192 GB/s

NVIDIA

$149

Amazon Newegg eBay PCPartPicker

NVIDIA RTX A1000 Embedded

4 GB VRAM • 224 GB/s

NVIDIA

NVIDIA RTX A2000 Embedded

4 GB VRAM • 192 GB/s

NVIDIA

AMD Radeon RX 6400

4 GB VRAM • 128 GB/s

AMD

$139

Amazon Newegg eBay PCPartPicker

AMD Radeon RX 6500 XT

4 GB VRAM • 144 GB/s

AMD

$70

Amazon Newegg eBay PCPartPicker

AMD Radeon RX 6500M

4 GB VRAM • 144 GB/s

AMD

Amazon Newegg eBay PCPartPicker

AMD Radeon RX 6600S

4 GB VRAM • 224 GB/s

AMD

$175

Amazon Newegg eBay PCPartPicker

Intel Arc A310

4 GB VRAM • 124 GB/s

INTEL

$79

Amazon Newegg eBay PCPartPicker

Intel Arc A350

4 GB VRAM • 124 GB/s

INTEL

$99

Amazon Newegg eBay PCPartPicker

Intel Arc A350M

4 GB VRAM • 112 GB/s

INTEL

Amazon Newegg eBay PCPartPicker

Intel Arc A370M

4 GB VRAM • 112 GB/s

INTEL

Amazon Newegg eBay PCPartPicker

AMD Radeon RX 6450M

4 GB VRAM • 128 GB/s

AMD

Amazon Newegg eBay PCPartPicker

AMD Radeon RX 6550M

4 GB VRAM • 144 GB/s

AMD

Amazon Newegg eBay PCPartPicker

AMD Radeon RX 6550S

4 GB VRAM • 128 GB/s

AMD

Amazon Newegg eBay PCPartPicker

NVIDIA GeForce RTX 4010

4 GB VRAM • 96 GB/s

NVIDIA

$199

Amazon Newegg eBay PCPartPicker

Find the best GPU for InternLM2 5B

Build Hardware for InternLM2 5B

Model Card

View on HuggingFace

InternLM2 5B — solid mid-range Chinese-English model.

InternLM2 5B

Quantization Options

Community Ratings

Benchmarks (1)

Run this model

Auto-setup with fitmyllm CLI

GPUs that can run this model

Model Card

InternLM2 5B — 4.5B Dense.