EXAONE Deep 2.4B — 2.4B Parameter Dense LLM
Model Specifications
- Parameters
- 2.4B
- Architecture
- Dense Transformer
- Context Length
- 32K tokens
- Capabilities
- reasoning, math, coding
- Release Date
- 2025-03-16
- Family
- exaone
VRAM Requirements
| Quantization | BPW | VRAM | Quality |
|---|---|---|---|
| Q4_K_M | 4.89 | 2.0 GB | 94% |
| Q5_K_S | 5.57 | 2.2 GB | 96% |
| Q5_K_M | 5.7 | 2.2 GB | 96% |
| Q6_K | 6.56 | 2.5 GB | 97% |
| Q8_0 | 8.5 | 3.0 GB | 100% |
| FP16 | 16 | 5.3 GB | 100% |
Benchmark Scores
MMLU-PRO25.3
MATH36.8
IFEval79.5
BBH15.9
GPQA2.1
MUSR3.2
How to Run EXAONE Deep 2.4B
Run EXAONE Deep 2.4B locally with Ollama (needs 2.0 GB VRAM at Q4_K_M):
ollama run exaone-deep:2.4bCompatible GPUs (30)
GPUs that can run EXAONE Deep 2.4B at Q4_K_M quantization:
AMD FireGL V8650(2GB, 111 GB/s)NVIDIA GeForce GTX 285 X2(2GB, 148 GB/s)NVIDIA GeForce GTX 480M(2GB, 77 GB/s)NVIDIA Quadro 5000M(2GB, 77 GB/s)AMD Radeon HD 6950(2GB, 160 GB/s)AMD Radeon HD 6970(2GB, 176 GB/s)Intel Aubrey Isle(2GB, 154 GB/s)AMD Radeon HD 5870 Eyefinity 6(2GB, 154 GB/s)NVIDIA GeForce GTX 485M(2GB, 96 GB/s)NVIDIA GeForce GTX 580M(2GB, 96 GB/s)NVIDIA Quadro 1000M(2GB, 29 GB/s)NVIDIA Quadro 2000M(2GB, 29 GB/s)NVIDIA Quadro 3000M(2GB, 80 GB/s)NVIDIA Quadro 3000M X2(2GB, 80 GB/s)NVIDIA Quadro 4000M(2GB, 80 GB/s)