OpenThinker 7B — 7B Parameter Dense LLM
Model Specifications
- Parameters
- 7B
- Architecture
- Dense Transformer
- Context Length
- 31K tokens
- Capabilities
- reasoning, math
- Release Date
- 2025-02-01
- Family
- openthinker
VRAM Requirements
| Quantization | BPW | VRAM | Quality |
|---|---|---|---|
| Q4_K_M | 4.89 | 4.8 GB | 94% |
| Q5_K_S | 5.57 | 5.4 GB | 96% |
| Q5_K_M | 5.7 | 5.5 GB | 96% |
| Q6_K | 6.56 | 6.2 GB | 97% |
| Q8_0 | 8.5 | 7.9 GB | 100% |
| FP16 | 16 | 14.5 GB | 100% |
Benchmark Scores
MMLU-PRO35.2
MATH42.6
IFEval40.9
BBH34.5
GPQA0.9
MUSR5.4
How to Run OpenThinker 7B
Run OpenThinker 7B locally with Ollama (needs 4.8 GB VRAM at Q4_K_M):
ollama run openthinker:7bCompatible GPUs (30)
GPUs that can run OpenThinker 7B at Q4_K_M quantization:
NVIDIA Tesla K20c(5GB, 208 GB/s)NVIDIA Tesla K20m(5GB, 208 GB/s)NVIDIA Tesla K20s(5GB, 208 GB/s)NVIDIA GeForce GTX 1060 5 GB(5GB, 160 GB/s)NVIDIA P102-100(5GB, 440 GB/s)NVIDIA Quadro P2000(5GB, 140.2 GB/s)NVIDIA Quadro P2200(5GB, 200.2 GB/s)NVIDIA RTX 3050 6GB(6GB, 168 GB/s)Intel Arc A380(6GB, 186 GB/s)NVIDIA RTX 2060 6GB(6GB, 336 GB/s)NVIDIA GTX 1660 SUPER(6GB, 336 GB/s)NVIDIA GTX 1660 Ti(6GB, 288 GB/s)NVIDIA GTX 1060 6GB(6GB, 192 GB/s)NVIDIA Tesla C2070(6GB, 143 GB/s)NVIDIA Tesla C2075(6GB, 150 GB/s)