granite-4.0-h-micro 3.2B — 3.2B Parameter Dense LLM
Model Specifications
- Parameters
- 3.2B
- Architecture
- Dense Transformer
- Context Length
- 128K tokens
- Capabilities
- chat
- Release Date
- 2025-09-16
- Provider
- IBM
- Family
- granite
VRAM Requirements
| Quantization | BPW | VRAM | Quality |
|---|---|---|---|
| Q4_K_M | 4.89 | 2.4 GB | 94% |
| Q5_K_S | 5.57 | 2.7 GB | 96% |
| Q5_K_M | 5.7 | 2.8 GB | 96% |
| Q6_K | 6.56 | 3.1 GB | 97% |
| Q8_0 | 8.5 | 3.9 GB | 100% |
| FP16 | 16 | 6.9 GB | 100% |
Benchmark Scores
MMLU-PRO20.2
MATH9.2
IFEval51.4
BBH21.7
GPQA6.6
MUSR1.3
How to Run granite-4.0-h-micro 3.2B
Run granite-4.0-h-micro 3.2B locally with Ollama (needs 2.4 GB VRAM at Q4_K_M):
ollama run granite:3bCompatible GPUs (30)
GPUs that can run granite-4.0-h-micro 3.2B at Q4_K_M quantization:
NVIDIA Quadro 5000(3GB, 120 GB/s)NVIDIA Quadro 5000 SDI(3GB, 120 GB/s)NVIDIA Tesla C2050(3GB, 144 GB/s)NVIDIA Tesla M2050(3GB, 148 GB/s)NVIDIA Tesla S2050(3GB, 148 GB/s)NVIDIA GeForce GTX 670MX(3GB, 67 GB/s)AMD Radeon HD 7950(3GB, 240 GB/s)AMD Radeon HD 7950 Boost(3GB, 240 GB/s)AMD Radeon HD 7950 Monica BIOS 1(3GB, 240 GB/s)AMD Radeon HD 7950 Monica BIOS 2(3GB, 240 GB/s)AMD Radeon HD 7970(3GB, 264 GB/s)AMD Radeon HD 7970 GHz Edition(3GB, 288 GB/s)AMD Radeon HD 7970 X2(3GB, 264 GB/s)NVIDIA GeForce GTX 770M(3GB, 96 GB/s)NVIDIA GeForce GTX 780(3GB, 288 GB/s)