FitMyLLM
Baidu/Mixture of Experts

BaiduERNIE 4.5 300B-A47B

ERNIE 4.5 300B-A47B from Baidu: MoE, 300B total and 47B active, 128K context. Tagged for coding, reasoning, math.

chatcodingreasoningmath
300B
Parameters (47B active)
128K
Context length
17
Benchmarks
17
Quantizations
1K
HF downloads
Architecture
MoE
Released
2025-06-28
Layers
54
KV Heads
8
Head Dim
128
Family
ernie

Quantization Options

Context length:
QuantBitsVRAM @ 16KQuality
IQ2_XXS2.38
92.3 GB
89.7 + 2.5 KV
low
IQ2_M2.93
112.9 GB
110.4 + 2.5 KV
low
Q2_K3.16
121.5 GB
119.0 + 2.5 KV
low
IQ3_XXS3.25
124.9 GB
122.4 + 2.5 KV
low
IQ3_XS3.5
134.3 GB
131.7 + 2.5 KV
low
Q3_K_S3.64
139.5 GB
137.0 + 2.5 KV
low
IQ3_M3.76
144.0 GB
141.5 + 2.5 KV
low
Q3_K_M4
153.0 GB
150.5 + 2.5 KV
low
Q3_K_L4.3
164.3 GB
161.7 + 2.5 KV
moderate
IQ4_XS4.46
170.3 GB
167.7 + 2.5 KV
moderate
Q4_K_S4.67
178.1 GB
175.6 + 2.5 KV
moderate
Q4_K_M4.89
186.4 GB
183.9 + 2.5 KV
good
Q5_K_S5.57
211.9 GB
209.4 + 2.5 KV
good
Q5_K_M5.7
216.8 GB
214.2 + 2.5 KV
good
Q6_K6.56
249.0 GB
246.5 + 2.5 KV
excellent
Q8_08.5
321.8 GB
319.2 + 2.5 KV
lossless
FP1616
603.0 GB
600.5 + 2.5 KV
lossless

Select your GPU above to see speed estimates and compatibility for each quantization.

Too big for a single GPU — plan a multi-GPU deployment
Even the lightest quant needs ~92 GB. Size GPUs, replicas, TCO and scaling for a production setup. Open in Enterprise →
Ready to run this?Rent by the hour

Rent a GPU and run ERNIE 4.5 300B-A47B now

Spin up an A100 / H100 / 4090 in ~60s. Pay by the second. Cancel anytime.

Community Ratings

Loading ratings...

Benchmarks (17)

Run this model

Easiest way to get started·Beginners
Docs ↗
curl -fsSL https://ollama.com/install.sh | sh
$# ERNIE 4.5 300B-A47B is not in Ollama's library, and we know no GGUF build of it

Search Hugging Face for a GGUF of it (https://huggingface.co/models?sort=trending&search=ERNIE-4.5-300B-A47B-Instruct+GGUF), or use the vLLM tab with the original weights.

Setup guide
>_

Auto-setup with fitmyllm CLI

Detects your GPU, recommends the best model, downloads it, and starts chatting — zero config. Benchmarks your speed and contributes anonymous data to improve predictions.

pip install fitmyllmthen run fitmyllmLearn more
Auto-detect GPULive tok/s in chatSpeed benchmarks9 inference engines

GPUs that can run this model

At Q4_K_M quantization. Sorted by minimum VRAM.

AMD Instinct MI300X
192 GB VRAM • 5300 GB/s
AMD
$15000
Apple M2 Ultra (192GB)
192 GB VRAM • 800 GB/s
APPLE
$5499
Apple M3 Ultra (192GB)
192 GB VRAM • 800 GB/s
APPLE
$6999
Apple M4 Ultra (192GB)
192 GB VRAM • 1092 GB/s
APPLE
$7499
AMD Radeon Instinct MI300A
192 GB VRAM • 10300 GB/s
AMD
$12000
AMD Radeon Instinct MI300X
192 GB VRAM • 10300 GB/s
AMD
$15000
AMD Radeon Instinct MI308X
192 GB VRAM • 10300 GB/s
AMD
$12000
Apple M5 Ultra (192GB)
192 GB VRAM • 1228 GB/s
APPLE
AMD Radeon Instinct MI325X
288 GB VRAM • 10300 GB/s
AMD
$20000
AMD Radeon Instinct MI350X
288 GB VRAM • 8190 GB/s
AMD
$25000
AMD Radeon Instinct MI355X
288 GB VRAM • 8190 GB/s
AMD
$30000
Apple M4 Ultra (384GB)
384 GB VRAM • 1092 GB/s
APPLE
$9999
Apple M5 Ultra (384GB)
384 GB VRAM • 1228 GB/s
APPLE

Find the best GPU for ERNIE 4.5 300B-A47B

Build Hardware for ERNIE 4.5 300B-A47B
Spec sheet

ERNIE 4.5 300B-A47B — 300B MoE.

Specifications
Parameters
300B (47B active)
Architecture
Mixture of Experts
Context Length
128K tokens
Capabilities
chat, coding, reasoning, math
Release Date
2025-06-28
Provider
Baidu
Family
ernie
VRAM requirements
QuantBPWVRAMQuality
IQ2_XXS2.3889.7 GB65%
IQ2_M2.93110.4 GB75%
Q2_K3.16119.0 GB78%
IQ3_XXS3.25122.4 GB82%
IQ3_XS3.5131.7 GB84%
Q3_K_S3.64137.0 GB85%
IQ3_M3.76141.5 GB86%
Q3_K_M4150.5 GB88%
Q3_K_L4.3161.7 GB90%
IQ4_XS4.46167.7 GB92%
Q4_K_S4.67175.6 GB93%
Q4_K_M4.89183.9 GB94%
Q5_K_S5.57209.4 GB96%
Q5_K_M5.7214.2 GB96%
Q6_K6.56246.5 GB97%
Q8_08.5319.2 GB100%
FP1616600.5 GB100%
Benchmark scores
HumanEval92.1
MMLU-PRO78.4
IFEval88.0
BBH94.3
MUSR69.9
LiveCodeBench38.8
AIME54.8
MATH-50096.4
GPQA Diamond81.1
HLE3.5
AA Intelligence15.0
AA Coding14.5
AA Math41.3
IFBench39.1
Terminal-Bench Hard6.1
SciCode31.5
AA Long Context2.3
Compatible GPUs
13 @ Q4_K_M