WHAT THIS CARD IS WORTH
ARM Mali-G76 MP16 holds 201 of the models in our catalogue and is, in practice, a IQ4_XS card — the largest it takes is Falcon3-10B at IQ4_XS.
TOKENS/SEC PER $100
—
8B at Q4_K_M, so cards compare like for like
VRAM PER $100
—
what memory costs on this card
THE BIGGEST IT TAKES
AGAINST CARDS OF SIMILAR MEMORY
ARM Mali-G76 MP168 GB——
Neighbours in memory rather than in price: memory decides whether a card can do the job at all, so two cards of the same size at different prices is the comparison you are making. Ordered by memory, then bandwidth — not by the value column, which is worked out from bandwidth and price alone and therefore rewards a cheap card whatever its software stack does to that bandwidth in practice. Read it as one input, not as a ranking.
▸ DEVICE UNDER TEST
ARM Mali-G76 MP16 — 8 GB VRAM.
▸ ARM MALI-G76 MP16 SPEC
- BRAND
- Apple
- VRAM
- 8 GB Shared
- BANDWIDTH
- 29.8 GB/s
- FP16 COMPUTE
- 0.8 TFLOPS
- TDP
- 6 W
- ARCHITECTURE
- Bifrost Gen3
▸ AI CAPABILITY
201/ 449 models @ Q4
With 8 GB VRAM and 29.8 GB/s bandwidth, this GPU handles models up to 9.63B parameters.
Speed ≈ bandwidth / model_size × efficiency. A 7B model at Q4 runs at ~3 tok/s.
RENT IT — LIVE PRICES
Checking what the clouds are charging…
§ 01TOP MODELS FOR ARM MALI-G76 MP16
201 FIT · SHOWING 20| MODEL | SIZE | VRAM Q4 | TOK/S | AVG |
|---|---|---|---|---|
| RecurrentGemma 9B | 9.63B | 6.4 GB | 3 | 35.0 |
| glm-4-9b | 9.4B | 6.2 GB | 3 | 20.5 |
| gemma-2-9b | 9.2B | 6.1 GB | 3 | 30.2 |
| Yi 1.5 9B | 9B | 6.0 GB | 3 | 30.3 |
| Yi Coder 9B | 9B | 6.0 GB | 3 | 35.8 |
| Ministral 3 8B | 8.92B | 5.9 GB | 3 | 25.7 |
| Ministral 3 8B Reasoning | 8.92B | 5.9 GB | 3 | — |
| NVIDIA-Nemotron-Nano-9B-v2 | 8.9B | 5.9 GB | 3 | 44.2 |
| InternLM3 8B Instruct | 8.8B | 5.9 GB | 3 | 38.7 |
| Gemma 1 7B | 8.54B | 5.7 GB | 3 | 24.7 |
| CodeGemma 7B | 8.54B | 5.7 GB | 3 | 40.2 |
| LFM2 8B A1B | 8.3B | 5.6 GB | 18 | 24.3 |
| Seed-Coder 8B Instruct | 8.25B | 5.5 GB | 3 | 34.1 |
| Seed-Coder 8B Reasoning | 8.25B | 5.5 GB | 3 | 32.9 |
| DeepSeek R1-0528 Qwen3 8B | 8.2B | 5.5 GB | 3 | 36.3 |
| Qwen3-8B | 8.2B | 5.5 GB | 3 | 43.3 |
| Granite 3.0 8B | 8.17B | 5.5 GB | 3 | 36.4 |
| Granite 3.1 8B | 8.17B | 5.5 GB | 3 | 38.6 |
| Command-R7B | 8.03B | 5.4 GB | 3 | 35.3 |
| Aya Expanse 8B | 8B | 5.4 GB | 3 | 27.8 |