▸ APPLE· M2 MAX

Apple M2 Max (32GB)

USABLE MEMORY

21.3 GB

MID-RANGE

BANDWIDTH

400

GB/S

MODELS Q4

279/449

62%

7B Q4 SPEED

~51

BLAZING

▸ MODEL COVERAGE @ Q462% OF ALL

▸ ESTIMATED SPEED· BY MODEL SIZE @ Q4

Average speeds at Q4 quantization. Actual performance varies by model architecture and context length.

~119

TOK/S

~51

TOK/S

14B

~25

TOK/S

32B

—

18.0GB NEEDED

70B

—

39.4GB NEEDED

▸ MEASURED RIG REPORTS

We rent the machine and time every model on it: decode, VRAM peak, concurrency, watts and cost per million tokens. Yours may already be one of them — and two are free to read in full.

SEE THE REPORTS →

▸ SPECIFICATIONS

USABLE MEMORY

21.3 GB of 32

BANDWIDTH

400 GB/s

FP16 COMPUTE

13.6 TFLOPS

TDP

60W

MEMORY

Unified

ARCHITECTURE

M2 Max

MSRP

$1,799

236

FAST MODELS · >30 TOK/S

Real-time chat speed

279

USABLE · >10 TOK/S

Comfortable for all tasks

279

TOTAL COMPATIBLE

Fit in usable memory at Q4

▸ DON’T WANT TO BUY?

Test M2 Max (32GB) (or anything bigger) without committing. Pay by the second, cancel anytime.

Rent on Vast.ai →Or RunPod →

Spin up in ~60s. Pay by the second. Cancel anytime.

Some links are affiliate links — we may earn a small commission at no extra cost to you. This helps keep FitMyLLM free and independent.

▸ COMPATIBLE MODELS· 279

Falcon-H1R Tiny 90M0.09B

FALCON·256K CTX· CHAT· REASONING

nomic-embed-text-v1.5 100M0.14B

EMBEDDING·8K CTX· CHAT

SMOLLM·8K CTX· CHAT· VISION

Snowflake Arctic Embed M v2.00.305B

EMBEDDING·8K CTX· EMBEDDING· MULTILINGUAL

bge-large-en-v1.5 335M0.335B

EMBEDDING·1K CTX· CHAT

mxbai-embed-large-v10.335B

EMBEDDING·1K CTX· EMBEDDING

Snowflake Arctic Embed L0.335B

EMBEDDING·1K CTX· EMBEDDING

LFM·125K CTX· CHAT· TOOL_USE

GPT-2 Medium 345M0.38B

SMOLLM·8K CTX· CHAT· VISION

FALCON·128K CTX· CHAT

EMBEDDING·8K CTX· EMBEDDING

Snowflake Arctic Embed L v2.00.568B

EMBEDDING·8K CTX· EMBEDDING· MULTILINGUAL

Qwen3-Embedding 0.6B0.6B

EMBEDDING·32K CTX· EMBEDDING· MULTILINGUAL

Falcon-H1R Tiny 0.6B0.6B

FALCON·32K CTX· CHAT· REASONING

Falcon Perception 0.6B0.6B

FALCON·4K CTX· VISION

LFM·125K CTX· CHAT· TOOL_USE

QWEN·32K CTX· CHAT· REASONING

GPT-2 Large 774M0.81B

QWEN·256K CTX· CHAT· CODING· MULTILINGUAL

OTHER·32K CTX· CHAT· VISION

MINICPM·128K CTX· CHAT· REASONING· MULTILINGUAL

LFM2.5-1.2B-Thinking1.2B

LFM·122K CTX· CHAT· REASONING· TOOL_USE

LFM·125K CTX· CHAT· TOOL_USE· MULTILINGUAL

OTHER·256K CTX· CHAT· VISION

DeepSeek Coder 1.3B1.35B

DEEPSEEK·16K CTX· CODING

PHI·2K CTX· CHAT· CODING

LFM·125K CTX· CHAT· TOOL_USE· MULTILINGUAL

▸ NEXT STEP

Get personalized recommendations.

See ranked models with benchmark scores, run commands, and precise speed estimates for your Apple M2 Max (32GB).

▸Find models for Apple M2 Max (32GB)Compare with other GPUs

WHAT THIS CARD IS WORTH

M2 Max (32GB) holds 279 of the models in our catalogue and is, in practice, a Q4_K_S card — the largest it takes is ERNIE 4.5 VL 28B A3B Thinking at Q4_K_S.

TOKENS/SEC PER $100

2.5

8B at Q4_K_M, so cards compare like for like

USABLE MEMORY PER $100

1.19 GB

what memory costs on this card

THE BIGGEST IT TAKES

ERNIE 4.5 VL 28B A3B Thinking28B · Q4_K_S19.1 GB115 tok/sEST

Qwen3.5-27B27.8B · Q4_K_S18.4 GB12 tok/sEST

Qwen 3.8 27B27.78B · Q4_K_S19.0 GB12 tok/sEST

gemma-3-27b27.4B · Q4_K_S18.6 GB13 tok/sEST

gemma-2-27b27.2B · IQ4_XS18.4 GB13 tok/sEST

Qwen 3.6 27B27B · Q4_K_S18.5 GB13 tok/sEST

Gemma 4 26B A4B26B · Q4_K_M18.7 GB83 tok/sEST

Aria 25B A3.9B25.3B · Q4_K_M19.1 GB85 tok/sEST

AGAINST CARDS OF SIMILAR MEMORY

M3 Max (36GB)27 GB$2,4991.5 tok/s per $100

M3 Pro (36GB)27 GB$1,9991.2 tok/s per $100

M2 Max (32GB)21 GB$1,7992.5 tok/s per $100

M1 Max (32GB)21 GB$1,4993.0 tok/s per $100

M2 Pro (32GB)21 GB$1,4991.9 tok/s per $100

Neighbours in memory rather than in price: memory decides whether a card can do the job at all, so two cards of the same size at different prices is the comparison you are making. Ordered by memory, then bandwidth — not by the value column, which is worked out from bandwidth and price alone and therefore rewards a cheap card whatever its software stack does to that bandwidth in practice. Read it as one input, not as a ranking.

▸ DEVICE UNDER TEST

Apple M2 Max (32GB) — 32 GB unified, 21.3 GB usable.

▸ APPLE M2 MAX (32GB) SPEC

BRAND: Apple
UNIFIED MEMORY: 32 GB
USABLE BY A MODEL: 21.3 GB
BANDWIDTH: 400 GB/s
FP16 COMPUTE: 13.6 TFLOPS
FP32 COMPUTE: 13.6 TFLOPS
TDP: 60 W
ARCHITECTURE: M2 Max
MSRP: $1799

▸ AI CAPABILITY

279/ 449 models @ Q4

With 21.3 GB of its 32 GB reaching a model and 400 GB/s bandwidth, this machine handles models up to 27.2B parameters.

Speed ≈ bandwidth / model_size × efficiency. A 7B model at Q4 runs at ~46 tok/s.

RENT IT — LIVE PRICES

Checking what the clouds are charging…

§ 01TOP MODELS FOR APPLE M2 MAX (32GB)

279 FIT · SHOWING 20

MODEL	SIZE	VRAM Q4	TOK/S	AVG
gemma-2-27b	27.2B	17.1 GB	13	34.6
Gemma 4 26B A4B	26B	16.4 GB	89	47.9
Aria 25B A3.9B	25.3B	16.0 GB	91	64.8
Mistral-Small-24B	24B	15.2 GB	15	25.0
Mistral-Small-3.1-24B	24B	15.2 GB	15	28.8
Magistral Small 24B	24B	15.2 GB	15	47.0
Devstral Small 2 24B	24B	15.2 GB	15	33.4
Mistral-Small-3.2-24B	24B	15.2 GB	15	44.4
LFM2 24B A2B	24B	15.2 GB	178	19.1
Devstral Small 22B	23.57B	14.9 GB	15	35.5
Codestral 22B	22.2B	14.1 GB	16	50.1
Mistral Small 22B	22.2B	14.1 GB	16	35.2
SOLAR-Pro 22B	22.1B	14.0 GB	16	44.2
ERNIE 4.5 21B A3B	21.95B	13.9 GB	119	—
GPT-OSS 20B	21B	13.3 GB	99	52.9
Reka Flash 3	21B	13.3 GB	17	36.2
Reka Flash 3.1	21B	13.3 GB	17	33.4
InternLM2 20B	19.8B	12.6 GB	18	45.1
InternLM2.5 20B	19.8B	12.6 GB	18	50.9
Ling-lite 16.8B	16.8B	10.8 GB	148	—