▸ APPLE· M3 MAX

Apple M3 Max (36GB)

VRAM

36 GB

HIGH-END

BANDWIDTH

300

GB/S

MODELS Q4

261/331

79%

7B Q4 SPEED

~38

FAST

▸ MODEL COVERAGE @ Q479% OF ALL

▸ ESTIMATED SPEED· BY MODEL SIZE @ Q4

Average speeds at Q4 quantization. Actual performance varies by model architecture and context length.

3B

~89

TOK/S

7B

~38

TOK/S

14B

~19

TOK/S

32B

~8

TOK/S

70B

—

39.4GB NEEDED

▸ SPECIFICATIONS

VRAM

36 GB

BANDWIDTH

300 GB/s

FP16 COMPUTE

16.4 TFLOPS

TDP

60W

MEMORY

Unified

ARCHITECTURE

M3 Max

MSRP

$2,499

170

FAST MODELS · >30 TOK/S

Real-time chat speed

226

USABLE · >10 TOK/S

Comfortable for all tasks

261

TOTAL COMPATIBLE

Fit in VRAM at Q4

▸ DON’T WANT TO BUY?

Test M3 Max (36GB) (or anything bigger) without committing. Pay by the second, cancel anytime.

Rent on RunPod →Or Vast.ai →

Spin up in ~60s. Pay by the second. Cancel anytime.

Some links are affiliate links — we may earn a small commission at no extra cost to you. This helps keep FitMyLLM free and independent.

▸ COMPATIBLE MODELS· 261

nomic-embed-text-v1.5 100M0.1B

EMBEDDING·8K CTX· CHAT

TOK/S · 2% VRAM

GPT-2 124M0.124B

GPT2·1K CTX· CHAT

TOK/S · 2% VRAM

SmolLM2 135M0.135B

SMOLLM·2K CTX· CHAT

TOK/S · 2% VRAM

bge-large-en-v1.5 335M0.335B

EMBEDDING·1K CTX· CHAT

TOK/S · 2% VRAM

mxbai-embed-large-v10.335B

EMBEDDING·1K CTX· EMBEDDING

TOK/S · 2% VRAM

Snowflake Arctic Embed L0.335B

EMBEDDING·1K CTX· EMBEDDING

TOK/S · 2% VRAM

GPT-2 Medium 345M0.345B

GPT2·1K CTX· CHAT

TOK/S · 2% VRAM

SmolLM2 360M0.36B

SMOLLM·8K CTX· CHAT

TOK/S · 2% VRAM

Falcon-H1 0.5B0.5B

FALCON·128K CTX· CHAT

TOK/S · 2% VRAM

Qwen 1.5 0.5B0.5B

QWEN·32K CTX· CHAT

TOK/S · 2% VRAM

Qwen 2.5 0.5B0.5B

QWEN·32K CTX· CHAT

TOK/S · 2% VRAM

EMBEDDING·8K CTX· EMBEDDING

TOK/S · 2% VRAM

QWEN·32K CTX· CHAT· REASONING

TOK/S · 2% VRAM

GPT-2 Large 774M0.774B

GPT2·1K CTX· CHAT

TOK/S · 3% VRAM

Qwen 3.5 0.8B0.8B

QWEN·256K CTX· CHAT· CODING· MULTILINGUAL

TOK/S · 3% VRAM

Qwen3.5-0.8B0.9B

QWEN·256K CTX· CHAT

TOK/S · 3% VRAM

FALCON·32K CTX· CHAT

TOK/S · 3% VRAM

INTERNLM·32K CTX· CHAT

TOK/S · 3% VRAM

TinyLlama 1.1B1.1B

LLAMA·2K CTX· CHAT

TOK/S · 3% VRAM

LFM2.5-1.2B-Thinking1.2B

LFM·122K CTX· CHAT· REASONING· TOOL_USE

TOK/S · 3% VRAM

Llama-3.2-1B1.2B

LLAMA·4K CTX· CHAT

TOK/S · 3% VRAM

DeepSeek Coder 1.3B1.3B

DEEPSEEK·16K CTX· CODING

TOK/S · 4% VRAM

EXAONE-4.0-1.2B1.3B

EXAONE·64K CTX· CHAT

TOK/S · 4% VRAM

OPT·2K CTX· CHAT

TOK/S · 4% VRAM

PHI·2K CTX· CODING

TOK/S · 4% VRAM

Phi-1.5 1.3B1.3B

PHI·2K CTX· CHAT· CODING

TOK/S · 4% VRAM

granite-4.0-h-tiny 6.9B6.9BMoE

GRANITE·128K CTX· CHAT

TOK/S · 13% VRAM

Falcon-H1 1.5B1.5B

FALCON·128K CTX· CHAT· CODING

TOK/S · 4% VRAM

GPT-2 XL 1.5B1.5B

GPT2·1K CTX· CHAT

TOK/S · 4% VRAM

Qwen2.5-Coder-1.5B1.5B

QWEN·32K CTX· CHAT· TOOL_USE· CODING

TOK/S · 4% VRAM

Qwen2 Math 1.5B1.5B

QWEN·4K CTX· REASONING

TOK/S · 4% VRAM

Qwen 2.5 1.5B1.5B

QWEN·32K CTX· CHAT· CODING

TOK/S · 4% VRAM

Yi Coder 1.5B1.5B

YI·125K CTX· CODING

TOK/S · 4% VRAM

stablelm-2-1_6b1.6B

STABLELM·4K CTX· CHAT

TOK/S · 4% VRAM

QWEN·32K CTX· CHAT· REASONING

TOK/S · 4% VRAM

SmolLM2 1.7B1.71B

SMOLLM·8K CTX· CHAT

TOK/S · 4% VRAM

Qwen 1.5 1.8B1.8B

QWEN·32K CTX· CHAT

TOK/S · 4% VRAM

Moondream2 1.9B1.9B

OTHER·2K CTX· VISION· CHAT

TOK/S · 5% VRAM

GEMMA·8K CTX· CHAT

TOK/S · 5% VRAM

Granite 3.0 2B2B

GRANITE·128K CTX· CHAT· CODING

TOK/S · 5% VRAM

▸ NEXT STEP

Get personalized recommendations.

See ranked models with benchmark scores, run commands, and precise speed estimates for your Apple M3 Max (36GB).

▸Find models for Apple M3 Max (36GB)Compare with other GPUs

▸ DEVICE UNDER TEST

Apple M3 Max (36GB) — 36 GB VRAM.

▸ APPLE M3 MAX (36GB) SPEC

BRAND: Apple
VRAM: 36 GB Unified
BANDWIDTH: 300 GB/s
FP16 COMPUTE: 16.4 TFLOPS
FP32 COMPUTE: 16.4 TFLOPS
TDP: 60 W
ARCHITECTURE: M3 Max
MSRP: $2499

▸ AI CAPABILITY

261/ 331 models @ Q4

With 36 GB VRAM and 300 GB/s bandwidth, this GPU handles models up to 51.6B parameters.

Speed ≈ bandwidth / model_size × efficiency. A 7B model at Q4 runs at ~34 tok/s.

§ 01TOP MODELS FOR APPLE M3 MAX (36GB)

261 FIT · SHOWING 20

MODEL	SIZE	VRAM Q4	TOK/S	AVG
Jamba 1.5 Mini 52B	51.6B	32.0 GB	22	24.2
Kimi-Linear-48B-A3B	48B	29.8 GB	89	26.6
Nemotron-H 47B	47B	29.2 GB	6	84.6
Mixtral-8x7B	46.7B	29.0 GB	21	18.8
Nous-Hermes-2-Mixtral-8x7B-DPO	46.7B	29.0 GB	21	27.4
Dolphin 2.6 Mixtral 8x7B	46.7B	29.0 GB	21	23.8
Phi-3.5 MoE 42B	41.9B	26.1 GB	40	56.7
Falcon 40B	40B	24.9 GB	7	20.9
Qwen3.5-35B-A3B	36B	22.5 GB	7	48.5
c4ai-command-r-v01 35B	35B	21.9 GB	8	27.5
Qwen 3.5 35B A3B	35B	21.9 GB	89	53.3
Qwen 3.6 35B A3B	35B	21.9 GB	89	62.7
Nous Capybara 34B	34.4B	21.5 GB	8	42.0
Yi-1.5 34B	34.4B	21.5 GB	8	45.3
Falcon-H1 34B	34B	21.3 GB	8	66.1
CodeLlama 34B	34B	21.3 GB	8	25.4
Nous Hermes 2 34B	34B	21.3 GB	8	47.0
Phind CodeLlama 34B	34B	21.3 GB	8	68.1
LLaVA-1.6 Yi 34B	34B	21.3 GB	8	47.4
WizardCoder Python 34B	34B	21.3 GB	8	73.2