▸ APPLE· M1 ULTRA

Apple M1 Ultra (64GB)

Running LLMs on the Apple M1 Ultra (64GB) — the long read: which models fit at which quantisation, and the settings worth changing. · Or what else $2,499 buys

USABLE MEMORY

48 GB

FLAGSHIP

BANDWIDTH

800

GB/S

MODELS Q4

345/449

77%

7B Q4 SPEED

~102

BLAZING

▸ MODEL COVERAGE @ Q477% OF ALL

▸ ESTIMATED SPEED· BY MODEL SIZE @ Q4

Average speeds at Q4 quantization. Actual performance varies by model architecture and context length.

~237

TOK/S

~102

TOK/S

14B

~51

TOK/S

32B

~22

TOK/S

70B

~10

TOK/S

▸ MEASURED RIG REPORTS

We rent the machine and time every model on it: decode, VRAM peak, concurrency, watts and cost per million tokens. Yours may already be one of them — and two are free to read in full.

SEE THE REPORTS →

▸ SPECIFICATIONS

USABLE MEMORY

48 GB of 64

BANDWIDTH

800 GB/s

FP16 COMPUTE

21 TFLOPS

TDP

100W

MEMORY

Unified

ARCHITECTURE

M1 Ultra

MSRP

$2,499

297

FAST MODELS · >30 TOK/S

Real-time chat speed

345

USABLE · >10 TOK/S

Comfortable for all tasks

345

TOTAL COMPATIBLE

Fit in usable memory at Q4

▸ DON’T WANT TO BUY?

Test M1 Ultra (64GB) (or anything bigger) without committing. Pay by the second, cancel anytime.

Rent on Vast.ai →Or RunPod →

Spin up in ~60s. Pay by the second. Cancel anytime.

Some links are affiliate links — we may earn a small commission at no extra cost to you. This helps keep FitMyLLM free and independent.

▸ COMPATIBLE MODELS· 345

Falcon-H1R Tiny 90M0.09B

FALCON·256K CTX· CHAT· REASONING

nomic-embed-text-v1.5 100M0.14B

EMBEDDING·8K CTX· CHAT

SMOLLM·8K CTX· CHAT· VISION

Snowflake Arctic Embed M v2.00.305B

EMBEDDING·8K CTX· EMBEDDING· MULTILINGUAL

bge-large-en-v1.5 335M0.335B

EMBEDDING·1K CTX· CHAT

mxbai-embed-large-v10.335B

EMBEDDING·1K CTX· EMBEDDING

Snowflake Arctic Embed L0.335B

EMBEDDING·1K CTX· EMBEDDING

LFM·125K CTX· CHAT· TOOL_USE

GPT-2 Medium 345M0.38B

SMOLLM·8K CTX· CHAT· VISION

FALCON·128K CTX· CHAT

EMBEDDING·8K CTX· EMBEDDING

Snowflake Arctic Embed L v2.00.568B

EMBEDDING·8K CTX· EMBEDDING· MULTILINGUAL

Qwen3-Embedding 0.6B0.6B

EMBEDDING·32K CTX· EMBEDDING· MULTILINGUAL

Falcon-H1R Tiny 0.6B0.6B

FALCON·32K CTX· CHAT· REASONING

Falcon Perception 0.6B0.6B

FALCON·4K CTX· VISION

LFM·125K CTX· CHAT· TOOL_USE

QWEN·32K CTX· CHAT· REASONING

GPT-2 Large 774M0.81B

QWEN·256K CTX· CHAT· CODING· MULTILINGUAL

OTHER·32K CTX· CHAT· VISION

MINICPM·128K CTX· CHAT· REASONING· MULTILINGUAL

LFM2.5-1.2B-Thinking1.2B

LFM·122K CTX· CHAT· REASONING· TOOL_USE

LFM·125K CTX· CHAT· TOOL_USE· MULTILINGUAL

OTHER·256K CTX· CHAT· VISION

DeepSeek Coder 1.3B1.35B

DEEPSEEK·16K CTX· CODING

PHI·2K CTX· CHAT· CODING

LFM·125K CTX· CHAT· TOOL_USE· MULTILINGUAL

▸ NEXT STEP

Get personalized recommendations.

See ranked models with benchmark scores, run commands, and precise speed estimates for your Apple M1 Ultra (64GB).

▸Find models for Apple M1 Ultra (64GB)Compare with other GPUs

WHAT THIS CARD IS WORTH

M1 Ultra (64GB) holds 345 of the models in our catalogue and is, in practice, a IQ4_XS card — the largest it takes is DeepSeek R1 Distill Llama 70B at IQ4_XS.

TOKENS/SEC PER $100

2.9

8B at Q4_K_M, so cards compare like for like

USABLE MEMORY PER $100

1.92 GB

what memory costs on this card

THE BIGGEST IT TAKES

DeepSeek R1 Distill Llama 70B70.6B · IQ4_XS43.1 GB8 tok/sEST

Llama 3.3 70B70.6B · IQ4_XS43.1 GB8 tok/sEST

Llama 3.1 70B70.6B · IQ4_XS43.1 GB8 tok/sEST

Llama 3 70B70.6B · IQ4_XS43.1 GB8 tok/sEST

Llama-3.1-Nemotron-70B70.6B · IQ4_XS43.1 GB8 tok/sEST

Cogito 70B70B · IQ4_XS42.8 GB8 tok/sEST

Llama 2 70B70B · IQ4_XS42.8 GB8 tok/sEST

CodeLlama 70B70B · IQ4_XS42.8 GB8 tok/sEST

AGAINST CARDS OF SIMILAR MEMORY

H100 SXM5 64 GB64 GB$25,0000.2 tok/s per $100

Radeon Instinct MI20064 GB$10,0001.8 tok/s per $100

Radeon Instinct MI21064 GB$8,0002.2 tok/s per $100

M1 Ultra (64GB)48 GB$2,4992.9 tok/s per $100

M2 Ultra (64GB)48 GB$2,9992.4 tok/s per $100

Neighbours in memory rather than in price: memory decides whether a card can do the job at all, so two cards of the same size at different prices is the comparison you are making. Ordered by memory, then bandwidth — not by the value column, which is worked out from bandwidth and price alone and therefore rewards a cheap card whatever its software stack does to that bandwidth in practice. Read it as one input, not as a ranking.

▸ DEVICE UNDER TEST

Apple M1 Ultra (64GB) — 64 GB unified, 48 GB usable.

▸ APPLE M1 ULTRA (64GB) SPEC

BRAND: Apple
UNIFIED MEMORY: 64 GB
USABLE BY A MODEL: 48 GB
BANDWIDTH: 800 GB/s
FP16 COMPUTE: 21 TFLOPS
FP32 COMPUTE: 21 TFLOPS
TDP: 100 W
ARCHITECTURE: M1 Ultra
MSRP: $2499

▸ AI CAPABILITY

345/ 449 models @ Q4

With 48 GB of its 64 GB reaching a model and 800 GB/s bandwidth, this machine handles models up to 65.2B parameters.

Speed ≈ bandwidth / model_size × efficiency. A 7B model at Q4 runs at ~91 tok/s.

RENT IT — LIVE PRICES

Checking what the clouds are charging…

§ 01TOP MODELS FOR APPLE M1 ULTRA (64GB)

345 FIT · SHOWING 20

MODEL	SIZE	VRAM Q4	TOK/S	AVG
LLaMA 1 65B	65.2B	40.3 GB	11	42.6
Jamba 2 Mini	52B	32.3 GB	59	9.2
Jamba 1.5 Mini 52B	51.6B	32.0 GB	59	24.2
Kimi-Linear-48B-A3B	48B	29.8 GB	237	26.6
Nemotron-H 47B	47B	29.2 GB	15	84.6
Mixtral-8x7B	46.7B	29.0 GB	55	18.8
Nous-Hermes-2-Mixtral-8x7B-DPO	46.7B	29.0 GB	55	27.4
Dolphin 2.6 Mixtral 8x7B	46.7B	29.0 GB	55	23.8
Phi-3.5 MoE 42B	41.9B	26.1 GB	108	56.7
Falcon 40B	40B	24.9 GB	18	20.9
InternVL3 38B	38B	23.7 GB	19	78.9
Seed-OSS 36B Instruct	36B	22.5 GB	20	54.4
c4ai-command-r-v01 35B	35B	21.9 GB	20	27.5
Qwen 3.5 35B A3B	35B	21.9 GB	237	53.3
Qwen 3.6 35B A3B	35B	21.9 GB	237	53.9
Nous Capybara 34B	34.4B	21.5 GB	21	42.0
Yi-1.5 34B	34.4B	21.5 GB	21	45.3
Falcon-H1 34B	34B	21.3 GB	21	66.1
CodeLlama 34B	34B	21.3 GB	21	25.4
Nous Hermes 2 34B	34B	21.3 GB	21	47.0