▸ NVIDIA· FERMI 2.0

NVIDIA GeForce GTX 560 OEM

VRAM

1 GB

BUDGET

BANDWIDTH

128.3

GB/S

MODELS Q4

18/331

5%

7B Q4 SPEED

~15

GOOD

▸ MODEL COVERAGE @ Q45% OF ALL

▸ ESTIMATED SPEED· BY MODEL SIZE @ Q4

Average speeds at Q4 quantization. Actual performance varies by model architecture and context length.

3B

—

1.7GB NEEDED

7B

—

3.9GB NEEDED

14B

—

7.9GB NEEDED

32B

—

18.0GB NEEDED

70B

—

39.4GB NEEDED

▸ SPECIFICATIONS

VRAM

1 GB

BANDWIDTH

128.3 GB/s

FP16 COMPUTE

0.8 TFLOPS

TDP

150W

MEMORY

GDDR5

ARCHITECTURE

Fermi 2.0

CUDA CORES

384

PCIE

Gen 2 x16

18

FAST MODELS · >30 TOK/S

Real-time chat speed

18

USABLE · >10 TOK/S

Comfortable for all tasks

18

TOTAL COMPATIBLE

Fit in VRAM at Q4

▸ DON’T WANT TO BUY?

Test GeForce GTX 560 OEM (or anything bigger) without committing. Pay by the second, cancel anytime.

Rent on RunPod →Or Vast.ai →

Spin up in ~60s. Pay by the second. Cancel anytime.

Some links are affiliate links — we may earn a small commission at no extra cost to you. This helps keep FitMyLLM free and independent.

▸ COMPATIBLE MODELS· 18

nomic-embed-text-v1.5 100M0.1B

EMBEDDING·8K CTX· CHAT

TOK/S · 44% VRAM

GPT-2 124M0.124B

GPT2·1K CTX· CHAT

TOK/S · 45% VRAM

SmolLM2 135M0.135B

SMOLLM·2K CTX· CHAT

TOK/S · 46% VRAM

bge-large-en-v1.5 335M0.335B

EMBEDDING·1K CTX· CHAT

TOK/S · 55% VRAM

mxbai-embed-large-v10.335B

EMBEDDING·1K CTX· EMBEDDING

TOK/S · 55% VRAM

Snowflake Arctic Embed L0.335B

EMBEDDING·1K CTX· EMBEDDING

TOK/S · 55% VRAM

GPT-2 Medium 345M0.345B

GPT2·1K CTX· CHAT

TOK/S · 56% VRAM

SmolLM2 360M0.36B

SMOLLM·8K CTX· CHAT

TOK/S · 57% VRAM

Falcon-H1 0.5B0.5B

FALCON·128K CTX· CHAT

TOK/S · 64% VRAM

Qwen 1.5 0.5B0.5B

QWEN·32K CTX· CHAT

TOK/S · 64% VRAM

Qwen 2.5 0.5B0.5B

QWEN·32K CTX· CHAT

TOK/S · 64% VRAM

EMBEDDING·8K CTX· EMBEDDING

TOK/S · 67% VRAM

QWEN·32K CTX· CHAT· REASONING

TOK/S · 68% VRAM

GPT-2 Large 774M0.774B

GPT2·1K CTX· CHAT

TOK/S · 77% VRAM

Qwen 3.5 0.8B0.8B

QWEN·256K CTX· CHAT· CODING· MULTILINGUAL

TOK/S · 78% VRAM

Qwen3.5-0.8B0.9B

QWEN·256K CTX· CHAT

TOK/S · 83% VRAM

FALCON·32K CTX· CHAT

TOK/S · 88% VRAM

INTERNLM·32K CTX· CHAT

TOK/S · 88% VRAM

▸ NEXT STEP

Get personalized recommendations.

See ranked models with benchmark scores, run commands, and precise speed estimates for your GeForce GTX 560 OEM.

▸Find models for GeForce GTX 560 OEM Compare with other GPUs

▸ DEVICE UNDER TEST

NVIDIA GeForce GTX 560 OEM — 1 GB VRAM.

▸ GEFORCE GTX 560 OEM SPEC

BRAND: NVIDIA
VRAM: 1 GB GDDR5
BANDWIDTH: 128.3 GB/s
FP16 COMPUTE: 0.8 TFLOPS
FP32 COMPUTE: 0.8 TFLOPS
CUDA CORES: 384
TDP: 150 W
ARCHITECTURE: Fermi 2.0

▸ AI CAPABILITY

18/ 331 models @ Q4

With 1 GB VRAM and 128.3 GB/s bandwidth, this GPU handles models up to 1B parameters.

Speed ≈ bandwidth / model_size × efficiency. A 7B model at Q4 runs at ~15 tok/s.

§ 01TOP MODELS FOR GEFORCE GTX 560 OEM

18 FIT · SHOWING 18

MODEL	SIZE	VRAM Q4	TOK/S	AVG
Falcon3-1B	1B	1.1 GB	103	42.0
InternLM2 1B	1B	1.1 GB	103	—
Qwen3.5-0.8B	0.9B	1.0 GB	114	20.5
Qwen 3.5 0.8B	0.8B	1.0 GB	128	23.4
GPT-2 Large 774M	0.774B	1.0 GB	133	5.6
Qwen3 0.6B	0.6B	0.9 GB	171	19.1
BGE-M3	0.568B	0.8 GB	181	63.0
Falcon-H1 0.5B	0.5B	0.8 GB	205	41.7
Qwen 1.5 0.5B	0.5B	0.8 GB	205	9.9
Qwen 2.5 0.5B	0.5B	0.8 GB	205	19.4
SmolLM2 360M	0.36B	0.7 GB	285	8.2
GPT-2 Medium 345M	0.345B	0.7 GB	298	5.9
bge-large-en-v1.5 335M	0.335B	0.7 GB	306	62.3
mxbai-embed-large-v1	0.335B	0.7 GB	306	64.7
Snowflake Arctic Embed L	0.335B	0.7 GB	306	56.0
SmolLM2 135M	0.135B	0.6 GB	760	7.0
GPT-2 124M	0.124B	0.6 GB	828	6.5
nomic-embed-text-v1.5 100M	0.1B	0.5 GB	1026	62.3