Google/Dense

TranslateGemma 12B

Name: TranslateGemma 12B
Author: Google

TranslateGemma 12B — stronger translation model with vision support.

chatmultilingualvision

13.19B

Parameters

128K

Context length

Benchmarks

Quantizations

397K

HF downloads

Architecture

Dense

Released

2026-01-13

Layers

KV Heads

Head Dim

256

Family

gemma

Quantization Options

Context length:

Quant	Bits	VRAM @ 16K	Quality
Q3_K_M	4	11.6 GB 7.1 + 4.5 KV	low
Q3_K_L	4.3	12.1 GB 7.6 + 4.5 KV	moderate
IQ4_XS	4.46	12.3 GB 7.8 + 4.5 KV	moderate
Q4_K_S	4.67	12.7 GB 8.2 + 4.5 KV	moderate
Q4_K_M	4.89	13.1 GB 8.6 + 4.5 KV	good
Q5_K_S	5.57	14.2 GB 9.7 + 4.5 KV	good
Q5_K_M	5.7	14.4 GB 9.9 + 4.5 KV	good
Q6_K	6.56	15.8 GB 11.3 + 4.5 KV	excellent
Q8_0	8.5	19.0 GB 14.5 + 4.5 KV	lossless
FP16	16	31.4 GB 26.9 + 4.5 KV	lossless

Select your GPU above to see speed estimates and compatibility for each quantization.

Deploying for a team or in production? Size GPUs, cost & scaling in Enterprise →

▸ READY TO RUN THIS?RENT BY THE HOUR

RENT A GPU AND RUN TRANSLATEGEMMA 12B NOW

Rent on Vast.ai →Or RunPod →

Spin up an A100 / H100 / 4090 in ~60s. Pay by the second. Cancel anytime.

Community Ratings

Loading ratings...

Benchmarks (6)

IFEval80.5

BBH44.2

MMLU-PRO37.4

MATH23.3

GPQA12.8

MUSR12.2

Run this model

▸Easiest way to get started·Beginners

DOCS ↗

curl -fsSL https://ollama.com/install.sh | sh

$ollama run translategemma:12b-it-q4_K_M

Downloads and runs automatically. Add --verbose for speed stats.

▸ SETUP GUIDE

Auto-setup with fitmyllm CLI

Detects your GPU, recommends the best model, downloads it, and starts chatting — zero config. Benchmarks your speed and contributes anonymous data to improve predictions.

pip install fitmyllmthen run fitmyllmLearn more

Auto-detect GPULive tok/s in chatSpeed benchmarks9 inference engines

HuggingFace Ollama Library GGUF Downloads Build Hardware

GPUs that can run this model

At Q4_K_M quantization. Sorted by minimum VRAM.

NVIDIA RTX 3080 10GB

10 GB VRAM • 760 GB/s

NVIDIA

$429

Amazon Newegg eBay PCPartPicker Rent on RunPod Rent on Vast.ai

Intel Arc B570

10 GB VRAM • 456 GB/s

INTEL

$219

Amazon Newegg eBay PCPartPicker Rent on RunPod Rent on Vast.ai

NVIDIA GeForce RTX 3080

10 GB VRAM • 760 GB/s

NVIDIA

$699

Amazon Newegg eBay PCPartPicker Rent on RunPod Rent on Vast.ai

AMD Radeon RX 6700

10 GB VRAM • 320 GB/s

AMD

$299

Amazon Newegg eBay PCPartPicker Rent on RunPod Rent on Vast.ai

AMD Radeon RX 6700M

10 GB VRAM • 320 GB/s

AMD

Amazon Newegg eBay PCPartPicker Rent on RunPod Rent on Vast.ai

AMD Radeon RX 6750 GRE 10 GB

10 GB VRAM • 320 GB/s

AMD

$229

Amazon Newegg eBay PCPartPicker Rent on RunPod Rent on Vast.ai

NVIDIA P102-101

10 GB VRAM • 320 GB/s

NVIDIA

Amazon Newegg eBay PCPartPicker Rent on RunPod Rent on Vast.ai

AMD Xbox Series X GPU

10 GB VRAM • 560 GB/s

AMD

Amazon Newegg eBay PCPartPicker Rent on RunPod Rent on Vast.ai

NVIDIA CMP 170HX 10 GB

10 GB VRAM • 1560 GB/s

NVIDIA

NVIDIA CMP 50HX

10 GB VRAM • 560 GB/s

NVIDIA

NVIDIA CMP 90HX

10 GB VRAM • 760 GB/s

NVIDIA

AMD Xbox Series X 6nm GPU

10 GB VRAM • 560 GB/s

AMD

Amazon Newegg eBay PCPartPicker Rent on RunPod Rent on Vast.ai

NVIDIA RTX 2080 Ti

11 GB VRAM • 616 GB/s

NVIDIA

$350

Amazon Newegg eBay PCPartPicker Rent on RunPod Rent on Vast.ai

NVIDIA GTX 1080 Ti

11 GB VRAM • 484 GB/s

NVIDIA

$200

Amazon Newegg eBay PCPartPicker Rent on RunPod Rent on Vast.ai

NVIDIA GeForce GTX 1080 Ti

11 GB VRAM • 484 GB/s

NVIDIA

Amazon Newegg eBay PCPartPicker Rent on RunPod Rent on Vast.ai

NVIDIA GeForce RTX 2080 Ti

11 GB VRAM • 616 GB/s

NVIDIA

$225

Amazon Newegg eBay PCPartPicker Rent on RunPod Rent on Vast.ai

NVIDIA RTX 5070

12 GB VRAM • 672 GB/s

NVIDIA

$549

Amazon Newegg eBay PCPartPicker Rent on RunPod Rent on Vast.ai

NVIDIA RTX 4070 Ti

12 GB VRAM • 504 GB/s

NVIDIA

$799

Amazon Newegg eBay PCPartPicker Rent on RunPod Rent on Vast.ai

NVIDIA RTX 4070 SUPER

12 GB VRAM • 504 GB/s

NVIDIA

$599

Amazon Newegg eBay PCPartPicker Rent on RunPod Rent on Vast.ai

NVIDIA RTX 4070

12 GB VRAM • 504 GB/s

NVIDIA

$549

Amazon Newegg eBay PCPartPicker Rent on RunPod Rent on Vast.ai

NVIDIA RTX 3080 Ti

12 GB VRAM • 912 GB/s

NVIDIA

$550

Amazon Newegg eBay PCPartPicker Rent on RunPod Rent on Vast.ai

NVIDIA RTX 3080 12GB

12 GB VRAM • 912 GB/s

NVIDIA

$599

Amazon Newegg eBay PCPartPicker Rent on RunPod Rent on Vast.ai

NVIDIA RTX 3060 12GB

12 GB VRAM • 360 GB/s

NVIDIA

$329

Amazon Newegg eBay PCPartPicker Rent on RunPod Rent on Vast.ai

AMD RX 7700 XT

12 GB VRAM • 432 GB/s

AMD

$449

Amazon Newegg eBay PCPartPicker Rent on RunPod Rent on Vast.ai

AMD RX 6700 XT

12 GB VRAM • 384 GB/s

AMD

$344

Amazon Newegg eBay PCPartPicker Rent on RunPod Rent on Vast.ai

AMD RX 6750 XT

12 GB VRAM • 432 GB/s

AMD

$299

Amazon Newegg eBay PCPartPicker Rent on RunPod Rent on Vast.ai

Intel Arc B580

12 GB VRAM • 456 GB/s

INTEL

$249

Amazon Newegg eBay PCPartPicker Rent on RunPod Rent on Vast.ai

NVIDIA Tesla K40c

12 GB VRAM • 288 GB/s

NVIDIA

NVIDIA Tesla K40d

12 GB VRAM • 288 GB/s

NVIDIA

NVIDIA Tesla K40m

12 GB VRAM • 288 GB/s

NVIDIA

Find the best GPU for TranslateGemma 12B

Build Hardware for TranslateGemma 12B

Model Card

View on HuggingFace

TranslateGemma 12B — stronger translation model with vision support.

QUANT	BPW	VRAM	QUALITY
Q3_K_M	4	7.1 GB	88%
Q3_K_L	4.3	7.6 GB	90%
IQ4_XS	4.46	7.8 GB	92%
Q4_K_S	4.67	8.2 GB	93%
Q4_K_M	4.89	8.6 GB	94%
Q5_K_S	5.57	9.7 GB	96%
Q5_K_M	5.7	9.9 GB	96%
Q6_K	6.56	11.3 GB	97%
Q8_0	8.5	14.5 GB	100%
FP16	16	26.9 GB	100%

TranslateGemma 12B

Quantization Options

Community Ratings

Benchmarks (6)

Run this model

Auto-setup with fitmyllm CLI

GPUs that can run this model

Model Card

TranslateGemma 12B — 13.19B Dense.