WHAT THIS CARD IS WORTH
CMP 30HX holds 130 of the models in our catalogue and is, in practice, a Q4_K_M card — the largest it takes is Falcon-H1 7B at Q4_K_M.
TOKENS/SEC PER $100
—
8B at Q4_K_M, so cards compare like for like
VRAM PER $100
—
what memory costs on this card
THE BIGGEST IT TAKES
AGAINST CARDS OF SIMILAR MEMORY
CMP 30HX6 GB——
Neighbours in memory rather than in price: memory decides whether a card can do the job at all, so two cards of the same size at different prices is the comparison you are making. Ordered by memory, then bandwidth — not by the value column, which is worked out from bandwidth and price alone and therefore rewards a cheap card whatever its software stack does to that bandwidth in practice. Read it as one input, not as a ranking.
▸ DEVICE UNDER TEST
NVIDIA CMP 30HX — 6 GB VRAM.
▸ CMP 30HX SPEC
- BRAND
- NVIDIA
- VRAM
- 6 GB GDDR6
- BANDWIDTH
- 336 GB/s
- FP16 COMPUTE
- 10.1 TFLOPS
- FP32 COMPUTE
- 5 TFLOPS
- CUDA CORES
- 1,408
- TDP
- 125 W
- ARCHITECTURE
- Turing
▸ AI CAPABILITY
130/ 449 models @ Q4
With 6 GB VRAM and 336 GB/s bandwidth, this GPU handles models up to 7B parameters.
Speed ≈ bandwidth / model_size × efficiency. A 7B model at Q4 runs at ~38 tok/s.
RENT IT — LIVE PRICES
Checking what the clouds are charging…
§ 01TOP MODELS FOR CMP 30HX
130 FIT · SHOWING 20| MODEL | SIZE | VRAM Q4 | TOK/S | AVG |
|---|---|---|---|---|
| Alpaca 7B | 7B | 4.8 GB | 38 | 27.7 |
| Baichuan2 7B | 7B | 4.8 GB | 38 | 21.5 |
| Vicuna 7B | 7B | 4.8 GB | 38 | 22.0 |
| MPT-7B | 7B | 4.8 GB | 38 | 7.8 |
| Orca 2 7B | 7B | 4.8 GB | 38 | 26.1 |
| WizardLM 2 7B | 7B | 4.8 GB | 38 | 26.1 |
| StarCoder2 7B | 7B | 4.8 GB | 38 | 17.0 |
| WizardCoder Python 7B | 7B | 4.8 GB | 38 | 53.7 |
| WizardLM 7B | 7B | 4.8 GB | 38 | 15.5 |
| OLMo 3.1 RLZero 7B Code | 7B | 4.8 GB | 38 | 21.8 |
| OLMo 3.1 RLZero 7B Math | 7B | 4.8 GB | 38 | 21.8 |
| Dolly v2 7B | 6.9B | 4.7 GB | 39 | 7.0 |
| granite-4.0-h-tiny 6.9B | 6.9B | 4.7 GB | 179 | 49.2 |
| Llama 2 7B | 6.74B | 4.6 GB | 40 | 21.1 |
| CodeLlama 7B | 6.74B | 4.6 GB | 40 | 28.1 |
| LLaMA 1 7B | 6.74B | 4.6 GB | 40 | 30.8 |
| DeepSeek Coder 6.7B | 6.7B | 4.6 GB | 40 | 23.6 |
| OPT 6.7B | 6.7B | 4.6 GB | 40 | 18.5 |
| ChatGLM2 6B | 6.24B | 4.3 GB | 43 | 20.7 |
| ChatGLM3 6B | 6.24B | 4.3 GB | 43 | 42.7 |