Choose one memory pool and leave space for the runtime. Compare models that fit your weight budget.
11.2 GB weight budget · 84 candidates · 12 with this benchmark
Results check weight size only. Backend support and actual runtime memory must also be checked. For system RAM, these are CPU-inference candidates; integrated-GPU allocation is not verified.
MMLU-Pro · GB = 1 billion bytes. Published scores may use different settings or precision.
Josev-2B · 2.045 GB · Q8_0 · 1.91B · Get weightsConfirm model architecture and quantization support in your runner.
Empero Qwen3.8 2B · 1.312 GB · Q4_K_M · 2.27B · Get weightsConfirm model architecture and quantization support in your runner.
Index Translate 2B · 1.312 GB · Q4_K_M · 2.27B · Get weightsTranslation specialist, not a general chat ranking. Apache-2.0 licensed. The official llama.cpp recipe uses the chat template with thinking disabled, temperature 0 and the target-language prompt. This 1.312 GB Q4_K_M file is text-capable by itself; image input needs the separate compatible projector. Runtime, KV cache and long contexts need memory beyond the weight file. The recorded FLORES result is from the source checkpoint, not a Q4 speed or compatibility test.
ColGrep-Agent-2B · 1.561 GB · Q4_K_M · 2.52B · Get weightsConfirm model architecture and quantization support in your runner.
TwIL LM3 · 1.915 GB · Q4_K_M · 3.08B · Get weightsConfirm model architecture and quantization support in your runner.
RefinedToolCall v5 · 2.538 GB · Q6_K · 3.09B · Get weightsConfirm model architecture and quantization support in your runner.
Liquid AI d1-3B · 2.875 GB · Q8_0 · 3.12B · Get weightsDecision model, not a chat model. Use a llama.cpp build with /v1/systemone support. The selected Q8_0 file contains language weights; image input needs a compatible separate projector. Total parameters include the vision encoder. LFM Open License v1.0 has commercial-use conditions. The recorded score is not a Q8_0 compatibility or speed test.
webAI TwIL-LM3-Pro · 2.244 GB · Q4_K_M · 3.66B · Get weightsConfirm model architecture and quantization support in your runner.
Clary 2 Cyber Heavy · 2.497 GB · Q4_K_M · 4.02B · Get weightsConfirm model architecture and quantization support in your runner.
OpenDecider-small-td · 2.497 GB · Q4_K_M · 4.02B · Get weightsConfirm model architecture and quantization support in your runner.
Switchboard Router 4B · 4.280 GB · Q8_0 · 4.02B · Get weightsConfirm model architecture and quantization support in your runner.
Spark X2.5 4B · 2.600 GB · Q4_K_M · 4.11B · Get weightsConfirm model architecture and quantization support in your runner.
grug 3B · 2.575 GB · Q4_K_M · 4.17B · Get weightsConfirm model architecture and quantization support in your runner.
Nanbeige 4.2 3B · 2.684 GB · Q4_K_M · 4.17B · Get weightsConfirm model architecture and quantization support in your runner.
NeoHorse 1 4B · 2.709 GB · Q4_K_M · 4.21B · Get weightsConfirm model architecture and quantization support in your runner.
Afrique Qwen v2 · 2.709 GB · Q4_K_M · 4.21B · Get weightsConfirm model architecture and quantization support in your runner.
Quinto 0.1 4B · 4.482 GB · Q8_0 · 4.21B · Get weightsConfirm model architecture and quantization support in your runner.
Gmcoder 9B · 9.786 GB · Q8_0 · 8.95B · Get weightsConfirm model architecture and quantization support in your runner.
OpenMobile-2 9B · 5.629 GB · Q4_K_M · 8.95B · Get weightsConfirm model architecture and quantization support in your runner.
K2 Horizon 7B · 5.592 GB · Q4_K_M · 9.00B · Get weightsConfirm model architecture and quantization support in your runner.
Cloudflare Clef-flash 9B · 6.041 GB · Q4_K_M · 9.08B · Get weightsDecision model. llama.cpp uses /v1/systemone; text generation is unavailable. Image input requires current model support plus a compatible multimodal projector. See the Clef comparison for sources and checks.
Ornith-1.5-9B · 5.780 GB · Q4_K_M · 9.20B · Get weightsConfirm model architecture and quantization support in your runner.
RapidChat 9B · 5.629 GB · Q4_K_M · 9.41B · Get weightsConfirm model architecture and quantization support in your runner.
APUS Reflex 9B · 5.629 GB · Q4_K_M · 9.41B · Get weightsConfirm model architecture and quantization support in your runner.
Empero Qwen3.8 9B · 5.780 GB · Q4_K_M · 9.65B · Get weightsReasoning distillation, not an official Qwen 3.8 9B release. Use a recent llama.cpp build with Qwen3.5 / Gated DeltaNet support; older builds can fail to load it. Apache-2.0 licensed. The 5.780 GB Q4_K_M file is only the weight file: runtime, KV cache and long contexts need additional memory. The recorded MMLU and GSM8K results are from the source checkpoint, not Q4 speed or compatibility tests.
Index-Translate-9B · 5.780 GB · Q4_K_M · 9.65B · Get weightsConfirm model architecture and quantization support in your runner.
Listing evidence: 2026-09-25. Amazon.com base price visible in an owner-supplied screenshot reviewed 25 Sep 2026; capture time not supplied. Dated reference, not a live quote. Excludes card signup offers, coupons, tax and shipping.
Listing evidence: 2026-10-03. Apple US launch price announced 22 September 2026: USD 1,699. Dated manufacturer reference, not an Amazon offer; tax and shipping may differ.
Listing evidence: 2026-09-24. GMKtec, EVO-X2 / 64GB / 1TB, recorded 22 Sep 2026; exact ASIN capacity identified 24 Sep. This is a dated reference, not a current Amazon price; tax, shipping and bundle contents may differ.
As an Amazon Associate I earn from qualifying purchases.
Model data: 14 October 2026. No device information is collected. Controls work in your browser; results use the same catalog as the main chart.
How recommendations are calculated
We compare one benchmark at a time. A Pareto choice has no other scored model with both an equal or smaller weight file and an equal or higher score, with at least one strict improvement. The first choice is the frontier point nearest the chart’s top-left corner, using the same rounded memory scale and 0–100 score scale as the main chart. Other frontier choices follow, then other scored models by score.
Score per GB is shown for context; it does not choose the champion. Changing the budget or dataset can change the result. Scores are published point estimates, often for the source checkpoint rather than the selected quantization. They do not establish statistically significant differences or equal evaluation conditions.
RAM, VRAM and unified memory
Use one memory pool. System RAM is used for CPU inference; a dedicated GPU has separate VRAM. Do not add RAM and VRAM as if they were one GPU pool. Partial CPU offload needs a supported backend and can change speed. Unified memory is shared by CPU, GPU and the operating system; software can limit how much the GPU can allocate.
Our initial weight budget reserves 30% of system RAM or unified memory, with a minimum of 2 GB. For VRAM it reserves 20%, with a minimum of 1 GB. These are adjustable planning assumptions, not measured requirements. Context cache, runtime buffers, other programs, multimodal files and concurrent users can need more. A file that passes the budget check is a candidate, not a confirmed hardware-compatible configuration.