Local AI Stats.
Skip to content

LOCAL LLM MEMORY CHECK

What can my computer run?

Choose one memory pool and leave space for the runtime. Compare models that fit your weight budget.

11.2 GB weight budget · 84 candidates · 12 with this benchmark

Results check weight size only. Backend support and actual runtime memory must also be checked. For system RAM, these are CPU-inference candidates; integrated-GPU allocation is not verified.

MMLU-Pro · GB = 1 billion bytes. Published scores may use different settings or precision.
Model / quantizationWeightsParametersScore / 100Score / GBBudget leftSources
MiniCPM5 2BQ4_K_M · Pareto choice1.561 GB2.517B70.845.3469.639 GBGet weights
Score source
Qwen3.5-4BQ4_K_M · Pareto choice2.741 GB4.206B79.128.8598.459 GBGet weights
Score source
LFM2.5 230MQ4_K_M · Pareto choice0.153 GB0.23B20.25132.00211.047 GBGet weights
Score source
Qwen3.5-9BQ4_K_M · Pareto choice5.681 GB9.653B82.514.5235.519 GBGet weights
Score source
gemma-4-12B-itQ4_K_M7.122 GB11.96B77.210.844.078 GBGet weights
Score source
Granite 4.2 8BQ4_K_M5.348 GB8.792B74.0413.8455.852 GBGet weights
Score source
Gemma 4 E4BQ4_K_M4.977 GB7.996B69.413.9446.223 GBGet weights
Score source
Granite 4.2 3BQ4_K_M2.244 GB3.66B67.8430.2328.956 GBGet weights
Score source
LFM2.5 2.6BQ4_K_M1.674 GB2.697B65.238.9389.526 GBGet weights
Score source
Gemma 4 E2BQ4_K_M3.107 GB5.123B6019.3138.093 GBGet weights
Score source
Noema 2BQ8_02.012 GB1.882B51.125.3979.188 GBGet weights
Score source
Kernel Logic 1.5Q4_K_M4.683 GB7.616B388.1146.517 GBGet weights
Score source
72 more files fit this weight budget, without this benchmark
  • Vela Lumen v1.1 · 0.143 GB · F16 · 0.05B · Get weightsConfirm model architecture and quantization support in your runner.
  • PicoLM 80M · 0.180 GB · F16 · 0.09B · Get weightsConfirm model architecture and quantization support in your runner.
  • PicoLM v2 81M · 0.193 GB · F16 · 0.10B · Get weightsConfirm model architecture and quantization support in your runner.
  • PicoLM v2.1 81M · 0.193 GB · F16 · 0.10B · Get weightsConfirm model architecture and quantization support in your runner.
  • Udgam 384M Chat · 0.238 GB · Q4_K_M · 0.38B · Get weightsConfirm model architecture and quantization support in your runner.
  • Quill 1 Preview · 0.398 GB · Q4_K_M · 0.49B · Get weightsCode-completion model; not a general chat model.
  • Switchboard Router 0.5B v0.1 · 0.994 GB · F16 · 0.49B · Get weightsConfirm model architecture and quantization support in your runner.
  • Liquid AI d1-omni-600M · 0.407 GB · Q8_0 · 0.59B · Get weightsConfirm model architecture and quantization support in your runner.
  • d3-edge 0.6B · 0.806 GB · Q8_0 · 0.75B · Get weightsConfirm model architecture and quantization support in your runner.
  • Satella-RAG 0.8B · 0.593 GB · Q5_K_M · 0.77B · Get weightsConfirm model architecture and quantization support in your runner.
  • LightOnOCR-3 0.8B · 0.529 GB · Q4_K_M · 0.85B · Get weightsConfirm model architecture and quantization support in your runner.
  • Limite 1B - Violetto · 2.071 GB · BF16 · 1.00B · Get weightsBF16 Safetensors; custom code or vLLM plugin. Single-turn math specialist.
  • MiniCPM-V 4.7 1B · 0.672 GB · Q4_K_M · 1.01B · Get weightsConfirm model architecture and quantization support in your runner.
  • OneJev 1.5 0.8B · 0.672 GB · Q4_K_M · 1.01B · Get weightsConfirm model architecture and quantization support in your runner.
  • K2 Horizon 0.9B · 0.666 GB · Q4_K_M · 1.08B · Get weightsConfirm model architecture and quantization support in your runner.
  • Granite concision edit · 2.673 GB · F16 · 1.33B · Get weightsConfirm model architecture and quantization support in your runner.
  • Spark X2.5 1.7B · 1.107 GB · Q4_K_M · 1.71B · Get weightsConfirm model architecture and quantization support in your runner.
  • DFM Mimir · 1.913 GB · Q8_0 · 1.79B · Get weightsConfirm model architecture and quantization support in your runner.
  • Noema 1.5 2B · 1.274 GB · Q4_K_M · 1.88B · Get weightsConfirm model architecture and quantization support in your runner.
  • StartLux-Decision-v1-2B · 1.274 GB · Q4_K_M · 1.88B · Get weightsConfirm model architecture and quantization support in your runner.
  • Curious 2B · 1.215 GB · Q4_0 · 1.88B · Get weightsConfirm model architecture and quantization support in your runner.
  • Arm-optimized Qwen3.5-2B · 1.274 GB · Q4_K_M · 1.88B · Get weightsConfirm model architecture and quantization support in your runner.
  • Josev-2B · 2.045 GB · Q8_0 · 1.91B · Get weightsConfirm model architecture and quantization support in your runner.
  • Empero Qwen3.8 2B · 1.312 GB · Q4_K_M · 2.27B · Get weightsConfirm model architecture and quantization support in your runner.
  • Index Translate 2B · 1.312 GB · Q4_K_M · 2.27B · Get weightsTranslation specialist, not a general chat ranking. Apache-2.0 licensed. The official llama.cpp recipe uses the chat template with thinking disabled, temperature 0 and the target-language prompt. This 1.312 GB Q4_K_M file is text-capable by itself; image input needs the separate compatible projector. Runtime, KV cache and long contexts need memory beyond the weight file. The recorded FLORES result is from the source checkpoint, not a Q4 speed or compatibility test.
  • MiniCPM5 abliterated v2 · 1.561 GB · Q4_K_M · 2.52B · Get weightsConfirm model architecture and quantization support in your runner.
  • ColGrep-Agent-2B · 1.561 GB · Q4_K_M · 2.52B · Get weightsConfirm model architecture and quantization support in your runner.
  • TwIL LM3 · 1.915 GB · Q4_K_M · 3.08B · Get weightsConfirm model architecture and quantization support in your runner.
  • RefinedToolCall v5 · 2.538 GB · Q6_K · 3.09B · Get weightsConfirm model architecture and quantization support in your runner.
  • Liquid AI d1-3B · 2.875 GB · Q8_0 · 3.12B · Get weightsDecision model, not a chat model. Use a llama.cpp build with /v1/systemone support. The selected Q8_0 file contains language weights; image input needs a compatible separate projector. Total parameters include the vision encoder. LFM Open License v1.0 has commercial-use conditions. The recorded score is not a Q8_0 compatibility or speed test.
  • webAI TwIL-LM3-Pro · 2.244 GB · Q4_K_M · 3.66B · Get weightsConfirm model architecture and quantization support in your runner.
  • Clary 2 Cyber Heavy · 2.497 GB · Q4_K_M · 4.02B · Get weightsConfirm model architecture and quantization support in your runner.
  • OpenDecider-small-td · 2.497 GB · Q4_K_M · 4.02B · Get weightsConfirm model architecture and quantization support in your runner.
  • Switchboard Router 4B · 4.280 GB · Q8_0 · 4.02B · Get weightsConfirm model architecture and quantization support in your runner.
  • Spark X2.5 4B · 2.600 GB · Q4_K_M · 4.11B · Get weightsConfirm model architecture and quantization support in your runner.
  • grug 3B · 2.575 GB · Q4_K_M · 4.17B · Get weightsConfirm model architecture and quantization support in your runner.
  • Nanbeige 4.2 3B · 2.684 GB · Q4_K_M · 4.17B · Get weightsConfirm model architecture and quantization support in your runner.
  • NeoHorse 1 4B · 2.709 GB · Q4_K_M · 4.21B · Get weightsConfirm model architecture and quantization support in your runner.
  • Afrique Qwen v2 · 2.709 GB · Q4_K_M · 4.21B · Get weightsConfirm model architecture and quantization support in your runner.
  • Quinto 0.1 4B · 4.482 GB · Q8_0 · 4.21B · Get weightsConfirm model architecture and quantization support in your runner.
  • H2O-Lightning 4B Native · 4.482 GB · Q8_0 · 4.21B · Get weightsConfirm model architecture and quantization support in your runner.
  • APUS Reflex 4B · 2.709 GB · Q4_K_M · 4.21B · Get weightsConfirm model architecture and quantization support in your runner.
  • FrogNano-4B-2609 · 2.798 GB · Q4_K_M · 4.33B · Get weightsConfirm model architecture and quantization support in your runner.
  • Agents A1 4B · 2.709 GB · Q4_K_M · 4.54B · Get weightsConfirm model architecture and quantization support in your runner.
  • Empero Qwen3.8 4B · 2.783 GB · Q4_K_M · 4.66B · Get weightsConfirm model architecture and quantization support in your runner.
  • Wald-Q4B v2.1 · 2.709 GB · Q4_K_M · 4.66B · Get weightsConfirm model architecture and quantization support in your runner.
  • K2 Horizon 3.7B · 3.157 GB · Q4_K_M · 5.06B · Get weightsConfirm model architecture and quantization support in your runner.
  • Ling 3.0 tiny · 4.824 GB · Q4_K_M · 7.89B · Get weightsConfirm model architecture and quantization support in your runner.
  • Ai2 AstaBrief 8B · 5.028 GB · Q4_K_M · 8.19B · Get weightsConfirm model architecture and quantization support in your runner.
  • UltraCoder L3 · 5.156 GB · Q4_K_M · 8.47B · Get weightsConfirm model architecture and quantization support in your runner.
  • DuoNeural Hermes v3 · 5.156 GB · Q4_K_M · 8.47B · Get weightsConfirm model architecture and quantization support in your runner.
  • DuoNeural Hermes v2 · 5.156 GB · Q4_K_M · 8.47B · Get weightsConfirm model architecture and quantization support in your runner.
  • MiMo-V2.6-Distill-Qwen-9B · 5.841 GB · Q4_K_M · 8.95B · Get weightsConfirm model architecture and quantization support in your runner.
  • Qwythos-9B Claude Mythos 5 1M · 5.629 GB · Q4_K_M · 8.95B · Get weightsConfirm model architecture and quantization support in your runner.
  • Gmcoder 9B · 9.786 GB · Q8_0 · 8.95B · Get weightsConfirm model architecture and quantization support in your runner.
  • OpenMobile-2 9B · 5.629 GB · Q4_K_M · 8.95B · Get weightsConfirm model architecture and quantization support in your runner.
  • K2 Horizon 7B · 5.592 GB · Q4_K_M · 9.00B · Get weightsConfirm model architecture and quantization support in your runner.
  • Cloudflare Clef-flash 9B · 6.041 GB · Q4_K_M · 9.08B · Get weightsDecision model. llama.cpp uses /v1/systemone; text generation is unavailable. Image input requires current model support plus a compatible multimodal projector. See the Clef comparison for sources and checks.
  • Ornith-1.5-9B · 5.780 GB · Q4_K_M · 9.20B · Get weightsConfirm model architecture and quantization support in your runner.
  • RapidChat 9B · 5.629 GB · Q4_K_M · 9.41B · Get weightsConfirm model architecture and quantization support in your runner.
  • APUS Reflex 9B · 5.629 GB · Q4_K_M · 9.41B · Get weightsConfirm model architecture and quantization support in your runner.
  • Empero Qwen3.8 9B · 5.780 GB · Q4_K_M · 9.65B · Get weightsReasoning distillation, not an official Qwen 3.8 9B release. Use a recent llama.cpp build with Qwen3.5 / Gated DeltaNet support; older builds can fail to load it. Apache-2.0 licensed. The 5.780 GB Q4_K_M file is only the weight file: runtime, KV cache and long contexts need additional memory. The recorded MMLU and GSM8K results are from the source checkpoint, not Q4 speed or compatibility tests.
  • Index-Translate-9B · 5.780 GB · Q4_K_M · 9.65B · Get weightsConfirm model architecture and quantization support in your runner.
  • Mellum2.1 12B A2.5B Thinking · 8.071 GB · Q4_K_M · 12.15B · Get weightsConfirm model architecture and quantization support in your runner.
  • Mistral-Nemo-Instruct-2407 · 7.477 GB · Q4_K_M · 12.25B · Get weightsConfirm model architecture and quantization support in your runner.
  • Ternary Bonsai 2 27B · 5.947 GB · PTQ1_0 · 26.90B · Get weightsCustom Prism llama.cpp kernels required; check backend support.
  • Ternary Bonsai 27B · 7.165 GB · PQ2_0 · 26.90B · Get weightsCustom Prism llama.cpp kernels required; check backend support.
  • Bonsai 27B (1-bit) · 3.803 GB · Q1_0 · 26.90B · Get weightsCustom Prism llama.cpp kernels required; check backend support.
  • Qwen3.8-27B-GSQ-RCO-GGUF · 10.094 GB · IQ3_XXS · 26.90B · Get weightsConfirm model architecture and quantization support in your runner.
  • Ternary Bonsai 2 27B Abliterated (BoldingBuilds) · 5.947 GB · PTQ1_0 · 26.90B · Get weightsConfirm model architecture and quantization support in your runner.
  • Swift Bonsai 2 27B (PQ2_0) · 7.206 GB · PQ2_0 · 26.90B · Get weightsConfirm model architecture and quantization support in your runner.
  • Mitsuba-ComfyUI-27B · 5.998 GB · PTQ1_0 · 27.32B · Get weightsConfirm model architecture and quantization support in your runner.

Compare computers for MiniCPM5 2B

These configurations pass the same weight-size planning check. Software support and actual speed still need verification.

CPU inference

Glorlin Ryzen 7 6800H Mini PC

Ryzen 7 6800H, Radeon 680M, 16GB LPDDR5-6400, 512GB SSD

$469.99Dated reference · not a live offer

16 GB system RAM · CPU planning

The LPDDR5 memory is listed with a 16GB maximum; no RAM upgrade is assumed.

Check price on Amazon ↗Specifications & model limits
Listing and price evidence

Listing evidence: 2026-09-25. Amazon.com base price visible in an owner-supplied screenshot reviewed 25 Sep 2026; capture time not supplied. Dated reference, not a live quote. Excludes card signup offers, coupons, tax and shipping.

Apple unified memory

Apple Mac mini M5 Pro · 24GB

15-core CPU, 16-core GPU, 24GB unified memory, 512GB SSD

$1,699.00Dated reference · not a live offer

24 GB unified memory

Fixed 24GB memory and internal storage limit model size; no CUDA support; Amazon main-offer price and stock were not verified in this run.

Check price on Amazon ↗Specifications & model limits
Listing and price evidence

Listing evidence: 2026-10-03. Apple US launch price announced 22 September 2026: USD 1,699. Dated manufacturer reference, not an Amazon offer; tax and shipping may differ.

AMD unified memory

GMKtec EVO-X2

Ryzen AI Max+ 395, 64GB LPDDR5X-8000, 1TB PCIe 4.0 SSD

$2,199.99Dated reference · not a live offer

64 GB unified memory

Memory is soldered and shared with the operating system.

Check price on Amazon ↗Specifications & model limits
Listing and price evidence

Listing evidence: 2026-09-24. GMKtec, EVO-X2 / 64GB / 1TB, recorded 22 Sep 2026; exact ASIN capacity identified 24 Sep. This is a dated reference, not a current Amazon price; tax, shipping and bundle contents may differ.

As an Amazon Associate I earn from qualifying purchases.

Compare more computers for this model

Model data: 14 October 2026. No device information is collected. Controls work in your browser; results use the same catalog as the main chart.

How recommendations are calculated

We compare one benchmark at a time. A Pareto choice has no other scored model with both an equal or smaller weight file and an equal or higher score, with at least one strict improvement. The first choice is the frontier point nearest the chart’s top-left corner, using the same rounded memory scale and 0–100 score scale as the main chart. Other frontier choices follow, then other scored models by score.

Score per GB is shown for context; it does not choose the champion. Changing the budget or dataset can change the result. Scores are published point estimates, often for the source checkpoint rather than the selected quantization. They do not establish statistically significant differences or equal evaluation conditions.

RAM, VRAM and unified memory

Use one memory pool. System RAM is used for CPU inference; a dedicated GPU has separate VRAM. Do not add RAM and VRAM as if they were one GPU pool. Partial CPU offload needs a supported backend and can change speed. Unified memory is shared by CPU, GPU and the operating system; software can limit how much the GPU can allocate.

Our initial weight budget reserves 30% of system RAM or unified memory, with a minimum of 2 GB. For VRAM it reserves 20%, with a minimum of 1 GB. These are adjustable planning assumptions, not measured requirements. Context cache, runtime buffers, other programs, multimodal files and concurrent users can need more. A file that passes the budget check is a candidate, not a confirmed hardware-compatible configuration.

Check the model’s runtime and quantization support before downloading. See the Transformers cache documentation and llama.cpp backend documentation. GB uses decimal bytes; operating systems can report GiB instead.