Local AI Stats.
Skip to content

ThakiCloud · MODEL RECORD

ThakiCloud RAG-Gate-27B

ThakiCloud RAG-Gate-27B has 27.321 billion total parameters. The selected Q4_K_M GGUF file is 16.547 GB.

Data snapshot: . 1 published test in this catalog.

Model file and details

Provider
ThakiCloud
Total parameters
27,320,697,856
Exact file size
16,547,401,504 bytes
Quantization / precision
Q4_K_M
Weight repository
mradermacher/RAG-Gate-27B-GGUF
Original model repository
ThakiCloud/RAG-Gate-27B
Weight revision
848de16c1866e568b3317f18883acf41453b70e9
Model revision
3f008df4d711f1aca5014d6b5e59646a0eca9c7d
Runtime notes
Confirm model architecture and quantization support in your runner.
Recorded release date
2026-10-07
Date evidence
ThakiCloud published the merged BF16 RAG-Gate-27B checkpoint on 7 October 2026; this third-party static GGUF repository was created and completed on 8 October 2026.

RAG-Gate-27B.Q4_K_M.gguf

GGUF file and download on Hugging Face · Original model card

Published benchmark results

These scores were compiled from the linked sources. These published scores were not independently tested here. Different prompts, precision, thinking budgets and tools can change results.

RAG-Gate · blind action accuracy

93.8 / 100

Accuracy choosing Answer, Retrieve or Stop on a publisher-held blind set of 14,818 evidence-state items from 2,256 multi-hop questions. Specialist evidence-sufficiency test, not a general intelligence benchmark.

Benchmark efficiency: 5.669 published score points per GB of selected weights. This ratio is not an inference-speed measure; check the test settings to see whether the score covers the selected quantization.

Test settings: ThakiCloud publisher evaluation of the merged BF16 source checkpoint on a held-out test set of 14,818 evidence-state items covering 2,256 distinct MuSiQue-derived multi-hop questions. The model selects the first-token action Answer, Retrieve or Stop from label probabilities without sampling. The reported 95% confidence interval, bootstrapped over base questions with 10,000 resamples, is 93.2% to 94.4%.

Source-checkpoint result, not an independent evaluation and not a direct benchmark of the selected Q4_K_M file. The publisher reports 5.5% unsupported-answer and 7.1% over-refusal rates, but evaluation is English-only, in-domain, limited to one source domain and inputs up to 2,048 tokens. The 16.547 GB file excludes runtime, KV cache and context memory; it does not establish device compatibility or speed.

Read the RAG-Gate · blind action accuracy source

Memory and comparison limits

Context and version evidence: The repository and file name identify the selected model. Revision hashes are shown above when recorded. Tested context length, full hardware configuration and run date are not consistently recorded in this snapshot. Only settings explicitly stated in each benchmark record are known.

The 16.547 GB figure covers model weights in this file. It excludes the context cache, runtime, operating system and any separate multimodal files. It is not a measured RAM requirement or a token-generation speed.

Use the model ranking chart to compare one test at a time. Use the 8, 16 and 32 GB memory guide. Check hardware memory and bandwidth before choosing a model.

Need a computer for ThakiCloud RAG-Gate-27B?

These complete configurations pass the initial weight-size check for the selected 16.55 GB file. Allow extra memory for context and software. Check the model’s runtime notes and your inference software before buying.

CPU inference

GMKtec K15 · 32GB

Core Ultra 5 125U, 32GB DDR5-4800 (2 x 16GB), 512GB PCIe 4.0 SSD

$669.99Dated reference · not a live offer

32 GB system RAM · CPU planning

Low-power CPU and shared graphics limit heavy inference.

Check price on Amazon ↗Specifications & model limits
Listing and price evidence

Listing evidence: 2026-09-25. Amazon.com base price visible in an owner-supplied screenshot reviewed 25 Sep 2026; capture time not supplied. Dated reference, not a live quote. Excludes card signup offers, coupons, tax and shipping.

Apple unified memory

Apple Mac mini M5 Pro · 24GB

15-core CPU, 16-core GPU, 24GB unified memory, 512GB SSD

$1,699.00Dated reference · not a live offer

24 GB unified memory

Fixed 24GB memory and internal storage limit model size; no CUDA support; Amazon main-offer price and stock were not verified in this run.

Check price on Amazon ↗Specifications & model limits
Listing and price evidence

Listing evidence: 2026-10-03. Apple US launch price announced 22 September 2026: USD 1,699. Dated manufacturer reference, not an Amazon offer; tax and shipping may differ.

AMD unified memory

GMKtec EVO-X2

Ryzen AI Max+ 395, 64GB LPDDR5X-8000, 1TB PCIe 4.0 SSD

$2,199.99Dated reference · not a live offer

64 GB unified memory

Memory is soldered and shared with the operating system.

Check price on Amazon ↗Specifications & model limits
Listing and price evidence

Listing evidence: 2026-09-24. GMKtec, EVO-X2 / 64GB / 1TB, recorded 22 Sep 2026; exact ASIN capacity identified 24 Sep. This is a dated reference, not a current Amazon price; tax, shipping and bundle contents may differ.

Memory matches are estimates, not tested compatibility or speed. As an Amazon Associate I earn from qualifying purchases.

Compare more computers for this model

RAM and VRAM planning for RAG-Gate-27B

Confirm model architecture and quantization support in your runner. The selected weights use 16.547 GB; this excludes context cache, runtime buffers and other programs.

System RAM (CPU inference)
24 GB planning tier · 16.8 GB initial weight budget
Dedicated VRAM
24 GB planning tier · 19.2 GB initial weight budget
Unified memory
24 GB planning tier · 16.8 GB initial weight budget

These are the first listed tiers that pass our reserve policy, not measured minimum requirements. System RAM and VRAM remain separate. Use the memory tool to change the reserve for your context and runner.

Related models with shared benchmark coverage

    Compare by memory and task · Browse the full model directory