Ai2 AstaBrief 8B has 8.191 billion total parameters. The selected Q4_K_M GGUF file is 5.028 GB.
Data snapshot: . 1 published test in this catalog.
Model file and details
Provider
Ai2
Total parameters
8,190,735,360
Exact file size
5,027,784,736 bytes
Quantization / precision
Q4_K_M
Weight repository
mradermacher/AstaBrief_8B-GGUF
Original model repository
allenai/AstaBrief_8B
Weight revision
a40b9eb85c6e349898737726b4b9ee69688b63a3
Model revision
6a34f54dcd7887b790a570249b4a2a2fe81c6694
Runtime notes
Confirm model architecture and quantization support in your runner.
Recorded release date
2026-10-02
Date evidence
Ai2 announced and open-sourced AstaBrief 8B on 2 October 2026; this third-party static GGUF quantization was created the same day and finalized 3 October 2026.
These scores were compiled from the linked sources. These published scores were not independently tested here. Different prompts, precision, thinking budgets and tools can change results.
ScholarQA-CS2 · test average
87 / 100
Cited scientific-report generation on 100 user-written computer-science research questions. Publisher composite averaging ingredient recall, answer precision, citation precision and citation recall; not a general intelligence test.
Benchmark efficiency: 17.304 published score points per GB of selected weights. This ratio is not an inference-speed measure; check the test settings to see whether the score covers the selected quantization.
Test settings: Ai2 publisher evaluation of the source checkpoint on the 100-question ScholarQA-CS2 computer-science test set. The displayed average combines ingredient recall 90.2, answer precision 89.0, citation precision 90.5 and citation recall 78.2. The card does not state decoding settings, judge-model details or hardware for this table.
Source-checkpoint result, not an independent test and not a direct benchmark of the selected Q4_K_M file. The model expects a research question plus retrieved literature excerpts in Ai2's recommended prompt; it is not a standalone literature retriever. The 5.028 GB file excludes runtime, KV cache and context memory, so it does not establish device compatibility or generation speed.
Context and version evidence: The repository and file name identify the selected model. Revision hashes are shown above when recorded. Tested context length, full hardware configuration and run date are not consistently recorded in this snapshot. Only settings explicitly stated in each benchmark record are known.
The 5.028 GB figure covers model weights in this file. It excludes the context cache, runtime, operating system and any separate multimodal files. It is not a measured RAM requirement or a token-generation speed.
These complete configurations pass the initial weight-size check for the selected 5.03 GB file. Allow extra memory for context and software. Check the model’s runtime notes and your inference software before buying.
Listing evidence: 2026-09-25. Amazon.com base price visible in an owner-supplied screenshot reviewed 25 Sep 2026; capture time not supplied. Dated reference, not a live quote. Excludes card signup offers, coupons, tax and shipping.
Listing evidence: 2026-10-03. Apple US launch price announced 22 September 2026: USD 1,699. Dated manufacturer reference, not an Amazon offer; tax and shipping may differ.
Listing evidence: 2026-09-24. GMKtec, EVO-X2 / 64GB / 1TB, recorded 22 Sep 2026; exact ASIN capacity identified 24 Sep. This is a dated reference, not a current Amazon price; tax, shipping and bundle contents may differ.
Memory matches are estimates, not tested compatibility or speed. As an Amazon Associate I earn from qualifying purchases.
Confirm model architecture and quantization support in your runner. The selected weights use 5.028 GB; this excludes context cache, runtime buffers and other programs.
These are the first listed tiers that pass our reserve policy, not measured minimum requirements. System RAM and VRAM remain separate. Use the memory tool to change the reserve for your context and runner.