These scores were compiled from the linked sources. These published scores were not independently tested here. Different prompts, precision, thinking budgets and tools can change results.
MMLU-Pro
78.4 / 100
Knowledge and reasoning across many subjects. Published accuracy; different evaluation settings can change the result.
Benchmark efficiency: 4.225 published score points per GB of selected weights. This ratio is not an inference-speed measure; check the test settings to see whether the score covers the selected quantization.
Test settings: Publisher-reported results for this exact source model. Evaluation settings differ across model cards; the selected GGUF has not been independently retested. Table row: MMLU-Pro.
Published point estimate, not an independent head-to-head evaluation. Quantization and inference settings can change results.
Solving coding problems. Version 6 only; published pass rates can vary with generation settings.
Benchmark efficiency: 2.328 published score points per GB of selected weights. This ratio is not an inference-speed measure; check the test settings to see whether the score covers the selected quantization.
Test settings: Publisher LiveCodeBench v6 result for February–May 2025 tasks, exact model column. Original weights; selected GGUF not independently tested.
Published point estimate, not an independent head-to-head evaluation. Quantization and inference settings can change results.
Following precise instructions. These cards report IFEval without consistently specifying prompt-level versus instruction-level scoring. Treat this view as approximate.
Benchmark efficiency: 4.564 published score points per GB of selected weights. This ratio is not an inference-speed measure; check the test settings to see whether the score covers the selected quantization.
Test settings: Publisher-reported results for this exact source model. Evaluation settings differ across model cards; the selected GGUF has not been independently retested. Table row: IFEval.
Published point estimate, not an independent head-to-head evaluation. Quantization and inference settings can change results.
Competition math from AIME 2025. Published answer accuracy.
Benchmark efficiency: 3.303 published score points per GB of selected weights. This ratio is not an inference-speed measure; check the test settings to see whether the score covers the selected quantization.
Test settings: Publisher-reported results for this exact source model. Evaluation settings differ across model cards; the selected GGUF has not been independently retested. Table row: AIME25.
Published point estimate, not an independent head-to-head evaluation. Quantization and inference settings can change results.
These cards say GPQA without naming the variant. Kept separate from confirmed GPQA Diamond results.
Benchmark efficiency: 3.794 published score points per GB of selected weights. This ratio is not an inference-speed measure; check the test settings to see whether the score covers the selected quantization.
Test settings: Publisher-reported results for this exact source model. Evaluation settings differ across model cards; the selected GGUF has not been independently retested. Table row: GPQA.
Published point estimate, not an independent head-to-head evaluation. Quantization and inference settings can change results.
Revised MMLU knowledge test. Kept separate from original MMLU and MMLU-Pro.
Benchmark efficiency: 4.812 published score points per GB of selected weights. This ratio is not an inference-speed measure; check the test settings to see whether the score covers the selected quantization.
Test settings: Publisher-reported results for this exact source model. Evaluation settings differ across model cards; the selected GGUF has not been independently retested. Table row: MMLU-Redux.
Published point estimate, not an independent head-to-head evaluation. Quantization and inference settings can change results.
Berkeley Function Calling Leaderboard version 3. Kept separate from version 4.
Benchmark efficiency: 3.508 published score points per GB of selected weights. This ratio is not an inference-speed measure; check the test settings to see whether the score covers the selected quantization.
Test settings: Publisher-reported results for this exact source model. Evaluation settings differ across model cards; the selected GGUF has not been independently retested. Table row: BFCL-v3.
Published point estimate, not an independent head-to-head evaluation. Quantization and inference settings can change results.
Context and version evidence: The repository and file name identify the selected model. Revision hashes are shown above when recorded. Tested context length, full hardware configuration and run date are not consistently recorded in this snapshot. Only settings explicitly stated in each benchmark record are known.
The 18.557 GB figure covers model weights in this file. It excludes the context cache, runtime, operating system and any separate multimodal files. It is not a measured RAM requirement or a token-generation speed.
These complete configurations pass the initial weight-size check for the selected 18.56 GB file. Allow extra memory for context and software. Check the model’s runtime notes and your inference software before buying.
Listing evidence: 2026-09-25. Amazon.com base price visible in an owner-supplied screenshot reviewed 25 Sep 2026; capture time not supplied. Dated reference, not a live quote. Excludes card signup offers, coupons, tax and shipping.
Listing evidence: 2026-10-02. Apple US launch price for the base M5 Max Mac Studio, published 22 September 2026: USD 2,499. Dated manufacturer reference, not an Amazon offer; tax and shipping may differ.
Listing evidence: 2026-09-24. GMKtec, EVO-X2 / 64GB / 1TB, recorded 22 Sep 2026; exact ASIN capacity identified 24 Sep. This is a dated reference, not a current Amazon price; tax, shipping and bundle contents may differ.
Memory matches are estimates, not tested compatibility or speed. As an Amazon Associate I earn from qualifying purchases.
RAM and VRAM planning for Qwen3-30B-A3B-Instruct-2507
Confirm model architecture and quantization support in your runner. The selected weights use 18.557 GB; this excludes context cache, runtime buffers and other programs.
These are the first listed tiers that pass our reserve policy, not measured minimum requirements. System RAM and VRAM remain separate. Use the memory tool to change the reserve for your context and runner.