Local AI Stats.
Skip to content

nvidia · MODEL RECORD

NVIDIA-Nemotron-3.5-Lightning-30B-A3B

NVIDIA-Nemotron-3.5-Lightning-30B-A3B has 32.913 billion total parameters. The selected Q4_K_M GGUF file is 25.477 GB.

Data snapshot: . 4 published tests in this catalog.

Model file and details

Provider
nvidia
Total parameters
32,913,266,240
Exact file size
25,477,403,616 bytes
Quantization / precision
Q4_K_M
Weight repository
bartowski/NVIDIA-Nemotron-3.5-Lightning-30B-A3B-GGUF
Original model repository
nvidia/NVIDIA-Nemotron-3.5-Lightning-30B-A3B-BF16
Weight revision
f0eec2267ae843d9eb21ea3926ab0046da0a8628
Model revision
a9904d24bcc1d289a1950fa9d2b978c47cf903b9
Runtime notes
Confirm model architecture and quantization support in your runner.
Recorded release date
2026-08-01
Date evidence
Source repository createdAt (release-date proxy)

NVIDIA-Nemotron-3.5-Lightning-30B-A3B-Q4_K_M.gguf

GGUF file and download on Hugging Face · Original model card

Published benchmark results

These scores were compiled from the linked sources. These published scores were not independently tested here. Different prompts, precision, thinking budgets and tools can change results.

MMLU-Pro

81.94 / 100

Knowledge and reasoning across many subjects. Published accuracy; different evaluation settings can change the result.

Benchmark efficiency: 3.216 published score points per GB of selected weights. This ratio is not an inference-speed measure; check the test settings to see whether the score covers the selected quantization.

Test settings: Publisher-reported results for this exact source model. Evaluation settings differ across model cards; the selected GGUF has not been independently retested. Table row: MMLU Pro.

Published point estimate, not an independent head-to-head evaluation. Quantization and inference settings can change results.

Read the MMLU-Pro source

GPQA Diamond

75.44 / 100

Hard science questions. This is a science reasoning test, not an overall intelligence score.

Benchmark efficiency: 2.961 published score points per GB of selected weights. This ratio is not an inference-speed measure; check the test settings to see whether the score covers the selected quantization.

Test settings: Publisher-reported results for this exact source model. Evaluation settings differ across model cards; the selected GGUF has not been independently retested. Table row: GPQA Diamond (no tools).

Published point estimate, not an independent head-to-head evaluation. Quantization and inference settings can change results.

Read the GPQA Diamond source

SciCode

32.6 / 100

Writing code to solve scientific problems. Published results can depend on the test scaffold.

Benchmark efficiency: 1.28 published score points per GB of selected weights. This ratio is not an inference-speed measure; check the test settings to see whether the score covers the selected quantization.

Test settings: Publisher-reported results for this exact source model. Evaluation settings differ across model cards; the selected GGUF has not been independently retested. Table row: SciCode.

Published point estimate, not an independent head-to-head evaluation. Quantization and inference settings can change results.

Read the SciCode source

SWE-bench Verified

51.56 / 100

Fixing real software issues with tools. Agent setup and external tools affect these scores. File size covers model weights only.

Benchmark efficiency: 2.024 published score points per GB of selected weights. This ratio is not an inference-speed measure; check the test settings to see whether the score covers the selected quantization.

Test settings: Publisher-reported results for this exact source model. Evaluation settings differ across model cards; the selected GGUF has not been independently retested. Table row: SWE-bench Verified.

Published point estimate, not an independent head-to-head evaluation. Quantization and inference settings can change results.

Read the SWE-bench Verified source

Memory and comparison limits

Context and version evidence: The repository and file name identify the selected model. Revision hashes are shown above when recorded. Tested context length, full hardware configuration and run date are not consistently recorded in this snapshot. Only settings explicitly stated in each benchmark record are known.

The 25.477 GB figure covers model weights in this file. It excludes the context cache, runtime, operating system and any separate multimodal files. It is not a measured RAM requirement or a token-generation speed.

Use the model ranking chart to compare one test at a time. Use the 8, 16 and 32 GB memory guide. Check hardware memory and bandwidth before choosing a model.

Need a computer for NVIDIA-Nemotron-3.5-Lightning-30B-A3B?

These complete configurations pass the initial weight-size check for the selected 25.48 GB file. Allow extra memory for context and software. Check the model’s runtime notes and your inference software before buying.

CPU inference

Reatan X8

Ryzen AI 9 HX 470, 48GB DDR5-5600, 1TB PCIe 4.0 SSD, OCuLink

$1,299.99Dated reference · not a live offer

48 GB system RAM · CPU planning

GPU memory allocation is unverified; external graphics hardware costs extra.

Check price on Amazon ↗Specifications & model limits
Listing and price evidence

Listing evidence: 2026-09-24. Reatan manufacturer store, US plug and 48GB / 1TB selected, observed 25 Sep 2026 at USD 1299.99. The manufacturer marks this configuration sold out. Dated manufacturer reference only; Amazon price and availability are unverified. Tax and shipping may differ.

AMD unified memory

GMKtec EVO-X2

Ryzen AI Max+ 395, 64GB LPDDR5X-8000, 1TB PCIe 4.0 SSD

$2,199.99Dated reference · not a live offer

64 GB unified memory

Memory is soldered and shared with the operating system.

Check price on Amazon ↗Specifications & model limits
Listing and price evidence

Listing evidence: 2026-09-24. GMKtec, EVO-X2 / 64GB / 1TB, recorded 22 Sep 2026; exact ASIN capacity identified 24 Sep. This is a dated reference, not a current Amazon price; tax, shipping and bundle contents may differ.

Memory matches are estimates, not tested compatibility or speed. As an Amazon Associate I earn from qualifying purchases.

Compare more computers for this model

RAM and VRAM planning for Nemotron 3.5 Lightning

Confirm model architecture and quantization support in your runner. The selected weights use 25.477 GB; this excludes context cache, runtime buffers and other programs.

System RAM (CPU inference)
48 GB planning tier · 33.6 GB initial weight budget
Dedicated VRAM
32 GB planning tier · 25.6 GB initial weight budget
Unified memory
48 GB planning tier · 33.6 GB initial weight budget

These are the first listed tiers that pass our reserve policy, not measured minimum requirements. System RAM and VRAM remain separate. Use the memory tool to change the reserve for your context and runner.

Related models with shared benchmark coverage

Compare by memory and task · Browse the full model directory