Local AI Stats.
Skip to content

NVIDIA · MODEL RECORD

NVIDIA Nemotron 3.5 Bolt E4B

NVIDIA Nemotron 3.5 Bolt E4B has 7.518 billion total parameters. The selected Q4_K_M GGUF file is 6.18 GB.

Data snapshot: . 1 published test in this catalog.

COMPARE MEMORY OPTIONS

Computers for NVIDIA Nemotron 3.5 Bolt E4B

These configurations pass a weight-size check for the 6.18 GB file. Compare the platforms, then check the exact Amazon listing.

Change platform or budget ↗

Weight size is not tested compatibility or speed. Check runtime support and memory for context before buying. Prices are dated references. As an Amazon Associate I earn from qualifying purchases.

How these options are selected

Up to three platforms, with the lowest dated reference price on each. Unknown prices follow known prices. Each memory pool keeps a reserve: 30% (minimum 2 GB) for system or unified memory; 20% (minimum 1 GB) for dedicated VRAM. System RAM is for CPU inference. This check does not establish GPU allocation, software support or context capacity.

Model file and details

Provider
NVIDIA
Total parameters
7,518,069,290
Exact file size
6,180,446,208 bytes
Quantization / precision
Q4_K_M
Weight repository
nvidia/NVIDIA-Nemotron-3.5-Bolt-E4B-4GB
Original model repository
nvidia/NVIDIA-Nemotron-3.5-Bolt-E4B-BF16
Weight revision
1db54d5b12533ff1bcaa8e42cf4c667988a1f1be
Model revision
49843eed8db1f1c616c47af75cfd36e07aec0667
Runtime notes
Confirm model architecture and quantization support in your runner.
Recorded release date
2026-10-23
Date evidence
Publisher states release on 2026-10-23. OpenMDW-1.1. Official Q4_K_M; roughly 7.52B packed language tensors (E4B is effective size, not total). The selected file is 6,180,446,208 bytes despite the repository 4GB name; no 4GB device-fit claim. Optional DFlash drafter excluded. Card supplies llama.cpp b11459 container examples; deployment recipe marked pending.

Nemotron-3.5-Bolt-E4B-Q4_K_M.gguf

GGUF file and download on Hugging Face · Original model card

Published benchmark results

These scores were compiled from the linked sources. These published scores were not independently tested here. Different prompts, precision, thinking budgets and tools can change results.

BFCL v3

67.31 / 100

Berkeley Function Calling Leaderboard version 3. Kept separate from version 4.

Benchmark efficiency: 10.891 published score points per GB of selected weights. This ratio is not an inference-speed measure; check the test settings to see whether the score covers the selected quantization.

Test settings: Publisher benchmark table, Bolt-E4B-4GB Q4_K_M column, BFCL-v3. Full protocol and repeat count not specified in table; recommended sampling temperature 1.0, top-p 0.95.

Publisher result; no independent replication or confidence interval supplied. OpenMDW-1.1. Official Q4_K_M; roughly 7.52B packed language tensors (E4B is effective size, not total). The selected file is 6,180,446,208 bytes despite the repository 4GB name; no 4GB device-fit claim. Optional DFlash drafter excluded. Card supplies llama.cpp b11459 container examples; deployment recipe marked pending. Weight size excludes runtime and KV-cache memory; this is not a measured device-fit or speed result.

Read the BFCL v3 source

Memory and comparison limits

Context and version evidence: The repository and file name identify the selected model. Revision hashes are shown above when recorded. Tested context length, full hardware configuration and run date are not consistently recorded in this snapshot. Only settings explicitly stated in each benchmark record are known.

The 6.18 GB figure covers model weights in this file. It excludes the context cache, runtime, operating system and any separate multimodal files. It is not a measured RAM requirement or a token-generation speed.

Use the model ranking chart to compare one test at a time. Use the 8, 16 and 32 GB memory guide. Check hardware memory and bandwidth before choosing a model.

RAM and VRAM planning for NVIDIA Nemotron 3.5 Bolt E4B

Confirm model architecture and quantization support in your runner. The selected weights use 6.18 GB; this excludes context cache, runtime buffers and other programs.

System RAM (CPU inference)
12 GB planning tier · 8.4 GB initial weight budget
Dedicated VRAM
8 GB planning tier · 6.4 GB initial weight budget
Unified memory
12 GB planning tier · 8.4 GB initial weight budget

These are the first listed tiers that pass our reserve policy, not measured minimum requirements. System RAM and VRAM remain separate. Use the memory tool to change the reserve for your context and runner.

Related models with shared benchmark coverage

Compare by memory and task · Browse the full model directory