What they found
The authors introduce Nemotron 3.5 Bolt E4B 4GB, a small open language model. It is post-trained from Gemma-4-E4B-it and tuned for speed and for intelligence per GB of memory. They say it improves multi-turn tool use, instruction following and input grounding (staying tied to the given input). On 21 benchmarks, they report the highest average accuracy and the fewest output tokens in both reasoning and non-reasoning modes, against Gemma-4-E4B-it and Qwen3.5-4B. The model ships with a DFlash drafter, a helper for speculative decoding (guessing ahead to speed up output). With it, the authors report 2.74× the per-user decode speed of inference without speculative decoding at concurrency 1. They also report 1.21× the generation throughput of Gemma-4-E4B-it with MTP at batch size 1.
Why it matters
Small models that run on a local device can power voice assistants, interactive characters and robot or IoT interfaces. They need no round trip to a data center. The target hardware named is GeForce RTX, Jetson and RTX/DGX Spark. The abstract gives no details on the training method or the benchmarks, so the size of the gains is hard to judge from it alone. The comparisons are limited to two other small models.
How it changes the race
This is mostly an incremental step in efficient small models. If the results hold, it makes capable local assistants cheaper and faster to run on modest hardware, and the open release lets more builders use it.
The abstract, by the authors
We introduce Nemotron 3.5 Bolt E4B 4GB, an open and efficient small language model further post-trained from Gemma-4-E4B-it and optimized for speed and intelligence per GB of memory used for fast conversational agents. The model carries forward Gemma's strong conversational capabilities and further improves multi-turn tool use, instruction following, and input grounding for fast, local voice/device assistants, interactive personas, and embedded/Edge interfaces. The model combines natural conversation with multi-turn agentic capabilities to power voice/device assistants, interactive characters and robotic/IoT interfaces running on GeForce RTX, Jetson, and RTX/DGX Spark. Experiments on 21 benchmarks show that Nemotron 3.5 Bolt E4B 4GB achieves the highest average accuracy while generating the fewest output tokens in both reasoning and non-reasoning modes, compared with Gemma-4-E4B-it and Qwen3.5-4B. The model is released with a DFlash drafter. With DFlash, Bolt E4B achieves 2.74× the per-user decode speed of inference without speculative decoding at concurrency~1, and 1.21× the generation throughput of Gemma-4-E4B-it with MTP at batch size 1.
Quoted from arXiv:2611.20771. The research and its words belong to its authors.
