NVIDIA Nemotron-Labs Diffusion Models Speed Up Text Generation
NVIDIA has released Nemotron-Labs Diffusion, a family of diffusion language models (DLM) that generate multiple tokens in parallel and iteratively refine them. Available in 3B, 8B, and 14B scales, the models support three inference modes: autoregressive, diffusion, and self-speculation. The 8B model achieves up to 6.4x higher tokens per forward pass compared to autoregressive models while improving average accuracy by 1.2% over Qwen3 8B.