MODEL REFERENCE / nvidia

nvidia/NVIDIA-Nemotron-3.5-Lightning-30B-A3B-BF16

NVIDIA Nemotron 3.5 Lightning hybrid Mamba-MoE (30B total / 3B active) with NVFP4 and BF16 checkpoints, 1M context, and MTP / DSpark / DFlash speculative decoding

View on HuggingFace View on ModelScope

vLLMSGLangmoe30B / 3B262,144 ctxvLLM 0.27.1+text

02 / Configure

Configure serving

Choose engine, hardware and deployment options. The command updates as you go.

03 / Understand

Technical notes

Model notes and examples