MODEL REFERENCE / nvidia

nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B-BF16

NVIDIA Nemotron-3-Nano Mamba-hybrid MoE (30B total / ~3B active) with BF16 and FP8 variants

vLLMmoe30B / 3B262,144 ctxvLLM 0.17.0+text

02 / Configure

Configure serving

Choose engine, hardware and deployment options. The command updates as you go.

03 / Understand

Model notes and examples