MODEL REFERENCE / inclusionAI

inclusionAI/Ling-3.0-flash

Ling-3.0-flash MoE model with BF16, FP8, FP4, and INT4 checkpoints, native MTP, and an external DSpark draft model

BF16, FP8, FP4, and INT4 support NVIDIA H20/H200 and AMD MI300X/MI355X; DGX Spark verified TP1 FP4/INT4

vLLMSGLangmoe124B / 5.5B262,144 ctxvLLM 0.28.0+text

02 / Configure

Configure serving

Choose engine, hardware and deployment options. The command updates as you go.

03 / Understand

Model notes and examples