MODEL REFERENCE / inclusionAI

inclusionAI/Ling-3.0-tiny

Ling-3.0-tiny lightweight hybrid-reasoning MoE with BF16, block-FP8, and compressed-tensors INT4 checkpoints

7.9B total / 1.3B active parameters with a 3:1 KDA-MLA stack; all three official checkpoints run with TP1

vLLMSGLangmoe7.9B / 1.3B131,072 ctxvLLM 0.28.0+text

02 / Configure

Configure serving

Choose engine, hardware and deployment options. The command updates as you go.

03 / Understand

Model notes and examples