MODEL REFERENCE / thinkingmachines

thinkingmachines/Inkling-Small

Natively multimodal 276B-parameter MoE from Thinking Machines Lab — 12B active parameters, text/image/audio in, text out, and up to 1M context.

276B total / 12B active Inkling architecture for lower-cost, lower-latency deployment

vLLMSGLangmoe276B / 12B1,048,576 ctxvLLM 0.26.0+multimodal

02 / Configure

Configure serving

Choose engine, hardware and deployment options. The command updates as you go.

03 / Understand

Model notes and examples