MODEL REFERENCE / moonshotai
moonshotai/Kimi-K3
Pre-release 2.8T-parameter native multimodal MoE with Kimi Delta Attention, Gated MLA, Attention Residuals, and a 1M-token context window
Pre-release TP8, TEP16, TP8xPP2, and disaggregated P/D profiles for the 2.8T MXFP4 checkpoint
View on HuggingFace
View on ModelScopevLLMSGLangmoe2.8T / 16 experts/token + shared (of 896 routed)1,048,576 ctxvLLM 0.29.0+multimodaltext
02 / Configure
Configure serving
Choose engine, hardware and deployment options. The command updates as you go.
03 / Understand