MODEL REFERENCE / baidu

baidu/ERNIE-4.5-21B-A3B-PT

Baidu ERNIE 4.5 MoE text models (21B-A3B, 300B-A47B) with BF16 and FP8 support plus ERNIE-MTP speculative decoding

vLLMmoe21B / 3B131,072 ctxvLLM 0.10.1+text

02 / Configure

Configure serving

Choose engine, hardware and deployment options. The command updates as you go.

03 / Understand

Model notes and examples