MODEL REFERENCE / meta-llama

meta-llama/Llama-3.2-3B-Instruct

Meta Llama 3.2 3.21B dense instruction-tuned language model with 128K context, validated for BF16 serving on Intel Xeon 6.

Validated on Intel Xeon 6 (GNR) with BF16 serving

vLLMdense3.21B131,072 ctxvLLM 0.6.2+text

02 / Configure

Configure serving

Choose engine, hardware and deployment options. The command updates as you go.

03 / Understand

Model notes and examples