MODEL REFERENCE / meta-llama

meta-llama/Llama-3.2-1B

Meta Llama 3.2 1.23B dense pretrained language model with 128K context, validated for BF16 serving on Intel Xeon 6.

Validated on Intel Xeon 6 (GNR) with BF16 serving

vLLMdense1.23B131,072 ctxvLLM 0.6.2+text

02 / Configure

Configure serving

Choose engine, hardware and deployment options. The command updates as you go.

03 / Understand

Model notes and examples