MODEL REFERENCE / meta-llama

meta-llama/Llama-3.2-1B-Instruct

Meta Llama 3.2 1B Instruct with CPU-validated Red Hat AI W8A8 and AMead10 AWQ variants.

W8A8 and AWQ variants validated on Intel Xeon 6

vLLMdense1.23B131,072 ctxvLLM 0.6.2+text

02 / Configure

Configure serving

Choose engine, hardware and deployment options. The command updates as you go.

03 / Understand

Model notes and examples