MODEL REFERENCE / meta-llama

meta-llama/Llama-3.1-8B

Meta Llama 3.1 8B dense base language model with a CPU-validated Red Hat AI W8A8 variant.

W8A8 variant validated on Intel Xeon 6

vLLMdense8B131,072 ctxvLLM 0.6.0+text

02 / Configure

Configure serving

Choose engine, hardware and deployment options. The command updates as you go.

03 / Understand

Model notes and examples