MODEL REFERENCE / meta-llama

meta-llama/Llama-3.1-8B-Instruct

Meta's Llama 3.1 8B dense instruction-tuned language model with 128K context

vLLMdense8B131,072 ctxvLLM 0.6.0+text

02 / Configure

Configure serving

Choose engine, hardware and deployment options. The command updates as you go.

03 / Understand

Model notes and examples