MODEL REFERENCE / meta-llama

meta-llama/Llama-3.3-70B-Instruct

Llama 3.3 70B dense model with NVIDIA FP8/FP4 quantized variants for Hopper and Blackwell GPUs

vLLMdense70B131,072 ctxvLLM 0.12.0+text

02 / Configure

Configure serving

Choose engine, hardware and deployment options. The command updates as you go.

03 / Understand

Model notes and examples