MODEL REFERENCE / Qwen

Qwen/Qwen2.5-VL-7B-Instruct

Qwen2.5-VL dense vision-language model (7B) for image and video understanding — fits on a single TPU v6e chip, one GPU, or Intel Xeon 6 CPU.

Verified on TPU v6e (Trillium) and Intel Xeon 6 CPU with BF16

vLLMdense7B128,000 ctxvLLM 0.10.2+multimodaltext

02 / Configure

Configure serving

Choose engine, hardware and deployment options. The command updates as you go.

03 / Understand

Model notes and examples