MODEL INDEX.
MODEL REFERENCE / mistralai

mistralai/Voxtral-Mini-4B-Realtime-2602

Multilingual realtime speech transcription (13 languages) with a natively streaming causal audio encoder; configurable 80ms–2.4s transcription delay served via vLLM's Realtime API

Matches offline open-source ASR accuracy at 480ms delay; >12.5 tok/s on a single 16GB GPU

vLLMdense4.4B131,072 ctxvLLM 0.20.0+multimodal
02 / Configure

Configure serving

Choose engine, hardware and deployment options. The command updates as you go.

03 / Understand

Technical notes

Model notes and examples