MODEL REFERENCE / vllm-sr
vllm-sr/d3-flash
Decision 3.0's 9B decision model: answers typed questions (choice, yes / no, score) about text, JSON, images and videos with a probability for every option, without generating text.
MI300X: 414 of 416 decisions match the checkpoint runtime (2 near-ties); 2.2x its server's requests per second at 64 clients
View on HuggingFace
View on ModelScope02 / Configure
Configure serving
Choose engine, hardware and deployment options. The command updates as you go.
03 / Understand