Model Recipes
Google

google/gemma-4-26B-A4B-it

Google's Gemma 4 MoE multimodal model (26B total / 4B active) with 128 fine-grained experts, top-8 routing, thinking mode, and tool-use protocol.

MoE multimodal model — 26B total / 4B active, 128 experts with top-8 routing

moe26B / 4B131,072 ctxvLLM 0.19.1+multimodaltext
Guide