.. _models_llm_qwen3.8-flash-next: ======================================== qwen3.8-Flash-Next ======================================== - **Context Length:** 262144 - **Model Name:** qwen3.8-Flash-Next - **Languages:** en, zh - **Abilities:** chat, vision, tools, reasoning, hybrid - **Description:** Qwen3.8-Flash-Next is a native vision-language Mixture-of-Experts model with 125B main-model parameters, 6B activated per token, and an additional 51B n-gram embedding table. Its Qwen4 experimental architecture combines Gated DeltaNet, Qwen Sparse Attention, gated residuals, and flexible thinking control. Specifications ^^^^^^^^^^^^^^ Model Spec 1 (pytorch, 125 Billion) ++++++++++++++++++++++++++++++++++++++++ - **Model Format:** pytorch - **Model Size (in billions):** 125 - **Quantizations:** none - **Engines**: vLLM, SGLang - **Model ID:** Qwen/Qwen3.8-Flash-Next - **Model Hubs**: `Hugging Face `__, `ModelScope `__ Execute the following command to launch the model, remember to replace ``${quantization}`` with your chosen quantization method from the options listed above:: xinference launch --model-engine ${engine} --model-name qwen3.8-Flash-Next --size-in-billions 125 --model-format pytorch --quantization ${quantization} Model Spec 2 (fp8, 125 Billion) ++++++++++++++++++++++++++++++++++++++++ - **Model Format:** fp8 - **Model Size (in billions):** 125 - **Quantizations:** FP8 - **Engines**: vLLM, SGLang - **Model ID:** Qwen/Qwen3.8-Flash-Next-FP8 - **Model Hubs**: `Hugging Face `__, `ModelScope `__ Execute the following command to launch the model, remember to replace ``${quantization}`` with your chosen quantization method from the options listed above:: xinference launch --model-engine ${engine} --model-name qwen3.8-Flash-Next --size-in-billions 125 --model-format fp8 --quantization ${quantization} Model Spec 3 (fp4, 125 Billion) ++++++++++++++++++++++++++++++++++++++++ - **Model Format:** fp4 - **Model Size (in billions):** 125 - **Quantizations:** FP4 - **Engines**: vLLM, SGLang - **Model ID:** nvidia/Qwen3.8-Flash-Next-NVFP4 - **Model Hubs**: `Hugging Face `__, `ModelScope `__ Execute the following command to launch the model, remember to replace ``${quantization}`` with your chosen quantization method from the options listed above:: xinference launch --model-engine ${engine} --model-name qwen3.8-Flash-Next --size-in-billions 125 --model-format fp4 --quantization ${quantization}