DeepSeek-V4.1-Flash#
Context Length: 1048576
Model Name: DeepSeek-V4.1-Flash
Languages: en, zh
Abilities: chat, vision, reasoning, hybrid, tools
Description: We introduce DeepSeek-V4.1-Flash, a multimodal Mixture-of-Experts (MoE) model with 552B backbone parameters and support for contexts of up to one million tokens. The model natively processes images and text, and generates text autoregressively.
Specifications#
Model Spec 1 (fp8, 552 Billion)#
Model Format: fp8
Model Size (in billions): 552
Quantizations: fp8
Engines: vLLM
Model ID: deepseek-ai/DeepSeek-V4.1-Flash
Model Hubs: Hugging Face, ModelScope
Execute the following command to launch the model, remember to replace ${quantization} with your
chosen quantization method from the options listed above:
xinference launch --model-engine ${engine} --model-name DeepSeek-V4.1-Flash --size-in-billions 552 --model-format fp8 --quantization ${quantization}