seallm_v2#
Context Length: 8192
Model Name: seallm_v2
Languages: en, zh, vi, id, th, ms, km, lo, my, tl
Abilities: generate
Description: We introduce SeaLLM-7B-v2, the state-of-the-art multilingual LLM for Southeast Asian (SEA) languages
Specifications#
Model Spec 1 (pytorch, 7 Billion)#
Model Format: pytorch
Model Size (in billions): 7
Quantizations: none
Engines: Transformers
Model ID: SeaLLMs/SeaLLM-7B-v2
Model Hubs: Hugging Face
Execute the following command to launch the model, remember to replace ${quantization}
with your
chosen quantization method from the options listed above:
xinference launch --model-engine ${engine} --model-name seallm_v2 --size-in-billions 7 --model-format pytorch --quantization ${quantization}
Model Spec 2 (ggufv2, 7 Billion)#
Model Format: ggufv2
Model Size (in billions): 7
Quantizations: Q4_0, Q8_0
Engines: llama.cpp
Model ID: SeaLLMs/SeaLLM-7B-v2-gguf
Model Hubs: Hugging Face
Execute the following command to launch the model, remember to replace ${quantization}
with your
chosen quantization method from the options listed above:
xinference launch --model-engine ${engine} --model-name seallm_v2 --size-in-billions 7 --model-format ggufv2 --quantization ${quantization}