xinference.client.Client.get_model#

Client.get_model(model_uid: str) → RESTfulModelHandle[source]#

Launch the model based on the parameters on the server via RESTful APIs.

Parameters:

model_uid (str) – The unique id that identify the model.

Returns:

The corresponding Model Handler based on the Model specified in the uid:

xinference.client.handlers.GenerateModelHandle -> provide handle to basic generate Model. e.g. Baichuan.
xinference.client.handlers.ChatModelHandle -> provide handle to chat Model. e.g. Baichuan-chat.

Return type:

ModelHandle

Raises:

RuntimeError – Report failure to get the wanted model with given model_uid. Provide details of failure through error message.