xinference.client.Client.register_model

Client.register_model(model_type: str, model: str, persist: bool, worker_ip: str | None = None)

Register a custom model.

Parameters:

• model_type (str) – The type of model.

• model (str) – The model definition. (refer to: https://inference.readthedocs.io/en/latest/models/custom.html)

• worker_ip (Optional[str]) – The IP address of the worker on which the model is running.

• persist (bool)

Raises:

RuntimeError – Report failure to register the custom model. Provide details of failure through error message.