xinference.client.Client.query_engine_by_model_name#

Client.query_engine_by_model_name(model_name: str, model_type: str | None = 'LLM', enable_virtual_env: bool | None = None)[source]#

Get the engine parameters with the model name registered on the server.

Parameters:

  • model_name (str) – The name of the model.

  • model_type (str) – Model type, LLM by default.

Returns:

The supported engine parameters of registered models on the server.

Return type:

Dict[str, List[Dict[str, Any]]]