Managing model registries

A model registry is used to store models. The following types are available:

• Hugging Face model registry is a public model platform that provides rich model resources.

  When you select a Hugging Face model registry to deploy an endpoint, the engine automatically pulls open-source models from Hugging Face and caches them locally before use.

• ModelScope model registry is a public model platform that provides model resources that can be browsed and deployed.

  When you select a ModelScope model registry to deploy an endpoint, the engine automatically pulls models from ModelScope and caches them locally before use.

• File system model registry: A private model registry suitable for storing proprietary models developed internally or customized third-party models. The file system model registry provides higher security and control. In this version, the file system model registry is based on NFS. Future versions will support local file systems.

  When deploying an endpoint, if you select a file system model registry, the engine will directly read the model from the file system.

Creating a model registry

1. Log in to the Neutree management interface. Click Model Registries in the left navigation pane, then click Create on the right.

2. Fill in the configuration.

   • Basic Information

     Parameter	Description	Editable after creation
     Name	The name of the model registry.	No
     Workspace	The workspace that the model registry belongs to.	No

   • Model Registry

     Parameter	Description	Editable after creation
     Type	The type of model registry: Hugging Face, ModelScope, or File System.	Yes
     URL	The address of the model registry. For a Hugging Face model registry, enter the Hugging Face Hub address. You can use the standard Hugging Face URL https://huggingface.co/, or a Hugging Face-compatible mirror URL, such as https://hf-mirror.com/. For a ModelScope model registry, enter the ModelScope address, such as https://www.modelscope.cn. For a File System model registry, use NFS as the model registry in the format nfs://$NFS_IP:/$PATH_TO_DIR. NFSv3 and NFSv4.x are currently supported.	Yes
     Credentials	For public model platforms, enter the access token for the corresponding platform, such as a Hugging Face token or ModelScope token. For how to obtain a Hugging Face token, see the Hugging Face documentation.	Yes

3. After confirming the configuration, click Save to complete creation.

Viewing model registries

Log in to the Neutree management interface. Click Model Registries in the left navigation pane. The registry list on the right shows all current model registries. Click a registry name to view its details.

On the model registry details page, you can view the model list and statistics in the model registry. The model list supports searching by model name and displays the model name, alias, version, size, and creation time. After you click a model name, the drawer on the right displays the model details, model information, and README.md.

For models in a file system model registry, you can edit the model alias and manually added model information on the model details page. You can also delete model versions.

Editing a model registry

After a model registry is created, you can modify its type, URL, and credentials as needed.

1. Log in to the Neutree management interface. In the registry list or details page, click the menu icon (…) and select Edit.

2. Modify the configuration as needed. For parameter descriptions, see Creating a model registry.

3. After confirming the configuration is correct, click Save to complete the edit.

Deleting model registries

You can delete one or more model registries at the same time.

Information:

Deleting a file system model registry does not delete the models saved in the corresponding directory.

1. Log in to the Neutree management interface. In the registry list or details page, click the menu icon (…) and select Delete; or select multiple registries in the list and click Delete above the list.

2. In the confirmation dialog, confirm the deletion and click Delete. The selected model registries will be permanently deleted.