Managing model registries

A model registry is used to store models. There are two types:

• Hugging Face model registry: A public model registry that provides a wide range of model resources.

  When deploying an endpoint, if you select a Hugging Face model registry, the engine will automatically pull open-source models from Hugging Face, cache them locally, and then use them.

• File system model registry: A private model registry suitable for storing proprietary models developed internally or customized third-party models. The file system model registry provides higher security and control. In this version, the file system model registry is based on NFS. Future versions will support local file systems.

  When deploying an endpoint, if you select a file system model registry, the engine will directly read the model from the file system.

Creating a model registry

1. Log in to the Neutree management interface. Click Model Registries in the left navigation pane, then click Create on the right.

2. Fill in the configuration.

   Parameter	Description	Editable after creation
   Name	The name of the model registry.	No
   Workspace	The workspace to which the model registry belongs.	No
   Type	The type of model registry: Hugging Face and File system.	Yes
   URL	The address of the model registry. For a Hugging Face model registry, enter the Hugging Face Hub address. You can use the standard Hugging Face URL https://huggingface.co/ or a Hugging Face-compatible mirror URL, such as https://hf-mirror.com/. For a File system model registry using NFS, use the format nfs://$NFS_IP:/$PATH_TO_DIR. NFSv3 and NFSv4.x protocols are currently supported.	Yes
   Credentials	For a Hugging Face model registry, enter the HF token (Hugging Face user access token). See Hugging Face official documentation for how to obtain it.	Yes

3. After confirming the configuration is correct, click Save to complete creation.

Viewing model registries

Log in to the Neutree management interface. Click Model Registries in the left navigation pane. The registry list on the right shows all current model registries. Click a registry name to view its details.

Editing a model registry

After a model registry is created, you can modify its type, URL, and credentials as needed.

1. Log in to the Neutree management interface. In the registry list or details page, click the menu icon (…) and select Edit.

2. Modify the configuration as needed. For parameter descriptions, see Creating a model registry.

3. After confirming the configuration is correct, click Save to complete the edit.

Deleting model registries

You can delete one or more model registries at the same time.

Note

Deleting a file system model registry does not delete the models saved in the corresponding directory.

1. Log in to the Neutree management interface. In the registry list or details page, click the menu icon (…) and select Delete; or select multiple registries in the list and click Delete above the list.

2. In the confirmation dialog, confirm the deletion and click Delete. The selected model registries will be permanently deleted.