Managing Model Registries

Model registries store models and come in two types: Hugging Face and File System:

• Hugging Face Model Registry is a public model registry that provides rich model resources.

  When deploying endpoints with a Hugging Face model registry selected, the inference engine will automatically pull open-source models from Hugging Face, cache them locally, and use them.

• File System Model Registry is a private model registry suitable for storing proprietary models developed internally or customized third-party models. File system model registries provide higher security and control. In version 1.0, file system model registries are implemented using NFS, with local file system support planned for future versions.

  When deploying endpoints with a file system model registry selected, the inference engine will directly read models from the file system.

Create Model Registry

1. Log in to the Neutree management interface, click Model Registries in the left sidebar, and click Create on the right page.

2. Fill in the configuration information.

   Parameter	Description
   Name	The name of the model registry.
   Workspace	The workspace to which the model registry belongs.
   Type	The type of model registry: Hugging Face or File System.
   URL	The address of the model registry. For Hugging Face model registries, enter the Hugging Face Hub URL: https://huggingface.co/. For File System model registries, use NFS, with format: nfs://$NFS_IP:/$PATH_TO_DIR. Both NFSv3 and NFSv4.x protocols are supported.
   Credentials	For Hugging Face model registries, enter your HF token (Hugging Face user access token). Refer to Hugging Face official documentation for details.

3. After confirming the configuration is correct, click Save to complete the creation.

View Model Registry

Log in to the Neutree management interface, click Model Registries in the left sidebar, and the model registry list on the right will display all current registries. Click on a registry name to view details.

Edit Model Registry

After creating a model registry, you can modify the model registry type, URL, and credentials according to actual needs.

1. Log in to the Neutree management interface, click the menu icon on the model registry list or details page, and select Edit.

2. Modify as needed on the configuration page. For parameter descriptions, refer to Create Model Registry.

3. After confirming the configuration is correct, click Save to complete the edit.

Delete Model Registry

Note

When deleting a file system model registry, the models saved in the corresponding directory will not be deleted.

Steps

1. Log in to the Neutree management interface, click the menu icon on the model registry list or details page, and select Delete.

2. In the pop-up dialog, confirm and click Delete. The model registry will be permanently deleted.