Managing Model Catalog

A model catalog is a collection of configuration parameters related to models, inference engines, and endpoints. You can quickly create endpoints by selecting a model catalog, enabling templated endpoint deployment.

Get Model Catalog

Verified model catalogs are published to the online model store. You can obtain the latest model catalog YAML files from the model store.

1. Visit the Model Store to view all available model catalogs. You can filter model catalogs by task type.

2. Select the desired model catalogs and click Generate YAML.

3. The Generated YAML Configuration window will display the YAML configuration file for the selected model catalogs. Click Copy to copy the complete YAML content.

   Note

   If you need to adjust configurations in the model catalog, you can modify the YAML file using a text editor before importing it into Neutree.

Match Model Names

When using model catalogs, ensure that models with the same configuration and matching names exist in the Neutree model registry.

Hugging Face Model Registry

Confirm that the model name configured in the model catalog matches the model name in the Hugging Face model registry.

1. Check the model name in the Hugging Face model registry.

   Taking https://huggingface.co/ as an example, you can view the model name through the model card. The model name format is $ORG/$MODEL. For example, the model name for https://huggingface.co/deepseek-ai/DeepSeek-R1-Distill-Qwen-1.5B is deepseek-ai/DeepSeek-R1-Distill-Qwen-1.5B.

2. Check the model name in the model catalog. View the .spec.model.name field in the YAML file or check the model name displayed in the Neutree management interface.

3. Confirm that the model name in the model catalog matches the model name in the Hugging Face model registry.

   If they don’t match, update the .spec.model.name field in the model catalog’s YAML file.

File System Model Registry

Confirm that the model name configured in the model catalog matches the model name set when pushing the model.

• If you already have a model catalog and want to push the corresponding model to the model registry, set the <model_name> field to match the model name in the model catalog when pushing the model.

• If the model registry already has a model corresponding to the model catalog but the names don’t match, update the .spec.model.name field in the model catalog’s YAML file.

Import Model Catalog

Log in to the Neutree management interface, click Import YAML, and select the appropriate import method to import the model catalog YAML file. For details, refer to the Import YAML section.

View Model Catalog

Log in to the Neutree management interface, click Model Catalog in the left sidebar, and the model catalog list on the right will display all currently imported model catalogs. Click on a catalog name to view details.

Edit Model Catalog

To adjust the content of an imported model catalog, modify the model catalog’s YAML file locally using a text editor, then re-import the modified YAML file into Neutree.

Delete Model Catalog

1. Log in to the Neutree management interface, click the menu icon on the model catalog list or details page, and select Delete.

2. In the pop-up dialog, confirm and click Delete. The model catalog will be permanently deleted.