Managing model catalogs

A model catalog is a collection of configuration parameters of the model, engine, and endpoint. By selecting a model catalog, you can quickly create an endpoint, enabling templated distribution of endpoints.

Getting model catalogs

Verified model catalogs are published to the online model store. You can get the latest model catalog YAML files from the model store.

1. Visit the Model Catalog to browse all available model catalogs. You can filter model catalogs by task type.

2. Select the desired model catalogs and click Generate YAML.

3. The Generated YAML Configuration window displays the YAML configuration for the selected model catalogs. Click Copy to copy the full YAML content.

   Note

   To adjust configuration in the model catalog, you can modify the YAML file with a text editor before importing it into Neutree.

Matching the model name

When using a model catalog, ensure that a model with the same name and configuration as specified in the model catalog exists in the Neutree model registry.

Hugging Face model registry

Confirm that the model name configured in the model catalog matches the model name in the Hugging Face model registry.

1. Check the model name in the Hugging Face model registry.

   For example, using https://huggingface.co/: you can view the model name on the model card. The model name format is $ORG/$MODEL. For example, the model name for https://huggingface.co/deepseek-ai/DeepSeek-R1-Distill-Qwen-1.5B is deepseek-ai/DeepSeek-R1-Distill-Qwen-1.5B.

2. Check the model name in the model catalog — look at the .spec.model.name field in the YAML file, or view the model name displayed in the Neutree management interface.

3. Confirm that the model name in the model catalog matches the model name in the Hugging Face model registry.

   If they do not match, update the .spec.model.name field in the model catalog YAML file.

File system model registry

Confirm that the model name configured in the model catalog matches the model name set when pushing a model.

• If you have an existing model catalog and want to push the corresponding model to the model registry, set the <model_name> field to the model name in the model catalog when pushing a model.

• If the model registry already contains a model corresponding to the model catalog but the names do not match, update the .spec.model.name field in the model catalog YAML file.

Importing a model catalog

Log in to the Neutree management interface, click Import YAML, and select the appropriate import method to import the model catalog YAML file. For details, refer to the Importing YAML section.

Viewing model catalogs

Log in to the Neutree management interface. Click Model Catalogs in the left navigation pane. The model catalog list on the right shows all currently imported model catalogs. Click a model catalog name to view its details.

Editing a model catalog

To modify an imported model catalog, edit the model catalog YAML file locally using a text editor, then import the updated YAML file into Neutree again.

Deleting model catalogs

You can delete one or more model catalogs at the same time.

1. Log in to the Neutree management interface. In the model catalog list or details page, click the menu icon (…) and select Delete; or select multiple model catalogs in the list and click Delete above the list.

2. In the confirmation dialog, confirm the deletion and click Delete. The selected model catalogs will be permanently deleted.