Managing model catalogs

Managing model catalogs

A model catalog is a collection of configuration parameters for models, engines, resources, and endpoints. When creating an endpoint, you can select a model catalog to quickly generate endpoint configurations that match the model catalog.

Model catalogs support the following forms:

• Standard model catalog: Describes a specific set of model, resource, engine, and custom configurations.
• Model catalog with variants and features: Describes a set of composable templates. When creating an endpoint, you can select different variants and features, and Neutree combines them to generate the final configuration.

Getting model catalogs

Verified model catalogs are published to the online model store. You can get the latest model catalog YAML files from the model store.

1. Visit the Model Catalog to browse all available model catalogs. You can filter model catalogs by task type.

2. Select the desired model catalogs and click Generate YAML.

3. The Generated YAML Configuration window displays the YAML configuration for the selected model catalogs. Click Copy to copy the full YAML content.

Matching the model name

When using a model catalog, ensure that a model with the same name and configuration as specified in the model catalog exists in Neutree model registry.

@tab Hugging Face model registry

Confirm that the model name configured in the model catalog matches the model name in the Hugging Face model registry.

1. Check the model name in the Hugging Face model registry.

   For example, using https://huggingface.co/: you can view the model name on the model card. The model name format is $ORG/$MODEL. For example, the model name for https://huggingface.co/deepseek-ai/DeepSeek-R1-Distill-Qwen-1.5B is deepseek-ai/DeepSeek-R1-Distill-Qwen-1.5B.

2. Check the model name in the model catalog.

   • Standard model catalog: Check the .spec.model.name field in the YAML file, or view the model name displayed in the Neutree management interface.
   • Model catalog with variants and features: Check the .spec.variants.<variant>.model.name field in the YAML file, or view the model name of each variant on the model catalog details page.

3. Confirm that the model name in the model catalog matches the model name in the Hugging Face model registry.

   If they do not match, update the model name in the model catalog.

@tab File system model registry

Confirm that the model name configured in the model catalog matches the model name set when pushing a model.

• If you have an existing model catalog and want to push the corresponding model to the model registry, set the <model_name> field to the model name in the model catalog when pushing a model.

• If the model registry already contains a model corresponding to the model catalog but the names do not match, update the model name in the model catalog.

Importing a model catalog

1. Log in to the Neutree management interface. In the left navigation pane, click Model Catalogs.

2. Click Import.

3. In the Import model catalogs dialog, select an import method.

   • Paste YAML: Paste the model catalog YAML content.
   • Upload file: Upload a local YAML file.
   • From URL: Enter a raw YAML link, and Neutree fetches the YAML content.

   Note

   • If metadata.workspace is not specified in the YAML, the system imports the model catalog to the Default workspace.
   • To import multiple model catalogs at a time, separate multi-document YAML with ---.

4. Click Import to import the model catalog.

Viewing model catalogs

Log in to the Neutree management interface. In the left navigation pane, click Model Catalogs. The model catalog list on the right displays all currently imported model catalogs as cards. You can search for model catalogs by name, or click Details on a model catalog card to view the model catalog details.

On the model catalog details page, you can view the following information:

• Overview: Basic information about the model catalog, such as the model, model file, engine, resources, and verified hardware.
• Key Configuration: Key engine configurations, such as context length, quantization, and KV cache type.
• Variants: For model catalogs with variants and features, the model information, minimum VRAM, and parameter overrides corresponding to different variants.
• Features: Optional or default-enabled features in the model catalog, and conflict relationships between features.
• Advanced (all fields): Complete advanced configuration fields of the model catalog.

Deploying an endpoint using a model catalog

In the model catalog list, click Deploy on a model catalog card to go to the endpoint creation page with that model catalog automatically selected. Standard model catalogs populate the model, resource, engine, and custom configurations. Model catalogs with variants and features require you to select variants and features when creating an endpoint.

For more information about creating endpoints, see Creating endpoints.

Editing a model catalog

To adjust the configuration of an imported model catalog, you can edit the model catalog Spec.

1. Log in to the Neutree management interface. In the left navigation pane, click Model Catalogs.

2. Click the edit icon on the model catalog card.

3. On the Edit model catalog page, modify Spec (YAML).

4. Click Save.

Note

Editing a model catalog updates only the model catalog Spec. It does not modify the configurations of endpoints that have already been created. If an invalid Spec is saved, the model catalog is displayed in the Failed status. Correct the Spec according to the error message.

Deleting model catalogs

You can delete one or more model catalogs at the same time.

1. Log in to the Neutree management interface. In the model catalog list or details page, click the menu icon (…) and select Delete; or select multiple model catalogs in the list and click Delete above the list.

2. In the confirmation dialog, confirm the deletion and click Delete. The selected model catalogs will be permanently deleted.