Select New Model Step to create an additional step.
Step Name - Enter a name for the step.
If classifications was used this must match the query classification label.
AI Model Service - Select the model service from the dropdown.
AI Model Provider - Select the provider that for this model.
Azure Open AI Generative - Azure Open AI Gen AI
Huggingface Extractive - Extractive models based on Huggingface models.
Huggingface Generative - Generative models based on Huggingface models.
Huggingface Generative Llama CPP - Generative models based on GGUF format models.
Model - Select the model for this task from the dropdown.
Make sure you select the right type of models for the shared model features you set on the general tab
You can not mix extractive and generative models.
Cache Context (Gen only) - Select if the context of results text is cached between calls to generative models. This will reduce the number of times results are fetched from Aiimi Insight Engine.
Max New Tokens (Gen only) - Enter the maximum number of new tokens that will be generated.
This must be smaller than the maximum value supported by the model.
