Sentence Transformer Models
You need to enable the Huggingface sentence transformers for the AIEnrichmentService and the AIModelService.
The AI enrichment service uses the transformer at enrichment. It converts a documents textContent into vectors.
The AI model service uses the transformer at search time. It converts a search query into vectors.
For support making these changes see our guide on enabling providers.
Using a GPU
If you are able to use a GPU we recommend using it for the AIEnrichment service.
There are two pre requisites for using a GPU with your sentence transformers.
The GPU is installed and set up.
For support setting this up see step 2 of our AI Model Service install requirements.
Within the ai.json, under the AIEnrichment Service model change the device to cuda:0.
For support making these changes see our guide on enabling providers.
