Provision an endpoint in Azure, and the models you want to use.
Export and edit the provider, changing the URL as required.
Create a new secret only credential within Control Hub.
For support setting up a secret only credential see
Update the provider with that correct path.
Sometimes the Tiktoken's tonkenizer is unable to resolve which causes an error on every call. "Failed to resolve 'openaipublic.blob.core.wi". This is caused by networking rules in certain environments.
The following steps resolve the issue by removing the need for the above call to occur in the first place.
Download the tiktoken tokenizer. .
If you are unable to download it from this link you may need to try on an unrestricted network.
Rename the file when it is downloaded to 9b5ad71b2ce5302211f9c61530b329a4922fc6a4
This needs no extension.
Create a new folder named tiktoken_cache.
This folder can have any path for example, C:\tiktoken_cache.
Move the downloaded and renamed item to this folder.
Set an environment variable called TIKTOKEN_CACHE_DIR that points to the folder you created.
