Azure Open AI
Using Azure Open AI
Provision an endpoint in Azure, and the models you want to use.
Export and edit the provider, changing the URL as required.
Create a new secret only credential within Control Hub.
For support setting up a secret only credential see our guide on creating secret only credentials.
Update the provider with that correct path.
Troubleshooting
Sometimes the Tiktoken's tonkenizer is unable to resolve which causes an error on every call. "Failed to resolve 'openaipublic.blob.core.wi". This is caused by networking rules in certain environments.
The following steps resolve the issue by removing the need for the above call to occur in the first place.
Download the tiktoken tokenizer. https://openaipublic.blob.core.windows.net/encodings/cl100k_base.tiktoken.
If you are unable to download it from this link you may need to try on an unrestricted network.
Rename the file when it is downloaded to 9b5ad71b2ce5302211f9c61530b329a4922fc6a4
This needs no extension.
Create a new folder named tiktoken_cache.
This folder can have any path for example, C:\tiktoken_cache.
Move the downloaded and renamed item to this folder.
Set an environment variable called TIKTOKEN_CACHE_DIR that points to the folder you created.
Last updated