Connection VAPI with Azure OpenAI
# support
m
Hi, I use VAPI through an Azure OpenAI model deployment, but it fails directly after connecting. The message "Exiting meeting because room was delayed" appears straight a few seconds after I start to speak - if I wait with speaking, the call maintains until I begin to speak. So it breaks as soon as it receives my first words. The logs say "Pipeline no available mo..." The call-id`s are f9bba5df-92e0-4ace-9945-721914514ea6 (long call) and e071a88c-4bd2-419d-b32d-899d934bc00d (short call). Here is the setting I use on my Azure OpenAI deployment, together with the setting I use on VAPI and on the Provider Credentials. Is there anything wrong? I notice the Azure OpenAI deployment has its own parameters like temperature and maximal response length, could that interfere with the settings of the VAPI assistant? I also noticed that every time I refresh my Provider Credentials page, the Azure OpenAI section shows "australia" with a mark beside it, and I have to select "swedencentral" manually every time - and only then the mark is rightfully on "swedencentral". Could it be that VAPI doesnt save the filled out credential?! Because I wonder what happens if there are multiple connections, which one selects VAPI then, if the mark isnt placed on the preferred one? Thanks for helping me @Shubham Bajaj https://cdn.discordapp.com/attachments/1343704609096601693/1343704609813954690/Screenshot_2025-02-24_125741.png?ex=67be3def&is=67bcec6f&hm=b2efd2b5020ae0e23626f4547329be3ee02a2e36582ad2dd0cbb2b66827e5b42& https://cdn.discordapp.com/attachments/1343704609096601693/1343704610136657940/Screenshot_2025-02-24_125831.png?ex=67be3def&is=67bcec6f&hm=5e26104746ef349f353afbc06ac508505b556048ced671b239c60ae722c06df6& https://cdn.discordapp.com/attachments/1343704609096601693/1343704610468003860/azure_openai.jpg?ex=67be3def&is=67bcec6f&hm=cc992947a0e3f5c3f946dbab5440d7eb81b8b834a557ebac2361650029add200& https://cdn.discordapp.com/attachments/1343704609096601693/1343704610703147229/Screenshot_2025-02-24_131121.png?ex=67be3df0&is=67bcec70&hm=eda2ada25127710fd6a84ef39d72d3785be52eb25e457f51aa68afd7c6d2a4aa& https://cdn.discordapp.com/attachments/1343704609096601693/1343704610988363776/Screenshot_2025-02-24_131444.png?ex=67be3df0&is=67bcec70&hm=a222e095dfd812eae8d7a0605515f74e5e2e70dd61ed67a15c221794bfd4c8d4& https://cdn.discordapp.com/attachments/1343704609096601693/1343704611260727417/vapi_credentials.jpg?ex=67be3df0&is=67bcec70&hm=053edfc6f085e0c8c6dd290deb3db368985fc33c4bc48ebdf761e8384bc6599e&
k
1. Your using BYOK with azure openai with swedencentral region 2. We dont have gpt-4o-2024-08-06 with region swedencentral in
AZURE_OPENAI_MODELS
3. Because your using BYOK, we try to filter for models based on the keys you've supplied: 4. Since we don't have swedencentral with the gpt-4o variant in
availableModels
, the second if statement never evaluates to true (region mismatch). Hence availableModels becomes empty and llm stream errors out with
Pipeline no available mo...
m
What do I have to do?
I need to have it in an EU region (or in Norway, Switzerland or UK).
Maybe you can provide a general workflow for EU users in need to follow data protection rules, which includes the use of knowledge bases (preferably via BYOK since it works). @User
Hm, gpt-4o-2024-08-06 is in the selection when swedencentral is choosed. In fact I choosed swedencentral because it has access to the newest version gpt-4o-2024-11-20 on Azure OpenAI, maybe VAPI can include this model version to give EU users the optimal solution.
It also doesnt work with gpt-4o-2024-05-13, neither with swedencentral (call-id 3feed894-2d98-44cd-af75-dfc37386a4d4) nor with France (call-id c53d9836-ecf4-403b-8f08-3a40d526a10d).
s
@Mario Sorry for the delay. We haven’t added those regions to our available regions list. I’ll create a feature request to add them and let you know when they’re available.
m
Can you please add especially swedencentral with the model "gpt-4o-2024-11-20"? @Shubham Bajaj This would be the optimal solution for EU users who have to follow data protection rules. Thank you! 🙏🏻
s
@Mario To unblock you for now, I recommend using
gpt-4-1106-preview
model in swedencentral region.
@Mario I will add these models and let you know.
l
@Shubham Bajaj This is highly needed here as well. It would be very appreciated if you could prioritise this feature. gpt-4o-2024-08-06 in swedencentral
o
I want to build on that, EU region for data protection rules is highly needed.
I was able to follow above advice along and connected gpt-4-1106-preview model in swedencentral region today. But it was needed to be triggered via API. The Model->Provider dropdown doesn't give me azure-openai option via VAPI dashboard (Web UI).
Until you add more models in the EU region, is there a list or documentation, to see which models you support in which azure region?
m
They say you can use "OpenAI" in the dropdown menu, but in the Provider Credential section you must not have your OpenAI account connected in the "OpenAI" section there, just the "Azure OpenAI" section, otherwise it will use your OpenAI-APIs instead of your "Azure OpenAI"-APIs.
k
Hello Oliver, glad to hear you got it partially resolved. As for that list we don't currently have it but feel free to drop that request here:
l
Azure News today: On 17 April 2025, we’ll begin upgrading preview models of GPT-4 (which include 1106-preview, 0125-preview, and vision-preview) to the latest GA version of GPT-4o 2024-11-20. So please prioritise this
m
Thank you very much, have sign it! @Oliver wanna too?
o
Super, thanks @lennox1113. I upvoted on vapi.canny.io
b
Done this side too.
3 Views