Latency is very high for real time conversation
# support
h
Hi , The latency I am getting is 700 ms although I am using groq and Deepgram combo along with azure which claims to have a minimum latency of 200-300ms . But what we are getting now is not acceptable for a phone call , since many of our customers are not able to understand that the bot is about to respond. https://cdn.discordapp.com/attachments/1271760107188781086/1271760107654615062/VID_20240807013948.mp4?ex=66b88265&is=66b730e5&hm=c8658fcc61731bd024cd8094d71fc9d2a5e05d765c5182471ee95f5c30a42b19&
v
message has been deleted
@Hirekarigar Hello! I understand that experiencing higher latency than expected can be frustrating, especially when it affects the quality of phone calls with your customers. To address this issue, we should look into several factors that could be contributing to the increased latency: 1. Network conditions between your service and the Azure servers. 2. The specific configuration and resource allocation for your services in Azure. 3. The integration points between GROQ, Deepgram, and Azure, and how they are managed within your application. To begin troubleshooting, I recommend the following steps: - Review your network setup to ensure there are no bottlenecks. - Check the Azure service configurations for any potential optimizations. - Analyze the integration flow between GROQ, Deepgram, and Azure to identify any inefficiencies. If you've already gone through these steps and the issue persists, it might be beneficial to reach out to Azure support for a more in-depth analysis of your setup. They can provide insights specific to their infrastructure that could help reduce latency. If you need further assistance with this or any other concerns, please let me know!
You can continue this conversation by mentioning me in the message.
h
@Vapi sir I have not configured groq , Deepgram or azure , I am using Vapi' s service so please help me resolve the issue .
v
@Hirekarigar I apologize for the inconvenience you're experiencing. Since you're using VAPI's service, which integrates with Deepgram and Azure, we should look into the issue from VAPI's end. To assist you better, I'll need to gather some additional information: 1. When did you start noticing the increased latency? 2. Is the latency consistent across all calls or does it vary? 3. Have there been any recent changes to your VAPI service configuration? Once I have this information, I can provide more targeted assistance. If this is an urgent issue, I would also recommend reaching out to VAPI's support team directly for immediate help.
h
Since when i converted to a paid account it's very slow .
s
@Hirekarigar please share the call id.
h
@Shubham Bajaj sorry to say but I have been reaching out to you since I started on Vapi ....you always ask for a call id ..but never ever able to give me a resolution. What do you actually do with call id ? Cc @jordan @User
s
Hello @Hirekarigar, I understand your frustration but, the latency shown on the dashboard is approximate and may fluctuate based on your location and the provider's current load. We've optimized speeds to the fullest but continue to seek further enhancements. If you share the call_id with @Shubham Bajaj, he can investigate the specific causes of delay and explore potential improvements if there are any.
h
@Sahil thanks and sure i will share the call id. But it's not call specific, happening for call calls . But still I can share
s
I get it; that’s happening for all your calls, but it might be related to your assistant configuration. So, we will need something to see if we can improve it or not.
2 Views