currently my latency is too much, it's
# general-english
e
currently my latency is too much, it's like 5 seconds or something, trying to get it down... but what is a good way to troubleshoot why the latency is this high?
l
If you go into vapi dashobard at the top of your assistant you should see latency details. It will show you exactly what is causing the latency.
e
yes but that's only an estimate right?
p
This is innacurate
l
It is not 100% accurate but it can give you sense of what is the bottleneck.
e
for me it say's 900ms but it' smuch more then that... e.g. when I measure from when I stop talking, until agent responds... it's like 5 seconds
p
This doenst take in mind any network latency
e
I understand there is also a delay of Twilio...
l
Okay then it is a bigger problem to investigate.
e
but I just want to figure out what is causing the delay
p
Where are you physically? 🙂
e
Netherlands
using Twilio
p
Yeah, so that's additional 300-400ms
Maybe more
But 5s is a lot
e
but weirdly enough... if I but my voice to a Dutch (netherlands) voice... then latecy is like 2-3 seconds which is acceptable to me
p
You can see in call logs how long LLM takes I believe, openAI is quite janky lately, response times deviate immensely request by request
e
ah maybe that explains why sometimes it's fast, while other times it's slow 🙂
so where exactly in the call logs can I see latencies?
e
ahhhhh
🙏
p
yeah, INFO tags
e
thank you for shoign that
great! now I have something to test with
p
Your endpointing is quite long
Check your assistant settings
"Start speaking plan" or whatever its called
3 Views