Getting 3400ms latency
# support
g
Hey all, been experiencing 3-5 second latencies recently. I've looked at the logs, and it says the model (gpt4o) is taking 3 seconds to return a response. Is this something that can be adjusted, or is it simply up to Open AI in this case? Call ID - 8371cfd5-1b0a-4d05-8fa6-b210c4e4a20f https://cdn.discordapp.com/attachments/1260314608455909437/1260314608619618464/image.png?ex=668edef2&is=668d8d72&hm=58b692203995af77b3ef8d2e5f3005497f6b556dc63d2b5c2b40bc36c529b787&
v
@Gabriel C I'm sorry to hear that you're experiencing high latency issues. The response time for the model can indeed vary based on several factors, including server load and the complexity of the request. However, if you're consistently seeing a 3-second delay, that's something we should definitely look into. To address this, we can review the specific call ID you've provided and investigate any potential issues on our end that could be contributing to the delay. We can also explore optimization strategies for your requests to ensure they are as efficient as possible. Let's start by reviewing the conversation data associated with the call ID you've provided. I'll look into this right away and get back to you with more information. Please hold on for a moment.
You can continue this conversation by mentioning me in the message.
s
@Gabriel C try now.