OpenAI HTTP request is failing a lot
# support
a
Latency, using a reasoning model in OpenAi can take 10-20 seconds for a response so if your agent isn’t expecting that it might call it again too soon, using LLM is not instant and adds a LOT of latency, especially for specific non real time prompts
k
So nothing can be done to increase success?
a
What are you using OpenAi for?
k
Thats my model for my assistant I am not sure what you mean. It uses my prompt to generate responses.
a
i see, i thought you were doing an external api
i'm not sure why it's calling twice then
k
Sometimes it calls twice and others it works the first time im not sure what I can do
I think maybe its retrying the request too early.
Because I look at normal time between request and output and for my assistant its usually 1.2-1.4 seconds and i noticed that it retrys the request at 1.5seconds. Im thinking maybe if it didnt retry the first request is probably almost done.
Is there a way to extend the time it waits before sending another model request? Instead of 1.5 seconds which is how long it seems to wait maybe set that too like 2 seconds or longer
Does anyone know if that is possible?
4 Views