Join Discord
Powered by
We convert all the LLM provider to OpenAI format a...
# general-english
s
Sahil
06/02/2025, 5:47 AM
We convert all the LLM provider to OpenAI format and this preprocessing can add up 10-20ms but apart from it. I don't think you should see any additional latency.
4
Views
Previous
Next