my german bots work quite well and have low latenc...
# german-speaking
m
my german bots work quite well and have low latency. One thing I have observed is that often times, if latency is super high, the prompt itself is not optimal (it may contain unclear instructions or contradictions), which leads to the LLM taking lots of time to respond. So you could try to create a super simple prompt and see if this improves latency
2 Views