Hey everyone, I’m fairly new to voice agents and currently struggling with structuring the system prompt.
I’ve read that the recommended prompt length is around 1000 tokens, but for our inbound agent we need to include company information like FAQs, services, and working hours, which brings us to around 2500 tokens.
Would it be better to move this information into a knowledge base? Also, does a larger prompt mainly increase the chances of hallucinations, or does it significantly impact latency as well?