Hi there, I'm having issues using the test suite for both voice and chat. Chat: When the test runs, the user doesn't wait for the ai to speak, and continues to speak and ends up answering their own question (or this could be a result of agent mix up) See image Voice: When the test runs, the user sometimes speaks first, interrupting the agent. Could this be caused by latency? All in all, I'm seeing a lot of inconsistent test results even when the log is a 1-2 sentence. My test suite id is: dd5cd4b6-5f46-4569-b8b8-9042210b634f Appreciate any help! https://cdn.discordapp.com/attachments/1394676676721508445/1394676676935548999/image.png?ex=6877ad5f&is=68765bdf&hm=cc57a48ae02eae37c9096ccb0e301b4a7cf85256306ad6272e71c316c15b7923&

Try increasing interruption thresholds, adding slight response delays like 0.5secs, adjusting endpointing to 300ms..

Hey, thanks for the reply. Are you referring to the agent config itself or the testing agent? We've configured the agent with start/speak plans that work in our environment. Are you suggesting we increase the delays with a duplicate agent for testing purposes?

Hey bobbychick, I sincerely apologize for the delay in our responses this week. We experimented with some process adjustments that didn’t work as intended, and unfortunately, this caused some disruptions. That’s entirely my responsibility. Just a quick note—our team is unavailable on weekends. However, if something urgent or critical comes up, feel free to reach out to me directly, and I’ll assist you. The support issues will be resolved in the coming weeks, and starting Monday, you can expect more consistent and improved support. Thank you so much for your patience and for continuing to stick with us!

hey @Shubham Bajaj thanks for the update! I'm seeing the same exact thing

Thanks @Shubham Bajaj for the response - Will give it a go this week. In the meantime, do you have any available resources on best practice guidelines? I do feel lik there has been some recovery, but still not in an ideal state. The highest priority for my team is for the testing to be able to accurately distinguish roles, let me know if you need any additional information

Here is some documentation regarding test suites, which includes some examples of best practices -->

Hey guys, has this been fixed by any chance? I'm seeing a similar behavior for chat https://cdn.discordapp.com/attachments/1394676676721508445/1397609828771430460/image.png?ex=68825915&is=68810795&hm=d14545d2644f99ecdeb3b45c0fc69b0520140c5b522ba7a70d5ea5b26d2401ae&

Hi, First off, we want to sincerely apologize for the delay in getting back to you. We understand how frustrating it is to wait - especially when you're counting on us - and we owe you a clear explanation of what’s been happening and how we’re addressing it. Over the past few weeks, we've seen a significant increase in support requests. While this reflects exciting growth, it has also stretched our small team and exposed some real challenges in scaling our support operations. To improve your experience, we’ve taken a step back to reassess our approach. Here’s what we’re implementing: - Smarter Support Through Automation: We’re investing in our AI support systems to help you resolve issues more efficiently. Soon, our support bot will offer expanded capabilities, making it easier to access accurate, instant help—particularly for common or repetitive queries. - Expanding the Support Team: To meet growing demand, we’re adding 2–3 new team members focused on managing support volume and improving response times. - Prioritized SLAs for High-Usage Accounts: We’re introducing service level improvements for users who are growing with us: - Accounts with usage over 1,000 minutes/month will receive prioritized support. - For all general inquiries, we’re establishing a standardized 48-hour response time. We’re confident these steps will lead to faster, more reliable support and help us better serve you as you grow with us. Also, in case you still need help with this ongoing ticket, do let us know, and we will help you get this resolved as soon as possible. Thank you for your continued patience and for being part of our journey. Warm regards, Vapi Team

Hi I also have the same problem. Dear Vapi team, could you tell, please, when are you going to fix it?

Test suites are currently under development and there is no ETA yet. Thank you for hanging in there.