AI Not Responding After Greeting in Test Suite
# support
m
Hello, I’m running into a recurring issue during my Test Suite runs. The assistant plays the greeting message (“Thank you for calling .......”) but never responds to user lines after that. Here’s what’s happening: The AI speaks the greeting successfully (so the model + voice work). The test script then feeds all user lines, but the transcript shows no AI responses beyond the greeting. My assistant responds normally during manual calls (Talk to Assistant), so this only happens inside the Test Suite. Test Suite reasoning says: “Transcript only includes user input and lacks AI responses.” Setup details: Model: gpt-4o Voice: ElevenLabs Turbo v2.5 Transcriber: gpt-4o-transcribe First Message Mode: “Assistant speaks first” Test Suite script uses multiple user messages (no parentheses, standard text) What I’ve tried: Adding and removing parentheses like (If asked) — no change Running manual calls (AI works perfectly there) Checking “Always Reply” and “Never Stay Silent” in the prompt — both are set to true Goal: I want the AI to reply naturally after each user message inside the Test Suite (like a real call). Could this be a timing / step delay issue in Test Suite configuration, or something to do with how user messages are injected? Any guidance on fixing this would be hugely appreciated — I just need the AI to actually respond in Test Suite mode again.
c
Hi there, Thank you for your message. Our team is currently out of the office. We operate Monday through Friday, from 9:00 AM to 8:00 PM Pacific Standard Time (PST). We’ll get back to you as soon as possible during our normal business hours. If your message is urgent, please mark it accordingly or include “URGENT” in the subject line, and we’ll do our best to respond promptly. Warm regards, Vapi Customer Support Team
v
Try switching your Test Suite to use the "Chat" test type instead of "Voice" for faster and more reliable agent response during testing. In your Test Suite, when adding or editing a test, select Chat as the test type, then define your user script as plain text lines (no parentheses needed). This approach isolates conversational logic and often resolves issues where the agent fails to respond after the greeting in Voice tests. Example:
Copy code
User: Hi, I have a question about my account.
User: Can you check my recent transactions?
For more, see the [Test Suites documentation](https://docs.vapi.ai/test/test-suites). Sources: - [Test Suites](https://docs.vapi.ai/test/test-suites) - [Chat Testing](https://docs.vapi.ai/test/chat-testing)
c
Hi MtDew, To set up and run a Test Suite for your AI voice agents, follow these steps: 1. **Create a New Test Suite**: Navigate to the Test tab in your dashboard, select Test Suites, and click Create Test Suite. 2. **Define Test Suite Details**: Enter a title for your Test Suite and select a phone number from your organization, ensuring it has an assistant linked to it. 3. **Add Test Cases**: After creating a Test Suite, add test cases by clicking Add Test. You can add up to 50 test cases. 4. **Configure Each Test Case**: - **Script**: Create a behavior script for the AI tester. - **Type**: Choose 'Chat' for text interactions or 'Voice' for call simulations. - **Rubric**: Specify evaluation criteria/questions. - **Attempts**: Determine the number of execution attempts per test case (up to 5). 5. **Run and Review Tests**: Execute your Test Suite by clicking Run Tests. Review the outcome where successful tests have check marks and failed ones have x-marks. You can view detailed results by clicking on individual test cases. For more information, refer to the [Test Suites](https://docs.vapi.ai/test/test-suites) documentation.