User response is <empty> when running chat based t...
# support
t
I've configured a test suite per the appointment scheduling example in https://docs.vapi.ai/test/test-suites#example-3-appointment-scheduling. I'm also using the default appointment scheduling assistant - Riley. But the test suites keep failing because in the transcript the user response is .
Copy code
AI: Thank you for calling Wellness Partners. This is Riley, your scheduling assistant. How may I help you today?
User: <empty>
AI: It seems like I didn’t catch that—how can I assist you with scheduling today? Are you looking to book, reschedule, or cancel an appointment?
User: <empty>
AI: I'd be happy to help you with scheduling. Let me get some information from you so we can find the right appointment. What type of appointment are you looking to schedule today?
p
Hey, Can you send me the latest call_id? Along with that, can you provide me the duration in the recording where you had this issue?
l
Hello, I was about to raise teh same issue, as i am having exactly the same problem.
Copy code
AI: Hi , you have reached Sea Breeze Physio. I'm Todd, an AI assistant. \n            Please note that this call is recorded for training and quality purposes.  I could not match your phone number to a client record. How can I help you today? How can I assist you today?
User: <empty>
AI: How can I help you today? If you’d like to check or book an appointment, I’ll just need your first name and date of birth to confirm your identity.
User: <empty>
AI: To assist you further, could you please tell me your first name and date of birth? This helps me find your record and make sure I’m looking at the right details for appointments or bookings.
User: <empty>
AI: To get started, may I please have your first name and date of birth? This will help me locate your record and assist you with your request.
User: <empty>
Test Suite ID: 1beb3925-0f58-4ce3-837d-d11b36439082
t
Hi, there are a lot more instances (i've never gotten the test suite to work) but here are some of my test IDs: - 5ee3bb43-f58b-433c-8b9a-05826506821 - 0b2c367b-bc3b-4b63-b4cb-583f404fa696 - 6cecae50-863a-4dcb-96da-f7daac425736
v
Check your test case script configuration. In the Test Suite, make sure the "Script" field for your chat test is filled out with a detailed, step-by-step prompt for the test agent. For example:
Copy code
markdown
1. Simulate a customer trying to schedule an appointment with urgency.
2. Begin by stating: "Hi, I'd like to book an appointment for next Monday at 3 PM."
3. If unavailable, ask: "What other times are available?"
If the script is empty or missing, user responses will show as
<empty>
. Double-check your test case setup and re-run the test after updating the script. [See example in the documentation](https://docs.vapi.ai/test/test-suites#example-3-appointment-scheduling) Sources: - [Test Suites Example 3: Appointment Scheduling](https://docs.vapi.ai/test/test-suites#example-3-appointment-scheduling) - [Test Suites Step 4: Configure Each Test Case](https://docs.vapi.ai/test/test-suites#step-4-configure-each-test-case)
c
I'm running into the same issue. All of the test suite functionality appears to be broken. I've generated these with AI and also manually testing both text and voice, and they all get an empty string for the user, completely broken. The test script configs are filled out with instructions. For the caller, something is broken in the back-end. https://cdn.discordapp.com/attachments/1375879648398807040/1376236042679615538/image.png?ex=68349731&is=683345b1&hm=2a938b3ba6a88287366539c430aa69308f41d899c4ab0ea92cc48524be348b73& https://cdn.discordapp.com/attachments/1375879648398807040/1376236043057107064/image.png?ex=68349731&is=683345b1&hm=864b8af8728fbf1f81386fb8569955111fbb52f050775370a95b8254f2fca803&
v
Action: Double-check that your test case's "Script" field is filled out with a detailed, step-by-step prompt for the test agent. For example:
Copy code
markdown
1. Simulate a customer trying to schedule an appointment with urgency.
2. Begin by stating: "Hi, I'd like to book an appointment for next Monday at 3 PM."
3. If unavailable, ask: "What other times are available?"
If your script is already set up like this and user responses are still
<empty>
, it may be a platform issue—please contact Vapi support with your test IDs for further help. [See example in the documentation](https://docs.vapi.ai/test/test-suites#example-3-appointment-scheduling) Sources: - [Test Suites Example 3: Appointment Scheduling](https://docs.vapi.ai/test/test-suites#example-3-appointment-scheduling) - [Test Suites Step 4: Configure Each Test Case](https://docs.vapi.ai/test/test-suites#step-4-configure-each-test-case)
If your test case "Script" field is already filled out and you still see
<empty>
user responses, this may indicate a platform issue not covered in the documentation.
The only documented cause for
<empty>
responses is a missing or empty script, so if your configuration matches the example below and the problem persists, please contact Vapi support with your test suite and test IDs for further investigation.
Copy code
markdown
1. Simulate a customer trying to schedule an appointment with urgency.
2. Begin by stating: "Hi, I'd like to book an appointment for next Monday at 3 PM."
3. If unavailable, ask: "What other times are available?"
Action: Email [support@vapi.ai](support@vapi.ai) or post in the [Vapi Discord #support channel](https://discord.com/invite/pUFNcf2WmH) with your test details, as this may require back-end attention. Sources: - [Test Suites Example 3: Appointment Scheduling](https://docs.vapi.ai/test/test-suites#example-3-appointment-scheduling) - [Test Suites Step 4: Configure Each Test Case](https://docs.vapi.ai/test/test-suites#step-4-configure-each-test-case) - [Vapi Support](https://docs.vapi.ai/support)
v
Message marked as helpful by @christian! 🎉
c
there's definitely an issue .. looking forward to getting this resolved because it's an awesome feature!!!
v
If your test case's "Script" field is already filled out and you still see
<empty>
user responses, this likely indicates a platform issue.
Next step: Email [support@vapi.ai](support@vapi.ai) or post in the [Vapi Discord #support channel](https://discord.com/invite/pUFNcf2WmH) with your test suite and test IDs for further investigation. This is the only recommended action if your configuration matches the documentation and the issue persists. [See documentation example](https://docs.vapi.ai/test/test-suites#example-3-appointment-scheduling) Sources: - [Test Suites Example 3: Appointment Scheduling](https://docs.vapi.ai/test/test-suites#example-3-appointment-scheduling) - [Test Suites Step 4: Configure Each Test Case](https://docs.vapi.ai/test/test-suites#step-4-configure-each-test-case) - [Vapi Support](https://docs.vapi.ai/support)
p
Hey @[timmmmmo](https://app.plain.com/workspace/w_01HYEQ5FKPH8CPX2MS608B6S51/customers/c_01JVWB4BY0PRBB9EY9G2W6JH6D/)**, @christian thanks for reporting this issue to us. We are doing rework on chat api and it will be ready to use in next 1.5-2 weeks.**
f
same issue here, unable to make the testing suite work
v
If your test case's "Script" field is already filled out and you still see
<empty>
user responses, this is a known platform issue.
The recommended action is to email [support@vapi.ai](support@vapi.ai) or post in the [Vapi Discord #support channel](https://discord.com/invite/pUFNcf2WmH) with your test suite and test IDs for further investigation. Vapi is currently reworking the chat API, with a fix expected in 1.5–2 weeks. [See documentation example](https://docs.vapi.ai/test/test-suites#example-3-appointment-scheduling) Sources: - [Test Suites Example 3: Appointment Scheduling](https://docs.vapi.ai/test/test-suites#example-3-appointment-scheduling) - [Test Suites Step 4: Configure Each Test Case](https://docs.vapi.ai/test/test-suites#step-4-configure-each-test-case) - [Vapi Support](https://docs.vapi.ai/support)
6 Views