Issue with (1) Squads call transfer and (2) refusi...
# supporta
Alejo
09/12/2024, 10:31 PMHey all! Having an issue with Squads, where the agent seems to have no understanding of it's role OR that it can transfer to another agent (prompts are short and clear). I tried with both Claude Sonnet (my preference for conversationability) and then tried GPT4o.
Call 1 (GPT 4o) where the agent straight up doesn't have any sort of knowledge that it can transfer the call. id: 6a690316-fea8-4f75-9a22-3418e8275992
Call 2 (Claude 3.5 Sonnet) where it transfered once but then reverted back to "as an AI language model, I can't...". id: 2c32e91c-a77d-4c33-bc80-159af0c41852
https://cdn.discordapp.com/attachments/1283917927111725098/1283917927304658985/Screenshot_2024-09-12_at_6.29.18_PM.png?ex=66e4bd3f&is=66e36bbf&hm=e728d72a0d129cedcd51ea34326d6cee8c50229f091fa0576af9650a8e429deb&
Alejo
09/12/2024, 10:32 PMOh and by the way when testing each individual agent without a squad it went great! Only start acting differently when in a squad.
v
Vapi
09/12/2024, 10:33 PM@Alejo
I'm sorry to hear you're experiencing issues with Squads. It seems like there might be a misunderstanding or a configuration error in the way the agents are set up to recognize their roles and the ability to transfer calls. To address this, we should review the setup of your Squads to ensure that each agent is properly configured with the knowledge of its capabilities, including the ability to transfer calls to other agents.
Could you please provide me with more details about how you have configured the Squads? This will help me assist you better. If you need immediate assistance with the technical setup, I would recommend reaching out to our support team for a more in-depth look into your specific case.
Vapi
09/12/2024, 10:33 PMYou can continue this conversation by mentioning me in the message.
Vapi
09/12/2024, 10:33 PMGot it. Tagging @User for additional help.
a
Alejo
09/12/2024, 10:33 PM@Sahil @Shubham Bajaj hey guys, not immediately urgent but if we can solve by tonight that'd be awesome - have a big demo tomorrow. Thanks!
j
jason
09/12/2024, 11:43 PMHey @Alejo do you have KB files with the assistant? If you do that is an instant killer of any squad functionality. I can talk more with you about this in our group call today. Let you know my experience. VAPI based KB files within a squad is like alcohol for your bot... it just seems to make it go loopy.
a
Alejo
09/12/2024, 11:50 PMLol no kb on the assistants
j
jason
09/12/2024, 11:59 PMHmmm weird... So no transfer is happening. And you're happy with the explanation of why to transfer? And you built this in platform as opposed to via API?
a
Alejo
09/13/2024, 12:10 AMYes (when to transfer, not why, am I messing that up?) and yes
j
jason
09/13/2024, 12:15 AMHave you tried an API postman set up of the squad to rule out that the on-platform squad set up is causing confusions.
a
Alejo
09/13/2024, 12:39 AMFair question
s
Shubham Bajaj
09/13/2024, 10:28 AM@Alejo looking into it.
Shubham Bajaj
09/13/2024, 11:01 AM@Alejo try using this squad config https://dump.sahilsuman.me/squad.json
Because this was your system prompt.
🔵 22:24:48:422 AzureOpenAIRequest. Messages:
[
{
"role": "system",
"content": "You are an assistant...."
},
{
"role": "assistant",
"content": "Welcome to coach to the max coaching simulation. Any questions before we begin?"
},
{"role": "user", "content": "Uh, no. We can start."}
]
Instead of this:
Purpose\nTo welcome users and introduce them to the AI-powered coaching simulation experience. You'll only do the introduction, and then immediately transfer the user to another agent, 'LISA v2 - Client Max'.\n\n## Key Characteristics\n- Friendly and professional tone\n- Clear and concise communication\n- Ability to set expectations and explain processes\n- Adaptable to user questions or concerns\n\n## Primary Functions\n- Greet users and explain the purpose of the simulation\n- Outline the structure of the coaching session\n- Introduce the \"lifeline\" feature and how to use it\n- Provide brief overview of the client they will be coaching\n- Offer opportunity for questions before starting the simulation\n- When the user is ready to start, transfer them to 'LISA v2 - Client Max'\n\n
Shubham Bajaj
09/13/2024, 11:02 AMBecause your prompt had assistant overrides which was passing ""You are an assistant...." into your system prompt.
a
Alejo
09/13/2024, 3:17 PM@Shubham Bajaj Thanks!
I wonder if that’s from the UI Squads setup 🧐
s
Shubham Bajaj
09/13/2024, 3:24 PMyes by default squads add these overrides when created using UI squads setup.