https://vapi.ai/ logo
Join Discord
Powered by
Language Detection VAPI squad
# support
s
I'm having difficulty with getting my Dutch assistant to transfer over to my English assistant. I'm using the assistant-request for the squad for inbound calls. The Dutch assistant is picking up but he's not switching over to the English assistant.` a4e57d87-925d-485d-b3ca-ac4e5d42b03d
v
@Saien | Exousia AI I'm sorry to hear you're experiencing issues with transferring calls between your Dutch and English assistants. To assist you better, could you please provide me with the name of the English assistant you're trying to transfer to? This will help me guide you through the correct process or perform the necessary actions to resolve the issue.
You can continue this conversation by mentioning me in the message.
s
Leo - English
v
@Saien | Exousia AI Thank you for providing the name of the English assistant, Leo. To troubleshoot the issue with the assistant-request feature, I'll need a bit more information: 1. Are you using a specific command or API call to initiate the transfer? 2. Is there any error message or behavior that indicates why the transfer isn't happening? 3. Have you set up any specific rules or conditions for the transfer that might not be met? Once I have this information, I'll be able to provide you with more targeted assistance or suggest the next steps to resolve the issue.
s
@User
Okay I seemed to get it to work but how can I ensure that it always works? b75d74b7-f61c-48a9-a8a3-852b924ee6e0
Latest test didn't work: 23cffb11-347e-4174-b51a-e339350b49cc
s
didn't work because no mention of transfering to english assistant.
Copy code
"transcript": "AI: Cash desk support met Leo. Hoe kan ik je vandaag helpen\nUser: Hi, Dior speakick.\nAI: Hallo Dior, hoe kan ik je vandaag helpen\nUser: Hallo, inlippus\nAI: Hallo Dior, hoe kan ik je vandaag helpen?\nUser: Kennspeed de Inclus assistent.\nAI: Het lijkt erop dat je een vraag hebt\n",
s
Please listen to the call recording
If you listen to the call recording you'll hear me speaking English but it's not registering on the transcript.
Here's what I mean @Shubham Bajaj The call ID is a721e8ff-4d97-4a97-9feb-2866da32bb72 The call transcript is: AI: CASHdesk support met Leo. Hoe kan ik je vandaag helpen? User: Hi, laat de speechste inlus assistent. AI: Hallo ik begrijp dat u hulp nodig heeft met de spraakgestuurde assistent. Kunt u mij vertellen wat precies het probleem is? Dan help ik u graag verder. Kunt u mij vertellen wat u precies wilt? Dan help ik u graag verder. But listen to the call recording: https://auth.vapi.ai/storage/v1/object/public/recordings/a721e8ff-4d97-4a97-9feb-2866da32bb72-1726144375656-1df294e0-965b-47cc-95eb-3a93eaa375af-mono.wav I'm clearly speaking English but it's not getting picked up
I set "languageDetectionEnabled": true in the API but I think since it's Dutch, it isn't supported
s
@Saien | Exousia AI this is what you can do [1] try without knowledge base [2] Transfer the call to english speaking assistant or customer representative named [3] turn off language detection and knowledge base
the first one will work.
s
Should I put [2] in the destination?
Also I really need the knowledge base for the assistant so is there a way to get the language detection to work while still using the KB?
Because the bot is a customer support agent and for each question, it relies on the knowledge base for the answer
s
use external tools for KB and still you can use language detection.
try if works for you.
I understand but squads are having issue with KB as of now, so using external tool will be a great save here and we are working on KB alternatives.
s
I tried it out. It doesn't work all of the time. How can I guarantee that the Dutch assistant always transfers the call to the English assistant 100% of the time when the lead speaks English on the call. I can't make the condition that the caller asks to speak with the English assistant because the caller won't know that there's multiple assistants for each language
Here's the assistant request JSON I'm using:
Copy code
{
  "squad": {
    "members": [
      {
        "assistantId": "060c7ba3-8ddb-4dec-84ff-4f47c51b548d",
        "assistantDestinations": [
          {
            "type": "assistant",
            "message": "Please hold on while I transfer you to the English assistant.",
            "description": "Transfer the caller to the English assistant if they speak English on the call.",
            "assistantName": "Leo - English"
          }
        ]
      },
      {
        "assistantId": "2cf02d08-0d51-4b86-9e45-02870a31d188",
        "assistantDestinations": [
          {
            "type": "assistant",
            "message": "Wacht even terwijl ik u doorverbind naar de Nederlandse assistente.",
            "description": "Transfer the caller to the Dutch assistant if they speak Dutch on the call.",
            "assistantName": "Leo"
          }
        ]
      }
    ]
  }
}
And I already removed the KB for both assistants
s
I understand your concern but description is all about this you have to try out different descriptions or derived the conversation according to your process from first message.
s
Why did you mark the ticket as 'solved' it's not been resolved. I see that the main issue arises from the fact that Dutch isn't part of the languages in the language Detection API config from VAPI so that is definitely causing complications. I'm keeping this ticket open until I either get the language detection in Dutch to work completely or if it is confrimed to be impossible as of right now to get it to work 100% of the time
s
@Saien | Exousia AI enable `transcriber.languageDetectionEnabled`for all of your assistants.
s
No because Dutch is not supported for that setting
Also you recommended me to turn it off in [3]
s
yeah but your case is different.
@Saien | Exousia AI you have to turn it on and then use it in description like "Transfer the caller to the English assistant if the response you received is in English language."
lmk how it goes.
s
in what way?
Okay I will try it
s
@Saien | Exousia AI hows it going?
s
swamped with work from other clients so I haven’t had a chance to work on this yet
I’ll update tomorrow or so
I just tested it and it seems to be working. Thank you very much for the help bro, really appreciate it
But now I just want to test and see if it works with a knowledge base attached as well.
Okay so the calls transfer to the other squad member isn't working when the knowledge base attached. Is there any workaround I can use without using a tool to sync with an external knowledge base? I don't want the assistant to have to say a phrase everytime it checks the knowledge base
Here's an example of the transfer working when no KB is attached (1 min recording): https://auth.vapi.ai/storage/v1/object/public/recordings/305dffd7-97d7-4c3d-8790-693c922b82da-1726749066956-8580a00e-6e6a-44d3-8497-c37de702a387-mono.wav Call ID: 305dffd7-97d7-4c3d-8790-693c922b82da
But in this call when I add in the KB, the it doesn't transfer to the English assistant. It just starts speaking English yet I'm talking to the Dutch assistant a843658e-2b63-420b-b57a-155ac37653ab
When I add in the knowledge, the language detection gets quite inconsistent. Sometimes it works sometimes it doesn't. Like in this call, the Dutch agent transferred to the English agent but it didn't work the other way around. https://auth.vapi.ai/storage/v1/object/public/recordings/c309dea0-63e9-4617-9378-f9ec04bc8749-1726750651413-9447dd06-179e-4fd2-bed3-0336e0a1c5f6-mono.wav id c309dea0-63e9-4617-9378-f9ec04bc8749
Should I update the prompting of the assistant to hopefully improve the call transfer? I don't think I should because doesn't that logic get handled by the squad and not the individual assistant? @User
In this call, the Dutch agent didn't transfer the call to the English agent. id 4ef4427d-18d2-4e9c-8525-20f8058e33b4
@Shubham Bajaj it's proving to be quite difficult to get this langugage detection to work all of the time. id 024f6001-eb45-48b2-bbe9-abcf1680d58f https://auth.vapi.ai/storage/v1/object/public/recordings/024f6001-eb45-48b2-bbe9-abcf1680d58f-1726754887509-9ae24c8c-55f3-4339-925a-4045f7606ea1-mono.wav
s
@Saien | Exousia AI as of know KB has issues with Squads so you have to use external tool and you can set tool messages array to empty array([]) so it doesn't speaks those messages.
2 Views
PreviousNext
Powered by