language aware tools
# support
z
Hello there! We are LOVING vapi it's so much beter than Syntfhlow and some other services - so much nicer too. Question tho, we have setup a multilingual agent (via vapi dashboard, cuz it was like super simple), and when it calls tools, it always reads the tools in ENGLISH - is there a way (via dashboard preferably) to make the tools message read out in the language of the ai? or do we only do this via the api?
v
Hey, great to hear you’re enjoying Vapi! I can help you get your multilingual agent to read tool messages in the right language. Usually, you can handle this either by setting language-specific tool prompts in your dashboard or dynamically through the API. The best option depends on how your tools are currently set up. Are your tool descriptions written only in English, or do you already have versions in other languages? @zackrspv
z
We created the tools on the dashboard - as that’s the simplest way. Those are if course done in English. Our primary bit is set to multi lingual with transcriber on multi. When users call in it asks them to press or say 1 for English or press or say two for Spanish and we do handoffs between both bots. The tools are added to both bots. Creating double tools just because we have two bots doing the same thing seems…pointless
v
Hey, I get what you mean, creating duplicate tools for each bot isn’t ideal. The reason it still speaks in English is because the dashboard tools don’t auto-translate yet. I can help you set it up so the tool messages switch language automatically based on the caller. It just needs a simple API tweak to handle translation on the fly. Kindly let's discuss more privately. @zackrspv
z
I see the instructions after searching for that here. Guess I missed the article on it. I’ll review and give it a try. If I cannot get it, I’ll reach out to ya
v
Alright Kindly let me know how it goes @zackrspv
r
Can you please share the article or “simple API tweak” to get this working? I appreciate it.
c
if you would like an assistant to speak the detected language before and after tool calls, use a multilingual transcriber like deepgram and voice with
eleven_turbo_v2_5
or
eleven_multilingual*
and leave the request-start message blank. instruct the assistant to speak the detected language.
4 Views