Multilingual Transcriber
# support
e
Hello, I've been watching several videos on YouTube claiming the capability of 'Multilingual Assistants' using your platform, and I have a question regarding this. It seems that while these assistants can respond in multiple languages, they can't transcribe languages other than the one set in the settings. This limitation seems to stem from the transcriber, not the assistant's capability itself. I know that Whisper by OpenAI can automatically detect and transcribe multiple languages without explicitly setting one. I used it many times in my apps, and it works like a charm. Could you please clarify if there's a way to configure the language settings in your system in such a manner? I cannot find an option in the dashboard to leave the language setting unspecified. I aim to enable the assistant to transcribe user responses in various languages, leveraging Whisper's capabilities. I appreciate your guidance on how to achieve this.
v
@Elizabeth Melnyk Hello! I'm glad to hear about your interest in creating multilingual assistants using our platform. You're correct that the ability to transcribe multiple languages can be crucial for a multilingual assistant. Regarding your query, our platform has evolved to make setting up multilingual support more streamlined. You no longer need to specify the desired language when configuring the voice assistant for language settings. Instead, you can directly choose a voice from your voice provider that supports the desired language. Since you're looking to leverage Whisper's capabilities for automatic language detection and transcription, you would integrate Whisper as your transcriber. Once Whisper is set up as the transcriber, it should automatically detect and transcribe the languages spoken by the user without the need for specifying a language in the settings. If you haven't already integrated Whisper or if you're unsure how to proceed with the integration, please let me know, and I can provide you with more detailed instructions or direct you to the appropriate resources.
You can continue this conversation by mentioning me in the message.
e
@Vapi well, I set Whisper in my setting as transcriber, but it doesn't transcribe my text correctly. it seems to try to transcribe it in the specified language. in your settings for transcriber, there is a language, and not an option to don't choose one for Whisper. So, I guess that this is the problem and issue of why the transcriber not working correctly when I start to talk with an assistant in different languages.
v
@Elizabeth Melnyk I understand the issue you're facing. It seems that the transcriber is not automatically detecting and transcribing languages as expected when using Whisper. This could be due to the language setting being locked to a specific language, which might be overriding Whisper's automatic language detection feature. To address this, you would typically need to ensure that the transcriber is configured to allow for automatic language detection, if such an option is available. However, based on your description, it appears that our platform's current settings may not provide an option to leave the language unspecified for Whisper. In this case, I recommend reaching out to our support team for further assistance. They can provide more detailed guidance on configuring Whisper for multilingual transcription or help troubleshoot the issue to ensure it transcribes correctly in various languages. Would you like me to guide you on how to contact support, or is there anything else I can assist you with?
e
@User
yeah, let's contact spport
v
@Elizabeth Melnyk I apologize for any confusion. To contact support, you can typically do so through the platform's help center or support section. Since you're experiencing issues with the language settings for the transcriber, they will be able to provide you with the necessary steps to resolve the problem or escalate it to the technical team if needed. If you're ready, I can initiate the process to contact support for you. Shall I go ahead and do that?
e
yeah, please
v
@Elizabeth Melnyk Sweet. Have a great day!
s
Hey @Elizabeth Melnyk , you can use deepgram and then set codeSwitchingEnabled: true and make sure to use 11labs v2.5
it will work.
e
I use 11 labs, 11 labs is not a problem... but a Transcriber, which transcribes to a specific language only. Deepgram supports only English or Spanish switches, I need to have all the languages switchable like Whisper does
if you use code whisper to transcribe, it has autodetection of language -> means I can start speaking any language (German, English, Spanish... etc. any language that whisper supports. and it supports around 90 languages) and will transcribe my speech. but in the UI of the transcriber setup for assistant, you hardcode language to only one. therefore if you test it it will not work this way. so it will only transcribe selected language. it will not autodetect language. -> Menas users could not speak all the languages from Whisper. but only one was chosen in UI.
Is it somewhere in your UI? because I didn't code anything. I use Dashboard from VAPI assistant: https://dashboard.vapi.ai/assistants/
@Vapi where can I find codeSwitchingEnabled toggle?
v
@Elizabeth Melnyk I apologize for any confusion earlier. It seems there might be a misunderstanding regarding the capabilities of the transcriber settings within the VAPI dashboard. If the
codeSwitchingEnabled
toggle or a similar feature for language autodetection is not visible in the UI, it's possible that this feature has not been implemented yet or is not exposed to users through the dashboard interface. Since you are looking for a way to enable language autodetection similar to Whisper's capabilities, and it's not available in the dashboard settings, the best course of action would be to contact support for more detailed assistance. They can provide information on whether such a feature is available and guide you on how to enable it for your assistant. Let me help you get in touch with support. Please hold on while I initiate the process for you.
s
Hey @Elizabeth Melnyk , deepgram supports multiple languages and we made our own model for language switching in deepgram. So, it works for various languages. You can enable this only via API tho.
s
@Elizabeth Melnyk how's it going?
because of no response closing this ticket.
3 Views