is there a multi lingual transcriber-voice combina...
# support
v
btw is there any transcriber - voice model combination able to adapt to language of the caller? Say if caller speaks French it switches to French. If caller speaks Arabic it switches to Arabic and so on
n
google transcriber, 11labs voice
use Eleven Turbo v2.5 model for voice
s
@User Yes, VAPI does have transcriber-voice model combinations that can automatically adapt to the language of the caller. There are a few different approaches available: ## Automatic Language Detection and Switching 1. **Deepgram Transcriber with Code Switching**: - Deepgram's transcription service can be configured with
codeSwitchingEnabled
option - This automatically switches the transcriber's language when the customer's language changes - VAPI uses a custom trained model to detect language changes - Supported languages include: Arabic, Bengali, Cantonese, Chinese, English, French, German, Hindi, Italian, Japanese, Korean, Portuguese, Russian, Spanish, Thai, Vietnamese, and more (some with limited support) 2. **Gladia Transcriber with Automatic Multiple Languages**: - Gladia transcriber can be configured with
languageBehaviour
set to "automatic multiple languages" - With this setting, the system doesn't require a predefined language and can automatically detect and switch between languages 3. **Talkscriber (Whisper) with Multilingual Support**: - Talkscriber can be set with
multilingual: true
option - This allows it to handle multiple languages in a single conversation ## How It Works The system includes a
LanguageDetectionBuffer
that: 1. Processes audio input 2. Uses language identification (LID) to detect the language being spoken 3. Compares detected language with current language setting 4. If different and confidence threshold is met, it switches to the appropriate language model 5. This change can trigger the voice model to also adapt to the new language When setting up an assistant with language switching capabilities, you need to: 1. Enable code switching/language detection on the transcriber 2. Configure a compatible voice model 3. The validation system ensures both components work together properly ## Setting It Up To enable automatic language switching: 1. Set
codeSwitchingEnabled: true
for Deepgram 2. Or set
languageBehaviour: 'automatic multiple languages'
for Gladia 3. Or set
multilingual: true
for Talkscriber When properly configured, the system will automatically detect when a caller switches languages and adapt both transcription and voice response to match their language.
For your information, Deepgram's Transcriber only works with 11Labs' Multilingual Voice Model. I'll suggest pairing up 11Labs' Multilingual model with other transcriber services as well.
4 Views