Vladimir
03/18/2025, 8:40 AMneelmehta247
03/18/2025, 5:23 PMneelmehta247
03/18/2025, 5:23 PMShubham Bajaj
03/19/2025, 1:55 AMcodeSwitchingEnabled
option
- This automatically switches the transcriber's language when the customer's language changes
- VAPI uses a custom trained model to detect language changes
- Supported languages include: Arabic, Bengali, Cantonese, Chinese, English, French, German, Hindi, Italian, Japanese, Korean, Portuguese, Russian, Spanish, Thai, Vietnamese, and more (some with limited support)
2. **Gladia Transcriber with Automatic Multiple Languages**:
- Gladia transcriber can be configured with languageBehaviour
set to "automatic multiple languages"
- With this setting, the system doesn't require a predefined language and can automatically detect and switch between languages
3. **Talkscriber (Whisper) with Multilingual Support**:
- Talkscriber can be set with multilingual: true
option
- This allows it to handle multiple languages in a single conversation
## How It Works
The system includes a LanguageDetectionBuffer
that:
1. Processes audio input
2. Uses language identification (LID) to detect the language being spoken
3. Compares detected language with current language setting
4. If different and confidence threshold is met, it switches to the appropriate language model
5. This change can trigger the voice model to also adapt to the new language
When setting up an assistant with language switching capabilities, you need to:
1. Enable code switching/language detection on the transcriber
2. Configure a compatible voice model
3. The validation system ensures both components work together properly
## Setting It Up
To enable automatic language switching:
1. Set codeSwitchingEnabled: true
for Deepgram
2. Or set languageBehaviour: 'automatic multiple languages'
for Gladia
3. Or set multilingual: true
for Talkscriber
When properly configured, the system will automatically detect when a caller switches languages and adapt both transcription and voice response to match their language.Shubham Bajaj
03/19/2025, 1:57 AM