mispronounced words
# supportm
Mark
05/30/2024, 8:43 PMHey guys, hope all is well. Wanted to ask a question as I've been beating my head on this problem for a few days now. I tested over 100 calls and numerous variations of agents, transcribers, models, etc and end up at the same spot.... There's a script I'm running and few words always seem to be mispronounced "ie. unpaid, vehicle, convenient". It ruins the flow of the entire agent and due to the mispronunciation by the AI agent of those specific words, the calls end up sounding robotic vs humanlike.... 95% of the call is okay but 5% gets disturbed due to those words, I've tried various variations to fix it but still no luck. What are your suggestions?
v
Vapi Support
05/30/2024, 8:43 PMHi @Mark, I'm an AI assistant for Vapi. I'll analyze available sources and get back to you shortly.
Vapi Support
05/30/2024, 8:43 PM### Answer
To address the issue of mispronunciations in your voice assistant's script, you can try several approaches to enhance the pronunciation clarity of your AI model:
1. **Customize Text-to-Speech (TTS) Settings**: Adjust the TTS settings to better handle specific phrases or words that are frequently mispronounced. This might involve tweaking the phonetic representations of words in the script.
2. **Explicit Tool Integration**: Use explicit instructions in your system prompt or script to guide the Text-to-Speech engine on how to pronounce difficult words. For example, phonetically spell out problematic words in a way that the TTS system can interpret them more accurately [(1)]() .
3. **TTS Provider Adjustments**: Consider experimenting with different TTS providers or voices that might offer better pronunciation for the specific terms that are problematic. Each TTS engine might handle speech synthesis differently, and some might have better outcomes with certain types of words or phrases.
4. **Feedback Loop**: Implement a feedback loop where mispronunciations can be flagged by users or testers, and adjustments can be made iteratively to the script or the TTS engine settings.
5. **Advanced Customizations**: If the standard adjustments are not sufficient, you might need to resort to more advanced customizations like using SSML (Speech Synthesis Markup Language) to fine-tune the pronunciation, pitch, and speed of specific words within the script.
By systematically applying these adjustments, you should be able to reduce the instances of mispronunciation and enhance the overall human-like quality of your voice assistant’s interactions.
For more detailed guidance on managing and adjusting TTS settings, you can refer to the specific documentation sections on tool integration and TTS customization within the Vapi platform do
Vapi Support
05/30/2024, 8:43 PMcumentation.
s
Sahil
05/30/2024, 8:53 PMCan you send me one call_id with the proper spelling, pronunciation, along with the audio timestamp?
Sahil
06/03/2024, 12:41 PMMarking it as complete as there is no follow up.
m
Mark Patterson
06/06/2024, 4:27 PMHi Sahil, I just saw your reply here. I'm still having the same issue. For example it cannot pronounce the word "allowed" here is the = call ID a66f347d-aadc-4501-bb2b-04c0c7bff6f1
Time stamps # 1 = 01:17
Time stamp # 2 = 01:46
s
Sahil
06/06/2024, 6:45 PMChange your voice provider it will fix the issue,
u
1lyad
06/06/2024, 6:55 PMfacing same thing with 11labs, also it repeats sometimes sentences multiple times
1lyad
06/06/2024, 6:59 PMJust checked other tickets, that knowledge base is breaking it, will try to remove it
7 Views