marem
03/25/2025, 3:49 PM6ff61393-8297-4b8b-94ef-726ad32912b1
Text sent to voice input is incomplete (it misses the meeting hour to suggest to customer).
Here is an extract from the call logs that illustrates the issue:
15:06:41:209
[LOG]
Model request started (attempt #1, gpt-4o-2024-11-20, openai)
Model output: Alors
Model output: ,
Model output: aujourd
Model output: 'hui
Model output: ,
Model output: le
Model output: prochain
Model output: cré
Model output: disponible
Model output: neau
Model output: est
Model output: à
Model output: 16
Model output: **
Model output: heures
Model output:
Model output: 45
Model output: **
Model output: Sinon
Model output: .
Voice input: Alors, aujourd'hui, le prochain créneau disponible est à .
According to model output, voice input should be: Alors, aujourd'hui, le prochain créneau disponible est à 16 heures 45.
instead of Alors, aujourd'hui, le prochain créneau disponible est à .
Vapi Support Bot
03/25/2025, 3:51 PM**heures**
), and according to the information I found, content between asterisks is removed during formatting between LLM output and voice provider.
According to the [Vapi documentation](https://discord.com/channels/1211482211119796234/1211483291191083018/threads/1342824967833653268), when LLM generated outputs go through formatting before being passed to the voice provider, any content inside asterisks (*) is automatically removed. For example, if the input is this *is* okie
, the output will be this okie
.
Here's how to fix this issue:
1. **Toggle off asterisk content removal**: This behavior can be toggled off using an API call if you need to preserve content between asterisks.
2. **Avoid using asterisks in your prompts**: Adjust your LLM prompts to avoid using asterisks for emphasis or formatting when that content needs to be spoken.
3. **Check your formatting settings**: Review your voice pipeline configuration to ensure it's set up correctly for your use case.
If you're still experiencing issues after trying these solutions, you might want to check other potential causes such as:
- Voice Activity Detection (VAD) settings that might be incorrectly calibrated
- Transcriber configuration issues (you might consider switching transcribers if the problem persists)
- Text-to-speech pronunciation issues with certain words or numbers
Would you like me to provide more detailed troubleshooting steps for any of these potential solutions?
Sources:
- [Discord Thread on Content Formatting](https://discord.com/channels/1211482211119796234/1211483291191083018/threads/1342824967833653268)Vapi Support Bot
03/25/2025, 3:51 PMmarem
03/25/2025, 3:59 PMmarem
03/25/2025, 4:11 PMmarem
03/25/2025, 4:11 PMmarem
03/25/2025, 4:12 PMVapi Support Bot
03/25/2025, 4:13 PMdefault voice.chunkPlan.formatPlan config
to address this issue. The documentation for this can be found at [Vapi's voice formatting plan documentation](https://docs.vapi.ai/documentation/core-concepts/assistants/voice-formatting-plan).
3. **Adjust the chunkPlan.enabled setting**: This setting controls how text is processed before being sent to the voice provider. When disabled, it bypasses several text processing steps, including basic text formatting which likely includes the asterisk removal.
4. **Check voice provider configuration**: In some cases, the asterisk removal might be a setting within the voice provider's configuration rather than Vapi itself.
For the most accurate and up-to-date instructions, you might want to check the Vapi documentation or API reference, as they would contain the specific details on how to toggle off this feature.
Is there anything else you'd like to know about handling text formatting in Vapi?
Sources:
- [Discord Thread on Content Formatting](https://discord.com/channels/1211482211119796234/1211483291191083018/threads/1342824967833653268)
- [Discord Thread on Voice Formatting](https://discord.com/channels/1211482211119796234/1211483291191083018/threads/1334184334361628734)
- [Discord Thread on Text Processing](https://discord.com/channels/1211482211119796234/1211483291191083018/threads/1343543475383046185)marem
03/25/2025, 4:58 PMmarem
03/25/2025, 5:09 PMVapi Support Bot
03/25/2025, 5:11 PMCartesiaVoice.language
, including Hindi, Italian, Korean, Dutch, Polish, Russian, Swedish, and Turkish. [Vapi Changelog](https://docs.vapi.ai/changelog/2024/10/30)
2. **Voice Speed and Emotional Range**: You can configure these parameters using Assistant.voice[provider="cartesia"].experimentalControls
. This allows you to adjust how fast the voice speaks and its emotional expression. [Vapi Changelog](https://docs.vapi.ai/changelog/2025/2/25)
3. **Voice Formatting Plans**: You can modify the default voice.chunkPlan.formatPlan config
according to your requirements. This affects how text is processed before being converted to speech. [Voice Formatting Documentation](https://docs.vapi.ai/documentation/core-concepts/assistants/voice-formatting-plan)
4. **Chunk Plan Settings**: The chunkPlan.enabled
setting controls text processing. When enabled, you can configure parameters like:
json
{
"voice": {
"chunkPlan": {
"enabled": true,
"minCharacters": 30, // Adjust between 1-80
"punctuationBoundaries": [".", "!", "?", ";"] // Customize based on your needs
}
}
}
5. **Custom Voice Configuration**: You can update the voice
property in the assistant configuration to use a custom voice.
It's worth noting that Vapi doesn't support SSML parsing with Cartesia voices, which is a limitation to be aware of.
Is there a specific formatting rule you're interested in configuring for your Cartesia voice?
Sources:
- [Vapi Changelog](https://docs.vapi.ai/changelog/2024/10/30)
- [Vapi Changelog](https://docs.vapi.ai/changelog/2025/2/25)Vapi Support Bot
03/25/2025, 5:11 PMKings Big
03/26/2025, 10:51 PMmarem
03/27/2025, 5:11 AMmarem
03/28/2025, 12:51 PMShubham Bajaj
03/28/2025, 4:34 PMjson
{
"voice": {
"chunkPlan": {
"enabled": true,
"formatPlan": {
"enabled": true,
"formattersEnabled": [
"quote",
"dash",
"newline",
"colon",
"acronym",
"dollarAmount",
"email",
"date",
"time",
"distance",
"unit",
"percentage",
"phoneNumber",
"number"
]
}
}
}
}
marem
03/28/2025, 4:35 PMKings Big
03/29/2025, 1:24 PM