Issue with leaving out product names in voice outp...
# support
b
Hi, the agent is mostly working great for us, but whenever it has to compare 2 or more of our products with each other it does not pronounce or speak out those product names. I've made a loom with an example call where this issue occurs and also went into the log where you can see what the issue might be. https://www.loom.com/share/6e494252facc42ea992e7455ee22d5db?sid=e1fba627-c57f-489e-b5a4-8ccd390655f7
v
Hi there! 👋 Thanks for sharing the Loom video. I've looked into both issues you're experiencing: Issue 1: Product Names Not Being Pronounced This is a known issue where Vapi's voice output omits product names during comparisons. It happens because the assistant's formatting process removes content enclosed within designated markers (like **). As a temporary solution, you can modify your formatting so product names aren't enclosed within these markers. Good news though - a feature is currently being developed that will allow you to toggle assistant output formatting options, which should resolve this issue more permanently [source](https://discord.com/channels/1211482211119796234/1211483291191083018/1337826579639963689). Issue 2: Mispronounced Numbers This could be happening due to several reasons: - Parsing errors when the bot has trouble with complete strings or numbers - Voice model tuning parameters set incorrectly - Speech synthesis bugs specific to certain systems You can try these solutions: - Use SSML tags to fine-tune pronunciation for numbers - Adjust settings like stability and similarity boost - Check your language and regional settings For both issues, using SSML with phonetic adjustments might help. You can enable SSML parsing in your Vapi settings with
enableSsmlParsing: true
[source](https://discord.com/channels/1211482211119796234/1211483291191083018/1296031572956549171). Let me know if you need more specific guidance on implementing any of these solutions! Sources: - [Discord Message about Product Name Omission](https://discord.com/channels/1211482211119796234/1211483291191083018/threads/1337826579639963689) - [Discord Message about SSML Parsing](https://discord.com/channels/1211482211119796234/1211483291191083018/threads/1296031572956549171) - [Discord Message about Parsing Errors](https://discord.com/channels/1211482211119796234/1211483291191083018/threads/1343612796717371393)
s
@bernd-hocke-hockt-gern could you please share the call ID so I can be certain about the issue?
b
Hi Shubham, thanks for getting back to me. The call ID is 14996971-b910-46bb-859e-6cc8374f9866. I looked at the recommendations, specifically this sentence "As a temporary solution, you can modify your formatting so product names aren't enclosed within these markers. Good news though - a feature is currently being developed that will allow you to toggle assistant output formatting options, which should resolve this issue more permanently" Not sure how true this statement is with the new feature, but the product names are not enclosed within any markers in our knowledge base documents so I don't think it has to do with that.
@Shubham Bajaj The same error happens frequently and also with other terms. I made another call asking a general question "Can you explain in detail what outpatient and inpatient treatment means?" and it omits the words outpatient and inpatient treatment in the voice input. In the call log you can see that it encloses both terms between two ** in the model output. The call ID of this call is a854ffaf-adac-452e-b098-6b101321eb4d.
k
Looking into this now for you.
Hey! So after taking a look into it I can see that because your products names are wrapped in \*\*, the voice formatting plan is removing them before it gets sent to the voice provider. We have two solutions: 1. Remove the markdown that is surrounding your product names 2. Turn off the voice formatting plan all together (not recommended) Here are some docs around how the Voice Formatting Plan works:
b
Hey, a bit late to the party but thanks for your reply. In my knowledge base document, there was no markdown surrounding the product names. I managed to solve the issue by adding the following part to the system prompt: "Do not use any formatting like bold, italics, lists, or markdown." Maybe this will help someone else with the same problem in the future.
k
Sounds, good.
5 Views