Voice bugs out and makes incomprehensible sounds
# support
j
I am currently using gpt 4o with 11labs and some times the voice just starts making random sound, it is in spanish. I tried with various 11labs voices but it happens with all of them, Backchanneling is disabled https://cdn.discordapp.com/attachments/1312140185298796654/1312140186288914553/a5dc5aa1-9b29-40f1-9c68-9dc301252e40-1732906436714-5d7d1e3a-5631-4d99-a408-120ab9bdd8a0-mono_mp3cut.net.wav?ex=674b6946&is=674a17c6&hm=1064975877dc4cd2c1cd2a8251d1c6dadce3cde27d3cdeaeca973d1023d57441&
v
@juli2kapo I'm sorry to hear that you're experiencing issues with the voice output. It sounds like there might be a technical glitch causing the random sounds. To help you better, could you provide me with more details about when the issue occurs? For example, does it happen after a specific duration of use, or is it triggered by certain types of content or commands? Additionally, have you checked for any updates or patches that might address this issue?
You can continue this conversation by mentioning me in the message.
j
@Vapi It seems to happen randomly, there is no specific time or tool usage
v
@juli2kapo I understand that the issue occurs randomly, which can be quite challenging to diagnose. Here are a few steps you can take to potentially resolve or isolate the problem: 1. **Update**: Ensure that all your software related to VAPI and 11labs is up to date. 2. **Logs**: Check if there are any error logs or messages that occur when the issue happens. 3. **Content**: Observe if the issue is related to specific phrases or types of content being processed. 4. **Network**: Verify your network connection stability, as intermittent connectivity could affect streaming quality. 5. **Support**: Reach out to 11labs support with detailed information about the issue, including any steps you've taken to resolve it. If you've already tried these steps without success, please let me know, and we can explore further options. If you'd like, I can also assist you in closing this support ticket if you feel the issue has been addressed to your satisfaction.
j
@Vapi According to the logs, the model output is fine
v
@juli2kapo If the logs indicate that the model output is fine, then the issue might be related to the audio synthesis or playback process. Here are a few additional steps you can try: 1. **Audio Configuration**: Check your audio configuration settings to ensure they are correct. Sometimes, incorrect settings can cause audio distortions. 2. **External Speakers/Headphones**: Test with different speakers or headphones to rule out hardware issues. 3. **Different Devices**: Try using the VAPI on a different device to see if the problem persists. 4. **Reinstallation**: Consider reinstalling the VAPI or related software to ensure that all components are correctly installed. 5. **Contact Support**: If none of these steps resolve the issue, it may be best to contact 11labs support directly for further assistance. Would you like to proceed with any of these steps, or is there anything else I can assist you with?
j
@User The issue happens no matter which channel I use (twilio call or web in the vapi page), it happens on different devices
@User The issue happens no matter which channel I use (twilio call or web in the vapi page), it happens on different devices
@Vapi The issue happens no matter which channel I use (twilio call or web in the vapi page), it happens on different devices
v
@juli2kapo Given that the issue persists across different channels and devices, it seems to be a problem that is not device-specific or related to a particular method of access. This could indicate a more systemic issue with the VAPI or the integration with 11labs. At this point, I would recommend the following steps: 1. **Detailed Report**: Document the issue in detail, including the times it occurs, the nature of the random sounds, and any patterns you've noticed. 2. **Contact 11labs Support**: Provide the detailed report to 11labs support. They may need to investigate the issue on their end, especially if it's happening across their platform. 3. **Contact VAPI Support**: Since the issue also occurs with Twilio, reaching out to VAPI support could help identify if there's a common factor causing the problem. If you need assistance in contacting support or providing them with the necessary information, please let me know. I'm here to help you through this process.
s
Hey @juli2kapo can your try one call without canonical knoweldge base or KB in short. Do let me know how it goes.
j
Currently it does have a knowledge base but the issue happened on instances without a KB too
s
Did you tried using other voice providers?
j
Testing that right now, noticed the problem doesn't happen if there are no KB and no tools
It doesn't seem to happen, it is only a problem with 11labs apparently
Another problem I am having is with anthropic not supporting KB, is this a current limitation of VAPI?
s
No there is no such limitation on Vapi.
@juli2kapo do you mind compiling your observations with call id, expectations vs actual response and timestamps so I can help you further and document the same for others.
2 Views