Multiple responses being given at the same time, r...
# support
s
Hello, It seems I have been having a weird issue when on calls with the agent. Sometimes it generates random as a output giberish, and it seems like there is two LLMs giving two different outputs at the same time, and it just mashes them together for the output I have temperature at 0, and the optimize streaming latency at 0 as well but it still happens, it was especially bad yesterday, any ideas what might be happening? For example here are some logs from some calss: AI: Hey there. Our training package costs 3900 dollars. Hey there. It Our includes up PTSD training package costs 3 dollars to 10 in 900. It's home 1 on includes up to 1 training sessions. 10 in Do You Home already have 1 on 1 training sessions? Or are you, there anything planning to get 1? Else you'd like to know about it? This happens with multiple models, open AI, Claude, both gtp4 and gpt4o.
v
Hi @Suzanna, I'm an AI assistant for Vapi. I'll analyze available sources and get back to you shortly.
----------------------------- **While I generate an answer, here are some sources that might be helpful**: * [Orchestration Models]() * [Web Calling]() * [Inbound Calling]() * [Billing Examples]() -----------------------------
### Answer It sounds like you're encountering issues with overlapping or garbled responses from the AI, which can be indicative of several potential issues in the configuration or integration of your voice AI setup with Vapi. 1. **Model Configuration Issues**: If multiple models are active or the system prompt within the models isn't correctly isolating its context, it could result in overlapping responses. Ensuring that the configuration aligns with a single task per call might mitigate this issue. 2. **Streaming or Latency Issues**: Even though you've optimized streaming latency, it's possible that network issues or server-side processing delays could be affecting performance. Ensuring that your server is properly scaled and your network is stable might help. 3. **Audio Processing Anomalies**: Issues with the audio input, such as noise or poor quality, could be misinterpreted by the transcriber, leading to erroneous text input to the models and thus confusing outputs. Checking the audio input quality could be a step towards a solution. 4. **Software Bugs or Integration Issues**: There could be a bug in the integration layer between Vapi and the underlying models, or potentially in how responses are handled and delivered back to the end-user. Reviewing logs and system metrics around the times these issues occur could provide insights. Since this behavior could be due to a complex interaction of components, consider isolating each part of the system (transcription, LLM processing, and text-to-speech) to diagnose where the issue might be more pronounced. This can be done by logging the outputs at each stage to see where the anomalies start. If the issue persists and is reproducible, contacting Vapi support with detailed logs and system configurations would be advisable to get more targeted assistance.
Got it. Tagging @User for additional help.
s
This call log, clearly showcases this issue: 95575e3b-4968-428c-afcc-c74ce9545979
s
Can you remove your KB and try it once?
s
Sure, the thing is it doesnt happena all the time, but will give it a try.
s
Thanks!
s
I have given a test for the last few days, and removing rag does solve the issue. Is there anything we can do to still use rag and not get this issue?
s
We are looking into it. So, just provide us some time until we fix it.
s
Sounds good thank u.
b
I am having the same issue. Removing the KB fixed it.
I had to create an entire new assistant though. Couldn't duplicate it either. Had to copy and paste all settings and prompt from scratch. I had a KB here named "knowledge base". Then after I deleted it, it turned into these random numbers and letters. I can't remove it even though no KB exist. I tested this broken assistant with the kb and it started speaking gibberish. Then my new assistant I created (same prompt+settings but no kb) stopped doing that. I won't even be touching the kb button. https://cdn.discordapp.com/attachments/1246016618790785117/1248068921219616889/7d8e57e7d4b4e89e811e57d13378aebf.png?ex=66625242&is=666100c2&hm=3242e78b122a1eb70757e8ec6dc9b7d76609f6729c5da0009e4b9f3f05f84b39& https://cdn.discordapp.com/attachments/1246016618790785117/1248068921454629015/9d56f24c96dd7960e558cef38127db21.png?ex=66625242&is=666100c2&hm=7292455d09fa39d504a45eeadb24b42f59e1725d2ec3d7dc0c28de50a73de7ec&
@Sahil any update on when this will be fixed ?
s
Fixed.
w
@Sahil Experiencing the same issue today, only on my agent with a KB attached
s
Pls create a new support ticket with latest call_id and the timestamp + what hallucinated during the call.
s
Experiencing the exact same thing as well
r
I also experience halluncination with KB..... here is the log ID: 0c1cc2ab-eb29-4b59-a08f-b276e0266a8a
s
As soon as I removed my KB, the issue never happen again so it’s definitely related to that in some way.
3 Views