Production go live blocker: Gibberish words in AI ...
# supports
stardust
03/12/2025, 12:58 AMWe were planning to go live in 1 week but the VAPI is unstable and lots of timeouts in LLM calls and started speaking gibberish words. This is a blocker for us to go live. I will create separate ticket for timeout.
Gibberish words issue:
Call ids:
95f6f073-13e6-4573-8596-c90d23025d98
f40a17ff-fe1d-42a1-af70-f4612415895c
Attached screenshot of transcript.
sample 1:
call id: 95f6f073-13e6-4573-8596-c90d23025d98
Copy code
transcript:
AI
U 0 9 2 e u 0 9 3 e u 0 9 3, c u 0 9 3 2, u 0 9 3 8, u 0 0 9 3 2 u 0 9 4 8 u 0 9 3 e u 0 9 3 e u u 0 9 3 2 u 0 9 4 0. News 0 9 2 8 u 0 9 3 e u 0 9 3 2 u 0 9 4 7 u 0 9 3 e. Copy code
transcript:
AI
Dylan Dank, Whortonside bit it off die by storm. Yourm
Mason
03/12/2025, 12:59 AMWhat LLM are you using?
s
stardust
03/12/2025, 1:01 AMOpen ai + gpt-4o
We are launch this assistant for our customer care.
https://cdn.discordapp.com/attachments/1349184573363453962/1349185539219390565/image.png?ex=67d22e73&is=67d0dcf3&hm=5c8ce1703674b76ad7008dff89715dbffdea7b55dc9b89e9b52b1d36a577e1b2&
stardust
03/12/2025, 6:36 PM@User @Mason any updates on this?
stardust
03/12/2025, 9:33 PM??
p
Praveen Nair
03/14/2025, 1:40 AMHey Stardust, looking into this now.
Praveen Nair
03/14/2025, 2:09 AMHey Stardust, I've escalated this ticket for you. In the mean time could you try disabling emotion detection for me and trying to test again?
s
stardust
03/14/2025, 8:06 PMok, we disabled emption detection. Please let if that is what is cauging this issue?
p
Praveen Nair
03/16/2025, 5:56 PMHey Stardust, do you mind testing with the new adjusted settings? If it doesn't work feel free to come back and provide a new call ID here.
v
VapiLLM
03/19/2025, 9:17 PMhi was this resolved? I had some giberish words too
s
stardust
03/24/2025, 7:09 PM@Mason No I still face random words in between. Also I see different language response. call id: 2a206378-aa7f-48e5-a46c-a4ed9947accc
transcript:
AI: I was able to find an account matching the phone number you're calling from. For security purposes, can you verify the last 4 digits of your Social Security number?
User: 1 2 3 4.
AI: Poor favor, DiGielo and Pas Mientras Verifi Iso.
In above transcript you see, AI is responding in spanish all of a sudden.
Emotion Detection: off
Backchanneling Enabled: off
stardust
03/24/2025, 7:43 PM@Mason also in the same call id in one of earlier response in beginning , a new word "Matt" is introduced unnecessarily. attached model output which didn't have that word.
User: Oh, Virgil. This is Virgil.
AI: Hi, Virgil. Matt To ensure the security of your account, we need to verify your identity. Just a moment, please.
https://cdn.discordapp.com/attachments/1349184573363453962/1353816462141427722/image.png?ex=67e30755&is=67e1b5d5&hm=00aafdc4cc3ca3c0a8f7e25ba8b9640ebc82d9aff297b5eb6113bf918892402c&
stardust
03/24/2025, 7:48 PMNot really. Sometimes it responds with unnecesary words. Even speaking different language.
stardust
03/24/2025, 8:09 PM@User our production launch is getting blocked. Different language and random words in AI response is blocking us. Please assist ASAP.