assistant hallucinating and vapi overcharging
# support
s
guys, my assistant shows 0.23$ per minute but when i talk for 1.5 minutes it deducts 60+ cents its draining my bank account the overview shows nothing about my assistant and does anyone know how we can get analysis report and summary using squads? and did anyone figure out how to log vapi calls to gh
v
@Shahzaib.aiii I'm sorry to hear that you're experiencing issues with billing and accessing information about your assistant. Let's address your concerns one by one: 1. **Billing Discrepancy**: If you're noticing a discrepancy in billing, it's important to reach out to our support team directly so they can look into your account details and resolve any issues. You can email them at [support@vapi.ai](support@vapi.ai) with your account information and a description of the problem. 2. **Assistant Overview**: If the overview is not showing information about your assistant, this could be a technical glitch or a problem with the account settings. Again, contacting support will be the best course of action to get this resolved. 3. **Analysis Report and Summary Using Squads**: To get an analysis report and summary using squads, you would typically need to use the specific features provided by VAPI for call analysis. However, since the context does not provide details on how to do this with squads, I recommend checking the Quickstart Guides, Examples, or FAQ sections for guidance, or reaching out to support for more detailed instructions. 4. **Logging VAPI Calls to GitHub**: Logging API calls to GitHub is not a standard feature provided by VAPI, and it would require custom implementation. You might need to set up a webhook or an event listener that captures the VAPI call data and then uses the GitHub API to log that information into a repository. For specific instructions, you may need to consult with a developer or reach out to support for more info on this. If you need immediate assistance with any of these issues, please don't hesitate to send an email to our support team. Would you like me to assist you with anything else at this moment?
You can continue this conversation by mentioning me in the message.
s
not github i want ot log calls in gohighlevel using make
and my assistant is having 12 functions, it is hallucinating someitmes but i have used gpt 4 model so it shouldnt do that
s
@Shahzaib.aiii Could you share recent call IDs so I can take a look? Also, regarding logging calls to GHL, you can use the end-of-call report and GHL webhooks to determine the structure and map the response to the required fields.
s
@Shubham Bajaj 33fcd146-eaa2-46f6-89c9-10abc2267f02
Says running function!
@Shubham Bajaj 36bef542-c827-41e2-8576-69d35c18ab33 repeats the whole sentence once interrupted
s
@Shahzaib.aiii The model temperature is currently set to 1, which enhances productivity and creativity but may lead to hallucinations. I recommend adjusting your model temperature to a range between 0 and 0.3; this should resolve your issue. Please give it a try for 2-3 calls and let me know the outcome.
s
@Shubham Bajaj 11cd711a-44ec-4279-9700-e757267b8fb6 check this, my client called in front of me, the agent was repeating the same lines, "do you want to book an existing appointment or a new one?" and the client kept saying new one, but in recording we cant hear the agent malfunctioning! is there anyway to reboot the vapi or smthg ihave a lot clients and after some using the agents starts malfunctioning! or is it eleven labs voices? can a particular voice cause a malfunction! i need to learn this in detail I have clients and its getting hard for me to keep up w the quality
and is {{now}} working ? for the time
8b90f865-5864-4d52-b03d-393e46c98d18 I have decreased the temperature to 0.3 for the one you told me it still says running the funciton adn stuff
why is deepseek not workking
Hi @Shubham Bajaj , till when can i get an update on this issue! Its urgent and will cost me 3 clients
s
@User I did, its hallucinating, what do i do its dead end for me
@Shubham Bajaj d0f7142c-f38f-4422-866d-d36fee1543e1 check this put! this much delay! at first it was going very fine
it has been 3-4 days that the latency and hallucination is very high
till when can we expect workfloes
like bland
0c4deeb5-a023-42b6-b30e-693efbef95e0
this also
s
@Shahzaib.aiii
logs
[1] šŸ”µ 16:28:40:184 Say Request Saying 19... (say: Hi! is this Cherie?) { "role": "bot", "time": 1738340921408, "source": "", "endTime": 1738340922628, "message": "Hi. Is this Sherry?", "duration": 1220, "secondsFromStart": 1.68 }, - Try Changing your first message it will be resolved. Because your message is correct but voice provider is hallucinating here things are going a bit off. [2] šŸ”µ 16:28:43:006 [user LOG] Transcriber output: Yes. šŸ”µ 16:28:43:014 [user LOG] Endpointing timeout 1014ms (rule:
smart
) šŸ”µ 16:28:44:032 AzureOpenAIRequest. Messages: [ { "role": "system", "content": "You are Abraham, a dedicated cold caller for *..." }, { "role": "assistant", "content": "Hi. Is this Sherry?" }, {"role": "user", "content": "Yes."} ] šŸ”µ 16:28:47:094 [user LOG] Endpointing timeout 925ms (rule:
smart
) šŸ”µ 16:28:48:023 OpenAIRequest Request. Messages: [ { "role": "system", "content": "You are Abraham, a dedicated cold caller for *..." }, { "role": "assistant", "content": "Hi. Is this Sherry?" }, {"role": "user", "content": "Yes. Yes. Yes."} ] šŸ”µ 16:28:50:200 [user LOG] Transcriber output: And who's calling? šŸ”µ 16:28:50:215 OpenAIRequest Request. Messages: [ { "role": "system", "content": "You are Abraham, a dedicated cold caller for *..." }, { "role": "assistant", "content": "Hi. Is this Sherry?" }, { "role": "user", "content": "Yes. Yes. Yes. And who's calling?" } ] šŸ”µ 16:29:05:550 [user LOG] Transcriber output: Sure. - This was an pure endpointing issue where it took the model little longer to identify the user has stopped speaking, sometimes models takes little longer to respond.
[3] I don't see any hallucinations involved here. Call ID: d0f7142c-f38f-4422-866d-d36fee1543e1
End of Q1 this year for sure.
s
Ill have to listen it again, but i am talking about the delay ,v high latency
s
This was because of end pointing model, and startSpeakingPlan used. Use the following config instead and then you wont' observer the percieved latency.
Copy code
json
    "start_speaking_plan": {
      "waitSeconds": 0.8,
      "smartEndpointingEnabled": true
    }
Copy code
json
    "transcriber": {
      "model": "nova-2",
      "language": "en",
      "provider": "deepgram",
      "endpointing": 300
    },
s
Okay thankyou, Also is their any issue w connection of twilio w canada or smthg,i have two clients in canada and when ever i call myself the agent still works okay but when they call from there its a total disaster, it keeps on repeating the same lines like 6-7 times
s
@Shahzaib.aiii No there is no issue can you share the call ID so I can take a look?
s
sure, will will send you in a while. But i sent you one before as well.
This was in canada
And today experienced samething w another client
In canada
s
"AI: Hello. This is Nevan from Ottawa Physiotherapy.\nUser: Just looking to book an appointment.\n", Can you check the call Id again or any recent call ID you have will work. I want you to get unblocked asap.
s
Yeah so in this call, i was in the call, and the agent kept saying how i can help you and my client kept on saying book an appointment, 5-6 times the agent repeated that, but when i listened to the recordings, i only heard my client repeating his words
I really appreciate that, but that account is in my employees laptop, i will share asap
Also i think you are from India? I am from Pakistan, can we talk in hindi/urdu if its easier for both of us?
s
Let us uphold the decorum of the forum by continuing to communicate in English.
s
Okay šŸ‘Œ
It should work perfectly now right??
s
@Shahzaib.aiii deepgram changes have to be done using API.
s
In the make http module?
I am not a developer
Do I add the json codes you sent under phonenumberid With {}
I am accessing the agent using assistant id so i think it should work directly from vapi, i havent built a full transient code based assistant
a2fae5b5-cd83-4347-a17c-049eb1c85596 8a83a665-bb42-404d-912c-c9bdcdec1a00
@Shubham Bajaj check the latency, nothing changed
@Shubham Bajaj
s
Copy code
{
  "transcriber": {
    "model": "nova-2-phonecall",
    "language": "en",
    "provider": "deepgram",
    "endoiting": 300
  },
  "startSpeakingPlan": {
    "smartEndpointingEnabled": true,
    "waitSeconds": 0.8
  }
}
curl -X PATCH https://api.vapi.ai/assistant/insert-your-assistant-id-here \ -H "Authorization: Bearer token" \ -H "Content-Type: application/json" \ -d '{ "transcriber": { "provider": "deepgram", "endpointing": 300, "model": "nova-2", "language": "en" } }'
I think its done
Its patch right?
s
@Shahzaib.aiii Your right it's PATCH.
s
d6eeb629-4189-43ab-8df8-9bb844f420de
Shubham check
Now its repeating itselfff after i changed the setting
@sh
@Shubham Bajaj
9dd07457-527c-4419-9662-c969b8708bbf
check yhis i just added knowledge base today again as it is important and now it has startred saying running function and stuff
@Shubham Bajaj we have clients we are working with and we are facing a quiet bit issues can we hop on a call with support team and discuss all of them together?
ac9c295c-8606-4b02-a478-885856ea566e Look at this pause, whats happening please help
s
@Shahzaib.aiii looking into it, and I suggest creating new #1211483291191083018 for new issues from next time for SLA management.
@Shahzaib.aiii There are two things to address: First, set the waitSeconds to 0.8 as suggested because user input comes earlier with our model while other service providers need more time to process them. Second, you're using Canonical as the KB provider which is deprecated, so please change it to Trieve. After these two changes, the calls will work more smoothly.
s
How to change it to Trieve
s
We have migrated from Canonical to Trieve. You will need to attach the Knowledge Base using the API. You can learn more about it here: https://docs.vapi.ai/knowledgebase
s
What is the file ID
I copied the file ID from vapi and pasted where needed in patch api call but it says knowledge bas enot found error
d8e7ee2e-bdc5-4588-91f3-d95a0bc6181c Shubham i have done everything which was told, no improvement, leads are being watsed