Speaking behavior of assistant
# support
s
I am unable to see where I can configure the behavior of the assistant, for example to make it speak slower or louder or faster, etc. @Vapi
v
message has been deleted
@Shrey To configure the behavior of your assistant, such as adjusting the speaking rate or volume, you'll typically need to access the settings where you can edit the voice properties. This is often found in the voice configuration section of your assistant's dashboard or settings page. If you're looking for a specific setting to change the speed or volume, you might look for options labeled as 'speech rate', 'tempo', 'speed', 'volume', or 'gain'. Adjusting these settings will allow you to make the assistant speak slower, faster, louder, or softer according to your preferences. If you're having trouble finding these settings or if they are not clearly labeled, please let me know, and I can provide further assistance or direct you to support for more detailed guidance.
You can continue this conversation by mentioning me in the message.
s
I am unable to find it on the assistant's dashboard, it would be helpful if you can navigate to it. @Vapi
v
@Shrey I'm here to help guide you through the process. To adjust the behavior of your assistant, such as speech rate or volume, you'll need to locate the voice settings within your assistant's dashboard. Here's a general approach to find these settings: 1. Log in to your assistant's dashboard. 2. Look for a section labeled 'Settings', 'Voice Settings', 'Speech Configuration', or something similar. 3. Within this section, search for options like 'Speech Rate', 'Volume', 'Pitch', or 'Voice Style'. 4. Adjust the sliders or input fields associated with these options to configure the speaking behavior. If these options are not visible on your dashboard, they might be part of an advanced settings menu or require additional permissions to access. In case you still cannot find these settings or if the dashboard does not provide these features, it might be necessary to contact support for further assistance. Since I'm here to assist you, if you provide me with more specific information about what you're seeing on your dashboard, I can offer more targeted guidance.
s
I cant see the settings yet. How can I contact the support? @Vapi
v
@Shrey I'm sorry to hear that you're having difficulty finding the settings. To contact support, you can typically do so through one of the following methods: 1. **Support Email**: Look for a support or help email address on the dashboard or the official website. You can send an email detailing your issue and asking for assistance. 2. **Help Center or FAQ**: Many services have a Help Center or FAQ section on their website where you can find answers to common questions or submit a support ticket. 3. **Live Chat**: Some dashboards offer a live chat feature where you can talk to a support representative in real-time. 4. **Contact Form**: There may be a contact form available on the dashboard or website that you can fill out to get in touch with support. 5. **Phone Support**: If the service provides phone support, you should find a contact number listed on the website or within the dashboard. 6. **Community Forums**: Some services have community forums where you can post your question and either the support team or other users can help you out. If you need assistance with any of these methods or if you have any other questions, please let me know, and I'll do my best to assist you.
s
Can you send me an email address or a link for the same? @Vapi
v
@Shrey Please ask support for more info on this.
s
@Shrey the speaking behaviour depends upon voice provider, which voice provider your using?
s
@Shubham Bajaj I am using 11labs
s
@Shubham Bajaj and where can I access it?
s
You have to use API for it.
s
@Shubham Bajaj I couldn't find these in the API documentation, am I missing something? I am unable to get a clear understanding on this.
s
Here's the link to the API you have to either create or update your assistant voice provider. @Shrey do let me know if you still find any difficulty.
Copy code
curl -X POST https://api.vapi.ai/assistant \
     -H "Authorization: Bearer " \
     -H "Content-Type: application/json" \
     -d '{
  "voice": {
    "provider": "11labs",
    "style": 0.5,
...
  }
}'
Ref: https://docs.vapi.ai/api-reference/phone-numbers/create?playground=%2Fapi-reference%2Fassistants%2Fcreate
s
@Shubham Bajaj can we get on a call and do this? What are your office hours btw?
s
What issue your facing?
s
@Shubham Bajaj I'll try this api thing tomorrow. I am just not sure if it will be done for sure. I'll let you know
Thanks for the info anyways
@Shubham Bajaj
Copy code
{
  "message": "Couldn't Find 11labs Voice. If you're using your credentials, check the voice exists in your 11labs account. If not, check the voice exists in the provided list. Hot tip, remove your credential if you're trying to use a Vapi provided voice.",
  "error": "Bad Request",
  "statusCode": 400
}
Copy code
{
  "message": "Couldn't Find 11labs Voice. If you're using your credentials, check the voice exists in your 11labs account. If not, check the voice exists in the provided list. Hot tip, remove your credential if you're trying to use a Vapi provided voice.",
  "error": "Bad Request",
  "statusCode": 400
}
@Vapi
v
@Shrey It seems like there's an issue with the voice provider configuration in your API request. The error message indicates that the 11labs voice you are trying to use cannot be found. Here are a few steps you can take to resolve this issue: 1. **Check Voice Availability**: Ensure that the voice you are trying to use is available in your 11labs account. Log in to your 11labs dashboard and verify that the voice exists. 2. **Correct Voice Identifier**: If the voice exists in your account, make sure that you are using the correct identifier for the voice in your API request. 3. **Credentials**: If you are using your own 11labs credentials in the API request, ensure that they are correct and have the necessary permissions. 4. **Vapi Provided Voice**: If you are trying to use a voice provided by Vapi, you might need to remove your personal 11labs credentials from the request to access the default list of voices provided by Vapi. 5. **Documentation**: Double-check the API documentation to ensure that you are using the correct parameters and format for your request. If you continue to experience difficulties, it may be best to contact Vapi support for further assistance. They can provide more detailed guidance and help troubleshoot the issue with you.
s
I am using the vapi bearer token. Also, what is the voice identifier, it is 11labs right? @Vapi
v
@Shrey The voice identifier is not simply "11labs"; that is the name of the voice provider. The voice identifier refers to the specific voice name or ID within the 11labs collection that you want to use. Each voice typically has a unique identifier that you need to specify in your API request to select it. Since you're using the Vapi bearer token, you should have access to the list of voices provided by Vapi. You need to ensure that you're using the correct identifier for one of the available 11labs voices. Here's what you can do: 1. **Check Available Voices**: Refer to the Vapi documentation or your Vapi dashboard to find the list of available 11labs voices and their identifiers. 2. **Update Your Request**: Once you have the correct voice identifier, update your API request to include it. The identifier should be placed in the appropriate parameter, which might be labeled something like "voiceId" or "voiceName". 3. **Remove Personal Credentials**: If you're using a Vapi provided voice, ensure that you're not including any personal 11labs credentials in your request. If you're still unsure about the correct voice identifier or how to proceed, please reach out to Vapi support for further clarification and assistance. They can provide you with the exact details you need to successfully configure your assistant's voice.
s
I am unable to find setting for speed @Vapi
v
@Shrey The setting for speech speed is typically controlled by a parameter that adjusts the rate at which the voice speaks. In the context of using an API like Vapi with a voice provider such as 11labs, this is often done by setting a 'style' or 'rate' parameter in your API request. Based on the API documentation you provided earlier, it looks like the 'style' parameter is used to control the speaking behavior, which may include speed. However, if 'style' does not directly correspond to speech rate or if you're unsure about the correct parameter to adjust the speed, you may need to consult the 11labs documentation or reach out to their support for the specific parameter name and acceptable values. If the documentation does not provide clear information on how to adjust the speech speed, or if you're having trouble finding the right setting, it's best to contact Vapi or 11labs support for detailed instructions on how to proceed. They can provide you with the specific parameters and values to use in your API request to control the speech speed of your assistant.
s
what value should I keep in the 'style' parameter so that the assitant speaks slowly? @Vapi
v
@Shrey The 'style' parameter in the API request typically controls various aspects of the voice's delivery, such as speaking style or emotion. However, it may not directly control the speech rate or speed. If the 'style' parameter in the 11labs API does influence speech rate, the specific value to make the assistant speak slowly would depend on the range and scale defined by 11labs. Without specific documentation from 11labs, it's challenging to provide an exact value. Generally, a lower value might correspond to a slower speech rate, while a higher value would indicate a faster rate. You might start with a value lower than the default (which is often set to 1 or 0.5) and adjust from there. For example, if the default 'style' value is 0.5, you might try setting it to 0.3 or 0.2 to see if it slows down the speech. Keep in mind that these values are hypothetical and you would need to confirm with 11labs documentation or support for the correct usage. If you're unable to find the information in the documentation or if the 'style' parameter does not control speed, you may need to look for a different parameter that specifically adjusts the speech rate, or contact 11labs support for guidance on how to achieve the desired speech speed.
s
Its done but it didnt affect the speechrate of the assistant
s
@Shrey can you share the CURL request your using to update speed of a voice.
s
curl -X POST https://api.vapi.ai/assistant \ -H "Authorization: Bearer " \ -H "Content-Type: application/json" \ -d '{ "voice": { "provider": "11labs", "voiceId": "a7S3uCnZYQsXwdBkySrU", "style": 0 } }' I used this, also fyi I used the api key in the bearer. The request was sent sucessfully but there was no change in speed of the assistant.
s
@Shrey Can you join today's Discord office hours? If not, please share the call ID along with the following information: - When exactly this happened (the timestamp) - What response you expected to get - What response you actually got instead
@Shrey Apologies, In ElevenLabs text-to-speech API, the style property also known as Style Exaggeration amplifies the original speaker's style characteristics. Regarding voice speed, the API does not offer a direct setting to adjust the speed of the generated voice. However, you can control the pacing by incorporating pauses in your text using the
<break time="1.5s" />
syntax.
s
@Shubham Bajaj when I tried 11 labs agent on 11 labs, it was pretty stable and took appropriate pauses. I expect same thing from Vapi, I don't know what am I missing in the configuration. I tried prompting and the ssml prompt as well but it doesn't work. I think we can figure this out because I don't want to shift other platform as of now. It would be good if you could help me with this. Thank you
s
@Shrey could you share a recent call id?
s
@Shubham Bajaj there are 2 problems that I am facing, one is the pacing and pause problem, second is regardin the knoledge base. When I ask something from the knowledge base, it gives some information and then suddenly stops in between. I am providing the callid, the speaking behavior is not desirable, although we were able to stabilize it a bit using prompting but still it needs improvement, also when speaking phone numbers, it is very fast and hard to understand. b0b403ad-f1c0-4245-848e-7b5b3fbe3c47
s
@Shrey 1. Please try adjusting the optimizeStreamingLatency setting to 2/3 2. Switch to using GPT-4 with a model temperature of 0.3 3. Consider replacing the current knowledge base provider with Trieve 4. Recommend increasing endpointing to 300ms to ensure complete word capture: "transcriber": { "provider": "deepgram", "endpointing": 300 } For context, the endpointing value (in milliseconds) determines how long the system waits to detect when a user has finished speaking. Regarding the phone number pronunciation issue - could you please provide more specific examples such as timestamp, expected vs actual response? This would help me offer more targeted solutions.
s
@Shubham Bajaj Actually there's a phone number that the assistant asks to call in case of further inquiries. I'll find jt oht and let you know
I'll do these adjustments and let you know
s
transcript
AI: Thank you for calling United Center Temecula office. This is Eva. If this is an emergency, please hang up and dial 9 1 1 immediately. Please note, this call is being recorded for quality and training purposes. How may I assist you today?\nUser: Can you tell me about ultrasound preparation instructions?\nAI: Of course, the ultrasound preparation instructure include fasting from food and fluids, except for a light breakfast if your appointment is in the morning. For bladder preparation, you need to empty your bladder 1 to 1.5 hours before the exam then drink 32 ounces of water within 30 minutes to ensure a full bladder. Your appointment is in the afternoon, you should stop eating and drinking by 7 AM. Additionally, you may need to administer an enema as per the provided guidelines. If you have any specific concerns or questions, it's advisable to consult with your doctor before following these instructions. Let me know if there's anything you need.\nUser: Can you continue?\nAI: Yes. Of course. Please continue with your inquiry, and I'll be happy to assist you further with any questions you may have.\n Couldn't find here, yeah do ping me @Shrey
s
@Shubham Bajaj can you tell me more about Trieve? I am just not very familiar with it'
s
@Shrey you can learn more about it from here https://docs.vapi.ai/knowledgebase
s
@Shubham Bajaj I sent a request from the create knowledge base API reference. It was a successful request because when I send the list knowledge bases request, it shows the files there. But when I try to see them on platform they aren't visible. I thought may be they wont be visible in the files section but they are there so I tried calling the assistant and check but the assistant is responding randomly and not from the knowledge base. What am I missing?
@Shubham Bajaj this was my request: { "provider": "trieve", "vectorStoreSearchPlan": { "searchType": "hybrid", "scoreThreshold": 0.1 }, "name": "Colonoscopy", "vectorStoreCreatePlan": { "fileIds": [ "47403e66-3a01-4cad-a7bd-33a36a84ce33", "016dce83-321e-42b3-8dd4-5e420b26308f" ] } }'
I mean the body of my request
s
@Shrey could you create a new #1211483291191083018 ticket and share all details over there in the following format: - The call ID - What response you expected to get - What response you actually got instead This would really help me figure out what went wrong!
11 Views