Realtime API bug (I'm setting voice to Alloy, it i...
# support
s
I'm using gpt 4o realtime cluster model. I want to use Alloy's voice, but for whatever reason it is always reset to Ash which in my language (Lithuanian) sounds like a person from jail. Definetely not the best case for normal business interactions. How to use Alloy's voice?
v
@SisyphusZen I'm here to help you set up Alloy's voice for your voice API. To ensure Alloy's voice is used consistently, you'll need to adjust the configuration settings of your voice pipeline. This typically involves setting the default voice to Alloy within your system's voice settings. If you're using a specific platform or service for your voice API, you would typically find an option to select the default voice in the settings or configuration file. Look for a voice or speech settings section where you can choose Alloy from the list of available voices. If you need assistance with the specific steps or commands to set Alloy's voice, could you please provide more details about the platform or service you're using for your voice API? This will help me give you more precise instructions.
You can continue this conversation by mentioning me in the message.
b
could you provide your assistant's ID? @SisyphusZen i'll look into this. are you using the dashboard or API?
s
19377252-7776-4fb5-995d-2a5255927ebb
@bryant on dashboard it works fine, through API doesn't work as expected
when I'm testing on doashbaord, I can hear Alloy's voice through API call voice becomes distorted, like I said, a man would talk from jail 😄
b
as in, a call that is started from the API?
or when you try to update the voice through the API, it becomes ash rather than alloy
s
I'm initiating a call through a HTTP request - URL: https://api.vapi.ai/call - Method: Post - Header contains API token - I'm sending this data in JSON { "phoneNumberId": "id_hidden", "customer": { "number": "phone_number", "extension": "" }, "assistantId": "19377252-7776-4fb5-995d-2a5255927ebb" } --- I tried to override the "fucked up" voice with updated JSON schema { "phoneNumberId": "id_hidden", "customer": { "number": "phone_number", "extension": "" }, "assistantId": "19377252-7776-4fb5-995d-2a5255927ebb", "assistant": { "voice": { "provider": "openai", "voiceId": "alloy" } } } in this case I hear Alloy's voice, but assistant didn't talk according to prompt instructions
I think the problem is specifically with realtime API, because if I'm using let's say azure voices (and openAI as an LLM), voices are not distorted
using realtime apie and not any other LLM + Voice combo is a must because the solution is built for lithuanian language which sounds good only with realtime api 😄
@bryant any idea how to solve it?
b
hey @SisyphusZen , i checked the logs and it seems the voice was set to ash from the config during the calls where you specified the assistant ID
it may potentially be a bug on the dashboard side, i will investigate
s
okay thanks @User , waiting for update
@bryant, any news?
hi @bryant, looking forward for any update we're starting to build a solution for a client after 10 days so it's important to check if Vapi provides all the necessary infrastructure or we need to search for a workaround
b
Hi @SisyphusZen the overridding bug should be fixed now on the dashboard
s
thanks. I see now that the voice on doashbaord changes however, it doesn't solve the fundamental problem. the calls sounds distorted, please listinen for the attached audio I tried other voices (Shimmer, Ash) - the voice tone is the same for the output via API call https://cdn.discordapp.com/attachments/1326125909580976180/1326916473746358373/audio_problem.m4a?ex=67812ac4&is=677fd944&hm=3a2006e7d328503b05da0a7354142141b21089a6f630df2a3ce047cb76ad9357&
b
Hi @SisyphusZen thanks for sending the audio sample, i'll investigate this
s
hi @bryant, any news? we start to work with client after 5 days so it's urgent to know if we can rely on using RealtimeAPI via Vapi infrastructure
@bryant any news?
b
Hi @SisyphusZen , would you be able to hop on a call to debug this? Still unable to reproduce the issue through phone calls or web calls
s
@bryant sounds good, would love to help with debugging. Here is my Calendly to schedule a meeting: https://calendly.com/leo-parnidia/meeting-with-leo
lmk if Calendy works 😉
b
Great, scheduled something in
s
awesome, I see you scheduled it for now, waiting in Google Meets
let's reschedule