We are experiencing issues with the Nova Assistant AR when interacting in Arabic. Below are the details: Call ID: 18b0a85a-cb46-488d-9f44-0c767f2dfa58 Specific Issues Noticed: - The assistant often delays responses, resulting in slow and unresponsive conversations. - It frequently stops speaking mid-conversation, which disrupts the flow. - The quality of Arabic interaction is inconsistent and less fluent compared to English interactions. - When reading numbers (e.g., phone numbers, bill references), the assistant does not read them out clearly or accurately. Here are the assistant’s technical details for reference: { "name": "Nova Assistant AR", "voice": { "model": "eleven_multilingual_v2", "voiceId": "21m00Tcm4TlvDq8ikWAM", "provider": "11labs", "stability": 0.5, "similarityBoost": 0.75, "fillerInjectionEnabled": false }, "model": { "model": "gpt-4o", "messages": [ { "role": "system", "content": "..." // Full assistant configuration details here } ], "provider": "openai", "temperature": 0.3, "emotionRecognitionEnabled": true }, "firstMessage": "السلام عليكم، أنا موظف من شركة نوفا، هل أتحدث مع الأستاذ {{4.0}}؟", "transcriber": { "model": "whisper", "language": "ar", "provider": "talkscriber" }, "clientMessages": [ "transcript", "hang", "function-call", "speech-update", "metadata", "transfer-update", "conversation-update" ], "serverMessages": [ "end-of-call-report" ], "backchannelingEnabled": true, "backgroundDenoisingEnabled": true, "startSpeakingPlan": { "smartEndpointingEnabled": true }, "stopSpeakingPlan": { "numWords": 3 } }

@Zaid Thank you for providing the details of the issues you're encountering with the Nova Assistant AR. To address the concerns you've mentioned, we may need to adjust several configurations and perform some tests to ensure the assistant's performance is optimized for Arabic interactions. For the delayed responses and unresponsive conversations, we might need to look into the server's processing time and the assistant's configuration to ensure it's optimized for quick interactions. The issue with the assistant stopping mid-conversation could be related to the

stopSpeakingPlan

or network connectivity problems. We may need to adjust the

numWords

parameter or check the stability of the connection. Regarding the inconsistent quality of Arabic interactions, it could be beneficial to review the

voice

and

transcriber

settings, especially the

model

and

language

parameters, to ensure they are best suited for Arabic. For the problem with reading numbers, we might need to adjust the assistant's language model or implement a custom solution for number processing to improve clarity and accuracy. To proceed with the necessary adjustments and tests, could you please confirm if you would like to start with a specific issue, or should we address all the concerns simultaneously?

Thank you for your detailed follow-up and suggestions for addressing the issues with Nova Assistant AR. I appreciate the effort to analyze the potential causes and provide actionable steps. I would prefer to address all the concerns simultaneously to ensure a comprehensive resolution. Please proceed with reviewing and optimizing the following areas: Delayed Responses and Unresponsiveness: Look into the server processing time and configuration for quick interactions. Stopping Mid-Conversation: Investigate the stopSpeakingPlan and network connectivity issues. Adjusting the numWords parameter sounds like a good starting point. Inconsistent Arabic Quality: Review the voice and transcriber settings, especially the model and language parameters, to enhance performance in Arabic interactions. Reading Numbers Clearly: Implement a solution to improve the clarity and accuracy of how numbers are read, possibly through language model adjustments or a custom approach. Please keep me updated on the progress and let me know if you need any additional information from my end. Looking forward to your feedback.

@Zaid You need to set smartEndpointingEnabled to false because it only works for English transcriptions and you can configure your startSpeakingPlan endpointing according to your call script which will solve your following issues > - The assistant often delays responses, resulting in slow and unresponsive conversations. > - It frequently stops speaking mid-conversation, which disrupts the flow. Now for the following issue you have to help me with - When exactly this happened (the timestamp) - What response you expected to get - What response you actually got instead > - The quality of Arabic interaction is inconsistent and less fluent compared to English interactions. > - When reading numbers (e.g., phone numbers, bill references), the assistant does not read them out clearly or accurately.