Inconsistent performance
# support
s
We're using VAPI for our appointment booking service, but it's very inconsistent. Sometimes it handles even complex flows without any issues, while other times it struggles with the simplest tasks. We are using the following: Transcriber provider: Deepgram Transcriber model: Nova-2 LLM provider: Anthropic LLM model: Claude-3-Haiku-20240307 How can we ensure consistent performance?
v
@sai saran I'm sorry to hear that you're experiencing inconsistencies with your appointment booking service using VAPI. To ensure consistent performance, consider the following steps: 1. **Data Quality**: Ensure that the audio input is of high quality. Background noise, poor microphone quality, or varying distances from the microphone can affect transcription accuracy. 2. **Model Tuning**: Check if the models you're using are the best fit for your use case. Sometimes, a different model or a custom-trained model might yield better results. 3. **Error Logging**: Implement comprehensive logging to capture when and where the inconsistencies occur. This can help identify patterns or specific issues that need attention. 4. **Update Models**: Ensure that you are using the latest versions of the models provided by Deepgram and Anthropic, as updates often include performance improvements. 5. **Feedback Loop**: Create a system to collect and analyze user feedback. This can help you identify specific areas where the system is underperforming. 6. **Testing and Validation**: Regularly test the system with a variety of scenarios to ensure it can handle a range of inputs consistently. 7. **Resource Allocation**: Verify that your system has sufficient computational resources allocated to it, as resource constraints can lead to performance issues. 8. **Consult with Providers**: Reach out to Deepgram and Anthropic support teams for advice on best practices and optimization for their respective models. 9. **Professional Services**: Consider hiring a consultant or professional services that specialize in voice AI to review your implementation and suggest improvements. If you've already tried these steps or need further assistance, please let us know more details about the specific issues you're facing so we can provide more targeted support.
You can continue this conversation by mentioning me in the message.
l
I can help you setup the appointment booking and working very good 👍
Check your dm
s
@sai saran the model might be halucinating, try using gpt-4o and refactor your prompt.