How does the checklist rubric for call evaluations? How can I implement it?

@Ibrahim The checklist rubric for call evaluations is a structured approach to assess the quality and effectiveness of calls based on specific criteria. To implement it, you would define a set of items that represent the key aspects of a successful call. Each item on the checklist is a criterion that the call should meet. Here's how you can implement a checklist rubric for call evaluations: 1. Define the Criteria: Determine what aspects of the call are important for your evaluation. This could include factors like call duration, customer satisfaction, resolution of the customer's issue, adherence to scripts, and professionalism. 2. Create the Checklist: List each criterion as an item on the checklist. This will serve as a guide for evaluators to follow when reviewing calls. 3. Train Evaluators: Ensure that those who will be using the checklist understand each criterion and how to assess it accurately. 4. Evaluate Calls: During or after the call, the evaluator will go through the checklist and mark whether each criterion was met. 5. Analyze Results: After the evaluation, analyze the results to identify areas of strength and opportunities for improvement. 6. Provide Feedback: Use the insights gained from the checklist to provide constructive feedback to the call handlers. 7. Continuous Improvement: Regularly update the checklist as needed to reflect any changes in your evaluation goals or to incorporate new best practices. If you need to set up a system for call evaluations using a checklist rubric within VAPI, you can customize the

successEvaluationPrompt

and

successEvaluationRubric

properties to define your criteria and implement the checklist. If you need assistance with setting this up or have any specific questions about the process, please let me know!

it's an system prompt which is passed to the llm, similar to this. [messages] - system prompt: your xyz etc... here's the transcription - user: do the rubric test on shared transcription