Structured outputs and Summary showing different r...
# support
a
Summary and Success Evaluation of analysis plan are going to be depreceated and it was suggested to move to structured outputs. Now we are invoking the vapi call via api and we are overriding the prompts for summary and success evaluation, but when we pass the same prompt to structured outputs, the result is different. I am using structuredDataMultiPlan for getting results for summary and success Evaluation. Is vapi also appending some extra prompt internally or can you guide us on this.
c
Can you share with us the call ID of both cases you mentioned( structured Data and structure output case)? The difference might be internal prompt or models used, I'll tell you the difference from our logs.
a
These are the call_ids: 019bc4f9-b2b2-755a-a74d-5323da32d656 019bc4eb-0362-7880-a6b2-7879d8ac2384
Can you share the update ?
It's really urgent for us
c
Sure, Aryaman, apologies for the delay due to the weekend. Going on your issue, will update soon.
It looks like the description of your structure output is not the same as the prompt of the summary feature. Yes, there's some minor difference in the system prompt, but it shouldn't affect the major output. Make sure the "prompt" value of summary is the same as the "description" of summary, not the "purpose" fields. Also the model used for summary in your case is anthropic, you can change this from dashboard too.