just set your Vapi agent to

responseOnly: true

(or its equivalent setting) so it speaks only what you send back from the n8n Respond to Webhook node, nothing else.