When I try to communicate with my assistant through the chat function and ask about some information that should be retrieved using the query tool, it doesn't do it, instead make up something or completely avoid to answer. Everything is working properly when having a call with it.
r
Roel
06/02/2025, 2:05 PM
I have the same error. Even after creating a new query tool and using different file formats it does not work :-(.
k
Kings_big💫
06/02/2025, 2:17 PM
Update your assistant’s system prompt to explicitly instruct using the Query Tool for specific queries, ensure the tool is correctly attached and active in the Vapi dashboard, and verify that the model you’re using supports tools in chat mode..
j
Jelic
06/02/2025, 3:16 PM
I think the problem lays in the fact that I use chatGPT model and since vapi is communicating through the completionAPI which only supports functions, query can't work. Maybe to connect vapi with the assistant created on the openaiAPI side through the response API, If this is possible.
k
Kings_big💫
06/02/2025, 3:49 PM
You're correct, switch your assistant in Vapi from using the Completion API to the Chat API like, GPT-4 to enable proper Query Tool support in chat mode.
v
Vapi
06/03/2025, 2:15 AM
Hey Jelic, checking if this is resolved/solved for you?
j
Jelic
06/03/2025, 2:59 PM
It's not since I still don't undersand whether the agent can call any function this way. It appears that it can generate a function call but Vapi isn't sending anything to the external server where the tool should be executed (Make.com in my case). Also I've encountered this problem using test suite.
Jelic
06/04/2025, 1:37 PM
Is there any way to fix this?
v
Vapi
06/04/2025, 3:39 PM
Hey! To help track down this issue, could you share:
- The call ID
- When exactly this happened (the timestamp)
- What response you expected to get
- What response you actually got instead
This would really help us figure out what went wrong!