Not sure about Vapi, but this can be easily done with Pipecat. You can build a pipeline which starts with userquery-> LLM-> STT. You can pipe user query to this pipeline and the assistant can answer just like a voice bot.