Hi, I'm trying to see if custom llm is the right use case for me.
Our goal is to create a prototype that integrates speech-to-text (STT), text-to-speech (TTS), and a conversational orchestration layer that can connect with an existing backend that was built for chat bot. This chatbot is integrated with LLM. We dont mind latency for the voice wrapper we'll build.
I'm thinking this: User Phonecall -(as Speech)-> VAPI -(as Text)-> Backend (with LLM)-(as Text)-> VAPI-(as Speech)-> User Phonecall
VAPI resource:
https://docs.vapi.ai/customization/custom-llm/using-your-server?utm_source=chatgpt.com