Pigeon
11/28/2024, 1:48 PMtranscribing/tts
> phone call
, all custom llm examples use some weird framework and just pipes through the stuff to open AI, I just want to get call recipient voice transcribed to text and then my LLM responds with text that should be TTSed to whoever i'm calling. Thats it. Why is it so complicated in here? I just want to send text so that vapi TTS it for call recipient. How do I format the reponse so vapi just TTSes the text?
TL;DR
I want to:
1. Receive transcription as text (Done)
2. My LLM setup answers that with text.
3. I want to send that text back to VAPI so ir TTSes it to call recipient (How do I do this?)
4. Loop 1-3 until call ends.Vapi
11/28/2024, 1:51 PMVapi
11/28/2024, 1:51 PMplaintext
{
"text": "Your LLM's response here",
"voice": "Jennifer",
"language": "en-US"
}
You would send this payload to the VAPI's TTS service. Once the text is converted to speech, VAPI will handle the delivery of the spoken message to the call recipient.
For the loop, you would continue to:
1. Receive the transcription as text.
2. Have your LLM generate a response.
3. Format the response as shown above and send it to VAPI for TTS.
4. VAPI will then play the TTS to the call recipient.
Repeat steps 1-4 until the call ends.
If you need the specific API endpoint or further assistance with the integration, please let me know, and I'll be happy to help! If there are any additional features or specific configurations you need, please ask support for more info on this.Pigeon
11/28/2024, 1:56 PMVapi
11/28/2024, 1:56 PMPigeon
11/28/2024, 2:25 PMShubham Bajaj
12/02/2024, 12:23 PMPigeon
12/04/2024, 7:15 AM