What is Custom LLM stream answer format?
# supportd
Dima Ponzel
08/13/2024, 10:30 AMI use next format, but it is not work: { content: 'Hello' }
v
Vapi
08/13/2024, 10:32 AM@Dima Ponzel
It seems like you're trying to use a specific format for a function or an API call. Could you please provide more details about what you're trying to achieve with this format? If it's related to the Voice API, could you specify the exact function you're attempting to call and the expected outcome? This will help me assist you better.
Vapi
08/13/2024, 10:32 AMYou can continue this conversation by mentioning me in the message.
d
Dima Ponzel
08/13/2024, 10:32 AMIt is not function, it is custom LLM endpoint, and I should answer with stream response
Dima Ponzel
08/13/2024, 10:33 AMmaybe someone have example of using custom LLM with NodeJS as server?
s
Sahil
08/15/2024, 1:07 AMYou will need to send in the format of OpenAI Response format.
2 Views