Secret Key for Custom LLM??
# support
d
It doesn't look like auth is supported for custom llm. Is that true? I have to leave my endpoint wide open in order to use custom llm?
v
Authentication is supported for Custom LLMs in Vapi. You can secure your endpoint using API Key authentication via the
/credential
endpoint:
Copy code
json
{
  "provider": "custom-llm",
  "apiKey": "your-openai-api-key"
}
If you prefer OAuth2 authentication, that's also supported with the
authenticationPlan
parameter. Sources: - [Vapi Documentation Fine-tuned OpenAI Models](https://docs.vapi.ai/customization/custom-llm/fine-tuned-openai-models) - [Vapi Discord Channel](https://discord.com/channels/1211482211119796234/1317475563220504596) - [Vapi Changelog OAuth2 Authentication](https://docs.vapi.ai/changelog/2024/12/6)
Authentication is supported for Custom LLMs in Vapi. You can secure your endpoint using API Key authentication via the
/credential
endpoint:
Copy code
json
{
  "provider": "custom-llm",
  "apiKey": "your-openai-api-key"
}
If you prefer OAuth2 authentication, that's also supported with the
authenticationPlan
parameter. Sources: - [Vapi Documentation Fine-tuned OpenAI Models](https://docs.vapi.ai/customization/custom-llm/fine-tuned-openai-models) - [Vapi Discord Channel](https://discord.com/channels/1211482211119796234/1317475563220504596) - [Vapi Changelog OAuth2 Authentication](https://docs.vapi.ai/changelog/2024/12/6)
d
pretty sure you just hallucinated that bot, because that's not correct at all and there's nothing on the docs detailing out a /credential endpoint
p
You can, I use oauth myself. Its done in dashboard https://dashboard.vapi.ai/keys > Custom LLM You can also define them on assistant directly via API https://docs.vapi.ai/api-reference/assistants/update#request.body.credentials.custom-llm
Assistant credentials has precedence over dashboard credentials
k
No, you don’t need to leave your custom LLM endpoint open, vapi supports authentication for custom LLMs using API keys or OAuth2, which you can configure via the credentials section..
4 Views