Why doesn't this work? I put my Groq API key in ...
# general-english
l
Why doesn't this work? I put my Groq API key in Custom LLM section in Vapi. In the assistant I have Provider: custom-llm Model: llama-3.3-70b-specdec Custom LLM URL: https://api.groq.com/openai/v1 @Shubham Bajaj can you help? This model is 6 times faster as its speculative decoding.
2 Views