Why doesn't this work?
I put my Groq API key in Custom LLM section in Vapi.
In the assistant I have
Provider: custom-llm
Model: llama-3.3-70b-specdec
Custom LLM URL:
https://api.groq.com/openai/v1
@Shubham Bajaj can you help?
This model is 6 times faster as its speculative decoding.