Join Discord
Powered by
Vapi X Groq NOT using prompt caching is burning $
# support
g
Geremayaa
11/11/2025, 1:50 PM
I have been trying to use Groq with GPT-OSS-120B through the native integration but there is a problem with pricing: It says that model costs about 0,01$/min but when I see the call logs, it is charging 0,04$ or even 0,05$ per call while GPT-4o mini (with the same pricing) is charging that 0,01$/min. The issue must be that Vapi is not using Groq prompt caching
https://groq.com/blog/introducing-prompt-caching-on-groqcloud
or there is something missconfigured. Please, could you take a look and tell me how to use this open-source models with lowest latency and at the cost it should be? At the same time, the native integration with Cerebras is not showing this GPT-OSS-120B model, would be interesting to test... Thanks.
https://cdn.discordapp.com/attachments/1437801663485448332/1437801663833313543/message.txt?ex=6942b525&is=694163a5&hm=e7bf5467a81d50d16425dce526c62aafb254f48979838da77874a1f2293d77f8&
s
Sahil
11/26/2025, 7:11 PM
can you share the call_id?
4
Views
Previous
Next