Gladia transcriber very slow
# support
p
I tried the Solaria model from Gladia because it was supposed to be more accurate and have a smaller latency than deepgram. I did some testing and ended up having an average of 2.42s when using Solaria compared to 1.24s for deepgram nova-2-general (exact same parameters for the rest) I don't understand the gap?? https://cdn.discordapp.com/attachments/1395407673016717375/1395407673343606826/Screenshot_2025-07-17_at_16.11.30.png?ex=687a562a&is=687904aa&hm=21b6c984ff78d13fb6d888fb68fa9673222514676d30dec3e68f4e9c7c9e4b47&
the call id: 2efb66ef-5fc2-4bec-9cb3-c33df46517e7
@Kings_bigšŸ’«
c
Looking into it
k
could you also share: When exactly this happened (the timestamp) What response you expected to get What response you actually got instead This would really help us figure out what went wrong! @pierreh
p
FYI, this is what they said: Hi, thanks for reaching out and for testing Gladia! You're absolutely right to expect lower latency and improved French accuracy with Solaria, that’s what we designed it for. That said, I don’t know the exact implementation details of how Gladia is integrated within Vapi, and from what I could find in their documentation, it’s unclear how they pass parameters like endpointing or custom vocabulary. This could be part of the latency discrepancy you're observing. Here are a few suggestions and examples you can try to improve your setup: āœ… Recommended Gladia Parameters Please make sure you're explicitly setting these parameters in your config (either directly or by asking Vapi support if these are passed through properly): Endpointing Lowering this value can drastically reduce perceived latency: { "endpointing": 0.05 } šŸ“˜ Docs on endpointing Custom Vocabulary If your use case includes domain-specific terms, brand names, or unusual phrases, you can use custom vocabulary to improve accuracy: "realtime_processing": { "custom_vocabulary": false, "custom_vocabulary_config": { "vocabulary": [ "Westeros", { "value": "Stark" } ], "default_intensity": 0.5 } šŸ“˜ Docs on custom vocab Speech Threshold Tuning (for noisy or degraded calls) If your calls are 8kHz or have background noise, try: { "pre_processing": { "audio_enhancer": false, "speech_threshold": 0.6 } } šŸ“˜ Docs on speech threshold
If you take any assistant, connect the gladia transcriber (solaria) and see the latency, you'll see that it's very high (about 2 sec) where normally it should be lower than for deepgram
its for every call i did using solaria
c
Hey pierreh, I sincerely apologize for the delay in our responses this week. We experimented with some process adjustments that didn’t work as intended, and unfortunately, this caused some disruptions. That’s entirely my responsibility. Just a quick note—our team is unavailable on weekends. However, if something urgent or critical comes up, feel free to reach out to me directly, and I’ll assist you. The support issues will be resolved in the coming weeks, and starting Monday, you can expect more consistent and improved support. Thank you so much for your patience and for continuing to stick with us!
p
Thank you @Shubham Bajaj , have a great WE!
c
We reached out to our team to have them take a look at our current Gladiia implementation and see what they can do to improve the experience for our users. Thank you for your patience while our team reviews it
p
thanks!
j
Great ! Adding on this the requested feature of custom vocabulary : https://vapi.canny.io/feature-requests/p/add-custom-vocabulary-feature-to-gladia-transcriber, also essential to proper gladia integration
c
Our team is currently working on making improvements to our implementation for Gladia. While there is no exact ETA on its release, you will either hear from us when it's deployed or it'll show up in the changelogs for upcoming updates to the platform.
p
any news on that ?
j
@pierreh I've recently asked during an OH (vapi-stage) and @Shubham Bajaj told me it was planned for last week / this week I believe šŸ¤” I hope to get some news soon !
c
No update yet, but it is in the works. Thank you for your patience
j
c
It should be live if it was found in our August 3rd changelog. Feel free to check it out
j
I've done a few tests but all transcriptions are translated in English by Gladia by default (couldn't change that). Opened a new ticket for this : https://discord.com/channels/1211482211119796234/1405511793064939562
p
let me know @Jeebs from eva.be when you here from them! We are getting there
j
@pierreh it does work šŸ‘ŒšŸ¼
p
what is your first feedbacks on Gladia vs Deepgram @Jeebs from eva.be ? Do you see a difference?