FLUX ending turn and not calling the LLM
# support
a
019a7bbc-94ce-7885-898a-53c2c60e79c8
The customer stop talking and neither: - The LLM has been called - The IdleTimeout has been triggered after 20 seconds. messagePlan: { idleMessages: [ "I'm still here if you need assistance." ], idleTimeoutSeconds: 20 },
v
Suggestion: Check if Vapi's endpointing is correctly detecting when the user has finished speaking, as this controls when the LLM is called. You can review your endpointing configuration or logs to ensure the system is not ending the turn prematurely. Example:
Copy code
// Ensure endpointing is enabled and configured
// (Pseudo-config, adjust for your setup)
{
  "endpointing": {
    "enabled": true
  }
}
If endpointing is misconfigured, the LLM may not be triggered as expected. See more in the orchestration/endpointing section of the documentation. Source: - [How Vapi Works](https://docs.vapi.ai/how-vapi-works)
a
@Sahil hey team, sorry to ping you directly, this is a prod customer, and almost all the call are failing
FLUX doesn't seems to work with stopSpeakingPlan and it's causing all the issues above
019a7bbc-94ce-7885-898a-53c2c60e79c8 -> Open AI been called but nothing has been brough back
019a8c58-6215-7663-b6a6-96608d166f4e -> Didn't get the timeout message "hey i'm still here if you need assistance"
c
Try these settings for deepgram flux:
Copy code
{
  "transcriber": {
    "provider": "deepgram",
    "model": "flux-general-en",
    "eotThreshold": 0.5,        // Lower from default 0.7 for better responsiveness
    "eagerEotThreshold": 0.35,  // Helps prepare responses earlier
    "eotTimeoutMs": 2500,       // Force EOT after 2.5s of silence
    "language": "en"
  }
}
And to configure a idleTimeoutMessage, use assistant hooks like the examples on the documentation here:
a
adjusting these value, what difference would make?
@kyle do you analyse any oof the logs? The eotTimeoutMs didn't get triggered at all seems like and that's why the assistant was not speaking
https://dashboard.vapi.ai/calls?callId=019a9408-28e3-7bba-87b8-adc40a0bfc0d The transcriber do not get the single digit... NINE
c
We reviewed the logs for the latest call ID you shared. The issue wasn’t a timeout failure — it was caused by the transcriber’s end-of-turn confidence being slightly too low to be accepted. What actually happened - Flux did send an
end_of_turn
signal at
22:59:46
- But its confidence was 0.6875, just below the configured threshold - Flux kept streaming partial transcripts afterward - Each partial update reset the silence timer - The system stayed stuck in agent_turn, waiting for a stronger signal - Later user speech was detected but ignored because the agent was still speaking Why this caused the problem Because confidence didn’t reach the 0.7–0.8 expected range, the system didn’t accept the turn ending, so it never handed control back to the LLM. Suggested settings to fix this
Copy code
json
{
  "transcriber": {
    "eotThreshold": 0.65,         // Accept the 0.6875 signal
    "eotTimeoutMs": 3000          // Force turn closure after silence
}
In short That 0.6875 confidence was just below your threshold, so the turn never ended and Flux kept streaming partials indefinitely.
a
019aa913-07cb-7229-81f3-2b007c1e3ce5 @kyle what about this one?
Why the eotTimeoutMs is not being triggered?
I can see the confidence was very low <0.4 but the person was speaking and the conversation has been completely shut down.
he was speaking for more than 30 seconds... shouldn't vapi have some sort of mechanism in place to don't end the call if the person is still speaking?
confidenceThreshold is default to 0.4... i do undeerstand that, however if we have some sort of input from the transcriber, VAPi should not end the call for timeout no?
019aaa96-869f-7446-ae87-417bb738fc71 -> The person speak at the end... it pass more than the silence timeout, and nothing happen... We're just wondering if we should wait to use FLUX and switch back to livekit?
Any news?
c
If the transcripted speech is below the confidence threshold, it will ignore the speech. In the call id
019aa913-07cb-7229-81f3-2b007c1e3ce5
the confidence for the speech at the end of the call was rated 0.394 which is below the 0.4 confidenceThreshold.
Copy code
🔵 01:03:36:814 Ignoring low confidence transcript (0.394 < 0.4) Yeah. I understand. Like, for your assistance. But I'm at it. Correct. So we'll go through the paperwork, uh, find out where I'm going, uh, go through my height requirements, like, you know, there are height requirements, height restrictions, road restrictions. So I will follow that, uh, according to my length and weight of the truck, and I will plan how many kilometers I need to travel, uh, before I can start my break. Uh, more particularly, like, I have on BFM. So, like, you know, for first five hours, I will drive, um, I So after getting the paperwork, I will go go through the truck, do a pre start inspection, go around the truck, check all the lights, uh, indicators, and, uh, and check the tires are okay. Um, the weight is properly loaded. Uh, if it is not, we'll get it, uh, done, verify the hook hook up of the trailers are, uh, perfectly fine for the road. And once it is done, I will start this, uh, truck up. I will inspect that it's good, like, all the oil labels and all the truck warnings are okay, uh, to go ahead. After doing that, like, you know, my work has already started, so I will
For the second call id
019aaa96-869f-7446-ae87-417bb738fc71
, "No" was not detected or transcribed and after "nothing today" the end of turn timeout kicked in which allowed the assistant to respond.
Copy code
🔵 08:07:55:242 `user` Flux final Transcript - EndOfTurn : Nothing today.: 0.9839
🔵 08:07:55:243 EndpointingBuffer: Transcriber detected EOT. Processing data.
Flux is great, but does require a bit of fine-tuning. If livekit was working well for you already, you can switch back.
a
@kyle 019aa913-07cb-7229-81f3-2b007c1e3ce5 -> Yes it was below, however shouldn't vapi automatically extend the timeout? As the call has been ended by VAPI meanwhile the candidate was speaking
Also is there anything we could do to improve the single digit number? We ask for feedback at the end, and seems like the single digit numbeer like saying "nine" is not very well recepted
mmm... ok is this because of the background noise doing something dodgy? 019accef-3a68-7009-b48d-5c1e530e6c1d
both 0:40 and 2:32 -> the audio is kind of cutted impossible to understsand, however form my side (i wasa testing) i clearly said the work in a slow pace and super understandable way. What could be the issue here?
Could it be KRISP cutting out the audio?
@kyle this is getting ridicolus... 019ae144-a3a4-7550-ae44-8edef8bd2766
this is because we've gone with the recocmmended setting, and now the bot is cutting off people talking. So can we bump it up again, but having a timeout working properly?
also the stop spekaing plan is not working anymore?!
We switched back to livekit.... after testing deepgram FLUX on their platform, it works much better. Why?
c
Web calls have faster transport than various phone service providers
5 Views