Posting something from our internal slack thread debugging this issue
yes, it's because of this in the call instructions
"After you respond to one of their responses pause before going on to the next question.
so the issue is that if you tell the LLM to "pause",
It doesn't know how to do it in reality (with respect to audio, since it just outputs text), therefore it wrote "pause as if you are processing the payment"
to avoid this, I would put in the instructions that
@Chris Alme
linked for 11labs to introduce a voice audio pause, something like
After you respond to one of their responses pause before going on to the next question, by using the special syntax "
" exactly
Curious if that approach would work, or if you're escaping stuff under the hood so 11 labs would get the instruction. I know we can also tune this with some of start speaking parameters, which I assume is doing something similar to the 11 labs tags under the hood