Have you inspected the difference between the web ui and twilio/vonage payload when it hits your custom LLM? Maybe there is a check or variable you are using from web that is not there from twilio/vonage?