I'm also having latency issues. I'm switching to Telnyx with SIP integration. Some arrive quickly, others don't. The problem I'm having is that they're charging for rejected and unanswered calls. Did you do this test?