It sounds like the latency was the cause of confusion of the call receiver. That's really what's holding back from ultra realistic. I've been plumbing for the same effect. All of your dialogue really lands.