just play around and find the best settings. Usually below 1sec is good. Let's say PlayHt will garantee you below 300ms of latency (for the voice part only)