Increase the response delay and wait time before speaking in the speech settings, and consider enabling smart endpointing for better speech flow control..