Try implementing a rule prompt for the assistant to speak slowly and wait a second after the user finish speaking before talking.