I had the same issue and your use case seems very similar to mine. There’s an ability to mute the assistant without ending the call. Check their API types of a Vapi object that gets returned when initialised. They have a “mute” assistant option that works much better than just starting and ending call every time.