@Lennui Ok interesting, this was a couple of months ago but I was able to start a call with the SDK without enabling the microphone but then ran into a subsequent issue with Daily so I dropped that feature for the time being.
What I was trying to achieve was to prevent the initial permissions check to enable the microphone, then have the ability to opt-in to use the microphone later in the call (essentially starting the call with text from the user and voice from the assistant).
Anyways it seems like you've got it figured out for your use case so best of luck! I'll be revisiting Daily's docs soon so if I come across something that may help your cause I'll let you know.