I had this issue all the time, then noticed this issue happens when a camera is active. Make sure that when Android Auto starts, there is no camera active (such as Indicators or Back Camera when reversing).
If the infotainment is on the idle state, Android Auto should start fine. I usually...