AC is typically something you only need when you are inside the house so it is not like any freak situation would occur. If it happens only super occasionnally at worse you just set it the homeassistant state using the remote manually.

I guess you should hide those remote in a drawer and remove the batteries when you start using homeassistant