In my case, I only use the AppleTV remote then rely on HDMI-CEC for everything else.

I've found it far simpler than explaining remotes to people.