Same happens with phone calls themselves. People on the other side seem to assume they take automatic precedence over whatever else you were doing.