To me, exclamation mark, full stop and question mark are of equal precedence; they are higher than colon, which is higher than semi-colon, and that is higher than comma.