I think being aware of it is already a step in the right direction. You can't control what you're saying at all time, but you can try and make effort to be less and less arrogant. Notice when you are and try to fix it, notice when you aren't and try to repeat the pattern.

Of course this advice assume you have already understood that 1) there is nothing to be gained but bad things by being arrogant and that 2) there is no reason to be arrogant.