If you're entering or going deeper into a building: pull. They're designed in this direction for fires so that if one breaks out all doors are push to open. This rule doesn't apply to a private residence.