During the day you will be 100% safe. After like 10PM there are a few places downtown that you maybe don't want to walk around alone but honestly if you can ignore homeless people shouting stuff at you the odds of getting robbed or anything are very low.