Large orbital debris is tracked, and manned spacecraft take efforts to avoid it. Natural stuff like meteoroids and whatnot are incredibly rare, combined with the fact that space is really, really, really big this makes getting hit by such things far less likely than, say, getting hit by lightning.