The network is not (only) your graduating peers, it's primarily the alumni. If you see a job you want and the hiring manager also went to Harvard, they will have a more favorable opinion of you. You may ask how this is any different from any other college, but, due to prior network effects, the prior Harvard graduates themselves are more likely to be in higher positions of power. Prestige begets prestige, in a way that lower universities do not.