Came here to say this. Office hours serve many purposes.

I remember going to office hours for homework guidance. I've also gone and been the only person there and delved deeper into a subject than an undergrad class normally would with leading experts in the field that otherwise might not give me the time of day

If you don't have a schedule conflict, try to go to office hours as much as possible!