Solar panels are, by weight, mostly(>90%) made up of glass and aluminium.

Also most of the environmental footprint of the panels comes from the production process, which requires high temperatures and solvents.

All in all it's not much of a problem.