This already exists for YouTube videos (it's called SponsorBlock). It is available as a browser extension that skips them automatically for you.

I think it would be harder with podcasts because of the diversity of available podcast players.