I read a sobering fact somewhere -- we'll only be able to read about 1000 books in our lifetime (50 years, 20 books a year or nearly 2 a month). Maybe 2000 or 3000 if you're a voracious reader.

Given that, it doesn't make sense to waste time with a bad book when it's taking the place of a better one. This helped me with that same guilt.