Why do you not allow google to index discussion threads?
Sometimes I can remember the comments on an article, but not the article itself. Unfortunately I can't search google using comment text, because Reddit doesn't allow google to index its comments.
Those only block the various sorts and individual comment links. The main comments pages are still searchable.
Google was getting overzealous and indexing every page hundreds of times because it would follow every link, which included every "context" link and every sort.
A lot of times, I see an interesting quote or word on reddit, and I google to find out more, and the first (sometimes only) result is the comment itself. That even happens with comments that are less than an hour old.
Sometimes I can remember the comments on an article, but not the article itself. Unfortunately I can't search google using comment text, because Reddit doesn't allow google to index its comments.