Yeah, /r/all needs to die. The problem is finding and showing great stuff while not flooding niche communities with new members. If you send tons of people to /r/gaming, /r/gaming will stop being good, people will migrate to /r/games, and the cycle will repeat. Any replacement for /r/all will have to address this issue somehow.
The system should be designed such that a flood of users doesn't degrade the community's usefulness. It should be obvious that it's difficult to obtain mass adoption if quality and readership are inversely correlated.
My point was that being on the front page causes a shift in quality. The challenge is to drive people to high-quality communities without ruining those communities.
Right, but if you just accept that the communities will be ruined and just shift to the next quality subreddit for a given topic once people have started migrating it might be better for everyone. Making communities more ephemeral and giving moderators less power would certainly chap some asses though.
I know the site can't scale without moderators but I think giving them so much ownership has resulted in a lot of problems. I'm not sure how else to incentivize them but the amount of power they're given clearly is good at attracting the type of people that it shouldn't (as well as the type of people it should, to be fair).