It's a problem inherent in all ideologies. Agile is an ideology and it would take a cognitive leap of epic proportions to deny that.

Agile is like communism in that way. On paper, it's great! In real life, everyone is miserable and everything is falling to bits and there's some other guy enjoying the fruits of your labour.