Working with brilliant/accomplished people is an important consideration. It changes the whole tenor of the job and helps you rise to their level of skill.

That said, at Google's scale I agree with you. They can't help but dilute their brainpower to grow as large as they have.