If someone who is truly overqualified would disrupt your organization, maybe it needs to be disrupted. After all being overqualified would imply that their judgment is superior to the norm within your organization. If their judgment wasn't good then they aren't qualified much less overqualified.
Wouldn't wisdom(I'll admit that it is hard to measure in an interview) be part of what makes someone qualified for a position. If you are super smart but lack wisdom, then you aren't overqualified let alone qualified.
Overqualified implies that the candidate exceeds by a large margin all requirements for the position whatever those qualifications are.
