Developer at SocialSci here. You're absolutely correct, the incentive for gaming the system is always there. The difference is that we also incentivize consistency and are very proactive about tracking down fake accounts through various means. You're right that it's a difficult problem, but while Amazon turns a blind eye to such abuse, our system is designed from the start to both disincentivize and prevent it, and in the meantime encourage good consistent high-quality responses over time.

We don't claim to entirely prevent fraud, but we're very confident that we raise the barrier and reduce the rate significantly.