I don't follow. If one bucket has many more iOS users, it seems like you have do... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		whimsicalism on June 16, 2023 \| parent \| context \| favorite \| on: Annoying A/B testing mistakes I don't follow. If one bucket has many more iOS users, it seems like you have done a bad job randomizing your treatment?

BoppreH on June 16, 2023 [–]

It could be self-selection happening after you randomized the groups. For example a desktop landing page advertising an app, which might be installed on either mobile operating system.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact