Kafka with a different partitioner would have worked fine. The problem was that ... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		kitd 6 months ago \| parent \| context \| favorite \| on: Kafka at the low end: how bad can it get? Kafka with a different partitioner would have worked fine. The problem was that the web workers loaded up the same partition. Randomising the chosen partition would have removed, or at least alleviated, the stated problem.

jiaaro 6 months ago [–]

Random and round robin partitioning are the configurations being discussed.

The main point of the article is that low message volumes mean you can get unlucky and end up with idle workers when there is still work to be done

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact