Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

Kafka. If your load is low enough for the problem described in the article to happen, your load is low enough that it's not an issue.


I'm not sure you understood the article. You can have a very low load but each task on your queue takes a while to process, in which case you want fair distribution of work.


The distribution is fair - everything is round-robin, so in the long run each worker receives the same rate of tasks. It's just "lumpy" - sometimes you can get a big batch sent to one worker, then a big batch sent to another worker - but it will all average out.




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: