Hacker News new | past | comments | ask | show | jobs | submit login

Sorry yeah, I didn't really answer your question.

Here is a non-exhaustive list of schedulers for differing use cases:

https://slurm.schedmd.com/documentation.html << mostly batch, not entirely convinced it actually scales that well

https://www.altair.com/grid-engine << originally it was sun's grid engine. There are a number of offshoots tuned for different scenarios.

https://rmanwiki.pixar.com/display/TRA/Tractor+2 << thats for the VFX crowd

https://www.opencue.io/ << open source which is vaguely related to the above

https://abelay.github.io/6828seminar/papers/hazelwood:ml.pdf << Facebook's version of airflow. It sits on top of two schedulers, so its not really a good fit. I can;t find what they publicly call their version of the borg

I'm assuming you've read about borg

As you've pointed out mesos is there as well.




Cool! Thanks! That's a lot of stuff I didn't hear about until now.

It's really nice that one can meet experts here on HN and get free valuable answers form them. Thank you.




Consider applying for YC's Spring batch! Applications are open till Feb 11.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: