Hacker News new | past | comments | ask | show | jobs | submit login

Disclosure: I work on Google Cloud.

Different things! Composer (based on Apache Airflow, which we contribute to) is a general purpose workflow system. Cloud AI Platform Pipelines is really focused on ML pipelines, specifically, like Kubeflow (the related OSS project that we contribute to) is meant to be.

Instead, I would argue that Kubeflow has lots of overlap with Airflow. But I don't think either will be cancelled :).




Curious but what’s driving the need to have a different pipeline system? As you say, Kubeflow has lots of overlap with Airflow so what’s different?




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: