I am Jay, just came across this platform yesterday and I loved the idea, specially because I was trying to do the same over the airflow.
👍 1
s
schrockn
07/10/2019, 7:48 PM
interesting. what were you trying to do over airflow?
j
Jay Sen
07/10/2019, 8:32 PM
build data pipeline where each task runs on different platform but outputs can kind of connect and passed on, and together seen as a single workflow for management, monitoring, etc... kind of like airflow but with one more layer on top of it.
i have yet to understand what dagster is built for....