For years I've worked with apache airflow and got used to it.
Recently a guy I interviewed mentioned they are using dagster, which was the first time I've heard about it.
Knowing airflow is not perfect, I'm wondering for a new project I'm now starting to work on, why should I choose dagster over airflow?
Sorry if it was asked already, I couldn't find this question online or here on slack.
Thanks, read it yesterday, will read it again.
I read yesterday for 2-3 hours about dagster to better understand the differences.
As I progressed with the reading, it was both clear to me that we are not the only ones who suffer from airflow downsides (and horrific UI).
But it was just as clear that even for someone who used airflow extensively for 3 years now like me, learning dagster is not a trivial task when actually working with bigdata, and not hello-cereal-world examples.