The cloud-native orchestrator for the whole development lifecycle, with integrated lineage and observability.

dagster

I was curious if one can put together a 100% open-source equivalent to what is considered Modern Data Stack and wrote a <https://www.linkedin.com/posts/glebmezh_the-modern-data-stack-open-source-edition-activity-6834153247717113856-VO8O|blog> to share my findings. Very curious to hear your thoughts and if I missed any great products!

You appear to have accidentally put dagster at the end rather than the beginning of the list of transformation tool options :wink:

I would love to see Dagster disrupt the Airflow family and become the go-to orchestrator!

Jesting aside - I propose adding Impala to the warehousing category.

I'm also finding the venerable SQLite a powerful addition to my toolbox, both for local dev / test environments and for "single user" datamarts via cross-compliations like <https://github.com/sql-js/sql.js/>

Is there a SaaS product that Impala “replaces”?

just to make the reference easy to relate to for the readers

Not sure.  The company I work for went from Redshift to Impala (on prem)