What is dagster?

Dagster is a data orchestrator for machine learning, analytics, and ETL. It introduces a data-aware, typed, self-describing, logical orchestration graph that models the implicit structure present in every data application and platform. This orchestration graph is designed to make data within organizations more organized and trusted, improve productivity, and facilitate collaboration between various roles involved in building complex data systems, such as data scientists, data engineers, and analysts. Dagster targets two primary audiences: full-stack engineers and data scientists who are responsible for end-to-end data applications and infrastructure, and platform teams that enable other data teams to efficiently and autonomously deliver features and capabilities. It is flexible and adaptable, designed to run any tool, use any storage, and deploy to any infrastructure. Dagster is an open-source project maintained by Dagster Labs.