What is dagster

Dagster is a data orchestrator. It is designed to organize and manage workflows that process and produce data. Unlike traditional workflow engines that focus solely on the execution order of data computations, Dagster introduces a data-aware, typed, self-describing logical orchestration graph. This graph models the structure inherent in every data application and platform, making it an integral part of the entire application lifecycle. Dagster targets two primary audiences: full-stack engineers and data scientists who are responsible for end-to-end data applications and infrastructure, and platform teams that enable other data teams to efficiently and autonomously deliver features and capabilities. It is flexible and adaptable, designed to run any tool, use any storage, and deploy to any infrastructure, facilitating collaboration between different roles involved in building complex data systems.