The cloud-native orchestrator for the whole development lifecycle, with integrated lineage and observability.

dagster

I haven't found it in the docs yet but if it's there lmk and I'll keep looking instead of asking here, but is it possible to run pipelines inside virtualenv (kind of like airflow virtualenv operator)? Or a solution to support different envs in se deployment using venv or something else

not currently, but this is one of the major features in `0.8.0` which is currently slated for release late next week

There wouldn't be any release docs on it yet would it :nerd_face:?

But that's lit than you so much, that's the main feature for piloting this for data science team since they have multiple python environments/jupyter kernel envs they use

its uh, coming in *hot* so docs writing is schedule for mid next week

you can peak at <https://dagster.phacility.com/D3253> if you want a preview - you will be able to load repositories of pipelines from different locations, and those locations can be separate python environments

I'll read through I don't mind waiting either but thank you :+1::skin-tone-5: