I was thinking about using Dagster as a general workflow engine - e.g. for at user signup flows where certain things need to happen in a specific order.
What are your thoughts on that? - and will will it scale?
03/08/2021, 4:16 PM
We have other users who have embedded dagster as a library in this fashion. I think I would need more context on your use case to know if it is a good fit or not.
03/08/2021, 5:29 PM
I’m thinking of using it for order processing in a telecom setting where I need to update multiple legacy systems in a very controlled manner.
So basically a lot of orders running as pipelines with short lived solids that might need to be retried multiple times
And all pipelines will be initiated from an api decoupled from the execution of the pipelines