Hello, I am using Op factory to dynamically create ops. Is there a way to have those ops run in sequence or limit the number of running ops at a time? So that we do not overload the source.

Hi @Shameel Faraz one thing you could try: when calling the factory function repeatedly, pass the previously created op as an input to the one currently being created. that would force them to run in sequence. alternately you can set op concurrency limits using tags https://docs.dagster.io/concepts/ops-jobs-graphs/job-execution#op-concurrency-limits so you would give all of the ops you create via the factory the same tag and then set the concurrency limit for the tag on the job that contains all of the ops