Stephen Bailey
05/11/2022, 1:42 PMdepends_on
, and it operates basically like an always-present Nothing input, a la -- @op(ins={"depends_on": In(Nothing)})
, which you can pass a list of outputs from other ops to.
Anyway, suggestion would be to do the same thing in Dagster to make order-based dependencies really intuitive to implement:
@op
def set_up_env_op():
pathlib.Path("foo").write_text("bar")
return True
@op
def run_main_op()
print("something that depends on the first thing being done.")
@job
def my_job():
done = set_up_env_op()
run_main_op(depends_on=[done])
Mark Fickett
05/11/2022, 2:52 PMstart
input explicitly, and just always have it as an option.yuhan
05/12/2022, 8:01 PMDagster Bot
05/12/2022, 8:01 PMyuhan
05/12/2022, 8:03 PM