https://dagster.io/ logo
s

schrockn

08/28/2018, 2:00 PM
“@jacob.vi the cjr thing is interesting. this could be handled by the framework, but I’m not sure it is a good idea meaning that I don’t think it’s really a bad thing to add unnecessary edges or redundant edges so we could have 1) core dagster detect redundant edges and remove them (e.g. if C depends on B and A, and B depends on A, the C to A dependency could be removed without consequence) however that could be super confusing in certain cases maybe we should just instead eliminate on the display time in dagit *on display time so ya three options 1) do nothing. (current state) 2) fix deps in the core dagster pipeline definition 3) rely on tooling to optionally do redundant edge checking”