I m getting Error occurred while loading input that just say

Question

I m getting Error occurred while loading input that just says Invariant failed I think this worked with 0 14 7 and started failing with 0 14 9 Here s the stack trace ``` battery data job local c49da2c4 6a0f 41b2 a477 f9baa34afc1f 1741477 data pipe graph sasquatch anode raw data graph publish raw data trace context STEP FAILURE Execution of step data pipe graph sasquatch anode raw data graph publish raw data trace context failed dagster core errors DagsterExecutionLoadInputError Error occurred while loading input pipe of step data pipe graph sasquatch anode raw data graph publish raw data trace context dagster check CheckError Invariant failed Stack Trace File home mfickett Documents mfickett dev data pipeline direnv python 3 9 5 lib python3 9 site packages dagster core execution plan utils py line 47 in solid execution error boundary yield File home mfickett Documents mfickett dev data pipeline direnv python 3 9 5 lib python3 9 site packages dagster core execution plan inputs py line 607 in load input with input manager value = input manager load input context File home mfickett Documents mfickett dev data pipeline direnv python 3 9 5 lib python3 9 site packages dagster core storage fs io manager py line 152 in load input context add input metadata path MetadataValue path os path abspath filepath File home mfickett Documents mfickett dev data pipeline direnv python 3 9 5 lib python3 9 site packages dagster core execution context input py line 325 in add input metadata if self asset key File home mfickett Documents mfickett dev data pipeline direnv python 3 9 5 lib python3 9 site packages dagster core execution context input py line 216 in asset key check invariant len matching input defs == 1 File home mfickett Documents mfickett dev data pipeline direnv python 3 9 5 lib python3 9 site packages dagster check init py line 1167 in invariant raise CheckError Invariant failed ``` The op in question is ``` op ins= start In Nothing def publish raw data trace context context publish current trace context context ``` And the `pipe` parameter it mentions is an enum value produced as a constant form a different op passed through a graph I m not really sure where to look next any suggestions

Mark Fickett · Answer

Confirmed that the same graph works if I drop back to `0 14 8` Happy to pull a debug file if that s helpful

johann · Answer

Related to <https dagster slack com archives C01U954MEER p1650387725216559>

johann · Answer

We have a fix going out today in 0 14 10

Mark Fickett · Answer

Thanks confirmed I m not hitting that error after upgrading to `0 14 10`

Mark Fickett · Answer

I m seeing another invariant error though when retrying from a failed step w in a subgraph ```2022 04 21 21 57 06 0400 dagster ERROR battery data job local cd139594 8283 49d9 9e36 24504be680f3 2375675 data pipe graph sasquatch cathode raw data graph normalize arbin4 task arbin f N5MJH STEP FAILURE Execution of step data pipe graph sasquatch cathode raw data graph normalize arbin4 task arbin f N5MJH failed dagster core errors DagsterInvariantViolationError Attempting to access run id but it was not provided when constructing the OutputContext Stack Trace File home mfickett Documents mfickett dev data pipeline direnv python 3 9 5 lib python3 9 site packages dagster core execution plan execute plan py line 232 in dagster event sequence for step for step event in check generator step events File home mfickett Documents mfickett dev data pipeline direnv python 3 9 5 lib python3 9 site packages dagster core execution plan execute step py line 360 in core dagster event sequence for step for evt in type check and store output step context user event input lineage File home mfickett Documents mfickett dev data pipeline direnv python 3 9 5 lib python3 9 site packages dagster core execution plan execute step py line 417 in type check and store output for evt in store output step context step output handle output input lineage File home mfickett Documents mfickett dev data pipeline direnv python 3 9 5 lib python3 9 site packages dagster core execution plan execute step py line 552 in store output for elt in iterate with context File home mfickett Documents mfickett dev data pipeline direnv python 3 9 5 lib python3 9 site packages dagster utils init py line 401 in iterate with context next output = next iterator File home mfickett Documents mfickett dev data pipeline direnv python 3 9 5 lib python3 9 site packages dagster core execution plan execute step py line 542 in gen fn gen output = output manager handle output output context output value File home mfickett Documents mfickett dev data pipeline direnv python 3 9 5 lib python3 9 site packages dagster core storage fs io manager py line 116 in handle output filepath = self get path context File home mfickett Documents mfickett dev data pipeline direnv python 3 9 5 lib python3 9 site packages dagster core storage fs io manager py line 99 in get path keys = context get output identifier File home mfickett Documents mfickett dev data pipeline direnv python 3 9 5 lib python3 9 site packages dagster core execution context output py line 380 in get output identifier run id = self run id File home mfickett Documents mfickett dev data pipeline direnv python 3 9 5 lib python3 9 site packages dagster core execution context output py line 157 in run id raise DagsterInvariantViolationError ```

johann · Answer

Was this a dynamic out

Mark Fickett · Answer

Yes the ` normalize arbin4 task` op is processing a dynamic out

johann · Answer

I think this is related to this issue Fix planned for first week of May <https github com dagster io dagster issues 6044>