Joseph Antonakakis
06/30/2022, 5:12 PMdagit
picks up the changes, but on running jobs, we hit some unexpected errors if the pipeline notably changed.
Some examples:
1. Received unexpected config entry "user_ids" at path root:inputs.
We hit this when we added a new user_ids
input to the job.
2. An exception was thrown during execution that is likely a framework error, rather than an error in user code.
Followed by a KeyError
with a new output from a new operator.
Whenever this happens, force-reloading the repo in dagit
always fixes the issue. I'm wondering why dagit
appears to have picked up the changes, but executing the job fails.chris
06/30/2022, 7:15 PMJoseph Antonakakis
06/30/2022, 7:33 PMchris
07/01/2022, 4:36 AM