jasono
05/23/2022, 5:43 PMSourceHashVersionStrategy
for Memoization, is changing the value of resources.value.config.some_variable
in Dagit Launchpad considered a version change and triggers the ops to re-run? In my example project, I define a yymm
variable to specify the period the assets from multiple ops are created for, but when I change the value of yymm to a new month, the ops don’t rerun. If I change the config_schema variable specific to those ops, they do rerun. This makes me think the memoization works but resource.config change isn’t considered a version change. Am I missing something?chris
05/23/2022, 8:46 PMjasono
05/23/2022, 8:49 PMcontext.resources.values["yymm"]
in multiple ops, if that’s what you mean by “config mapping”.chris
05/23/2022, 8:50 PMjasono
05/23/2022, 8:53 PMchris
05/23/2022, 9:08 PMjasono
05/24/2022, 5:42 AMchris
05/24/2022, 6:54 PMdagster job list_versions
command and verify that versions are changing if you change the config. ex:
dagster job list_versions -f hello_world.py -j
pandas_hello_world -c "pandas_hello_world/*.yaml"
jasono
05/24/2022, 7:36 PM