The `with resources` function doesn t work for `job` objects

Question

The `with resources` function doesn t work for `job` objects Is it possible to define a `job` once and then provide different resources for different repositories e g dev and prod Normally this could be done via defining a `job` from `graph` but my job is defined using `build assets job` from assets What s the best solution here

sandy · Answer

Hey Daniel are you able to use `define asset job`

Daniel Gafni · Answer

Thanks seems like this is what I need However it fails with ```dagster check CheckError Invariant failed Description Assets defined for node catalog session events have a partitions def of Daily starting 2022 05 01 Europe Moscow but job daily etl has non matching partitions def of Daily starting 2022 05 31 Europe Moscow ``` These assets have a different start date since some of the downstream assets depend on multiple partitions of the upstream assets and therefore should start later This error doesn t seem logical especially considering I m using partitions mapping and Dagster should know the assets are mapped correctly but most importantly this forbids sharing an asset between two jobs with different partitioning Consider 1 Training job has a daily partitioning with an offset of 1 day because we need the current partition to make targets for the previous one 2 Inference job has a normal daily partitioning Currently it s impossible to share `data` and `model` assets between these two jobs created via `define asset job` because they required different partitioning Anyway after changing all the partitions def to be the same just to try `define asset job` out I got this error ```dagster check CheckError Invariant failed Description Duplicate definition found for daily etl partition set``` Seems like this is a bug I can t find any duplicated definitions I found it reported <https dagster slack com archives C01U954MEER p1656777806113929|elsewhere> So seems like I ll have to go with `build assets job` for now as it allows to override the asset partitioning when building the job I ll just have to call it once per every `repository` every time with different resources Maybe `define asset job` should let the user to override the partitioning in the same way

Jeremy · Answer

< sandy> I think something similar is happening with our dag < Daniel Gafni> did you resolve this

sandy · Answer

Hey < Jeremy> are you seeing an error like this ```dagster check CheckError Invariant failed Description Duplicate definition found for daily etl partition set``` if so that s fixed in a recent version of Dagster

Daniel Gafni · Answer

I didn t try this in the new version yet Will do today

Daniel Gafni · Answer

Nope still can t use assets with different partitions `start date` for the same `define asset job` ```dagster check CheckError Invariant failed Description Assets defined for node line items stats with aggs have a partitions def of Daily starting 2022 05 15 Europe Moscow but job daily etl has non matching partitions def of Daily starting 2022 05 01 Europe Moscow ```

Daniel Gafni · Answer

This means I can t use the same asset ML model both for training and inference jobs as they have different partitions ```dagster check CheckError Invariant failed Description Assets defined for node ranking model have a partitions def of Daily starting 2022 05 29 Europe Moscow End offsetted by 1 partitions but job catalog ranking inference has non matching partitions def of Daily starting 2022 05 01 Europe Moscow ```

Jeremy · Answer

upgrading worked for me