Jan Rouš
07/10/2023, 9:58 PMBaseModel
and/or BaseSettings
(the structures here are quite nested and complex). As far as I can tell, dagster ConfigurableResource
should be very similar to this, and likely based on the same pydantic base classes.
Now, I would like to turn few of these top-level configs into dagster resources, but I'm not quite sure how to go about that.Jan Rouš
07/10/2023, 10:02 PMchris
07/10/2023, 10:12 PMConfigurableResource
and it will just work. All of the extra resource wrapping / converting to dagster’s config system can just go away. I’m not honestly sure how BaseSettings
works in comparison to BaseModel
, but I think it’s worth a more generic treatment / discussion so going to open onechris
07/10/2023, 10:23 PMDagster Bot
07/10/2023, 10:23 PM