Seth Kimmel
02/09/2023, 7:49 PMdefine_asset_job
object and passing a config, but it seems you are only able to pass config entries to the ops?jamie
02/09/2023, 8:04 PM@asset(
io_manager_key="snowflake_io_mgr"
)
def my_asset():
...
define_asset_job(name="staging_job", selection=[my_asset], resource_defs={"snowflake_io_mgr": snowflake_io_manager.configured(<staging_config>))
define_asset_job(name="prod_job", selection=[my_asset], resource_defs={"snowflake_io_mgr": snowflake_io_manager.configured(<prd_config>))
Seth Kimmel
02/09/2023, 8:39 PMdefine_asset_job
doesn't have a resource_defs
paramjamie
02/09/2023, 8:44 PM@asset(
io_manager_key="snowflake_io_mgr"
)
def my_asset():
...
define_asset_job(name="staging_job", selection=[my_asset], config={"resources": {"snowflake_io_mgr":{<staging_config}}})
define_asset_job(name="prod_job", selection=[my_asset], config={"resources": {"snowflake_io_mgr":{<staging_config}}})
if your repository/definitions when you set up the mapping of resource to resource key, you won’t use the .configured
api, instead all the configuration will be provided as the config
arg in define_asset_job
Seth Kimmel
02/09/2023, 9:01 PMfs_io_manager
is required by the first op, but not provided. What would make it recognize the resource in the Definitions
class, but not in the config?jamie
02/09/2023, 9:02 PMdefine_asset_job
and your Definitions
?Seth Kimmel
02/09/2023, 9:05 PM