mrdavidlaing
12/28/2020, 8:18 PMat_date
config; which every solid then depends on
2. A "for_day" solid that takes a at_date
config wraps all the other solids and passes the value to it as a via an output@resource(
{
"at_date": Field(str, is_required=True, description="The partition date - YYYY-MM-DD used in the pipeline"),
}
)
def partition_config(context):
return context.resource_config
@solid(
required_resource_keys={"partition_config"}
)
def extract_accounts_from_vmap(context) -> DataFrame:
at_date = context.resources.partition_config['at_date']
...snip...
Noah K
12/29/2020, 12:05 PMsashank
12/29/2020, 3:21 PMNoah K
12/29/2020, 3:25 PM