19913d85-f662-4518-a9a1-7adc1793dfd4.png){kind=small}
Hi, I have a newbie question. I have an asset grou...
# ask-communityj
jasono
09/08/2022, 12:22 AMHi, I have a newbie question. I have an asset group with 4 monthly partitioned assets with interdependencies. When I click
materialize all (4)Upstream data Missing: 2022-07-01 cannot be materialized because upstream materializations are missingy
yuhan
09/08/2022, 1:06 AMDo you mind sharing your asset group or the code that specifies the dependency?
j
jasono
09/08/2022, 1:15 AMSure
jasono
09/08/2022, 1:16 AM Copy code
# from pandas import DataFrame
from dagster import asset
from repo.partitions import monthly_partitions
@asset(partitions_def=monthly_partitions)
def asset1(context):
<http://context.log.info|context.log.info>(
f"Processing asset partition '{context.asset_partition_key_for_output()}' "
)
@asset(partitions_def=monthly_partitions)
def asset2_partitioned(context, asset1):
<http://context.log.info|context.log.info>(
f"Processing asset partition '{context.asset_partition_key_for_output()}' "
)jasono
09/08/2022, 1:18 AMThat was asset group 1, and below is group 2.
Copy code
# from pandas import DataFrame
from dagster import asset, SourceAsset, AssetKey
from repo.partitions import monthly_partitions
# from repo.assets.asset_grp1.asset_one import asset2_partitioned
# source_asset1 = SourceAsset(key=AssetKey("asset2_partitioned"))
@asset(partitions_def=monthly_partitions)
def asset_grp2_1(context, asset2_partitioned):
<http://context.log.info|context.log.info>(
f"Processing asset partition '{context.asset_partition_key_for_output()}' "
)
@asset(partitions_def=monthly_partitions)
def asset_grp2_2_partitioned(context,asset_grp2_1):
<http://context.log.info|context.log.info>(
f"Processing asset partition '{context.asset_partition_key_for_output()}' "
)jasono
09/08/2022, 1:21 AMAnd finally this is the repository.py.
Copy code
from dagster import repository, with_resources
from .assets import asset_grp1_assets, asset_grp2_assets
all_assets = [*asset_grp1_assets,*asset_grp2_assets]
@repository
def ngls_repository():
definitions = [
all_assets
]
return definitionsjasono
09/08/2022, 1:23 AMAt first, I didn't have asset1 as a partitioned asset but Dagster didn't seem to like partitioned asset depending on an unpartitioned asset.
jasono
09/08/2022, 7:45 AMOkay. Here is what I just realized. When I first click to materialize all, I do get that error/warning message mentioned above. However, if I click the materialize button again, this time Dagster does materialize all assets.
jasono
09/08/2022, 7:45 AMSo in my opinion, the error/warning message is a bit misleading.
s
sandy
09/08/2022, 2:18 PMhey @jasono - which version are you running? this is a bug that I believe we fixed recently: https://github.com/dagster-io/dagster/issues/9291
j
jasono
09/09/2022, 7:12 AMoh.. 1.0.4. Let me try to upgrade i. Thank you!!
jasono
09/09/2022, 7:13 AM@sandy
4 Views