19913d85-f662-4518-a9a1-7adc1793dfd4.png){kind=small}
Hi I’m new to dagster and I have few questions abo...
# ask-communitya
Adrien Philippe
04/18/2023, 7:40 AMHi I’m new to dagster and I have few questions about Multi-Dimensional partitions including a Dynamic partition + Time partition.
Context :
Basically I create one job by client and for each of the jobs, I have an asset which is defined with the same definition.
Then I have a sensor that checks if there is new partitions for each client and add/remove them.
Problem :
All the dynamic partitions are mixed up between all my jobs like if they were all connected.
I can’t find the way to do it in documentation.
If you could give me some advices or be available for a call it would be awesome.
Adrien Philippe
04/18/2023, 8:30 AMCould it be due to the fact that I generate my job using same
partition_defgroup_name Copy code
for client in clients:
job = define_asset_job(
name=f"snowflake_client_{client['tenant_id']}",
selection=AssetSelection.groups(SNOWFLAKE_GROUP_NAME),
partitions_def=full_partition,
config={
"ops": {
"extract_snowflake_logs": {
"config": {"tenant_id": client["tenant_id"], "accounts": client["accounts"]}
},
"extract_snowflake_metadata": {
"config": {"tenant_id": client["tenant_id"], "accounts": client["accounts"]}
},
}
},
)v
Vinnie
04/18/2023, 12:57 PM`DynamicPartitionsDefinition`s with the same name are shared across assets/jobs using it.
❤️ 1
3 Views