Lihao Yu
08/08/2022, 9:51 PMPRIORITIZED_EXCHANGES
and EXT_EXCHANGES
), but it seems like all runs are triggered at the same time even though the PRIORITIZED group has higher priority than the other, below is my scheduler code, thanks in advance!
@schedule(
job=daily_data_download_job,
cron_schedule="0 12 * * *",
execution_timezone="US/Eastern",
description="Triggers daily_data_download_job at 12:10am UTC everyday."
)
def tardis_download_schedule():
for exchange in PRIORITIZED_EXCHANGES:
yield RunRequest(
run_key=exchange,
tags={"dagster/priority": "3"},
run_config={
"resources": {
"exchange": {
"config": exchange
}
}
}
)
for exchange in EXT_EXCHANGES:
yield RunRequest(
run_key=exchange,
tags={"dagster/priority": "-1"},
run_config={
"resources": {
"exchange": {
"config": exchange
}
}
}
)
claire
08/08/2022, 10:52 PMPRIORITIZED_EXCHANGES
and EXT_EXCHANGES
values?