https://dagster.io/ logo
Title
m

Marco

02/20/2023, 6:24 PM
Hi - is there a way to make my custom io_manager backfill-aware? Basically I want to persist outputs in a different folder if they are the product of a backfill (and make the output path contain the backfill id as well as any additional backfill tags)
c

claire

02/22/2023, 12:10 AM
Hi Marco. You could do something like this within the
handle_output
method of your IO manager to check whether the output was generated in a backfill:
from dagster._core.storage.tags import BACKFILL_ID_TAG
context.step_context.get_tag(BACKFILL_ID_TAG)