https://dagster.io/ logo
Title
a

Alexey Romanov

05/03/2023, 12:38 PM
Hi, I have a question about how to set up assets properly in a particular case. Suppose I would like to request some API on a daily basis and put the responses into my DB. However, there already is a bunch of historical responses stored on a disk in some filesystem. Is it possible to arrange a single Dagster DB asset for the whole set of responses in such a way that new partitions would go straight into DB while historical partitions could be backfilled from FS?
s

sandy

05/04/2023, 9:39 PM
Hey Alexey - take a look at this discussion: https://github.com/dagster-io/dagster/discussions/12561
❤️ 1