05/20/2020, 5:57 PM
Just our of curiosity is the ability to perform a pipeline backfill from the UI on the roadmap? Right now it looks like it’s only executable from the CLI (
05/20/2020, 7:45 PM
! It’s not on our immediate roadmap… would your use case mainly be re-running a partitioned schedule across all partitions?
05/20/2020, 8:04 PM
Yeah that’s the main use case. I also have some semi-technical users where if they had to manually do a backfill it would just be easier with a button click
05/20/2020, 8:05 PM
I see… but they wouldn’t need to customize the config on a per-partition basis, aside from the function provided to the schedule definition?
I think that’s the main complexity around providing a complete backfill-via-UI solution
that and how to handle / throttle the batch of requests
We’ve informally been pointing people to this example backfill schedule:
This schedule runs every minute, looking for partitions that do not have successful runs and kicks off a run for it
So it’s kind of a continuous backfill schedule that you can turn on/off via the UI
It’s just not customizable to every schedule 😕
05/20/2020, 8:11 PM
Ah that example is helpful 🙂 Thanks