Backfills are cool, but i'd love better control. I created the same twice, but cannot delete/cancel it before the jobs actually are requested.

Thanks for the feedback @Casper Weiss Bang. I agree. I logged an issue in github so we get this on our radar and you can track any progress on the feature.