Is there a way to query the config of running and queued job runs? I'm setting up a sensor which can initiate job runs and would like the query to look something like

SELECT download_url from file_requests
MINUS
SELECT download_url from acquired_files
MINUS
SELECT download_url from in_process_and_queued_files

For each record returned by this query I'd like to initiate a run request for a job (

job_A

) that requires

download_url

as config.

job_A

updates the

acquired_files

table but, depending on the file size and number of runs already queued, I'm concerned the

acquired_files

table will not always be updated in time for the next sensor evaluation tick which could result in initiating another

RunRequest

for a

download_url

that is already either in progress or in queue. Is there a way to handle this besides increasing the sensor tick to a higher value?