https://dagster.io/ logo
#ask-community
Title
# ask-community
t

Tom Reilly

02/27/2023, 8:45 PM
Is there a way to query the config of running and queued job runs? I'm setting up a sensor which can initiate job runs and would like the query to look something like
Copy code
SELECT download_url from file_requests
MINUS
SELECT download_url from acquired_files
MINUS
SELECT download_url from in_process_and_queued_files
For each record returned by this query I'd like to initiate a run request for a job (
job_A
) that requires
download_url
as config.
job_A
updates the
acquired_files
table but, depending on the file size and number of runs already queued, I'm concerned the
acquired_files
table will not always be updated in time for the next sensor evaluation tick which could result in initiating another
RunRequest
for a
download_url
that is already either in progress or in queue. Is there a way to handle this besides increasing the sensor tick to a higher value?
🤖 1
You can disregard this. Seems like I can use the
run_key
arg when initiating the
RunRequest
to handle this situation.
👍 1