https://dagster.io/ logo
#ask-community
Title
# ask-community
v

victor

05/07/2021, 2:05 PM
What is the support in dagit for dynamic DAGs? I can see the dynamic output in the dag definition graph, but on launching a run there's a Javascript error in the console and the screen goes blank. It does not happen for pipelines in the same repository that don't have dynamic outputs. Is this expected at the moment?
Screen recording of the above in action:
a

alex

05/07/2021, 2:17 PM
Do you have access to the dagit webserver logs? Haven’t seen this issue before
@dish
ack 1
did you encounter this error before upgrading to 0.11.8 as well?
v

victor

05/07/2021, 2:24 PM
dagit server logs is happily chugging along executing the pipeline, no weird messages. This is running 0.11.8, tested on Firefox and Chrome on macOS.
(I was running it with
in_process
executor, I can test with other if you think it's relevant)
a

alex

05/07/2021, 2:38 PM
hmm i cant repro locally with our toy dynamic pipeline
can you “download debug file” in the
...
menu on the runs page and send it over
(assuming theres nothing sensitive in the events )
v

victor

05/07/2021, 2:43 PM
Sure, I'll do that. I'm also having some graphql connection problems, not sure if it is related.
debug file for a run of that pipeline:
a

alex

05/07/2021, 3:16 PM
nice i can repro with that
👍 1
d

dish

05/07/2021, 3:26 PM
Thanks @victor!
cc @Ben Gotow Looks like an issue in
toGraphQueryItems
at :74, the key doesn’t exist in the
keyExpansionMap
so we’re getting an undefined
upstreamKeys
b

Ben Gotow

05/07/2021, 3:29 PM
oh interesting… does this pipeline use dynamic orchestration? any chance this is an older run of a pipeline that was modified and now has different solids?
v

victor

05/07/2021, 3:29 PM
yes, it's using dynamic orchestration, and happens on a fresh run as well
b

Ben Gotow

05/07/2021, 3:33 PM
ok great! sorry just read the beginning of the thread 🙂 taking a look at that log file now
v

victor

05/10/2021, 9:44 AM
Did you figure something out from the logs?
a

alex

05/10/2021, 2:52 PM
yea https://dagster.phacility.com/D7814 fix should go out in next release
v

victor

05/10/2021, 2:54 PM
nice, thanks!
a

alex

05/10/2021, 2:55 PM
thank you for sending debug file over - made it really easy to resolve
3 Views