What is the support in dagit for dynamic DAGs? I c...
# ask-community
v
What is the support in dagit for dynamic DAGs? I can see the dynamic output in the dag definition graph, but on launching a run there's a Javascript error in the console and the screen goes blank. It does not happen for pipelines in the same repository that don't have dynamic outputs. Is this expected at the moment?
Screen recording of the above in action:
a
Do you have access to the dagit webserver logs? Haven’t seen this issue before
@dish
ack 1
did you encounter this error before upgrading to 0.11.8 as well?
v
dagit server logs is happily chugging along executing the pipeline, no weird messages. This is running 0.11.8, tested on Firefox and Chrome on macOS.
(I was running it with
in_process
executor, I can test with other if you think it's relevant)
a
hmm i cant repro locally with our toy dynamic pipeline
can you “download debug file” in the
...
menu on the runs page and send it over
(assuming theres nothing sensitive in the events )
v
Sure, I'll do that. I'm also having some graphql connection problems, not sure if it is related.
debug file for a run of that pipeline:
a
nice i can repro with that
👍 1
d
Thanks @victor!
cc @Ben Gotow Looks like an issue in
toGraphQueryItems
at :74, the key doesn’t exist in the
keyExpansionMap
so we’re getting an undefined
upstreamKeys
b
oh interesting… does this pipeline use dynamic orchestration? any chance this is an older run of a pipeline that was modified and now has different solids?
v
yes, it's using dynamic orchestration, and happens on a fresh run as well
b
ok great! sorry just read the beginning of the thread 🙂 taking a look at that log file now
v
Did you figure something out from the logs?
a
yea https://dagster.phacility.com/D7814 fix should go out in next release
v
nice, thanks!
a
thank you for sending debug file over - made it really easy to resolve