https://dagster.io/ logo
#announcements
Title
# announcements
j

Jeff Hulbert

03/22/2021, 3:48 PM
Has anyone had any issues with getting the timeline to dynamically refresh while a pipeline is executing. I can reload the page during execution and get the timeline to update but not in real-time. This is both when running Dagit within an Azure Web App or within k8s (behind Ambassador Edge). Chrome web console has a message like "failed: WebSocket is closed before the connection is established." Are there some timeout settings that may need to be adjusted when Dagit is behind a load balancer type setup?
a

alex

03/22/2021, 3:53 PM
the live execution view is powered by a GraphQL Subscription that happens over websockets. If something in the load balancer set up is causing the websocket connection to terminate, the live updates will stop
if you use the browser dev tools to look at the websocket network traffic you may gain some insight
j

Jeff Hulbert

03/22/2021, 4:01 PM
seems other websocket traffic is getting through fine except the live execution view. Are there any settings on server-side that can be changed?
a

alex

03/22/2021, 4:03 PM
no settings in
dagit
is it one persistent websocket connection or are new ones being set up repeatedly?
j

Jeff Hulbert

03/22/2021, 4:15 PM
looks like many, did some more tests and looks like they are getting interrupted. Will do some more digging on potential settings in Ambassador
s

szalai1

03/22/2021, 8:03 PM
I'm actually experiencing similar issues. Just upgraded to 0.10.6 and the new deployment cannot connect to ws. The old could. Even if I portfowrad dagit from k8s.
j

Jeff Hulbert

03/22/2021, 8:12 PM
I'm on 0.11.0 and k8s portforward of dagit isn't working either (in addition to ws via Ambassador)
a

alex

03/22/2021, 8:24 PM
cc @rex
just to clarify - when port forwarding to the
dagit
pod
it does not work at all? Or just issues with the live updating execution view?
j

Jeff Hulbert

03/22/2021, 8:27 PM
live updating execution view
a

alex

03/22/2021, 8:34 PM
have you restarted the dagit pod? just want to rule out weird transient webserver state
j

Jeff Hulbert

03/22/2021, 8:47 PM
confirmed same after restart of pod
ack 1
a

alex

03/22/2021, 8:52 PM
i think the next step is probably to file an issue with as much detail as possible about your setup. I tried to repro on a few of our internal deploys and was unable to.
j

Jeff Hulbert

03/22/2021, 9:25 PM
will include this in the issue but while the execution is running I can actually see payloads coming across in the websocket connection on chrome developer tab, seems its just not visualizing it until the page is reloaded
a

alex

03/22/2021, 9:30 PM
huh very weird
a

alex

03/22/2021, 9:48 PM
thanks for the details
3 Views