so I just ran a historical sync of all the data we use from

Question

so I just ran a historical sync of all the data we use from one of our systems helluva graph kudos to the cloud team for making this view so much faster than it used to be

Charlie Bini · Answer

that s all I could fit into a screenshot

Charlie Bini · Answer

took a little over 13 min to complete

Charlie Bini · Answer

k8s job executor is not messing around

Charlie Bini · Answer

331 individual steps using a dynamic graph

Charlie Bini · Answer

is there a dagster abuse channel

Stephen Bailey · Answer

no but please let s make one

Stephen Bailey · Answer

half the things i do to dagster are acts of abuse

Binoy Shah · Answer

is there a code base to see the code behind this at work

Jaap Langemeijer · Answer

I ran a fanout of 72k ops on the k8s job executor so reach out if you need any material