Hello, is there a limit to how many software defined asset a dagster job can materialize?
I have a job that materialize 13 assets with 16g of memory. 11 of them runs and finished very quickly with in 30s while the remaing 2 took forever to finish. but when I run those 2 jobs separately they can finish with in 30s. what might be the cause here?
09/06/2022, 6:22 PM
hey Ruoyu, we haven’t encountered such a limit in assets. my hunch is the cause is in the processes which ran the two hanging assets. were you able to repro the issue in another run? could you access the log of the hanging assets/processes?