https://dagster.io/ logo
s

Scott Jones

02/16/2021, 3:11 PM
Hi everybody! 🤓 Does anybody here have experience running Julia tasks from Dagster? I found one repo on GitHub, where someone was using the
pyjulia
package to call into Julia from Python, I wanted to know if are other methods people had used, any recommendations. I am concerned about calling Julia, which uses asynchronous threads / tasks, from Python with it’s GIL.
👍 1
s

sashank

02/16/2021, 3:17 PM
Hey Scott, others might have good suggestions for Julia specifically, but you might find Alex’s answer in this thread helpful: https://dagster.slack.com/archives/CCCR6P2UR/p1613307284118600
👍 1
s

Scott Jones

02/16/2021, 6:00 PM
One big difference though, is that Julia can be called in the same process (using the pyjulia package).