Sam
04/04/2023, 11:20 AMdagster dev
and when dagster jobs init / start new steps also. I've also tried using the forkserver config applied to each job to see if that helps, but no luck so far.
config={
"execution": {
"config": {
"multiprocess": {
"start_method": {
"forkserver": {},
},
},
}
}
}
get_asx_news_job = define_asset_job(
name="sync_asx_news",
description="",
selection=AssetSelection.keys("extract_asx_news").downstream(),
config=config,
)
For additional info I am importing a module of code (basically a service/API lib) written prior to using dagster which gets called inside some assets - but i wouldn't think 10 or so python files should impact this that dramatically?daniel
04/04/2023, 2:46 PM