https://dagster.io/ logo
#ask-community
Title
# ask-community
h

Harpal

06/21/2022, 7:03 PM
Heya team! Does anyone have experience with software defined assets on Dagster? The rest of my dagster jobs work fine (sensors, etc.), but when I add the job that utilises software defined the repo.py it causes an error below. It also shows that page where dagitui cannot see any of your repositories (see attached image).
Copy code
dagster._check.CheckError: Invariant failed. Description: Invalid asset dependencies: {AssetKey(['sector_cls__hold__train_set_csv_rig_refactor'])} specified in `internal_asset_deps` argument for multi-asset '_assets' on key 'sector_cls__hold__train_set_csv_rig_refactor'. Each specified asset key must be associated with an input to the asset or produced by this asset. Valid keys: {AssetKey(['public', 'sector_cls__hold__eval_set_csv']), AssetKey(['public', 'sector_cls__hold__isolate_all_caf']), AssetKey(['public', 'sector_cls__hold__isolate_test_caf']), AssetKey(['public', 'sector_cls__hold__isolate_test_haw']), AssetKey(['public', 'sector_cls__hold__train_set_csv_rig_refactor']), AssetKey(['public', 'sector_cls__hold__not_test_wak']), AssetKey(['public', 'sector_cls__hold__train_gcal']), AssetKey(['public', 'sector_cls__hold__isolate_test_wak']), AssetKey(['public', 'sector_cls__hold__train_caf']), AssetKey(['public', 'sector_cls__hold__eval_set_ids']), AssetKey(['public', 'sector_cls__hold__test_set_csv']), AssetKey(['public', 'sector_cls__hold__not_test_caf']), AssetKey(['public', 'sector_cls_crunchbase_data']), AssetKey(['public', 'sector_cls__hold__not_test_set_ids']), AssetKey(['gcs', 'sector_cls__hold__train_set_csv_rig_refactor']), AssetKey(['public', 'sector_cls__hold__train_unk']), AssetKey(['public', 'sector_cls__hold__isolate_all_unk']), AssetKey(['public', 'sector_cls__hold__eval_set_csv_rig_refactor']), AssetKey(['public', 'sector_cls__hold__not_test_unk']), AssetKey(['public', 'sector_cls__hold__test_set_csv_rig_refactor']), AssetKey(['public', 'sector_cls__hold__train_wak']), AssetKey(['public', 'sector_cls__hold__isolate_all_haw']), AssetKey(['public', 'sector_cls__hold__isolate_all_wak']), AssetKey(['public', 'sector_cls__hold__isolate_test_set_ids']), AssetKey(['public', 'sector_cls__hold__isolate_test_gcal']), AssetKey(['public', 'sector_cls__hold__train_set_ids']), AssetKey(['public', 'sector_cls__hold__isolate_test_unk']), AssetKey(['public', 'sector_cls__hold__not_test_gcal']), AssetKey(['public', 'sector_cls__hold__train_haw']), AssetKey(['public', 'sector_cls__hold__train_set_csv']), AssetKey(['public', 'sector_cls__hold__not_test_haw']), AssetKey(['gcs', 'sector_cls__hold__test_set_csv_rig_refactor']), AssetKey(['public', 'sector_cls__hold__isolate_all_gcal']), AssetKey(['gcs', 'sector_cls__hold__eval_set_csv_rig_refactor'])}

Stream closed EOF for dagstertest/dagster-dagster-user-deployments-moonfire-dagster-repo-6c5p8z8k (dagster-user-deployments)
Any help would be much appreciated 🎉 Code snippets available in the comments!
🤖 1
s

sandy

06/21/2022, 9:21 PM
hi @Harpal - what version are you on?
I think it might work if you remove the
internal_asset_deps=deps
line
h

Harpal

06/21/2022, 9:51 PM
Hi @sandy! I’m using version 0.14.17
Copy code
dagster==0.14.17
dagster-dbt==0.14.17
dagster-graphql==0.14.17
dagster-k8s==0.14.17
dagster-pandas==0.14.17
dagster-postgres==0.14.17
dagster-slack==0.14.17
Let me run it with that line removed and get back to you ASAP dagsir
👍 1
Yooo it works locally! I’m gonna try it on my k8s cluster to be 100% sure
Thank you!!
s

sandy

06/21/2022, 10:03 PM
awesome
h

Harpal

06/21/2022, 10:29 PM
OK my DAGs are visible and running on k8s now! They’re just failing for other reasons 😅 Thanks for the advice!