Hello I am trying to figure out how to debug in an IDE pycha dagster #ask-community

Hello! I am trying to figure out how to debug in a...

Jeff Nawrocki

02/17/2023, 5:36 PM

Hello! I am trying to figure out how to debug in an IDE (pycharm). I am using the cereals example and created a job to run all assets. I then try to run the job:

Copy code

all_assets_job = define_asset_job(name="all_assets_job")

defs = Definitions(
    assets=[cereals, nabisco_cereals, cereal_protein_fractions, highest_protein_nabisco_cereal],
    jobs=[all_assets_job],
)

if __name__ == "__main__":
    result = all_assets_job.execute_in_process()

This throws an error:

AttributeError: 'UnresolvedAssetJobDefinition' object has no attribute 'execute_in_process'

Is there a way to debug this while in an IDE, and is

all_assets_job.execute_in_process()

the correct way to run the assets?

Jeff Nawrocki

02/17/2023, 5:37 PM

I am able to run this job via

dagster dev

but I would ideally be able to debug in the IDE.

Jeff Nawrocki

02/17/2023, 5:45 PM

It seems like I could use

materialize([cereals, nabisco_cereals, cereal_protein_fractions, highest_protein_nabisco_cereal])

which is possibly the better way to go in this case. If there is a mix of ops and assets, I would still need to run a job right?

Jean Gonzalez

02/17/2023, 5:50 PM

This is actually related https://dagster.slack.com/archives/C01U954MEER/p1676651073355379

Jean Gonzalez

02/17/2023, 5:51 PM

.resolve().execute_in_progress() but then we got stuck with other error

👀 1

Jeff Nawrocki

02/17/2023, 5:52 PM

Will take a look, thanks @Jean Gonzalez

Saul Burgos

02/17/2023, 5:58 PM

@Jeff Nawrocki Hey Owen has answered on the link posted by Jean

🌈 2

19 Views

Open in Slack

Previous Next