Hi We are trying to understand how to define the configuration when running

execute_pipeline

. 1. We set the

DAGSTER_HOME

environment 2. When running

dagit

we can see that the logs are saved under the

storage

and under

history/runs

3. When running the

execute_pipeline

from within a python file the logs are not saved (under the environment_dict we have the configurations for the

solids

that we are running in the

pipeline

. What is the correct manner to configure

exectue_pipeline

? Update I guess we need to define the instance .

You can control how intermediates are persisted in each pipeline invocation - to have the intermediates persisted to disk you add

storage:
  filesystem:

to your environment config

Thx