Alexis M
11/27/2019, 2:08 PMalex
11/27/2019, 4:04 PMos.getenv
can be used in your @resource creation functionAlexis M
11/27/2019, 4:08 PMabhi
11/27/2019, 6:19 PMmax
11/27/2019, 6:24 PMimport os
from dagster import Field, ModeDefinition, String, execute_pipeline, pipeline, resource, solid
@resource(config_field=Field(String))
def env_resource(init_context):
return os.getenv(init_context.resource_config)
@solid(required_resource_keys={'dagster_home'})
def log_dagster_home(context):
<http://context.log.info|context.log.info>(context.resources.dagster_home)
@pipeline(
mode_defs=[ModeDefinition(resource_defs={'dagster_home': env_resource})]
)
def dagster_home_pipeline():
log_dagster_home()
if __name__ == '__main__':
execute_pipeline(
dagster_home_pipeline, {'resources': {'dagster_home': {'config': 'DAGSTER_HOME'}}}
)
Alexis M
11/27/2019, 6:24 PMabhi
11/27/2019, 6:31 PMos.getenv
to access your environment variables)Alexis M
11/27/2019, 6:34 PM