Or should I be using environment variables instead which the

Question

Or should I be using environment variables instead which these already are for the database config just had pipeline specific config via yaml edit reading <https docs dagster io tutorial advanced pipelines parametrizing pipelines with resources> it showed that `resources yaml` is included edit2 Ah it is probably presets

mrdavidlaing · Answer

To add another option you can have pipeline presets read from Env variables

mrdavidlaing · Answer

Personally I would Capture any non sensitive config as presets Have sensitive config in the presets configured to read from environment variables

mrdavidlaing · Answer

See StringSource docs <https docs dagster io apidocs config|https docs dagster io apidocs config>

Josh Taylor · Answer

Yep That s exactly what I want to do I just didn t want to have an environment variable for non secret values

Josh Taylor · Answer

Fantastic This is exactly what I needed means I can split out my yaml config as required and the secret values are in env as defined in the yaml and the non secret in yaml Thanks so much slightly smiling face