Steven Murphy
08/09/2023, 10:31 AMdbt_assets = load_assets_from_dbt_project(
project_dir=DBT_PROJECT_DIR,
profiles_dir=DBT_PROFILES_DIR,
key_prefix=['aa']
)
However I don't see that in DbtCliResource
, I had tried setting --profiles-dir
in global_config_flags
to be told that option is not available.
Running a raw DBT command, I can see the option is not there either:
(venv) ➜ dbt_project git:(airbyte_integration) ✗ dbt --profiles-dir a
Usage: dbt [OPTIONS] COMMAND [ARGS]...
Try 'dbt -h' for help.
Error: No such option: --profiles-dir
(venv) ➜ dbt_project git:(airbyte_integration) ✗
It is still shown as an option on the DBT website (using the DBT_PROFILES_DIR
env var still works) - https://docs.getdbt.com/docs/core/connect-data-platform/connection-profiles#advanced-customizing-a-profile-directory
I'm wondering if this is a regression on the DBT side or if I'm missing something, thanks.
Edit: not a DBT regression, it was me forgetting that you need to use the switch in conjunction with another command, eg dbt build --profiles-dir your_dir
rex
08/09/2023, 10:50 AMprofiles.yml
in the root of their directory, so we’ve added it back as configuration to DbtCliResource
! https://github.com/dagster-io/dagster/pull/15722Steven Murphy
08/09/2023, 10:55 AMLooks like it isn’t intuitive for folks to have theirAgreed. In my case I'm putting references to JSON files which BigQuery uses for authentication purposes. Not sensitive in itself, though no need to be in the repo. I take it that change you made will be on the next release? I see its mergedprofiles.yml
Steven Murphy
08/09/2023, 10:59 AMrex
08/09/2023, 11:01 AMSteven Murphy
08/09/2023, 11:01 AM