https://dagster.io/ logo
#dagster-feedback
Title
# dagster-feedback
g

George Pearse

06/29/2022, 3:09 PM
Some of the error messages around the edge of the DBT integration aren't clear at all.
Copy code
Using temporary directory /home/georgep/projects/behold-pipelines/tmpnu9_gb7h for storage. This will be removed when dagit exits.
To persist information across sessions, set the environment variable DAGSTER_HOME to a directory to use.

0it [00:00, ?it/s]
0it [00:00, ?it/s]
/home/georgep/environments/behold-pipelines/lib/python3.10/site-packages/dagster/core/workspace/context.py:554: UserWarning: Error loading repository location repo.py:FileNotFoundError: [Errno 2] No such file or directory: 'dbt'

Stack Trace:
  File "/home/georgep/environments/behold-pipelines/lib/python3.10/site-packages/dagster/grpc/server.py", line 224, in __init__
    self._loaded_repositories = LoadedRepositories(
  File "/home/georgep/environments/behold-pipelines/lib/python3.10/site-packages/dagster/grpc/server.py", line 98, in __init__
    loadable_targets = get_loadable_targets(
  File "/home/georgep/environments/behold-pipelines/lib/python3.10/site-packages/dagster/grpc/utils.py", line 33, in get_loadable_targets
    else loadable_targets_from_python_file(python_file, working_directory)
  File "/home/georgep/environments/behold-pipelines/lib/python3.10/site-packages/dagster/core/workspace/autodiscovery.py", line 26, in loadable_targets_from_python_file
    loaded_module = load_python_file(python_file, working_directory)
  File "/home/georgep/environments/behold-pipelines/lib/python3.10/site-packages/dagster/core/code_pointer.py", line 86, in load_python_file
    return import_module_from_path(module_name, python_file)
  File "/home/georgep/environments/behold-pipelines/lib/python3.10/site-packages/dagster/seven/__init__.py", line 50, in import_module_from_path
    spec.loader.exec_module(module)
  File "<frozen importlib._bootstrap_external>", line 883, in exec_module
  File "<frozen importlib._bootstrap>", line 241, in _call_with_frames_removed
  File "/home/georgep/projects/behold-pipelines/repo.py", line 13, in <module>
    from pipelines.analytics.dbt_analytics_assets import dbt_analytics_assets
  File "/home/georgep/projects/behold-pipelines/pipelines/analytics/dbt_analytics_assets.py", line 12, in <module>
    dbt_assets = load_assets_from_dbt_project(
  File "/home/georgep/environments/behold-pipelines/lib/python3.10/site-packages/dagster_dbt/asset_defs.py", line 358, in load_assets_from_dbt_project
    manifest_json, cli_output = _load_manifest_for_project(
  File "/home/georgep/environments/behold-pipelines/lib/python3.10/site-packages/dagster_dbt/asset_defs.py", line 38, in _load_manifest_for_project
    cli_output = execute_cli(
  File "/home/georgep/environments/behold-pipelines/lib/python3.10/site-packages/dagster_dbt/cli/utils.py", line 75, in execute_cli
    process = subprocess.Popen(command_list, stdout=subprocess.PIPE, stderr=subprocess.STDOUT)
  File "/home/georgep/.pyenv/versions/3.10.2/lib/python3.10/subprocess.py", line 966, in __init__
    self._execute_child(args, executable, preexec_fn, close_fds,
  File "/home/georgep/.pyenv/versions/3.10.2/lib/python3.10/subprocess.py", line 1842, in _execute_child
    raise child_exception_type(errno_num, err_msg, err_filename)
Is just what happens when dbt-core isn't installed, but I've hit it twice and both times it's taken me a while to realise that (I always assume I'm missing some directory in DBT's very structured file config).
r

rex

06/29/2022, 4:57 PM