George Pearse
06/29/2022, 3:09 PMUsing temporary directory /home/georgep/projects/behold-pipelines/tmpnu9_gb7h for storage. This will be removed when dagit exits.
To persist information across sessions, set the environment variable DAGSTER_HOME to a directory to use.
0it [00:00, ?it/s]
0it [00:00, ?it/s]
/home/georgep/environments/behold-pipelines/lib/python3.10/site-packages/dagster/core/workspace/context.py:554: UserWarning: Error loading repository location repo.py:FileNotFoundError: [Errno 2] No such file or directory: 'dbt'
Stack Trace:
File "/home/georgep/environments/behold-pipelines/lib/python3.10/site-packages/dagster/grpc/server.py", line 224, in __init__
self._loaded_repositories = LoadedRepositories(
File "/home/georgep/environments/behold-pipelines/lib/python3.10/site-packages/dagster/grpc/server.py", line 98, in __init__
loadable_targets = get_loadable_targets(
File "/home/georgep/environments/behold-pipelines/lib/python3.10/site-packages/dagster/grpc/utils.py", line 33, in get_loadable_targets
else loadable_targets_from_python_file(python_file, working_directory)
File "/home/georgep/environments/behold-pipelines/lib/python3.10/site-packages/dagster/core/workspace/autodiscovery.py", line 26, in loadable_targets_from_python_file
loaded_module = load_python_file(python_file, working_directory)
File "/home/georgep/environments/behold-pipelines/lib/python3.10/site-packages/dagster/core/code_pointer.py", line 86, in load_python_file
return import_module_from_path(module_name, python_file)
File "/home/georgep/environments/behold-pipelines/lib/python3.10/site-packages/dagster/seven/__init__.py", line 50, in import_module_from_path
spec.loader.exec_module(module)
File "<frozen importlib._bootstrap_external>", line 883, in exec_module
File "<frozen importlib._bootstrap>", line 241, in _call_with_frames_removed
File "/home/georgep/projects/behold-pipelines/repo.py", line 13, in <module>
from pipelines.analytics.dbt_analytics_assets import dbt_analytics_assets
File "/home/georgep/projects/behold-pipelines/pipelines/analytics/dbt_analytics_assets.py", line 12, in <module>
dbt_assets = load_assets_from_dbt_project(
File "/home/georgep/environments/behold-pipelines/lib/python3.10/site-packages/dagster_dbt/asset_defs.py", line 358, in load_assets_from_dbt_project
manifest_json, cli_output = _load_manifest_for_project(
File "/home/georgep/environments/behold-pipelines/lib/python3.10/site-packages/dagster_dbt/asset_defs.py", line 38, in _load_manifest_for_project
cli_output = execute_cli(
File "/home/georgep/environments/behold-pipelines/lib/python3.10/site-packages/dagster_dbt/cli/utils.py", line 75, in execute_cli
process = subprocess.Popen(command_list, stdout=subprocess.PIPE, stderr=subprocess.STDOUT)
File "/home/georgep/.pyenv/versions/3.10.2/lib/python3.10/subprocess.py", line 966, in __init__
self._execute_child(args, executable, preexec_fn, close_fds,
File "/home/georgep/.pyenv/versions/3.10.2/lib/python3.10/subprocess.py", line 1842, in _execute_child
raise child_exception_type(errno_num, err_msg, err_filename)
Is just what happens when dbt-core isn't installed, but I've hit it twice and both times it's taken me a while to realise that (I always assume I'm missing some directory in DBT's very structured file config).rex
06/29/2022, 4:57 PM