Stephen Bailey
07/20/2023, 11:50 PMload_assets_from_dbt_manifest
instead?Stephen Bailey
07/21/2023, 2:55 AMdagster._core.errors.DagsterUserCodeUnreachableError: User code server request timed out due to taking longer than 60 seconds to complete.
to parse the manifest im just doing:
manifest = json.loads(pathlib.Path("target/manifest.json").read_text())
@dbt_assets(manifest=manifest)
def my_models(dbt: DbtCliResource):
...
Charlie Bini
07/21/2023, 3:07 AMrex
07/21/2023, 3:28 AMrex
07/21/2023, 4:20 AMStephen Bailey
07/21/2023, 10:57 AMdbt_resource.get_run_results_json
?rex
07/21/2023, 1:45 PMimport json
from dagster_dbt import DbtCliResource
with open("path/to/manifest.json", "r") as f:
manifest = json.load(f)
dbt = DbtCliResource(project_dir="/path/to/dbt/project")
dbt_cli_task = dbt.cli(["run"], manifest=manifest)
# Retrieve the run_results.json artifact.
if dbt_cli_task.is_successful():
run_results = dbt_cli_task.get_artifact("run_results.json")
Stephen Bailey
07/21/2023, 2:58 PM