Hi everyone! I’m curious to hear if anyone is using dagster to generate (and serve) the dbt documentation website from
dbt docs generate
in some production-like setup? Like a lightweight data catalog.
03/14/2023, 5:44 PM
Yes to generate, no to serving. We're serving via a proxy from an S3 bucket, but dagster updates the catalog in that bucket
03/14/2023, 6:58 PM
Just curious: What is the value of the DBT catalog over dagster`s asset graph? (from the leightweight perspective) and why don`t you deploy something heavy-weight like open-metadata or others if you need more?
03/14/2023, 7:03 PM
For stakeholders and dbt developers that seeks information on how data is transformed in our data warehouse I find dbt:s autogenerated docs a better fit than Dagsters asset graph. But yes, we’re considering The DataHub project for heavyweight catalog business. But that’s on an entirely different timescale 😉