The cloud-native orchestrator for the whole development lifecycle, with integrated lineage and observability.

dagster

When working with dbt-impala how can I run a kinit command up-front (when not manually writing a job but rather when using assets? I.e. can I run a pre-hook that runs the kinit before each materialization for dagster-dbt ?

Unfortunately, they do not seem to support a keytab file and only work with the ticket cache

A workaround could be to run a kinit on a chron schedule. But this would be bad as other jobs might be using these credentials then

I think one way to do this today you'd need to implement your own dbt cli resources that inherits the existing one but adds a init step to run kinit

<@U01J51Y6B9D> has been thinking recently about other ways to add pre-hooks to dagster's use of dbt