The cloud-native orchestrator for the whole development lifecycle, with integrated lineage and observability.

dagster

My run is failing with the following message:
&gt; Run 68469 failed with result state: DatabricksRunResultState.Failed. Message: Unexpected failure while waiting for the cluster (0615-083841-631eilja) to be ready.Cause Cluster 0615-083841-631eilja is unusable since the driver is unhealthy
To what driver is dagster referring to?

probably the driver of the spark cluster you're using on databricks

this is an error surfaced from databricks by the way, not dagster - dagster was polling the databricks job you started and saw that the cluster failed to start and retrieved one of the famously ambiguous databricks cluster errors for you