The cloud-native orchestrator for the whole development lifecycle, with integrated lineage and observability.

dagster

Hi everyone, I have a question regarding partitioning (static partitions) and conditional materialization. Is there a way to materialize downstream assets if only some of the selected partitions yield a result or must all of the partitions I select to materialize yield a result for the downstream asset to also materialize?

For example, if only 2 out of 5 partitions yield an output is there a way to still materialize the downstream asset?

<@U04N3SAF52N> Hi, replying here to keep track of the original post. Currently I am using conditional materialization as described in the link you provided. My main issue at the moment is if I try to materialize three partitions, say 'A', 'B' and 'C'. If only 'A' passes the condition I have specified and consequently 'B' and 'C' do not yield an output, the downstream asset does not materialize. I understand this is the default behaviour, with good reason, but trying to find a way to change this.

Hi Alfie, Thanks for the question. I’ve put out a call for a more knowledgable colleague to answer this.