19913d85-f662-4518-a9a1-7adc1793dfd4.png){kind=small}
Channels
announcements
dagster-airbyte
dagster-airflow
dagster-bigquery
dagster-cloud
dagster-cube
dagster-dask
dagster-dbt
dagster-de
dagster-ecs
dagster-feedback
dagster-kubernetes
dagster-machine-learning
dagster-noteable
dagster-releases
dagster-serverless
dagster-showcase
dagster-snowflake
dagster-spatial
dagster-support
dagster-wandb
dagstereo
data-platform-design
events
faq-read-me-before-posting
gigs-freelance
github-discussions
introductions
jobs
random
tools
豆瓣酱帮
Title
c
Charlie Bini
03/02/2023, 3:47 PMIs there a quick way to determine via context if an asset has ever been materialized?
s
sandy
03/02/2023, 7:54 PMHey @Charlie Bini - I created a discussion to answer this, because I suspect others might be curious too: https://github.com/dagster-io/dagster/discussions/12666
c
Charlie Bini
03/02/2023, 8:32 PMvery nice!
@sandy uncovered a potential bug related to this. I have an asset using
context.instance.get_latest_materialization_eventI can send you the debug logs for the run in DMs if you want
e
Emir Karamehmetoglu
03/18/2023, 2:35 PMCharlie isn't an asset that had a run failure a different state than one that has never materialized? The behavior you describe is what I would expect.
It did materialize, just not successfully. There could be many reasons for this, but I would expect to look at the status of the materialization for more info, not to have it show up as never materialized.
p
Pawel Gucik
05/15/2023, 3:27 PMHi all, I am wondering if there has been any success using the provided GitHub code? I have asset A being updated daily. Then, end of week I want to save a snapshot of asset A as asset B for use with an op that compares the changes of asset B weekly.
It looks like my issue is only on the instantiation of the pipeline similar to the above: the provided code fails, then returns a materialization record upon retry but fails because asset B does not yet exist.
So my full question is, is it possible to do something along the lines of the below?
if context.instance.get_latest_materialization_event(asset_A_key) is None:
return empty_dataframe
else:
return asset_b_dataframe