Weekly Release Highlights: 0.15.6 ✨ 🔍 Dagit now displays full chain of exceptions 🔀 dbt seeds and snapshots can now be loaded as Dagster assets 🏎️ Various fixes and performance improvements to partitions

A new Dagster version was just published: 0.15.7. 📦 PyPI: https://pypi.org/project/dagster/0.15.7/ ☸️ Helm Chart: https://artifacthub.io/packages/helm/dagster/dagster/0.15.7 🛠️ Dagster Changelog: https://docs.dagster.io/changelog#0157 ☁️ Dagster Cloud Changelog: https://github.com/dagster-io/dagster-cloud/blob/main/CHANGES.md 📖 Docs: https://docs.dagster.io/0.15.7/getting-started

A new Dagster version was just published: 0.15.8. 📦 PyPI: https://pypi.org/project/dagster/0.15.8/ ☸️ Helm Chart: https://artifacthub.io/packages/helm/dagster/dagster/0.15.8 🛠️ Dagster Changelog: https://docs.dagster.io/changelog#0158 ☁️ Dagster Cloud Changelog: https://github.com/dagster-io/dagster-cloud/blob/main/CHANGES.md 📖 Docs: https://docs.dagster.io/0.15.8/getting-started

A new Dagster version was just published: 1.0.0. 📦 PyPI: https://pypi.org/project/dagster/1.0.0/ ☸️ Helm Chart: https://artifacthub.io/packages/helm/dagster/dagster/1.0.0 🛠️ Dagster Changelog: https://docs.dagster.io/changelog#100 ☁️ Dagster Cloud Changelog: https://github.com/dagster-io/dagster-cloud/blob/main/CHANGES.md 📖 Docs: https://docs.dagster.io/1.0.0/getting-started

A new Dagster version was just published: 1.0.1. 📦 PyPI: https://pypi.org/project/dagster/1.0.1/ ☸️ Helm Chart: https://artifacthub.io/packages/helm/dagster/dagster/1.0.1 🛠️ Dagster Changelog: https://docs.dagster.io/changelog#101 ☁️ Dagster Cloud Changelog: https://github.com/dagster-io/dagster-cloud/blob/main/CHANGES.md 📖 Docs: https://docs.dagster.io/1.0.1/getting-started

A new Dagster version was just published: 1.0.2. 📦 PyPI: https://pypi.org/project/dagster/1.0.2/ ☸️ Helm Chart: https://artifacthub.io/packages/helm/dagster/dagster/1.0.2 🛠️ Dagster Changelog: https://docs.dagster.io/changelog#102 ☁️ Dagster Cloud Changelog: https://github.com/dagster-io/dagster-cloud/blob/main/CHANGES.md 📖 Docs: https://docs.dagster.io/1.0.2/getting-started

A new Dagster version was just published: 1.0.3. 📦 PyPI: https://pypi.org/project/dagster/1.0.3/ ☸️ Helm Chart: https://artifacthub.io/packages/helm/dagster/dagster/1.0.3 🛠️ Dagster Changelog: https://docs.dagster.io/changelog#103 ☁️ Dagster Cloud Changelog: https://github.com/dagster-io/dagster-cloud/blob/main/CHANGES.md 📖 Docs: https://docs.dagster.io/1.0.3/getting-started

A new Dagster version was just published: 1.0.4. 📦 PyPI: https://pypi.org/project/dagster/1.0.4/ ☸️ Helm Chart: https://artifacthub.io/packages/helm/dagster/dagster/1.0.4 🛠️ Dagster Changelog: https://docs.dagster.io/changelog#104 ☁️ Dagster Cloud Changelog: https://github.com/dagster-io/dagster-cloud/blob/main/CHANGES.md 📖 Docs: https://docs.dagster.io/1.0.4/getting-started

A new Dagster version was just published: 1.0.6. 📦 PyPI: https://pypi.org/project/dagster/1.0.6/ ☸️ Helm Chart: https://artifacthub.io/packages/helm/dagster/dagster/1.0.6 🛠️ Dagster Changelog: https://docs.dagster.io/changelog#106 ☁️ Dagster Cloud Changelog: https://github.com/dagster-io/dagster-cloud/blob/main/CHANGES.md 📖 Docs: https://docs.dagster.io/1.0.6/getting-started

A new Dagster version was just published: 1.0.7. 📦 PyPI: https://pypi.org/project/dagster/1.0.7/ ☸️ Helm Chart: https://artifacthub.io/packages/helm/dagster/dagster/1.0.7 🛠️ Dagster Changelog: https://docs.dagster.io/changelog#107 ☁️ Dagster Cloud Changelog: https://github.com/dagster-io/dagster-cloud/blob/main/CHANGES.md 📖 Docs: https://docs.dagster.io/1.0.7/getting-started

A new Dagster version was just published: 1.0.8. 📦 PyPI: https://pypi.org/project/dagster/1.0.8/ ☸️ Helm Chart: https://artifacthub.io/packages/helm/dagster/dagster/1.0.8 🛠️ Dagster Changelog: https://docs.dagster.io/changelog#108 ☁️ Dagster Cloud Changelog: https://github.com/dagster-io/dagster-cloud/blob/main/CHANGES.md 📖 Docs: https://docs.dagster.io/1.0.8/getting-started

A new Dagster version was just published: 1.0.9. 📦 PyPI: https://pypi.org/project/dagster/1.0.9/ ☸️ Helm Chart: https://artifacthub.io/packages/helm/dagster/dagster/1.0.9 🛠️ Dagster Changelog: https://docs.dagster.io/changelog#109 ☁️ Dagster Cloud Changelog: https://github.com/dagster-io/dagster-cloud/blob/main/CHANGES.md 📖 Docs: https://docs.dagster.io/1.0.9/getting-started

Weekly Release Highlights: 1.0.11 ✨ 🆕 Assets can be loaded outside of a run, e.g. in notebooks 🤝 Snowflake IO Manager now works with dbt assets 🖇️ Python dependency: latest version of Alembic is supported

Thanks for the quick fix. However, @sandy

repo.load_asset_value(AssetKey(["prefix", "key"]), partition_key="2022-10-03")

fails with:

Failure condition: Inputs of type typing.Any not supported. Please specify a valid type for this input either on the argument of the @asset-decorated function.

https://dagster.slack.com/archives/C01UC74PQAF/p1665066527388759?thread_ts=1664489160.587019&cid=C01UC74PQAF

Weekly Release Highlights: 1.0.12 ✨ 🔥 Orchestrate Dagster jobs from Airflow w/ DagsterOperator (integration guide) 🆕 Auto-generated assets from Airbyte connections (integration guide) ✅ Multi-asset sensor now supports asset selection (apidoc) ⛓️

build_asset_reconciliation_sensor

automatically materializes your assets after their parents (apidoc) 📑

load_asset_value

now supports partitions with the optional partition_key parameter (apidoc) 💻 Users on ECS now enjoy support for tasks on EC2 instances (issue)

Weekly Release Highlights: 1.0.13 ✨ duckdb DuckDB I/O managers w/ native Pandas & PySpark supports (dagster-duckdb, dagster-duckdb-pandas, dagster-duckdb-pyspark) 🧰

dagster run migrate-repository

is now available to help migrate run history A

DagsterCloudOperator

and

DagsterOperator

now support Airflow 2 airbyte More dagster-airbyte updates: new param to specify auth details, ability to ignore certain connections to load, and option to change request timeout. docster Lots of docs updates ◦ Step-by-step tutorial for using dbt models with Dagster assets (tutorial doc) ◦ Asset reconciliation and more updates to multi-asset sensors (Asset Sensors concept doc) ◦ How-to example for smoke tests (example) ◦ Credential handling with Dagster Cloud Docker agent (doc)

Weekly Release Highlights: 1.0.16 ✨ 💻 New Overview and Workspace pages enabled for all in Dagit 📁 New filesystem-agnostic

UPathIOManager

🕐 Multithreaded mode is now available in schedule daemon (doc) 🔧 Assets and multi_assets work with retry policies Integration improvements: A

make_dagster_job_from_airflow_dag

now supports airflow 2 (api docs) jupyter New

define_dagstermill_asset

to load notebooks as assets (api docs) new

NotebookMetadataValue

to log notebook location (api docs) ❄️ Improved docs for Snowflake IO manager (api docs)

Weekly Release Highlights: 1.0.17 ✨ 📡 Asset subselection now available in sensors (api docs) duckdb DuckDB integration fully supports PySpark DataFrames (api docs) 5️⃣ [Experimental] Auto-generated assets from Fivetran connectors (api docs) docster New docs about using env vars and secrets (docs)

This release requires db migration, how is this db migration supposed to be handled in Kubernetes environments ? Higher environments have limitation where direct access to

dagster

command might not be available

sensor logs! 🎉

Release code name: all the docs? https://docs.dagster.io/changelog#documentation

For those of you just joining us, here is a 1.1+ release recap: https://dagster.io/blog/dagster-1-1-thank-u-next

Weekly Release Highlights: 1.1.7 ✨ 🆕 New opt-in entrypoint

Definitions

which eliminates unnecessary concepts such as Repository and Workspace. Dagit, examples, docs are largely updated to reflect this. ⌛ Lagged / rolling window partition mappings 🔀 Asset partitions can now depend on earlier time partitions of the same asset 🏎️ Schedules created by

build_schedule_from_partitioned_job

execute more performantly dagsir More on integrations: • dbt dagster-dbt now supports declarative scheduling (API Docs) • A dagster-airflow allows for configuring Airflow connections used by migrated DAGs (API Docs) • A New docs for transitioning to Dagster from Airflow: https://docs.dagster.io/integrations/airflow/from-airflow-to-dagster

I just posted a GH discussion to further announce and discuss the switch from

@repository

to

Definitions

. Again to reiterate, there is no need to migrate at the present time. However I do know that many of your are accountable to stakeholders that you need to onboard onto Dagster, and we think this smooths the way. And it will be front-and-center in our documentation and content, so migration will make your code more in line with that.

Hi All! What’s the recommended way to pass a

graph

to

Definitions

? It doesn’t appear to be supported

A new Dagster version was just published: 1.1.8. 📦 PyPI: https://pypi.org/project/dagster/1.1.8/ ☸️ Helm Chart: https://artifacthub.io/packages/helm/dagster/dagster/1.1.8 🛠️ Dagster Changelog: https://docs.dagster.io/changelog#118 ☁️ Dagster Cloud Changelog: https://github.com/dagster-io/dagster-cloud/blob/main/CHANGES.md 📖 Docs: https://docs.dagster.io/1.1.8/getting-started

A new Dagster version was just published: 1.1.9. 📦 PyPI: https://pypi.org/project/dagster/1.1.9/ ☸️ Helm Chart: https://artifacthub.io/packages/helm/dagster/dagster/1.1.9 🛠️ Dagster Changelog: https://docs.dagster.io/changelog#119 ☁️ Dagster Cloud Changelog: https://github.com/dagster-io/dagster-cloud/blob/main/CHANGES.md 📖 Docs: https://docs.dagster.io/1.1.9/getting-started

Weekly Release Highlights: 1.1.8 ✨ 🆕 Asset backfills now work with partition mapping 🧐 Asset output values can be fetched by key from execution results, which works with

materialize

,

materialize_to_memory

, and

execute_in_process

🏷️ Op concurrency limits can be configured thru executors with op tags (docs) 🧬 Experimental: • 👌

BranchingIOManager

allows to read assets from prod and write them to a dev env • python Op and asset configs can be defined and accessed using Python 3 typing • dbt dagster-dbt allows asset selection using dbt selection syntax docster More on docs: • Revamped Dagster Cloud getting started guide • Lots of updates to the dagster-airflow docs, including ◦ Dagster tutorial from Airflow background (link) ◦ Migration guide (link) ◦ Airflow vs Dagster concept map (link)

A new Dagster version was just published: 1.1.10. 📦 PyPI: https://pypi.org/project/dagster/1.1.10/ ☸️ Helm Chart: https://artifacthub.io/packages/helm/dagster/dagster/1.1.10 🛠️ Dagster Changelog: https://docs.dagster.io/changelog#1110 ☁️ Dagster Cloud Changelog: https://github.com/dagster-io/dagster-cloud/blob/main/CHANGES.md 📖 Docs: https://docs.dagster.io/1.1.10/getting-started

Weekly Release Highlights: 1.1.10 ✨ daggy success Stale assets can be materialized from a schedule or sensor python grpcio pin is removed for Python 3.10 and 3.11 airbyte Airbyte assets now work with freshness policies