yuhan
01/06/2023, 9:21 PMmaterialize
, materialize_to_memory
, and execute_in_process
🏷️ Op concurrency limits can be configured thru executors with op tags (docs)
🧬 Experimental:
• 👌 BranchingIOManager
allows to read assets from prod and write them to a dev env
• python Op and asset configs can be defined and accessed using Python 3 typing
• dbt dagster-dbt allows asset selection using dbt selection syntax
docster More on docs:
• Revamped Dagster Cloud getting started guide
• Lots of updates to the dagster-airflow docs, including
◦ Dagster tutorial from Airflow background (link)
◦ Migration guide (link)
◦ Airflow vs Dagster concept map (link)Stephen Bailey
01/06/2023, 9:26 PMdagster-dbt allows asset selection using dbt selection syntax
. this is the one. is there a writeup on it?sandy
01/06/2023, 9:34 PMyuhan
01/06/2023, 9:35 PMZach P
01/07/2023, 12:03 AMStephen Bailey
01/07/2023, 12:32 AMfrom dagster_dbt import DbtManifestAssetSelection
my_selection = DbtManifestAssetSelection(
manifest_json,
select="tag:foo,path:marts/finance",
node_info_to_asset_key=my_node_info_to_asset_key_fn,
)
Félix Tremblay
01/13/2023, 2:12 PM