sandy
08/30/2022, 4:15 PMGhanashyam Alakke
08/30/2022, 4:21 PMJon Simpson
09/01/2022, 10:21 PMTamas Foldi
09/02/2022, 1:25 AMfrom dagster import with_resources, define_asset_job, repository
from dagster_dbt import dbt_cli_resource, load_assets_from_dbt_project
dbt_assets = with_resources(
load_assets_from_dbt_project("dbt/my-project"),
{"dbt": dbt_cli_resource},
)
zhengye
09/02/2022, 2:53 AMJonathan Neo
09/02/2022, 9:01 AMv2.1.0
, v1.9.0
. This allows for consumers to consume the version they wish, and also give them more time to transition to the new version before the old version deprecates.
Does anyone else have a need for this?
A full explanation and example in the thread.Ismael Rodrigues
09/02/2022, 2:04 PMCharlie Bini
09/06/2022, 8:14 PMRetryPolicy
could benefit from a callback function arg ala https://github.com/rholder/retryingBinoy Shah
09/06/2022, 9:33 PMStephen Bailey
09/07/2022, 11:26 AMAssetExpectations
this morning, and it looks like the expectation results are not available for viewing on the Asset homepage. Is that expected?Timothy Elder
09/08/2022, 4:12 PMBinoy Shah
09/08/2022, 9:16 PMAlan Dao
09/09/2022, 6:03 AMStephen Bailey
09/09/2022, 4:31 PMJisan Zaman
09/09/2022, 7:42 PMMatt Clarke
09/12/2022, 5:02 PMBianca Rosa
09/13/2022, 2:31 PMEcsRunLauncher
.Fraser Marlow
09/13/2022, 3:19 PMMatt Clarke
09/13/2022, 5:07 PMhackernews-elementl-prod
viewable for example would be good for understanding what ends up in that bucket when running the fully featured project exampleMatt Clarke
09/16/2022, 9:15 AMprotobuf==3.20.2
release which is causing dagit/dagster daemon to fail to run. https://github.com/protocolbuffers/protobuf/issues/10571
Pinning protobuf = "3.20.1"
resolves it.Zach
09/16/2022, 10:28 PMNathan Gould
09/18/2022, 7:53 PMdagster
module. That might be handy for experienced users, but as a newcomer I generally expect stuff available at the top level to be the most important, core concepts and models. Learning the structure below that tends to reveal a lot about the mental model that the framework uses. I think I'd be learning faster if the import structure and docs forced me to reach into the relevant sub-module for what I need.Stephen Bailey
09/19/2022, 8:06 PMdefine_asset_job
and supply run config
3. open up that asset job with shift+click
in dagit to enter the launchpad...
The launchpad will be empty? In the normal job framework, the config supplied at job definition would be shown (and that's what I'd like to have)Zach P
09/19/2022, 8:47 PMBinoy Shah
09/21/2022, 1:25 PMBernardo Cortez
09/23/2022, 6:51 AMPrratek Ramchandani
09/23/2022, 7:52 PMStephen Bailey
09/26/2022, 3:16 PMk = AssetKey(["snowflake", "db", "schema", "table"])
k.path
['snowflake', 'db', 'schema', 'table']
k.to_string()
'["snowflake", "db", "schema", "table"]'
k.to_user_string()
'snowflake/db/schema/table'
# for op config - no method available
'snowflake__db__schema__table'
My intuition is basically that 1) every AssetKey should assume a list (appears it does this according to path
), and 2) the only alternate representation should be the __
method, since its config-compatible. Is there a reason for the many different string representations?Binoy Shah
09/28/2022, 3:47 PM@job
Quality Check Job --> transform::(dbt-assets) --> @job
post-process
How can I add interception between two assetsNathan Gould
09/29/2022, 2:38 AM