With all the buzz around software-defined assets, @sandy you really have to reference the Bourne movies in a future deck or something. I mean, it's right there...

We just published a blog post about Dagster @ Earnest Research 🙂 https://www.earnestresearch.com/technology/from-machine-learning-experiment-to-production-our-journey-to-adopting-dagster/

Can we use dagster in anger now that we have a pandas model of the backend? Let's find out, a twitter thread.

"What version of dagster do I have deployed?" mouses over logo for some kind of "about" page:

💯

Anybody got tips on how to tell a language server that it's dagster and that missing context arguments are fine?

@Manny Schneck See https://github.com/dagster-io/dagster/discussions/5835

View Image Data in

dagit

Some of my ops will use a resource that wraps a headless selenium webdriver. I'd like to take screenshots of the pages that the headless webdriver is interacting with and expose them via

dagit

so that someone following up on a failed job can see what the headless webdriver was seeing. Does anyone have any suggestions on how to achieve something like this? I'd imagined that I could create a failure sensor that would get a screenshot from the webdriver resource and "put" it somewhere.

DagsterStepOutputNotFoundError

for

op

which yields

AssetMaterialization

I have an

op

which doesn't have an output. I have added yielding of an

AssetMaterialization

and now I'm getting

DagsterStepOutputNotFoundError

. I've tried adding: •

yield

•

yield Output()

•

yield Nothing

I'm on

0.13.9

. What does the

op

need yield in addition to the

AssertMaterialization

?

This message was deleted.

Saw this question yesterday on reddit (https://www.reddit.com/r/dataengineering/comments/r9cy2k/dagster_in_place_of_airflow/), thought it would be interesting if someone from the community could also give some comments there.

I know this is more of a GitHub question .. however, maybe I get lucky and someone here has a solution 😄 I’m using GitHub Dependabot to keep my dependencies up to date. Every time a package has a new version, Dependabot creates a new branch and GitHub Actions takes over and run my tests .. isn’t the world beautiful However, when Dagster is updated, my tests always fails because I both have Dagit and Dagster - Dependabot creates a seperate branch for each package, and if Dagit and Dagster doesn’t have the same version, it fails. What can I do here 😊

Anybody else getting a 'rust for orchestrated dags' vibe from dagster?

@Manny Schneck I think we need that.

I am having a really excellent time with https://pandera.readthedocs.io/en/stable/index.html for doing dataframe validation outside of the dagster context. Has anyone used this with dagster?

The unification of gradual/static/dataframe typing is really really excellent.

Hi Dagster Team. I would like to know if there is any plan in near future to depreciate/remove DagsterGraphQLClient ?

Hi Team. What happens on the 15 second polling on Dagit UI ? Only UI is refreshed or whole python code to generate repository and workspace is re-run to get latest definitions ?

Hi! I’m curious is it pragmatic to use Dagster as tool of choice to orchestrate mixed purpose workflows. Initial idea is to introduce gradual automatisation of business tasks (tasks that very loosely related with creation of data assets) by implementing workflow engine (aka runbooks) alongside with data pipeline using same tooling. Proprietary airplane.dev can be example of such tool. So, how convenient is to use Dagster as general purpose workflow engine? Is it against Dagster philosophy?

has anyone here used pytest-mockito? and what do you think?

Greetings, does anyone have info on how to integrate semantic solutions like RDFox to Dagster?

Has anyone here implemented Dagster with any Data Cataloging tool? (i.e. DataHub or Amundsen)

Happy birthday @chris!!!

I am Mohan Kancherla, from Panasonic. I looked at Dagster cloud demo video in the website and I have few questions on the tool, as we are exploring new tool for Orchestration Framework. Can anyone please let me know whom should I reach out to

Hey there 👋🏻, I wrote a bit of a controversial post, maybe. But check out yourself if you are interested. Dagster is also playing a role as part of the Analytics API as orchestration component 🙂 --> Building an Analytics API with GraphQL: The Next Level of Data Engineering

Hi All, Can anyone point me to a small example (on my laptop) where I use dask executor to run a toy pipeline?

Should probably cut back on my concurrent jobs 😛

Hi! I'm really new to dagster and I'm trying to use dagster-shell. could anyone point me to an example on how to use the shell_op? Thanks!!

Hi! Is it possible in dagster to run sensors without dagit ? like for jobs with

job_name.execute_in_process(run_config=run_config)

#dagster-support is a better place to ask