(I mean I guess they could, not my project, but that seems unlikely and a very bad move 🙂

projects that i work on (may or may not use dagster). I usually have to sell type hinting to someone so that I can use it when working with them

Gotcha, then just pick whichever you like best. They all use the same annotations (given or take a few varying edge cases)

So it's not like you're locked in

MyPy prioritizes being simpler

Pyre and PyRight optimizes for huge codebases

If you are frequently hitting edge cases where any of the three returns a different result, your code is probably too clever for its own good

having opened several issues on pyright i never seem to have to wait more than about 30mins for help, I’m really impressed. Anyway I floated this idea recently…https://github.com/microsoft/pyright/issues/1443

I usually start new projects on MyPy because it has the most community integrations and if needed, transition to one of the other two when incremental checking becomes important for speed

do you have a reference project setup? Would like to see which integrations etc.

Not that's public 🙂

I would look at Hynek's projects though

He usually has a good and up to date skeleton to start from

Dumb question here - but what is the easiest/best way to update Dagster to the latest version?

Like a deployed Dagit or locally?

Locally.

Which of the following do you use: Poetry, Pipenv, Pipfile, Pip, easy_install, apt-get install, yum install, conda?

congrats drizly team!! @Emily @dhume https://investor.uber.com/news-events/news/press-release-details/2021/Uber-to-Acquire-Drizly/default.aspx

I thought that it might serve the community  to have a new  

showcase

 channel to allow dagster community to showcase/share their blogs, OSS projects or adoptions related to Dagster. Also, to get some excitement going..

I’m looking into learning a new functional programming (FP) language. I’m a data engineer and using a lot of python lately as well with dagster giving me the FP on Python. For now, I’m favouring clojure, but also, elixir looks excellent, and a lot of stuff is written in scala. Any ides or thought here, what would you learn and why?

Hi Dagster lovers 👋 Building tools for data productivity has been my passion that I turned into career, first as Data Tools PM at Lyft and now building Datafold, a data observability platform. I am now researching the current state of tools & pain points in Data workflows and would really appreciate you taking a short survey about your experience. We will publish the anonymized results for everyone to learn from and are also raffling cool prizes including a DJI drone and Nintendo Switch. Thanks in advance for taking the time! 🙂

Hi all 👋, If you have been recently thinking about improving your data testing and productivity in general, come join us for the upcoming Data Quality Meetup on Thursday, March 11th at 9AM PST to learn about the latest trends, tools and success stories for data observability, quality management and productivity! We have an amazing list of speakers for the upcoming event including: • David Wallace (Senior Data Engineer @ Dutchie) – btw, check out Dave's post on using D to identify & deprecate stale data assets! • John Lee (Director of Analytics @ Thumbtack) • Julia King (VP of Data @ Carta) RSVP here If you are curious to learn more about Data Quality Meetup, you can check out the digest and recordings from the previous event.

Hi team, maybe this is not relevant so that is why I am posting to this channel. I've noticed that the documentation for version 0.8.8 seems to be ranking so high in the Google index. When you search, for example, "deploy dagster to kubernetes" this is the link that shows up first https://docs.dagster.io/0.8.0/docs/deploying/k8s. I believe this may be misleading for newcomers who don't know what the most recent version of Dagster is.

I posted a new blog post where dagster plays a major role. It’s very hands-on, and the code is open. So maybe it helps some of you guys starting with dagster: https://sspaeti.medium.com/building-a-data-engineering-project-in-20-minutes-85c37cad4d87 Included are tools like beautifulsoup, S3, MinIO, spark, delta lake, jupyter notebooks, druid, superset. And everything is managed together with dagster, of course! 😉 Plus, everything runs on top of #kubernetes and deploys in any cloud and locally on your machine. Hope you enjoy, let me know what you think, always enjoy comments and feedback as I’m doing this in my free time 😅.

Hey all, can you help me settle a bet with my manager? Did you call your steps in the pipeline

solids

because Dagster is a solid idea?

Hello! Maybe you are interested that Dagster is being used to generate the data for https://3dbag.nl . This is an up-to-date data set containing 3D building models of the Netherlands. As far as we know this is the first open 3D building data set that is generated fully automatically and covers a whole country on this level of detail. Some of the use cases for this data are: • Applications related to energy use in buildings, such as estimating energy demand, retrofitting costs, finding suitable roofs for solar panels. • Simulating the wind flow and pollutant dispersion in urban areas. • Calculating noise pollution in urban areas. • Analysing the urban structure and evaluating new developments.

can i post emoji requests here? 😂 you know how there is a dbt eyes emoji in dbt slack? i really want a 👀 emoji but i do not have the proper emoji skills for this

Anyone knows how to deploy Dagster to heroku?

I have a crazy idea of using Dagster to replace BPMN or other traditional business process management system. I know Dagster was designed to be a data flow system, but using concepts such as Sensors, Assets, and Pipeline I think it’s doable. Whether it should be done is different question but I think Dagster is very elegant, much more so compared to the BPMN solutions out there.

Any would you please help me to learn How to use Dagster (Like any complete video tutorial anything like that ??)