announcements
  • Fraser Marlow

    Fraser Marlow

    10/05/2022, 7:16 PM
    Just a reminder that the Dagster Demo + live Q&A is taking place tomorrow @ 9:00 PST / 12:00 EST / 18:00 CET. Sign up here: https://dagster.io/dagster-demo-signup
  • Fraser Marlow

    Fraser Marlow

    10/07/2022, 3:42 PM
    @Pete Hunt, our Head of Engineering just shared a new Dagster crash course, for anybody looking to ramp up quickly 🚗 🏁 https://dagster.io/blog/dagster-crash-course-oct-2022
  • Fraser Marlow

    Fraser Marlow

    10/10/2022, 5:43 PM
    Reminder that the next Dagster Community Meeting is happening tomorrow at 9AM PT. On the agenda: :dagster-spin: Community spotlights.:airflow: Updated Dagster-Airflow to make migration even easier.😛owerup: Asset updates: Loading asset values, multi-asset sensors, and asset reconciliation 📺 Dagit enhancements:magic_wand: Orchestrating Airbyte with Dagster And we will leave time for your questions at the end. You can sign up for Community Meeting reminders here.
  • Fraser Marlow

    Fraser Marlow

    10/11/2022, 3:30 PM
    Today’s community meeting starts in 30 minutes. Join the Zoom Meeting here:https://us02web.zoom.us/j/88939083535
  • yuhan

    yuhan

    10/12/2022, 4:29 PM
    :daggy-celebrate: Community Spotlights recap from the Community Meeting :daggy-celebrate: • [Blog post] Dagster Day: Thoughts for Airflow Users by Hector Robles • [Blog post] Data News: Dagster 1.0 Launch Recap by Simon Späti at Airbyte • [Blog post] Dagstermill: passing notebook results downstream in 3 steps by Stefan Samba • [Blog post] 4 Essential Steps for Building a Simulator by Devjit Chakravarti at Doordash • [Blog post] Dabbling with Dagster - Part 1 by David Jayatillake • [Blog post] Tchau Tchau Airflow, Olá Dagster by Lucas Gabriel • [Blog post] Dagster + Airbyte + dbt: How Software-Defined Assets Change the Way We Orchestrate by Tamas Foldi • [Blog post] A Dagster Crash Course by Pete Hunt • [Video]

    Why EvolutionIQ Picked Dagster For Their Data Orchestration Layer

    by SeattleDataGuy w/ EvolutionIQ • [CoRise course] Data Engineering with Dagster by Dennis Hume:heart-hands: Shout out to everyone who contributes to this community and thank you for the support :daggy-love: 🗣️ Besides the Community Spotlights, we’d also love to have some community members demo your use cases or contributions. The next Community Meeting will be held in early December. If you would like to see your name in lights, or have something to share with the community, please DM me directly! If you haven’t already, please the Dagster Github Repo - this helps us raise the visibility for the open source project.
  • josh

    josh

    10/17/2022, 3:54 PM
    Hey all! Dagster Product Designer here. 👋 We are testing out a couple UI updates in this week's Dagster release that bring some big performance improvements to the Workspace + new improvements to the Instance Overview. You can check out a demo of these changes

    here

    and you can try them out for yourself by enabling the
    New workspace pages, overview pages, and top navigation
    feature flag in your user settings. We’d love for you to try these out and let us know what you think! Feel free to share any feedback in this thread or in the #dagster-feedback channel.
  • Fraser Marlow

    Fraser Marlow

    10/22/2022, 8:55 PM
    For all of you following dagster on Twitter, you will notice we have changed our handle: we are now simply @dagster. The account stays the same, and if you were following @dagsterio you will still be getting all our updates.
  • rex

    rex

    10/25/2022, 1:38 AM
    📰 Hi all, we created a channel (#faq-read-me-before-posting) that highlights the structure of our Slack workspace. For new users and existing users, it contains some links to get started with Dagster and the Slack. Also, it highlights all of our channels in one place and separates them by category (e.g. Dagster Cloud users, integration specific use-cases, or just general interest). This new channel is meant to be read-only, so please don’t post there! Let us know if you have any questions :daggy-love:
  • rex

    rex

    10/25/2022, 2:14 AM
    We’ll be highlighting new channels in the upcoming weeks that are dedicated to integrations that we’re actively working on to be fully compatible with the Dagster framework out-of-the-box. In addition to library support, we’ll be providing step-by-step guides to use the key features of the integration in tandem with Dagster. One of these new channels is #dagster-airbyte, with integration development being led by our very own @ben! Here’s some of his recent efforts in making the integration software-defined asset compatible. We can generate the corresponding assets in Dagster as you manage your connections in Airbyte. It’s pure magic If you’re interested in using this integration, join the channel to receive weekly updates and discuss your use-cases :next-level-daggy:
  • rex

    rex

    10/26/2022, 3:09 PM
    :alert: Another channel highlight! Many of you have been familiar with orchestration, even before Dagster. For those of you who already working with an existing orchestration platform, like Airflow, we’ve been making incredible strides to make an incremental migration path. You can incrementally adopt Dagster and realize the value and potential of our programming model to manage your data assets. In #dagster-airflow, @Joe has led the development of three methods to help you on this path to incremental migration:1. ➡️ You can orchestrate Dagster runs from Airflow by using the
    DagsterCloudOperator
    or
    DagsterOperator
    operators in your existing Airflow DAGs. 2. 🤯 You can automatically create a Dagster job from an existing Airflow DAG - we’ll infer all the dependencies for you. 3. 👀 You can take advantage of Dagster’s programming model to create robust, testable, and reusable jobs to materialize your data assets - we’ll infer the Airflow DAG for you. Join the channel for updates and to discuss your Airflow migration questions :dagster-spin:
  • Fraser Marlow

    Fraser Marlow

    11/01/2022, 8:00 PM
    Our next open demo and live Q&A is on Thursday, Join us at 9:00 AM PST for the demo or at 9:30 AM if you just want to join the Q&A. Join us:https://dagster.io/dagster-demo-signup
  • Fraser Marlow

    Fraser Marlow

    11/07/2022, 6:18 PM
    Many thanks to @David Jayatillake for leading the way in creating a Mastodon server specific for the data community. We are happy to be part of it as @dagster@data-folks.masto.host You can find us there and across the Mastodon network.
  • schrockn

    schrockn

    11/07/2022, 9:14 PM
    🕴:elementl: ➡️:computercat: 😛lanet-daggy: Hello all! Dagster is a growing and thriving community, and the project is backed by a company, Elementl. Up until now I’ve been the CEO of Elementl. That changes today. @Pete Hunt––who was our Head of Engineering––is assuming the role of CEO, and I am moving to the CTO role. I am incredibly excited about this change. I will get to intensely focus on product, engineering, and evangelism of Dagster knowing that the operations and execution at the company are in Pete’s immensely capable hands. You can expect more activity from me in both the codebase and in Slack! We’ll be announcing this news more broadly next week but we wanted this to be the first public forum to push this out! -- Nick
  • yuhan

    yuhan

    11/08/2022, 5:00 PM
    :dagsir: Hi folks, we will be downgrading our Slack plan on Wednesday, November 9th. This plan change shouldn’t affect most of our day-to-day conversations nor our support workflow, i.e. we will still be using Slack as a main community space to provide more hands-on support and make announcements about events and releases, and we’ll keep using GitHub Discussions as the public knowledge base complement to Slack. What this will affect is that we will only be able to view the most recent 90 days of messages and files. To retain the messages and files for longer than 90 days and keep the discoverability of them, we’re introducing *discuss.dagster.io*: • It is a place where we sync all the public conversations to in real-time. • You can use the search bar inside the site to find older conversations. • The contents will also be Google-searchable.
  • Fraser Marlow

    Fraser Marlow

    11/10/2022, 12:01 AM
    We would like to welcome our 5,000th Slack community member!
  • rex

    rex

    11/10/2022, 3:27 PM
    :next-level-daggy: We’re giving another channel highlight! Recently, we partnered with Noteable on an integration on top of our existing dagstermill infrastucture. You can now manage Noteable notebooks as software-defined assets, and orchestrate their execution in tandem with the other assets in your data platform! @jamie, alongside the Noteable team, led the development of this integration. We just pushed out a blog post about this - check it out! Join the channel #dagster-noteable to receive updates about this integration as well as to discuss your use cases with orchestrating your notebooks 📖
  • Fraser Marlow

    Fraser Marlow

    11/21/2022, 2:00 PM
    DAGSTER COMMUNITY DAY: DEC 7TH @ 9:00 AM PST There has been a lot going on with Dagster: new features, community activity, partnership integrations, Elementl team expansion…. We are happy to announce a special Dagster community day on Dec 7th to share all the updates. Sign up here and join us online.https://dagster.io/community-day
  • jordan

    jordan

    11/22/2022, 8:04 PM
    The Dagster team will be out of office Thursday 11/24 and Friday 11/25 for Thanksgiving. Our Slack responsiveness will be limited until we return to work on Monday 11/28.
  • rex

    rex

    11/28/2022, 11:49 PM
    :alert: :dbt: Another channel highlight! We recently revamped our dbt integration to support software-defined assets for dbt Cloud. Essentially, we’re bringing parity to our support for dbt Core and dbt Cloud. Read our step-by-step guide to get started! For example, you can now understand your dbt Cloud job’s model dependencies, all within Dagster! And we’re still cooking up more features for this integration, like partition support and the ability to materialize individual models from a dbt Cloud job. Join the channel #dagster-dbt to receive updates about this integration as well as to discuss your use cases with dbt ⚙️
  • rex

    rex

    11/29/2022, 6:07 PM
    📰 Hi all! We’re starting a newsletter that will highlight developments, content, and events that are happening within our Dagster community. To subscribe, sign up here: https://dagster.io/newsletter-signup We’ll be sending out the first newsletter later today 👀
  • Fraser Marlow

    Fraser Marlow

    11/30/2022, 3:56 AM
    Our next open demo and live Q&A is on Thursday, Join us at 9:00 AM PST / 5:00 PM GMT for the demo or at 9:30 AM PST / 5:30 PM GMT if you just want to join the Q&A. Join us:https://dagster.io/dagster-demo-signup