Today’s demo will start in just a few minutes. You can join directly with this link: https://us02web.zoom.us/j/81542945555?pwd=U3BTeGxFU2szalorNWdXb3hENEhXdz09

👋🎉👋 We'll be hosting our next Dagster community call on June 13th at 12PM ET. We see lots of developers doing with Dagster across data engineering, machine learning, and analytics, and we want to give you the opportunity to showcase some of those projects to the broader community. If this sounds exciting to you or someone on your team reply to this thread 🧵 to showcase on the next call. Looking forward to seeing what you've been working on!

📈 📈 📈 Exciting news Elementl has raised a $33M Series B to accelerate the growth of Dagster and Dagster Cloud! See the blog post and tweetstorm for more details. 📈 📈 📈 We’re really starting to see Dagster as oriented around data engineering as a craft and discipline. This is a subtle yet important shift, as people often jump directly to the data engineer job title. But it’s not just about data engineers. Lots of ML engineers and data scientists use Dagster, and it makes sense since ML engineering is mostly data engineering. Analytics engineering is a data engineering subspecialty focused on sql-based analytics workflows. When they want to expand beyond that use case, or operationalize dbt in a broader data-engineering-driven platform, they bring in Dagster. Lots of you reading are also data platform engineers, whose job is to scale data engineering across an organization, and think of all the other job titles above as your stakeholders. Our vision is that Dagster is the best place to build python-based data pipelines and the system that ties the work of all of you together in a single, coherent layer and control plane. This capital will allow us to think bigger not just in terms of community and commercial growth, but also product expansion. In terms of realizing the potential of data engineering as a discipline, we are still in early days. Practitioners on the ground know there is so much more possible in terms of improving productivity and reducing chaos. We have an exciting roadmap ahead. Thanks to all our users, community members, and Cloud customers. Your usage and support is what makes this all possible. If you want to join us on this mission, we’re hiring across Sales, Marketing, Design, Operations, and Developer Relations. See our open roles here!

Our next open demo and live Q&A is tomorrow - Thursday, June 1st, Join us at 9:00 AM PST / 5:00 PM GMT for the demo or at 9:30 AM PST / 5:30 PM GMT if you want to join the Q&A. Sign up for reminders: https://dagster.io/dagster-demo-signup Or just jump on the call tomorrow: https://us02web.zoom.us/j/81542945555?pwd=U3BTeGxFU2szalorNWdXb3hENEhXdz09

Hey friends in the Dagster community, we're looking to collect feedback from our users via a survey. It will take approximately 10m to answer, and helps us align our roadmap items to the needs of the community. AND we'll send you a $25 dollar gift card to say thanks!

📣📣📣 June 13th at 12:00 PM ET is the next Dagster Community call! Join via Zoom: https://us02web.zoom.us/j/88939083535 On the agenda: - Arun Kumar from DoorDash on the use of Dagster to power metrics layer and scale experimentation - Andrew Grigorev from FaceApp on Breaking the Monotony of Cron Jobs: An Exploration of Dagster Partitioning In addition, we will be sharing our Dagster User survey results, sharing some company updates, and answering your questions. We look forward to seeing you there!

Our next open demo and live Q&A is today at 9:00 AM PST / 5:00 PM GMT for the demo or at 9:30 AM PST / 5:30 PM GMT if you just want to join the Q&A. https://us02web.zoom.us/j/81542945555?pwd=U3BTeGxFU2szalorNWdXb3hENEhXdz09

Hey everyone - we’ve made our company and project roadmap public. Please let us know your feedback! https://dagster.io/blog/dagster-master-plan

Our team will be partially OOO on July 3 and totally OOO on July 4 for US Independence Day 🇺🇸 Sorry 🇬🇧, we’ll always be great friends. Support turnaround will be a bit slower on those days. Thanks for your patience.

If you have been following Dagster on Twitter and are switching to Threads, we will be double posting at https://www.threads.net/@dagster.io . Let’s see how this plays out!

📣📣📣 Next Tuesday, August 8th at 12:00 PM ET is the next Dagster Community call! Join via Zoom: https://us02web.zoom.us/j/88939083535 On the agenda: - dagster-dbt integration updates! - Unlocking Advanced Metadata Extraction with the New DBT API in Dagster with Georg Heiler We look forward to seeing you there!

Just over 1 hour until our community meeting! Join via Zoom: https://us02web.zoom.us/j/88939083535 https://dagster.slack.com/archives/C039ZLVNZ09/p1691446599504519

🇯🇵🎉 🇯🇵New channel highlight! Many of our community members are using Dagster in Japan, and we are launching a new Slack channel for discussions in Japanese and on Japan-related topics. Join the channel #dagster-jp to discuss Dagster, meetups, local conferences, and more.

🏁 New channel alert 🏁 I just created the #data-quality-asset-checks channel, to host discussion about data quality, expectations, validations, checks, data tests, and the like. I'll also be posting details and asking for feedback about functionality that we're planning to introduce on this topic.

Elementl, the company behind the Dagster project, has been renamed as Dagster Labs. In the following blog post, @schrockn and @Pete Hunt share the thinking behind the change. https://dagster.io/blog/introducing-dagster-labs

Welcome!

Stefan R

joined #announcements.

Monday, Sept 4th is a US holiday and the Dagster team will be taking a break. Thank you for your patience as our support team will be out for the day.

Welcome!

Jim Nisivoccia

joined #announcements. Also,

Jared Miner

joined.

Dagster External Execution Protocol (ext) Hey everyone. Just want to highlight a github discussion we just posted, detailing a feature coming out in our next release (currently scheduled on September 28th). We call it the Dagster External Execution Protocol or “ext.” ext has a few goals: • Make it easier to orchestrate existing code with Dagster with little to no modifications to that existing code • Make it easier for centralized data and data engineers to onboard stakeholder teams onto Dagster incrementally • Run code in external environments and easily get streaming logging and structured metadata back into Dagster’s UI and tools • Formal support for separation of orchestration and business logic environments • First-class multi-language support in Dagster Please read the github discussion for more details and to give feedback, but how are achieving these goals is shipping a toolkit for greatly improved integrations with external environments such as Kubernetes, Spark, and other external runtimes. It standardizes parameter/context passing, as well as streaming logs and metadata back to Dagster. It is also extensible and pluggable, so that users can build on it to orchestrate their own customized environments. We’ve created a channel #dagster-ext to follow updates and discuss in more detail. Thanks all! Looking forward to getting this out to everyone.

Welcome!

avneeshs1

joined #announcements.

Reminder that our bi-weekly demo + Q&A will take place tomorrow (Thursday) at 9 AM PST / 5 PM UK / 6PM CET. https://dagster.io/dagster-demo-signup.

Welcome!

avneesh saxena

joined #announcements.

Today’s demo will be starting shortly: https://us02web.zoom.us/j/81542945555?pwd=U3BTeGxFU2szalorNWdXb3hENEhXdz09

Welcome!

edward852

joined #announcements.

Hi everyone, here at Dagster Labs, we are looking for our first Support Engineer! 🎉 If you know of anyone or want to be part of the team, let us know! The best candidates are experienced engineers who are excited about Dagster and helping our customers be successful in using it. Read more or apply here and ping me for questions. Thanks!

Welcome!

Adam May

joined #announcements. Also,

Yaroslav Volkov

joined.

📣 Community Call update 📣 Our next community call will be on November 14th, our last call for 2023. This is a change from the originally scheduled October 10th because we will be having a major event that week, with lots for the community to enjoy. • Add the invite for the November 14th community call to your calendar here. • Sign up for launch week here.

We will be hosting our Fall Launch Week from October 6th to the 13th. Each day, we will announce and showcase new features and capabilities on the Dagster platform. The theme of Launch Week is “*Escaping the Modern Data Trap*.” Why? The advent of the Modern Data Stack revolutionized the domain of data engineering. But over time, it drifted from its original premise. It became fragmented, overcomplicated, and expensive to run. Join members of the Dagster Labs team as we share our vision of how to escape this Modern Data Trap and get back to the initial intent: to deliver a developer experience that is unified, streamlined, collaborative, and where you are in control of costs. We hope you will join us for this discussion and new updates: https://dagster.io/events/dagster-launch-week-oct-2023

Welcome!

Alex Kwiatkowski

joined #announcements.