https://dagster.io/ logo
Title
a

Axel Bock

04/30/2023, 6:44 PM
so, i created this blog post with a step-by-step tutorial and my personal real-world-use case which brought me here. i don’t want to bash, yet i still think the docs are incredibly bad to get started, so this is my short-term contribution to anyone who is trying to get up and running as well. https://www.flypenguin.de/2023/04/30/getting-started-with-dagster/
y

yuhan

05/01/2023, 7:50 PM
Hi Axel, thanks for sharing! #dagster-showcase as well as #dagster-feedback might be a better place to surface content like this! cc @Tim Castillo / @Odette Harary who are actively thinking of our docs
s

sandy

05/01/2023, 9:56 PM
Thanks for the feedback @Axel Bock . This inspired me to write a few docs PRs: • https://github.com/dagster-io/dagster/pull/14034https://github.com/dagster-io/dagster/pull/14030https://github.com/dagster-io/dagster/pull/14027 Your post led me to believe that our docs over-emphasize ops and graphs for these kinds of use cases. If it were me, I would implement your use case using dynamically partitioned assets instead of ops and jobs. Here's an example of a pipeline that uses dynamically partitioned assets, to create a file for every object observed by a sensor: https://github.com/dagster-io/dagster/tree/master/examples/assets_dynamic_partitions