I am currently building a pipeline that 1. pulls d...
# ask-community
j
I am currently building a pipeline that 1. pulls data from a google sheet -> 2. gets gpt to write a summary of the data -> 3. sends a message on slack. I have heard that I can use dagster to run this on a schedule as well as change one variable each time it runs, I have written the code and it works already but am not sure how to convert it into a dagster project, has anyone created something similar which I could take a look at, or have advice for how I can approach this project.
🤖 1
z
https://docs.dagster.io/guides/dagster/intro-to-ops-jobs/single-op-job you could do it all in one op just to get started to make things simple, just calling your existing code from the op. then once you've got that working you could split it into 3 ops to model the three steps in your pipeline
😄 1
y
here’s a blog post talking about this transition: https://dagster.io/blog/dagster-script-to-assets
😄 1
j
thanks!