Jonathan Sims
08/24/2023, 7:11 PM@op
or @asset
decorators to define "tasks" in the pipeline? I haven't been able to find a straightforward answer as to when to use which or if one is preferred over the other going forward.
I am working on an app where developers write Dagster jobs as modules to ingest data for use by AI models. This process is basically an ETL pipeline (ingest data, chunk it, embed it, index it).jamie
08/24/2023, 7:15 PMJonathan Sims
08/24/2023, 7:16 PM