How to loop pipeline? I have csv having URL list I...
# announcements
k
How to loop pipeline? I have csv having URL list I want to develop pipeline that will take each URL > Download File from URL > Run other solid and convert data into target format. So should I just create loop in python and pass each argument from CSV? or is there any other better approach ?
s
Hey @Keval, your question looks similar to this one: https://github.com/dagster-io/dagster/discussions/3211. Let me know if that doesn’t answer your question and we can follow up here