Josh Lloyd09/22/2021, 3:13 PM
and the process of extraction here requires a sequence of several solids. Option 1b: (not possible) Create a DynamicOutput solid that gives the list of databases for each instance then another DynamicOutput solid that effectively loops over the databases within that instance. However, you get an error when you have a dynamic output downstream of another dynamic output. Option 2: (not good) Setup a new pipeline for each instance, but then you have a whole lot of duplicate code and also doesn’t take into account the dynamic list of instances (an instance could be added or removed on any given day). Any thoughts on how to accomplish this?