I’m using Dagster to extract data from postgres to other resources(s3, bigquery etc…).
I have to extract many tables(about 50). So, Should I make jobs every table’s num?
or Should I use in another way?(for example, use DynamicOutput..etc)
06/16/2022, 8:24 PM
Hi ygt. Yes, I think dynamic outputs make sense if you aren't sure how many tables you'll need to extract and you're using shared operations to do the extraction