sri raghavan03/07/2023, 9:15 PM
that uploads to S3 and persists the blob path to our production customer DB? is this use case better served by a custom
chris03/07/2023, 9:21 PM
Mark03/08/2023, 5:43 AM
sri raghavan03/08/2023, 7:15 AM
, so presumably we'll need both of those partition keys available when uploading / generating the blob path. it sounds like partitioning the dependent job with the same
is the way to do that? (at least, i was able to get it working that way).
for (1) - yep, that helps, though what I'm really looking for is the ability to view the asset contents in Dagit directly
@Mark - that's a great idea. it's not the whole asset, but it'll certainly give us enough to be able to spot-check results, and I think that's what we're looking for here to grease the iteration wheels. thanks!!