What’s the best way to send a huge number of inputs to a Dagster job? Lets say i have like…. 18k integers that I was hoping to pass on my run_config, but that didn’t quite work because we hit the limit of
characters on the database for the run config 😅 Are Assets to store this data an option here?
dagster bot responded by community 1
02/02/2023, 9:34 PM
Not sure what your use case is, but you should be able to load those as an asset (or a SourceAsset if you don't care about materialization date/status).