Hi! Is there a way to run a job in batches? For example, if I have 100000 records that need to be processed, is there a way to pass 100 records at a time through a job? And is it possible to do this at scale?

hi @Shriram Holla -- the best solution here depends on where you're getting records from and what type of records they are, but as a surface level take, I'd recommend writing configurable job which can (for example) accept config like "start_index" and "end_index", and will use that config to only process records in that range.