zafar mahmood

04/13/2023, 12:19 PM
looking into this documentation does dagster has dagster-glue operator library ? if not then what would be the best way to import glue resources for a very simple pipeline.

Tim Castillo

04/13/2023, 2:56 PM
Hi! Dagster doesn't have a native integration with Glue, however it's is flexible enough to support working with Glue as you would with a normal Python script, with any other AWS python packages you would use. That being said, the best practice is to manage the connection's made by these generic packages with making your own Resources.