The cloud-native orchestrator for the whole development lifecycle, with integrated lineage and observability.

dagster

:snowflake: New in dagster-snowflake 0.18.7 :snowflake:
 In this release, we have added new `SnowflakePandasIOManager` (<https://docs.dagster.io/_apidocs/libraries/dagster-snowflake-pandas#dagster_snowflake_pandas.SnowflakePandasIOManager|api docs>) and `SnowflakePySparkIOManager` (<https://docs.dagster.io/_apidocs/libraries/dagster-snowflake-pyspark#dagster_snowflake_pyspark.SnowflakePySparkIOManager|api docs>) that follow the new Pythonic Config and Resources system. The existing `snowflake_pandas_io_manager` and `snowflake_pyspark_io_manager` _*are still and will continue to be supported.*_ However, we think that the new Pythonic system has huge ergonomic benefits so we recommend you check it out! You can read more about the Pythonic Config and Resources system <https://dagster.io/blog/pythonic-config-and-resources|here> , and expect to see even more resources (including updated guides) in the coming weeks!