The cloud-native orchestrator for the whole development lifecycle, with integrated lineage and observability.

dagster

:planet-daggy:  New for the BigQuery I/O manager in 0.17.21 :planet-daggy:
:spark:  The BigQuery I/O manager now supports PySpark DataFrames
:books: New <https://docs.dagster.io/integrations/bigquery/using-bigquery-with-dagster|tutorial> and <https://docs.dagster.io/integrations/bigquery/reference|reference guide > goes over how to set up and configure the BigQuery I/O manager, storing and loading assets, working with partitions, and more!

This release also includes a bugfix where `location` configuration was not being used when storing Pandas DataFrames

Thanks again to everyone who has tried out the I/O manager and given feedback so far!

Im always impressed how fast things happen here. Great documentation. Thank you!