https://dagster.io/ logo
#random
Title
s

Simon Späti

08/26/2022, 6:20 AM
I wrote about Data Lakes and Lakehouse, how to build a Data Lake on top of 1. Storage Layer (AWS S3, Azure Blob Storage, Google Cloud Storage) 2. File Format (Apache Parquet, Avro, ORC) and 3. Table Format (Delta Lake, Apache Hudi, and Iceberg). The next thing would be to add an orchestrator such as dagster to combine all the building blocks. I thought maybe it would be interesting for this audience. If you have any questions, please let me know; happy to chat 🙂
👌 3
2 Views