Gitlab's <Meltano> project has announced a focus o...
# announcements
n
Gitlab's Meltano project has announced a focus on becoming the open-source data extractor/loader alternative to Alooma, Fivetran, Stitch, Matillion, etc. The announcements on the refocus are here: • https://meltano.com/blog/2020/05/13/revisiting-the-meltano-strategy-a-return-to-our-roots/https://meltano.com/blog/2020/05/13/why-we-are-building-an-open-source-platform-for-elt-pipelines/ Meltano's approach reminds me of a narrower in scope and more opinionated Dagster, but packaged all together as a platform. They use Airflow for orchestration, and Stitch's Singer specification for taps and targets, DBT for transformations, and their own BI layer. I don't know how modular their extractor/loader portion is, but I'm happy to see the Singer specs getting more robust productionization options. If Dagster is interested in going farther upstream, Meltano would be an interesting project to follow.
s
Thanks for sharing, didn't know about it. There is a dedicated channel #tools with other tools and comparison. I will add this to my list to compare as well.
n
oh, thanks. I'll join the channel.
s
"Orchestrating reliable data pipelines is a solved problem" 🤔🤔🤔
n
heh, I didn't catch that part