I'm looking for assistance in: • first evaluating Dagster for a particular use case • if Dagster is indeed a fit, building a small proof-of-concept • assuming we're able to get the broader team on board after demonstrating the proof-of-concept, begin building out the broader platform The project can be described as a research and data aggregation platform. It pulls data from multiple online sources, drilling down in detail using what it learned in prior steps. Data sources include: - websites (that need to be crawled and then scraped) - commercially available APIs - custom search engines we create (using https://www.microsoft.com/en-us/bing/apis/bing-custom-search-api) At the end of the day, the current vision is that all data ends up in Elasticsearch for querying. You may ping me here or use the following methods to contact me: Telegram: https://t.me/tomgriffin Signal: +1-201-259-8860 Email: tom@thegrif.net Linkedin: https://linkedin.com/in/tomgriffin

Hey Tom 👋 I messaged you on LinkedIn