Hi Dagster team, I’m currently trying to clean up our periodic tasks (cron) and data flow (ingest). I’ve been looking at a couple of open-source projects to help with this (Airflow, Prefect) and now have found our about Dagster. For our use case we are trying to schedule parsing of old-school data formats (CSV dumps via SFTP, periodic SOAP over HTTP pulls, etc). I’m not sure that Dagster would be a fit for us as it seems as though it lacks a scheduler? I believe that prefect (www.prefect.io) does scheduling and uses a Dask engine for execution. We are also working on on-prem Kubernetes cluster for our container orchestration and execution. The part I don’t see clearly with using Dagster is the scheduling part. Can you clarify this for me?

Hey Stephen! Currently we do not come out-of-the-box with a scheduler. Dagster is currently meant to be a pure software that one can deploy to arbitrary schedulers and compute targets.