Dagster team, have you run into OpenFaaS? Would you consider making it possible for your "agent" to trigger functions (FaaS functions) written in Python rather than your own model for invocation? Schedulers could be via their

cron-connector

. What do you think?

Hey Greg, would love to hear more. What are the advantages of executing in that way?

For us it would be that these two things, dagster and FaaS, are similar and complimentary. Dagster can provide the “how things connect” and orchestration for the data flow while the functions are the units of work. I don’t think it’s hard to create a template for a function that could be based on your code (a Docker file and a startup python script, see https://github.com/openfaas/templates/tree/master/template/python3) and tie the two together.