Hi All, Wondering if there’s any documentation or other resources for deploying/scaling Dagster on AWS Fargate or ECS? P.S simply using Dagster Cloud is already an included consideration dagsir

Hi Eric! Check out the following link: https://docs.dagster.io/deployment/guides/aws#deploying-in-ecs Regarding Fargate - That’s possible but I don’t know if I’d recommend that for a complex graph, as Fargate takes about 1.5-2.5 minutes to raise up an EC2, pull the Docker image, and setup everything up. That’s a time overhead for each Op being executed on ECS, as well as Fargate overhead that you might have to take into account (for example, we use DataDog to collect logs from the containers, and Fargate requries a sidecar for each Fargate pod we deploy. Fargate also allocates about 0.25vCPU and 250m RAM for node for internal K8s stuff).

Appreciate the link and insight Roei! Noted your comments on overhead in Fargate. 🎉