Hi everyone, I'm currently trying to deploy Dagste...
# ask-community
r
Hi everyone, I'm currently trying to deploy Dagster on ECS using the example provided. I would like to customize the installation by using a custom AWS LoadBalancer instead of creating one from scratch. Is there a Terraform script out there that I can tweak to do that?
Otherwise, it is possible to use the EcsRunLauncher without having Dagster installed on ECS itself? For now, dagit & dagster-daemon sit on an EC2 but I would like to know if it's possible to move the workers only.
j
The EcsRunLauncher currently requires that the process that initializes the launcher (typically the daemon or dagit) is also running in an ECS Fargate task. This is because the launcher infers the task’s networking configuration from the launching task. There is some early groundwork being laid what would make it possible to relax those constraints but I don’t have an estimate for when that work will complete: https://github.com/dagster-io/dagster/pull/8295
If you’re deploying ECS using the docker compose example, there are some examples in the Docker docs for configuring your own load balancer: https://docs.docker.com/cloud/ecs-compose-examples/#service
r
Alright thanks a lot, I'm having a look!
Yep, that did the trick. For futur reference, you can use already existing ressources through docker compose. I did just that with our load balancer.