Marcin Grzybowski
11/17/2022, 10:05 AMdagster.core.launcher
but I would like to use dagster_aws.ecs (EcsRunLauncher) to decrease amount of AWS Fargate instances and launch them when I need them (via Dagster UI/Scheduler). Is it possible to configure EcsRunLauncher
for each of different AWS ECS Tasks?
For example:
APP1 -> ecs_task_app1 (Docker_Image_app1)
APP2 -> ecs_task_app2 (Docker_Image_app2)
APP2_1 -> ecs_task_app2 (Docker_Image_app2)
APP2_2 -> ecs_task_app2 (Docker_Image_app2)
APP3 -> ecs_task_app3 (Docker_Image_app3)
daniel
11/17/2022, 2:33 PMMarcin Grzybowski
11/17/2022, 2:41 PMrun_launcher:
module: dagster_aws.ecs
class: EcsRunLauncher
config:
task_definition: "arn:aws:ecs:us-east-1:XXXXXXXXXXXXX:task-definition/dev-dagster-project1:2"
container_name: "dev_dagster_project1"
and I ran project based on this Task Definition.
I am not sure where I should overwrite this configuration to use different Task Definition in other job()daniel
11/17/2022, 2:43 PMMarcin Grzybowski
11/17/2022, 2:51 PM