One strategy that might work for you is to set up an initial deployment using docker-compose. This under the hood will create a cloud formation stack inside of your AWS account. You should be able to grab the template from this stack and modify it to suit your needs.