Channels
dagster-de
topic-async-execution
dagster-jp
dagster-cube
gigs-freelance
dagster-wandb
dagster-feedback
dagster-machine-learning
dagster-bigquery
dagster-support
dagster-dask
dagster-snowflake
dagster-releases
dagster-dbt
faq-read-me-before-posting
tools
dagster-pipes
project-flexible-range-backfills
data-platform-design
events
dagster-serverless
dagster-noteable
introductions
dagster-airflow
dagster-cloud
random
dagster-airbyte
dagster-spatial
announcements
github-discussions
豆瓣酱帮
dagstereo
dagster-ecs
dagster-kubernetes
jobs
dagster-showcase
data-quality-asset-checks
Powered by
#random
Title
n
nate
04/24/2019, 11:42 PM
wtf amazon
https://docs.aws.amazon.com/emr/latest/ManagementGuide/AddMoreThan256Steps.html
“oh, you’d like to run more than 256 things on your long-running cluster? ¯\_(ツ)_/¯” all of their suggestions for how to deal with this are nuts… “just SSH to the master and manually submit things!” (with PuTTY of course)
Post