Channels
announcements
dagster-airbyte
dagster-airflow
dagster-bigquery
dagster-cloud
dagster-cube
dagster-dask
dagster-dbt
dagster-de
dagster-ecs
dagster-feedback
dagster-kubernetes
dagster-machine-learning
dagster-noteable
dagster-releases
dagster-serverless
dagster-showcase
dagster-snowflake
dagster-spatial
dagster-support
dagster-wandb
dagstereo
data-platform-design
events
faq-read-me-before-posting
gigs-freelance
github-discussions
introductions
jobs
random
tools
豆瓣酱帮
Powered by
Title
z
Zachary Bluhm
11/16/2022, 8:35 PM
Hi all - trying to understand if job "tasks" (or steps maybe they're called) can be run in their own k8s pod, versus each step running in the same k8s pod as the job itself I see:
https://docs.dagster.io/_apidocs/libraries/dagster-k8s#dagster_k8s.k8s_job_executor
Which might be what I'm after, but want to confirm that a "step" == "op" Edit: but reading this:
https://docs.dagster.io/deployment/guides/kubernetes/deploying-with-helm
Its not clear whether or not individual steps are ran in their own k8s pod
d
daniel
11/16/2022, 8:43 PM
Can confirm that step = op! For the purpose of this question at least - to be maximally pedantic, op is the definition in code, step is the actual thing that runs
#dagster-support
Join Slack