https://dagster.io/ logo
#deployment-kubernetes
Title
# deployment-kubernetes
b

Billie Thompson

06/04/2021, 2:50 PM
What’s the best way to default some options for the run config? Things like resources. It feels a bit clunky having in the code, it looks like we can define it in a dagster.yaml (maybe?), but I can’t see any way to create that with helm. For example https://docs.dagster.io/_apidocs/libraries/dagster-azure#dagster_azure.adls2.adls2_resource has a bunch of yaml under it
Copy code
resources:
  adls2:
    config:
      storage_account: my_storage_account
      # str: The storage account name.
      credential:
        sas: my_sas_token
        # str: the SAS token for the account.
        key:
          env: AZURE_DATA_LAKE_STORAGE_KEY
        # str: The shared access key for the account.
Where is this supposed to go?
b

Billie Thompson

06/04/2021, 2:54 PM
Can we use that with celery?
a

alex

06/04/2021, 2:55 PM
for all the resources yes the
executor
/
execution:
section in
celery-k8s
has a restriction against it
b

Billie Thompson

06/04/2021, 2:55 PM
Thanks! We will give a try
a

alex

06/04/2021, 2:56 PM
that restriction makes me very sad and someday well get rid of it
2 Views