I was wondering if this sort of a set up is possib...

# announcementsz

Zuhair Ikram

03/05/2021, 1:49 AMI was wondering if this sort of a set up is possible with

`dagster`

? The other two boxes represent hosts with like an agent or a “lite” version of dagster. The agent kicks off processes on the host when main dagster scheduler tells it to.n

Noah K

03/05/2021, 4:39 AMAs in you want to implement solids in both arbitrary python and dbt?

z

Zuhair Ikram

03/05/2021, 6:00 AMYes

n

Noah K

03/05/2021, 6:17 AMSure, solids can be written however you need 🙂

z

Zuhair Ikram

03/05/2021, 6:34 AMSorry, let me rephrase. Would I basically do a

`pip install dagster`

on all three boxes + `pip install dagit`

on one box to get this going?Zuhair Ikram

03/05/2021, 6:35 AMIs there a write up on how one would set up what I have diagrammed there?

n

Noah K

03/05/2021, 6:37 AMrunning things on multiple servers is unrelated to the language you are writing your solids in

Noah K

03/05/2021, 6:38 AMLook at things like dagster_celery and dagster_k8s for multi-node execution options at varying levels of complexity 🙂

z

Zuhair Ikram

03/05/2021, 8:07 AMYeah, I think we went down the wrong path for my question. It wasn’t about the language for solids, but more about a multi-node installation. I was trying to compare the complexity for implementing a multi-node installation for dagster vs some alternatives like Airflow2, etc.

n

Noah K

03/05/2021, 8:10 AMOverall fairly similar

Noah K

03/05/2021, 8:10 AMCelery on Kubernetes is the usual way forward 🙂

Noah K

03/05/2021, 8:10 AMYou can mix-n-match it a bit from there

z

Zuhair Ikram

03/05/2021, 8:16 AMThanks!

n

Noah K

03/05/2021, 8:17 AM(Dask is also supported but I hateses it and will literally never recommend it 🙂