https://dagster.io/ logo
t

Travis Cline

03/07/2020, 11:24 PM
Just familiarizing myself with dagster - does it fit the programming model to have a portion of a dag be an external training job such as with gcp's ai platform training? https://cloud.google.com/ai-platform/training/docs/overview
n

nate

03/07/2020, 11:40 PM
yep totally. You could specify some feature extraction in one solid(s) and then have another which goes and trains a model, etc. - we haven’t built any out-of-the-box integration with GCP AI Platform yet but it should be pretty straightforward to use their Python APIs from Dagster
2 Views