https://dagster.io/ logo
j

Johnathan Brooks

03/10/2021, 8:51 PM
Hi all! I'm evaluating Dagster for two mid-sized projects I'm working on. In both cases we may use Dagster to orchestrate tasks and interactions between Sagemaker and S3, and dbt models on Snowflake. Has anyone had experience running SageMaker jobs (e.g. run a notebook, Sagemaker batch prediction transforms, etc.) via Dagster? If so, curious if there's any docs or lessons learned from the experience!
👀 4
t

Ted Conbeer

05/06/2021, 6:25 PM
Hi @Johnathan Brooks - did you figure out how to do this? About to embark on something similar myself, and was surprised to see Sagemaker isn't in
dagster-aws
j

Johnathan Brooks

05/06/2021, 7:23 PM
Hey Ted! Unfortunately not quite yet, I actually was about for awhile for surgery, so getting back into the swing of things now, but planned to jump back in soon
t

Ted Conbeer

05/06/2021, 7:25 PM
ok, no problem. Hope you're doing okay -- I'll let you know what I find. I've created by own resources before in dagster (e.g., dbt cloud), and it's pretty easy