Hey real general quick question can I have tasks that are re

Question

Hey real general quick question can I have tasks that are reactive to system events in addition to gRPC or am I scripting the CLI and using calendar only

Alex Flanagan (Proof Zero) · Answer

Link to docs appreciated

Noah K · Answer

You would have to write something to glue the events to GraphQL calls but sure

Noah K · Answer

Can you give a more concrete example

Alex Flanagan (Proof Zero) · Answer

I want a client to connect a gRPC server pull in data and execute using that input

Alex Flanagan (Proof Zero) · Answer

I could also have a write to a data store and want to trigger a workflow off of that for example a write event on AWS that fired an EventBridge event that triggered a Lambda that used Dagster

Alex Flanagan (Proof Zero) · Answer

Etc I want to react to system events

Noah K · Answer

What client do you mean

Noah K · Answer

Dagster is not itself an event engine you would need something else doing that part of thing

Alex Flanagan (Proof Zero) · Answer

A custom client that would establish a gRPC connection to our swarm

Alex Flanagan (Proof Zero) · Answer

A custom client that would establish a gRPC connection to our swarm

Noah K · Answer

And then you use the GraphQL API to kick off runs or similar

Alex Flanagan (Proof Zero) · Answer

What does GraphQL have to do with it

Noah K · Answer

That s the API Dagit exposes to launch pipeline runs

Alex Flanagan (Proof Zero) · Answer

Ahh thank you I m wondering about Dagster alone Our use case is coordinating a data pipeline across a distributed compute infra It seems like maybe Dagster is not a fit That s what I m trying to validate

Alex Flanagan (Proof Zero) · Answer

We want the compute instances to be actioning tasks in the dag

Noah K · Answer

You can do that via the API

Noah K · Answer

I don t really understand the question

Noah K · Answer

When you want to launch a run you use the API to do that

Alex Flanagan (Proof Zero) · Answer

Okay thank you I will RTFM and ask a better question slightly smiling face

alex · Answer

I think the `sensors` feature that is coming in `0 10 0` may be what you are looking for

Alex Flanagan (Proof Zero) · Answer

< alex> is there some reading I can do on that I d like to know more about `sensors`

alex · Answer

< prha>

Alex Flanagan (Proof Zero) · Answer

Thanks

daniel · Answer

< Alex Flanagan Proof Zero > we also have a high level overview of the sensors feature in the last 1 3rd or so of our most recent Community Meeting More detailed docs are coming very soon as we finalize things for the upcoming release

Adrian · Answer

thanks Daniel