with dynamic pipelines I m trying to get a dynamic schedule

Question

with dynamic pipelines I m trying to get a dynamic schedule to work and it renders okay but i m trying to render a dynamic pipeline as follows ``` schedule pipeline name=yaml file name name=yaml file name + schedule cron schedule= mode= prod execution timezone= UTC def foobar schedule date name = eval yaml file name name get preset prod run config``` but I get an error that `NameError name mypipelinename is not defined` Is it possible to call a dynamic pipeline to execute

daniel · Answer

Hi josh is there an pipeline or PipelineDefinition for the pipeline as well Dynamically defining a schedule in code should work but you d also need to define the pipeline separately

Josh Taylor · Answer

Yep I dynamically define it in code as well The reason for this is because we have a directory of files that are basically define config for schedules and dagster is a great fit for this I define it like this ``` pipeline name=yaml file name ``` so they all show up correctly in dagit and can be executed manually using the UI CLI just unsure how to call the dynamic pipeline by name in the schedule to be executed

daniel · Answer

oh I see It s the name = eval yaml file name line

daniel · Answer

let s see

daniel · Answer

There isn t a function in dagster that can take in just the name of a pipeline and return the PipelineDefinition for it one reason for this is that pipeline names are repository scoped You could load the repository within the schedule function and get it that way though So something like ```def foobar schedule date from your module import your repository pipeline definition = your repository get pipeline yaml file name return pipeline definition get preset prod run config``` Bit strange but I can t think of a reason it wouldn t work

Josh Taylor · Answer

Fantastic This works great thanks