Karan Nanda
04/10/2023, 12:01 PMmkdir my_dagster_project
cd my_dagster_project
pip install dagster pandas
import pandas as pd
from dagster import pipeline, solid
@solid
def read_csv_file(context):
df = pd.read_csv('numbers.csv')
return df['number']
@solid
def compute_sum(context, numbers):
total = sum(numbers)
return total
@pipeline
def sum_pipeline():
numbers = read_csv_file()
compute_sum(numbers)
dagster pipeline execute -f sum_pipeline.py
Error is:
Usage: dagster [OPTIONS] COMMAND [ARGS]...
Try 'dagster -h' for help.
Error: No such command 'pipeline'.Qwame
04/10/2023, 5:25 PMclaire
04/10/2023, 8:09 PMdagster job execute ....
Karan Nanda
04/11/2023, 6:27 AM