19913d85-f662-4518-a9a1-7adc1793dfd4.png){kind=small}
Can we use dagster in anger now that we have a pan...
# randomm
Manny Schneck
12/02/2021, 8:19 AMCan we use dagster in anger now that we have a pandas model of the backend? Let's find out, a twitter thread.
👌 1
Manny Schneck
12/02/2021, 8:37 AMI can't share the code but yeah.
Manny Schneck
12/02/2021, 8:37 AMI can.
Manny Schneck
12/02/2021, 8:38 AMThis is entirely hacking at the toplevel of the ipython repl.
Manny Schneck
12/02/2021, 8:38 AMI have an idempotent script/makefile.
Manny Schneck
12/02/2021, 8:38 AMAnd it's just lifting cleanly into dagster.
Manny Schneck
12/02/2021, 8:45 AM Copy code
2021-12-02 02:43:16 - dagster - INFO - doPrice - 77da679c-9ab6-4237-b7de-699bceebe25e - price - 0xDEADBEEF: 3.2069958317065073Manny Schneck
12/02/2021, 8:45 AMCan't share more than that because $JOB, but that's all the wirign working.
Manny Schneck
12/02/2021, 8:45 AM Copy code
(venv) [2/12/21 2:43:16] ➜ analysis git:(dagster) ✗ dagster job execute -f scripts/end_to_end.pyManny Schneck
12/02/2021, 8:56 AMThis is ripping out some intermediate state from an excel worksheet and pulling all kinds of stuff in from dev to mix and match.
Manny Schneck
12/02/2021, 8:56 AMAnd it runs in the orchestrator.
Manny Schneck
12/02/2021, 9:29 AMThis lift might be completely smooth....
Manny Schneck
12/02/2021, 9:30 AMCopying values from the old script into unit job-integration tests and just slicing up the old script into steps.
Manny Schneck
12/02/2021, 10:59 AMAnd I don't even know dagster!
Manny Schneck
12/02/2021, 10:59 AMI just used ops.
Manny Schneck
12/02/2021, 10:59 AM Copy code
baselines_frame(
baselines_io_remote(
eu,
)),Manny Schneck
12/02/2021, 10:59 AMStuff like this in my dag job.