Can we use dagster in anger now that we have a pandas model

Question

Can we use dagster in anger now that we have a pandas model of the backend Let s find out a twitter thread

Manny Schneck · Answer

I can t share the code but yeah

Manny Schneck · Answer

I can

Manny Schneck · Answer

This is entirely hacking at the toplevel of the ipython repl

Manny Schneck · Answer

I have an idempotent script makefile

Manny Schneck · Answer

And it s just lifting cleanly into dagster

Manny Schneck · Answer

```2021 12 02 02 43 16 dagster INFO doPrice 77da679c 9ab6 4237 b7de 699bceebe25e price 0xDEADBEEF 3 2069958317065073```

Manny Schneck · Answer

Can t share more than that because $JOB but that s all the wirign working

Manny Schneck · Answer

``` venv 2 12 21 2 43 16 analysis git dagster dagster job execute f scripts end to end py```

Manny Schneck · Answer

This is ripping out some intermediate state from an excel worksheet and pulling all kinds of stuff in from dev to mix and match

Manny Schneck · Answer

And it runs in the orchestrator

Manny Schneck · Answer

This lift might be completely smooth

Manny Schneck · Answer

Copying values from the old script into ~unit~ job integration tests and just slicing up the old script into steps

Manny Schneck · Answer

And I don t even know dagster

Manny Schneck · Answer

I just used ops

Manny Schneck · Answer

```baselines frame baselines io remote eu ```

Manny Schneck · Answer

Stuff like this in my dag job