there are a couple of facilities in dagster that should make it easier to run tests like this -- our goal is that the solid code (the business logic of the spark job) shouldn't have to change in test