@villebro there are a couple of approaches here, but typically we would suggest unit testing your spark solids against a local cluster, with a small test data set. you might also want to run integration tests against a prod or staging cluster, again with small test data, but probably less frequently.