however fair warning, this is meant to be consumed by the system and so all interemediate values are pickled by default