Somehow wrapping the dagstermill op in a graph, and creating an asset from the graph makes the op into an asset. I have

dagstermill.yield_result(out, output_name="encoders")

as the last line in my notebook as recommended when turning a notebook into an op