Hi, I’m trying to define a non-partitioned graph a...
# ask-community
a
Hi, I’m trying to define a non-partitioned graph asset that depends on the last partition of a partitioned upstream asset with something like this:
Copy code
@op
def my_op(my_input):
   ...

@graph_asset(
    name="my_graph_asset",
    ins={
        "my_input": AssetIn(
            AssetKey(["my_upstream_asset"]),
            partition_mapping=LastPartitionMapping(),
        )
    },
)
def valuation_components(my_input):
    return my_op(my_input)
but it still tries to load all the partitions from the upstream in
my_op
. How to do this properly? (I guess I need to do something with my op, but I cannot figure out what.)
Upstream asset is using
PickledObjectS3IOManager
from
dagster_aws.s3
, which is a subclass of
UPathIOManager
. Is it possible that this won’t support partition mapping?
y
Which Dagster version are you on?
a
@yuhan I was trying this on 1.4.4