Hi all. I could just be trying to use assets incorrectly but I have an asset that is the result of an http call. I need to do something computationally expensive with that asset. I am using dynamic outputs to do the computation efficiently. I then return a call to collect() from the result of a map() in my graph but that doesnt seem to be allowed? I need to somehow convert the fanin into a list or op output prior to returning? My plan was to make this a "graph-backed asset".

Collect() is a function called in a Graph/Job not inside an Op. So

@op(out=DynamicOut())
def first():
  for i in range(10):
    yield i

@op
def fetch_a_lot_of_data(id: int):
  results : List[int] = fetch_data(id)
  return results

@op
def sum_stuff(large_list:List[int]):
  return sum(large_list)

@graph
def my_job():
  mystuff = first()
  results = mystuff.map(fetch_a_lot_of_data)
  summed = sum_stuff(results.collect())

#do asset from graph stuff

I am calling it from inside the graph and returning it: return thing().map(expensive_thing).collect()