Trying to use software defined assets for my new pipelines c

Question

Trying to use software defined assets for my new pipelines currently receiving this error for my SourceAsset definition My code ```ml cxr datalake = SourceAsset key=AssetKey ml cxr datalake io manager key= ml mongo warehouse description= Mongo collection with ready for CXR model training ``` error ```docker dev dagster pipelines | File usr local lib python3 9 site packages dagster core definitions target py line 35 in new docker dev dagster pipelines | check inst param docker dev dagster pipelines | File usr local lib python3 9 site packages dagster check init py line 633 in inst param docker dev dagster pipelines | raise param type mismatch exception docker dev dagster pipelines | dagster check ParameterCheckError Param target is not one of GraphDefinition PipelineDefinition UnresolvedAssetJobDefinition Got SourceAsset key=AssetKey ml cxr datalake metadata entries= io manager key= ml mongo warehouse description= Mongo collection with ready for CXR model training partitions def=None group name= default resource defs= which is type lt class dagster core asset defs source asset SourceAsset gt ```

sandy · Answer

Hey < George Pearse> it looks like this error is occurring at the time you re trying to instantiate a schedule or sensor Is that something your code is doing

George Pearse · Answer

I just load the asset into the repo as is Purely trying to test out wiring up some assets tried with the name of the asset directly specified and just via the function name

George Pearse · Answer

I ll try one of your simple example scripts and tweak the script 1 step at a time until I break something

sandy · Answer

Are you using ` repository` If you share more of your code or how you re launching Dagit I d likely be able to help you fix it

George Pearse · Answer

repository just loading via docker compose for local dev work for the minute Version 0 15 0 will send you the script DM d all the relevant code

George Pearse · Answer

Actually still hitting problems Copied the weather example as closely as I can and running via dagit just on this file ```from dagster import load assets from modules with resources AssetKey SourceAsset asset IOManager IOManagerDefinition with resources define asset job repository import pandas as pd from pandas import DataFrame import os sfo q2 weather sample = SourceAsset key=AssetKey sfo q2 weather sample description= Weather samples taken every five minutes at SFO metadata= format csv class LocalFileSystemIOManager IOManager Translates between Pandas DataFrames and CSVs on the local filesystem def get fs path self asset key AssetKey gt str rpath = os path join asset key path + csv return os path abspath rpath def handle output self context obj DataFrame This saves the dataframe as a CSV fpath = self get fs path context asset key obj to csv fpath def load input self context This reads a dataframe from a CSV fpath = self get fs path context asset key return pd read csv fpath asset def daily temperature highs sfo q2 weather sample DataFrame gt DataFrame Computes the temperature high for each day sfo q2 weather sample valid date = pd to datetime sfo q2 weather sample valid return sfo q2 weather sample groupby valid date max rename columns= tmpf max tmpf asset def hottest dates daily temperature highs DataFrame gt DataFrame Computes the 10 hottest dates return daily temperature highs nlargest 10 max tmpf repository def software defined assets return with resources hottest dates daily temperature highs resource defs= io manager IOManagerDefinition hardcoded io manager LocalFileSystemIOManager define asset job weather assets job ``` ```Using temporary directory opt dagster pipelines research and development tmpbv49k8pj for storage This will be removed when dagit exits To persist information across sessions set the environment variable DAGSTER HOME to a directory to use 0it 00 00 it s 0it 00 00 it s opt dagster behold pipelines env lib python3 7 site packages dagster core workspace context py 556 UserWarning Error loading repository location software defined assets py dagster core errors DagsterInvalidDefinitionError Input asset sfo q2 weather sample for asset daily temperature highs is not produced by any of the provided asset ops and is not one of the provided sources Stack Trace File opt dagster behold pipelines env lib python3 7 site packages dagster grpc server py line 227 in init self container image File opt dagster behold pipelines env lib python3 7 site packages dagster grpc server py line 103 in init loadable target origin attribute File opt dagster behold pipelines env lib python3 7 site packages dagster grpc utils py line 33 in get loadable targets else loadable targets from python file python file working directory File opt dagster behold pipelines env lib python3 7 site packages dagster core workspace autodiscovery py line 26 in loadable targets from python file loaded module = load python file python file working directory File opt dagster behold pipelines env lib python3 7 site packages dagster core code pointer py line 86 in load python file return import module from path module name python file File opt dagster behold pipelines env lib python3 7 site packages dagster seven init py line 50 in import module from path spec loader exec module module File lt frozen importlib bootstrap external gt line 728 in exec module File lt frozen importlib bootstrap gt line 219 in call with frames removed File software defined assets py line 48 in lt module gt repository```

George Pearse · Answer

And literally copying the example file for file for the spark weather assets demo I get ```ld pipelines env lib python3 7 site packages dagster core workspace context py 556 UserWarning Error loading repository location repo py dagster core errors DagsterInvalidDefinitionError Bad return value from repository construction function all elements of list must be of type JobDefinition GraphDefinition PipelineDefinition PartitionSetDefinition ScheduleDefinition SensorDefinition AssetsDefinition or SourceAsset Got value of type lt class list gt at index 0 Stack Trace File opt dagster behold pipelines env lib python3 7 site packages dagster grpc server py line 227 in init self container image File opt dagster behold pipelines env lib python3 7 site packages dagster grpc server py line 103 in init loadable target origin attribute File opt dagster behold pipelines env lib python3 7 site packages dagster grpc utils py line 33 in get loadable targets else loadable targets from python file python file working directory File opt dagster behold pipelines env lib python3 7 site packages dagster core workspace autodiscovery py line 26 in loadable targets from python file loaded module = load python file python file working directory File opt dagster behold pipelines env lib python3 7 site packages dagster core code pointer py line 86 in load python file return import module from path module name python file File opt dagster behold pipelines env lib python3 7 site packages dagster seven init py line 50 in import module from path spec loader exec module module File lt frozen importlib bootstrap external gt line 728 in exec module File lt frozen importlib bootstrap gt line 219 in call with frames removed File software defined assets repo py line 6 in lt module gt repository File opt dagster behold pipelines env lib python3 7 site packages dagster core definitions decorators repository decorator py line 258 in repository return Repository name File opt dagster behold pipelines env lib python3 7 site packages dagster core definitions decorators repository decorator py line 69 in call Bad return value from repository construction function all elements of list location name=location name error string=error to string 2022 06 22 16 21 49 +0000 dagit INFO Serving dagit on <http 127 0 0 1 4000> in process 1024118```

sandy · Answer

Yikes Iooks like there s an error there This should fix it add the ` ` ``` repository def software defined assets return spark weather assets ```