I am trying to run the dagster hoolie example but observe st

Question

I am trying to run the dagster hoolie example but observe strange parsing errors when DBT is used for 1 3 0 dagster ```dagster core errors DagsterSubprocessError During multiprocess execution errors occurred in child processes In process 86457 json decoder JSONDecodeError Expecting value line 1 column 1 char 0 Stack Trace File demeetup lib python3 10 site packages dagster core executor child process executor py line 79 in execute command in child process for step event in command execute File demeetup lib python3 10 site packages dagster core executor multiprocess py line 72 in execute execution plan = create execution plan File demeetup lib python3 10 site packages dagster core execution api py line 759 in create execution plan pipeline def = pipeline get definition File demeetup lib python3 10 site packages dagster core definitions reconstruct py line 238 in get definition return self repository get definition get maybe subset job def File demeetup lib python3 10 site packages dagster core definitions reconstruct py line 117 in get definition return repository def from pointer self pointer self repository load data File demeetup lib python3 10 site packages dagster core definitions reconstruct py line 789 in repository def from pointer target = def from pointer pointer File demeetup lib python3 10 site packages dagster core definitions reconstruct py line 679 in def from pointer target = pointer load target File demeetup lib python3 10 site packages dagster core code pointer py line 221 in load target module = load python module self module self working directory File demeetup lib python3 10 site packages dagster core code pointer py line 135 in load python module return importlib import module module name File demeetup lib python3 10 importlib init py line 126 in import module return bootstrap gcd import name level package level File lt frozen importlib bootstrap gt line 1050 in gcd import File lt frozen importlib bootstrap gt line 1027 in find and load File lt frozen importlib bootstrap gt line 1006 in find and load unlocked File lt frozen importlib bootstrap gt line 688 in load unlocked File lt frozen importlib bootstrap external gt line 883 in exec module File lt frozen importlib bootstrap gt line 241 in call with frames removed File de meetup pipelines hooli data eng pipelines hooli data eng init py line 1 in lt module gt from definitions import defs File de meetup pipelines hooli data eng pipelines hooli data eng definitions py line 5 in lt module gt from hooli data eng assets import forecasting raw data marketing dbt assets File de meetup pipelines hooli data eng pipelines hooli data eng assets dbt assets py line 76 in lt module gt daily dbt assets = load assets from dbt project File demeetup lib python3 10 site packages dagster dbt asset defs py line 505 in load assets from dbt project manifest json cli output = load manifest for project File demeetup lib python3 10 site packages dagster dbt asset defs py line 94 in load manifest for project return json load f cli output File demeetup lib python3 10 json init py line 293 in load return loads fp read File demeetup lib python3 10 json init py line 346 in loads return default decoder decode s File demeetup lib python3 10 json decoder py line 337 in decode obj end = self raw decode s idx= w s 0 end File demeetup lib python3 10 json decoder py line 355 in raw decode raise JSONDecodeError Expecting value s err value from None The above exception occurred during handling of the following exception StopIteration 0 Stack Trace File demeetup lib python3 10 json decoder py line 353 in raw decode obj end = self scan once s idx ```

geoHeil · Answer

< Sean Lopp> is this a version mismatch of the latest dagster in dagster hooli

geoHeil · Answer

Or is this intentional to showcase some flakiness At least it is unclear to me

geoHeil · Answer

I am not sure if the dynamic partitions are discovered correctly at least I had to hand set them and they were not automatically derived from the sku stats

geoHeil · Answer

The outputted key product deepdive assets are some binary file at least when simply choosing foo as the name I thought that a jupyter notebook would be outputted there as well

geoHeil · Answer

it is pickled but for the hex resource I was expecting to see the notebook somewhere Is it intentional that the result is only a pickled pandas data frame

Sean Lopp · Answer

Thanks for trying this out Georg The JSON decode error is unexpected I will take a look to see if I can reproduce with the latest 1 3 0 release The dynamic partitions inside the project are currently a bit contrived the idea is to show how you can create dynamic partitions through the UI if for example you had an executive request to look into a specific SKU The expected output currently is a pickled file and the metadata is shown for the materialized partition which is quite nice The hex label is there because we use that pickle file as the input to a simple hex notebook but the hex notebook is not part of the hooli project There is a separate asset that shows an integrated Jupyter notebook If we wanted to automatically create dynamic partitions based on the upstream data we d need to add in a sensor that yields `SensorResults` with `dynamic partition requests` when it finds new partitions in the data