https://dagster.io/ logo
#ask-community
Title
# ask-community
a

Aned Esquerra Arguelles

02/08/2024, 6:10 PM
Hello team! I'm facing unwanted behavior from Dagster Webserver when doing development on EC2: In one of the assets I'm using an object, when I tried to materialise the asset containing the object dagster goes unresponsive and EC2 crashes! Any help or documentation? Thanks in advance!
a

Alejandro A

02/08/2024, 7:38 PM
Are there any logs you can share?
b

Brendan Jackson

02/08/2024, 7:39 PM
Are you materialising this asset using the same machine as the dagster server?
It sounds suspiciously like it's running out of memory.
a

Aned Esquerra Arguelles

02/08/2024, 7:43 PM
yes I'm running everything in an EC2 instance!
i

Ion Koutsouris

02/08/2024, 10:59 PM
Pandas is not really known for its Memory efficiency, so maybe keep an eye on resource consumptiom
a

Alejandro A

02/09/2024, 8:53 AM
That's also a good point, is there any way you can try with a smaller dataframe (do something like df.head(100)) or monitor the resources of the EC2? I believe if you are getting an OOM error it'd be also logged somewhere in AWS console