https://dagster.io/ logo
#ask-community
Title
# ask-community
m

Marc Keeling

12/21/2021, 6:33 PM
I was wondering what the reason for the history, runs, schedules, and storage folders being stored like this are (see attached) Shouldn't the folder names just be "history", "schedules", etc. without the prefix that they have? It looks like the back-slashes in the folder path should be forward-slashes. How do I make it so that the folder have the normal correct name?
o

owen

12/21/2021, 6:56 PM
hi @Marc Keeling, this is pretty weird -- under the hood the paths are created using (e.g.)
os.path.join(base, "schedules")
, where
base
is by default the value of the
DAGSTER_HOME
environment variable. I'm assuming you're on a windows machine, and using something like WSL for your terminal? If so, this might be the source of the issues, where python recognizes you're on a windows machine, and so these functions create Windows-type paths, but when commands are actually run, they're being run as if they're unix commands.
🙏 1
m

Marc Keeling

12/21/2021, 7:07 PM
Thanks for your quick response @owen! I developed on windows but the code is running on ubuntu Here is a screen shot of the DAGSTER_HOME environment var and os info. Is there specific way/deployment step I might be missing?
o

owen

12/21/2021, 7:25 PM
oh that's especially strange in that case -- do you mind sharing the contents of your dagster.yaml file? I'm wondering if a windows directory name got baked into that somehow
m

Marc Keeling

12/21/2021, 7:27 PM
That's probably it. I have the base_dir hard coded as 'base_dir: C:\Users\marc.keeling\Development\reports_python_auto\python_reports_dagster' Do I just need to switch all the "\" to "/"?
o

owen

12/21/2021, 7:30 PM
I think you should actually be able to delete basically all of this without issue. It looks like all of these are the default classes that Dagster will use if nothing is specified, and without base_dir being explicitly set to some value, it will default to the $DAGSTER_HOME directory, which seems like what you want.
👏 1
m

Marc Keeling

12/21/2021, 7:31 PM
Awesome! Thank you @owen!
o

owen

12/21/2021, 7:31 PM
no problem 🙂
2 Views