I was wondering what the reason for the history, runs, schedules, and storage folders being stored like this are (see attached) Shouldn't the folder names just be "history", "schedules", etc. without the prefix that they have? It looks like the back-slashes in the folder path should be forward-slashes. How do I make it so that the folder have the normal correct name?

hi @Marc Keeling, this is pretty weird -- under the hood the paths are created using (e.g.)

os.path.join(base, "schedules")

, where

base

is by default the value of the

DAGSTER_HOME

environment variable. I'm assuming you're on a windows machine, and using something like WSL for your terminal? If so, this might be the source of the issues, where python recognizes you're on a windows machine, and so these functions create Windows-type paths, but when commands are actually run, they're being run as if they're unix commands.

Thanks for your quick response @owen! I developed on windows but the code is running on ubuntu Here is a screen shot of the DAGSTER_HOME environment var and os info. Is there specific way/deployment step I might be missing?

oh that's especially strange in that case -- do you mind sharing the contents of your dagster.yaml file? I'm wondering if a windows directory name got baked into that somehow

That's probably it. I have the base_dir hard coded as 'base_dir: C:\Users\marc.keeling\Development\reports_python_auto\python_reports_dagster' Do I just need to switch all the "\" to "/"?

I think you should actually be able to delete basically all of this without issue. It looks like all of these are the default classes that Dagster will use if nothing is specified, and without base_dir being explicitly set to some value, it will default to the $DAGSTER_HOME directory, which seems like what you want.

Awesome! Thank you @owen!

no problem 🙂