As per the documentation, I'm supposed to find conf files at /opt/dagster, but there is nothing there.

You need to create the file. You should follow the tutorial section of docs.