@prha and I are discussing of an approach that does not need to restart dagit and modify workspace.yml for adding new python files or packages.
I tried pointing workspace.yml to a file and in that file importing others as bellows:
from hello_dagster import *
However it fails: