Muthu
04/14/2020, 9:39 PMModuleNotFoundError: No module named 'dagster.serdes'
Muthu
04/14/2020, 9:40 PMMuthu
04/14/2020, 9:45 PMDAGSTER_HOME=/opt/dc/workflow_engine/app /Users/muthu/miniconda3/envs/workflow/bin/dagit -f <http://dcpipes.py|dcpipes.py> -n define_repo -h 0.0.0.0 -p 3000
Traceback (most recent call last):
File "/Users/muthu/miniconda3/envs/workflow/lib/python3.6/site-packages/dagster/core/serdes/__init__.py", line 185, in rehydrate
module = importlib.import_module(self.module_name)
File "/Users/muthu/miniconda3/envs/workflow/lib/python3.6/importlib/__init__.py", line 126, in import_module
return _bootstrap._gcd_import(name[level:], package, level)
File "<frozen importlib._bootstrap>", line 994, in _gcd_import
File "<frozen importlib._bootstrap>", line 971, in _find_and_load
File "<frozen importlib._bootstrap>", line 941, in _find_and_load_unlocked
File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
File "<frozen importlib._bootstrap>", line 994, in _gcd_import
File "<frozen importlib._bootstrap>", line 971, in _find_and_load
File "<frozen importlib._bootstrap>", line 955, in _find_and_load_unlocked
File "<frozen importlib._bootstrap>", line 665, in _load_unlocked
File "<frozen importlib._bootstrap_external>", line 678, in exec_module
File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
File "/Users/muthu/miniconda3/envs/workflow/lib/python3.6/site-packages/dagster_postgres/__init__.py", line 1, in <module>
from .event_log import PostgresEventLogStorage
File "/Users/muthu/miniconda3/envs/workflow/lib/python3.6/site-packages/dagster_postgres/event_log/__init__.py", line 1, in <module>
from .event_log import PostgresEventLogStorage
File "/Users/muthu/miniconda3/envs/workflow/lib/python3.6/site-packages/dagster_postgres/event_log/event_<http://log.py|log.py>", line 17, in <module>
from dagster.serdes import (
ModuleNotFoundError: No module named 'dagster.serdes'
During handling of the above exception, another exception occurred:
Chris Roth
04/14/2020, 9:47 PMMuthu
04/14/2020, 10:21 PMJohn Mav
04/15/2020, 4:09 PMroot:/opt/dagster/app# crontab -l
* * * * * /var/shared/dagster/schedules/scripts/Repo.test_run.sh # dagster-schedule: Repo.test_run
I’m wondering what I am missing here so that turning “on” the schedule actually runs the job?Chris Roth
04/16/2020, 5:52 PMChris Roth
04/16/2020, 6:00 PMChris Roth
04/16/2020, 6:00 PMChris Roth
04/16/2020, 6:03 PMChris Roth
04/16/2020, 7:17 PMChris Roth
04/16/2020, 8:18 PMChris Roth
04/16/2020, 10:03 PMuser
04/17/2020, 5:44 AMmax
04/17/2020, 5:49 AMTobias Macey
04/17/2020, 5:36 PMdict
type?Chris Roth
04/17/2020, 11:19 PMYou're running the worker with superuser privileges
in docker. celery accepts --uid
option but not docker-celery
Chris Roth
04/18/2020, 12:31 AMdagster.core.errors.DagsterLaunchFailedError: Host <http://localhost:3000> failed sanity check. It is not a dagit server.
after upgrading to 0.7.7Binh Pham
04/20/2020, 5:32 PMChris Roth
04/21/2020, 3:16 PMChris Roth
04/21/2020, 3:17 PM#!/bin/sh
# See: <https://unix.stackexchange.com/a/453053> - fixes inflated hard link count
touch /etc/crontab /etc/cron.*/*
service cron start
# Migrate dagster Postgres database
dagster instance migrate
# Add all schedules
dagster schedule up
# Restart previously running schedules
dagster schedule restart --restart-all-running
dagit -h 0.0.0.0 -p 3000
Chris Roth
04/21/2020, 3:18 PMTobias Macey
04/21/2020, 4:34 PMChris Roth
04/21/2020, 6:13 PMChris Roth
04/21/2020, 7:16 PMRes Dev
04/21/2020, 8:21 PMRes Dev
04/21/2020, 8:37 PMRes Dev
04/21/2020, 8:38 PMRes Dev
04/21/2020, 8:38 PMRomain
04/22/2020, 10:49 AM