Hey team, I've run into the following error when t...
# announcements
r
Hey team, I've run into the following error when trying to run a pipeline after deploying with docker-compose:
Copy code
Traceback (most recent call last):
  File "/usr/local/bin/dagster", line 8, in <module>
    sys.exit(main())
  File "/usr/local/lib/python3.8/site-packages/dagster/cli/__init__.py", line 41, in main
    cli(auto_envvar_prefix=ENV_PREFIX)  # pylint:disable=E1123
  File "/usr/local/lib/python3.8/site-packages/click/core.py", line 829, in __call__
    return self.main(*args, **kwargs)
  File "/usr/local/lib/python3.8/site-packages/click/core.py", line 782, in main
    rv = self.invoke(ctx)
  File "/usr/local/lib/python3.8/site-packages/click/core.py", line 1259, in invoke
    return _process_result(sub_ctx.command.invoke(sub_ctx))
  File "/usr/local/lib/python3.8/site-packages/click/core.py", line 1259, in invoke
    return _process_result(sub_ctx.command.invoke(sub_ctx))
  File "/usr/local/lib/python3.8/site-packages/click/core.py", line 1066, in invoke
    return ctx.invoke(self.callback, **ctx.params)
  File "/usr/local/lib/python3.8/site-packages/click/core.py", line 610, in invoke
    return callback(*args, **kwargs)
  File "/usr/local/lib/python3.8/site-packages/dagster/cli/api.py", line 86, in execute_run_with_structured_logs_command
    DagsterInstance.from_ref(args.instance_ref) if args.instance_ref else DagsterInstance.get()
  File "/usr/local/lib/python3.8/site-packages/dagster/core/instance/__init__.py", line 311, in from_ref
    run_storage=instance_ref.run_storage,
  File "/usr/local/lib/python3.8/site-packages/dagster/core/instance/ref.py", line 196, in run_storage
    return self.run_storage_data.rehydrate()
  File "/usr/local/lib/python3.8/site-packages/dagster/serdes/__init__.py", line 342, in rehydrate
    module = importlib.import_module(self.module_name)
  File "/usr/local/lib/python3.8/importlib/__init__.py", line 127, in import_module
    return _bootstrap._gcd_import(name[level:], package, level)
  File "<frozen importlib._bootstrap>", line 1014, in _gcd_import
  File "<frozen importlib._bootstrap>", line 991, in _find_and_load
  File "<frozen importlib._bootstrap>", line 961, in _find_and_load_unlocked
  File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
  File "<frozen importlib._bootstrap>", line 1014, in _gcd_import
  File "<frozen importlib._bootstrap>", line 991, in _find_and_load
  File "<frozen importlib._bootstrap>", line 975, in _find_and_load_unlocked
  File "<frozen importlib._bootstrap>", line 671, in _load_unlocked
  File "<frozen importlib._bootstrap_external>", line 783, in exec_module
  File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
  File "/usr/local/lib/python3.8/site-packages/dagster_postgres/__init__.py", line 4, in <module>
    from .run_storage import PostgresRunStorage
  File "/usr/local/lib/python3.8/site-packages/dagster_postgres/run_storage/__init__.py", line 1, in <module>
    from .run_storage import PostgresRunStorage
  File "/usr/local/lib/python3.8/site-packages/dagster_postgres/run_storage/run_storage.py", line 3, in <module>
    from dagster.core.storage.runs import DaemonHeartbeatsTable, RunStorageSqlMetadata, SqlRunStorage
ImportError: cannot import name 'DaemonHeartbeatsTable' from 'dagster.core.storage.runs' (/usr/local/lib/python3.8/site-packages/dagster/core/storage/runs/__init__.py)
I've followed the deploy docker example and the only difference is the docker_example pipelines dockerfile (where I use my own app). All the containers are up and running but the error rises when a new container is spawned after trying to run a pipeline. Anybody knows why does this happen? Edit: The log error comes from the spawned container (which stops immediately)
d
Hi Ruben - this error looks like the dagster_postgres package is running in a newer version (0.10.x) than the dagster package (0.9.x). Is it possible to check if they’re in sync? If you post your changed Dockerfile we can take a closer look.
r
Ill have a look at this and will come back to you when I test it ^^
By the way, why do you guess that the issue may be that? Can I look at some documentation or anything so I can get a better understanding? Because I am unable to connect the dots at the moment
d
I see it complaining about a class not existing (DaemonHeartbeatsTable) that was added to the dagster package in the 0.10.0 release, which makes me conclude that it must be running an old version of the dagster package
r
thanks Daniel, I will get back to you later
Ok it was JUST that haha, you made my day Daniel, I've been fighting with my docker files for like 4 hours and I didn't understand anything. I was using 0.9.22 for dagster and 0.10.6 for dagster-postgres (the reason was I copied the dockerfile from the tutorial that installs 0.10 but in my requirements dagster was installed with 0.9.22)
thanks a lot really!
condagster 1