Xu Zhang
08/25/2021, 12:24 AM@op
and @graph
, my GRPC server in staging box no longer works
OSError: [Errno 30] Read-only file system: '/export/content/lid/apps/dagster-web'
File "/export/content/lid/apps/meeseeks-backend-dagster-grpc-server/i001/libexec/meeseeks-backend_015263caabc6969a26157a73f5dcbb71f6e53ea18d1e4d986685ee6b374c9871/site-packages/dagster/core/execution/plan/execute_plan.py", line 193, in _dagster_event_sequence_for_step
for step_event in check.generator(step_events):
File "/export/content/lid/apps/meeseeks-backend-dagster-grpc-server/i001/libexec/meeseeks-backend_015263caabc6969a26157a73f5dcbb71f6e53ea18d1e4d986685ee6b374c9871/site-packages/dagster/core/execution/plan/execute_step.py", line 326, in core_dagster_event_sequence_for_step
for evt in _type_check_and_store_output(step_context, user_event, input_lineage):
File "/export/content/lid/apps/meeseeks-backend-dagster-grpc-server/i001/libexec/meeseeks-backend_015263caabc6969a26157a73f5dcbb71f6e53ea18d1e4d986685ee6b374c9871/site-packages/dagster/core/execution/plan/execute_step.py", line 380, in _type_check_and_store_output
for evt in _store_output(step_context, step_output_handle, output, input_lineage):
File "/export/content/lid/apps/meeseeks-backend-dagster-grpc-server/i001/libexec/meeseeks-backend_015263caabc6969a26157a73f5dcbb71f6e53ea18d1e4d986685ee6b374c9871/site-packages/dagster/core/execution/plan/execute_step.py", line 490, in _store_output
handle_output_res = output_manager.handle_output(output_context, output.value)
File "/export/content/lid/apps/meeseeks-backend-dagster-grpc-server/i001/libexec/meeseeks-backend_015263caabc6969a26157a73f5dcbb71f6e53ea18d1e4d986685ee6b374c9871/site-packages/dagster/core/storage/fs_io_manager.py", line 119, in handle_output
mkdir_p(os.path.dirname(filepath))
File "/export/content/lid/apps/meeseeks-backend-dagster-grpc-server/i001/libexec/meeseeks-backend_015263caabc6969a26157a73f5dcbb71f6e53ea18d1e4d986685ee6b374c9871/site-packages/dagster/utils/__init__.py", line 150, in mkdir_p
os.makedirs(path)
File "/export/apps/python/3.7/lib/python3.7/os.py", line 213, in makedirs
makedirs(head, exist_ok=exist_ok)
File "/export/apps/python/3.7/lib/python3.7/os.py", line 213, in makedirs
makedirs(head, exist_ok=exist_ok)
File "/export/apps/python/3.7/lib/python3.7/os.py", line 213, in makedirs
makedirs(head, exist_ok=exist_ok)
[Previous line repeated 4 more times]
File "/export/apps/python/3.7/lib/python3.7/os.py", line 223, in makedirs
mkdir(name, mode)
/export/content/lid/apps/dagster-web
is the HOME of the Dagit, which is on host `A`;
the grpc server is running on the host B
, which only has the access to /export/content/lid/apps/meeseeks-backend-dagster-grpc-server
; and it was trying to create a folder under dagster-web
, which it does not have access to.
@daniel helped me previously by asking me to remove the local compute log manager, thus I switched to NoOpComputeLogManager
, which works perfectly.
I have no idea why switching from @solid
to @op
would causing grpc server to behave differently.sandy
08/25/2021, 3:16 AMchris
08/25/2021, 3:16 AMsandy
08/25/2021, 3:17 AMXu Zhang
08/25/2021, 4:12 AMresource_defs (Optional[Dict[str, ResourceDefinition]]) – Resources that are required by this graph for execution. If not defined, io_manager will default to filesystem.
sandy
08/25/2021, 6:31 AM<http://my_graph.to|my_graph.to>_job(resource_defs={"io_manager": mem_io_manager}, executor_def=in_process_executor)
Xu Zhang
08/25/2021, 3:08 PMsandy
08/25/2021, 6:12 PM