https://dagster.io/ logo
Title
c

chrispc

08/18/2021, 3:58 PM
Hi team. I am seeing something very weird running backfills. It is normal to have success execution with a critical error? I am running it in red hat REHL 7 server. @daniel hi, I am getting troubles with grpc in linux as well but this error is different. It is looking a path of local windows computer in the linux server how is that posible? (The big deal is this is a hidden error because dagit said the execution is success)
FileNotFoundError: [WinError 2] The system cannot find the file specified
File "C:\Users\***\Anaconda3\envs\borrar\lib\site-packages\dagster\core\host_representation\grpc_server_registry.py", line 177, in _get_grpc_endpoint
server_process = GrpcServerProcess(
File "C:\Users\****\Anaconda3\envs\borrar\lib\site-packages\dagster\grpc\server.py", line 1060, in __init__
self.server_process, self.port = open_server_process_on_dynamic_port(
File "C:\Users\****\Anaconda3\envs\borrar\lib\site-packages\dagster\grpc\server.py", line 1011, in open_server_process_on_dynamic_port
server_process = open_server_process(
File "C:\Users\****\Anaconda3\envs\borrar\lib\site-packages\dagster\grpc\server.py", line 978, in open_server_process
server_process = open_ipc_subprocess(subprocess_args)
File "C:\Users\*****\Anaconda3\envs\borrar\lib\site-packages\dagster\serdes\ipc.py", line 195, in open_ipc_subprocess
return subprocess.Popen(parts, creationflags=creationflags, **kwargs)
File "C:\Users\*****\Anaconda3\envs\borrar\lib\subprocess.py", line 858, in __init__
self._execute_child(args, executable, preexec_fn, close_fds,
File "C:\Users\s4957336\Anaconda3\envs\borrar\lib\subprocess.py", line 1311, in _execute_child
hp, ht, pid, tid = _winapi.CreateProcess(executable, args,
this is even worse
d

daniel

08/18/2021, 4:17 PM
Hey, are you totally sure that you are only running a single daemon? The only reason I can think of for the same run failing and succeeding at the same time would be if two different daemons were launching it simultaneously
c

chrispc

08/18/2021, 4:24 PM
it is weird @daniel because this is in the server so I have the daemon running in the server. One colleague is working in a branch other pipeline in his machine, he just told me he is seeing (daemon logs) in his daemon the processes that are being executed in the server. So how is possible that Dagit in the server is communicating whit others local daemon? How can I block this communication? I was guessing that Dagit only can communicate with the daemon running in the same enviroment.
is it something related with the VPN we use in the company? I am lost here
d

daniel

08/18/2021, 5:08 PM
Do you have two users hitting the same instance / database?
the way that dagit tells the daemon to launch a run is by adding a run to the db. the daemon than reads it off of the DB and updates it to be running. So the only way for your dagit to communicate with another person's daemon is if you're sharing the DB
c

chrispc

08/18/2021, 5:41 PM
@daniel thank you! that was the reason. But should it raise a error? I mean, talking about the inconsistencies in the images
d

daniel

08/18/2021, 5:42 PM
The daemon output should raise a warning when it detects that another daemon may be running at the same time
1