https://dagster.io/ logo
Powered by
c

Chris Roth

04/18/2020, 12:31 AM
getting 
dagster.core.errors.DagsterLaunchFailedError: Host <http://localhost:3000> failed sanity check. It is not a dagit server.
after upgrading to 0.7.7
s

sashank

04/18/2020, 12:33 AM
You need to be running dagit if you’re using the 
RemoteDagitRunLauncher
c

Chris Roth

04/18/2020, 12:33 AM
yeah it's running
s

sashank

04/18/2020, 12:34 AM
And it’s running on :3000 not :3333 right
c

Chris Roth

04/18/2020, 12:34 AM
right
s

sashank

04/18/2020, 12:34 AM
Hmm trying to repro
c

Chris Roth

04/18/2020, 12:35 AM
it seems like clicking "launch execution" might be crashing something - it becomes unresponsive right after i click that, eg if i try refreshing the page, it sort of takes a minute to load
but i don't see anything in the logs
also noticing it takes longer to boot up than before
m

max

04/18/2020, 12:40 AM
@Chris Roth did you run 
dagster instance migrate
?
c

Chris Roth

04/18/2020, 12:40 AM
yep
s

sashank

04/18/2020, 12:43 AM
Was able to repro - thanks for catching this. Taking a look at the fix
c

Chris Roth

04/18/2020, 12:43 AM
cool! thank you for taking a look and glad it's not just my imagination 😛
hm also getting 
alembic.script.revision.ResolutionError: No such revision or branch
after reverting back to 0.7.6
looks migration related
still in the staging phase with this thing, so could just delete the dagster db and re-create it if needed
is it possible to reverse a migration?
s

sashank

04/18/2020, 12:59 AM
cc @max, @prha
c

Chris Roth

04/18/2020, 1:07 AM
something weird is going on here - i downgraded to 0.7.6 and started with a fresh database but still getting the error
p

prha

04/18/2020, 1:30 AM
@Chris Roth just to confirm, you’re configuring the 
RemoteDagitRunLauncher
on dagit to launch runs against itself?
c

Chris Roth

04/18/2020, 1:31 AM
yeah. i'm actually having some weird issue that makes me think it might be an issue on my end - gimme a min to debug
p

prha

04/18/2020, 1:31 AM
I can definitely repro, though
just not 100% positive if this is a new breakage or an old breakage, because I haven’t run through this flow before
c

Chris Roth

04/18/2020, 1:32 AM
i thought maybe it could be that one of my env variables changed but just confirmed that it's not that either
it smells like sub-dependency version issue to me
because nothing else has changed
is it possible that a minor version didn't get pinned down somewhere in pip or npm and maybe that is causing it?
p

prha

04/18/2020, 1:35 AM
yes, definitely… we tend not to pin versions because we can’t predict what requirements folks downstream will have
c

Chris Roth

04/18/2020, 1:35 AM
makes sense
hm
p

prha

04/18/2020, 1:37 AM
yeah, we don’t have a test at the moment for this specific flow
c

Chris Roth

04/18/2020, 1:38 AM
i think i found the issue
yesterday i added:
Copy code
dagit:
  execution_manager:
    disabled: True
    max_concurrent_runs: 25
when i remove that from dagster.yaml it fixes it!
p

prha

04/18/2020, 1:39 AM
interesting
c

Chris Roth

04/18/2020, 1:41 AM
actually, this kind of makes sense, i guess
it's specifically the 
disabled: True
line
p

prha

04/18/2020, 1:41 AM
hmm, and this is on 
0.7.6
?
c

Chris Roth

04/18/2020, 1:42 AM
0.7.6 and 0.7.7
the docs say 
# whether dagit can run pipelines in a sub process
this makes sense though - maybe this is not a bug
p

prha

04/18/2020, 1:43 AM
right…. having that disabled will remove the 
Start Execution
option from dagit
c

Chris Roth

04/18/2020, 1:43 AM
damn, i feel stupid
hah
p

prha

04/18/2020, 1:44 AM
well, I can still repro on 0.7.7 without the disabled flag, so I’ll keep digging in, but good to know that you can work around it
Just for curiosity’s sake… what’s the main purpose of launching vs starting an execution on the local dagit
c

Chris Roth

04/18/2020, 1:46 AM
yeah the fact that you can reproduce is curious
i'm launching via celery workers for the most part
but on local machine finding it easier to work when they just run on the dagit instance
p

prha

04/18/2020, 1:51 AM
got it
s

sashank

04/18/2020, 1:52 AM
@Chris Roth if you click on this dropdown you can switch over to 
Start Execution
You don’t want to be using the 
RemoteDagitRunLauncher
when executing in Dagit locally
c

Chris Roth

04/18/2020, 2:00 AM
cool, i think we're good then
sorry about the confusion here
and also thank you guys again for all the help, you are amazing
can't believe how hard you guys work
❤️ 1
p

prha

04/18/2020, 2:02 AM
aw shucks
btw, it’s totally fine to have the remote dagit run launcher configured
but i don’t think it will work to actually launch runs against itself
as long as the 
disabled
flag is not on, you should have the option of starting, rather than launching
c

Chris Roth

04/18/2020, 2:09 AM
yeah the only reason i have it enabled is for launching pipelines from another pipeline haha
🦜 1
m

max

04/18/2020, 3:13 AM
that's very cool
i would love to hear more about that
Powered by