[07:01:15] hello people [07:01:35] I see thumbor1001 and ms-be1034 down, going to check them [07:04:13] so thumbor1001 is not pooled, maybe already in maintenance mode [07:05:17] mmm not really, anyway I am going to powercycle [07:12:47] ms-be1034 is powered down, since the 10th at around 19:30 UTC [07:13:27] but I don't see anything on the sal [07:19:15] effie: o/ I see from SAL that you did maintenance for thumbor100x recently, I am leaving 1001 depooled for the moment and will let serviceops handle it [07:19:41] for ms-be1034 I'd be inclined to wait for godog [07:19:48] (since it is powered off) [08:09:09] elukey: I don't know offhand why ms-be1034 would be powered off, I'll power it back on [08:10:36] godog: perfect! I didn't find anything in the hp logs that justified a powerdown, but I have to admit that the syslogs in the serial console are not that friendly [08:12:07] headsup: I'm rebooting bast3005 (currently noone's using it) [08:12:37] elukey: ok! yeah not the best, I wonder what happened [08:12:51] nvm, actually quite a few people, gonna ping people individually [08:29:26] bast3005 is back up [09:54:50] worth a look: https://github.com/satwikkansal/wtfpython [09:56:05] eheheh a classic [12:35:30] something seems up with apertium [12:36:16] anybody working on it? [12:36:39] akosiaris: --^ [12:36:50] yup, that's me [12:37:07] ahhh okok [12:37:19] I tried to check https://grafana.wikimedia.org/d/SPDbjWJMz/apertium but didn't see metrics :( [12:38:08] I 'd be surprised if you did, it doesn't report anything :-( [12:38:20] Even the saturation is because we get it from our infra. [12:38:33] But now that we are behind envoy, maybe we can get it through that [12:45:07] okok perfect, thanks :) [16:39:55] apergos: would like to review https://gerrit.wikimedia.org/r/c/operations/puppet/+/663603 ? [16:40:51] I don't need to, bstorm and arturo are already on it, and it's the public facing servers i.e. theirs [16:40:56] thank you for asking [16:41:12] er, sorry to cite you in your own question, thought someone else asked [16:41:19] :-) [16:41:24] anyways no I trust your judgment on this one :-) [16:41:46] ok, merging [17:23:41] jbond42: do you know if https://gerrit.wikimedia.org/r/c/operations/software/puppet-compiler/+/661278/ is deployed on the puppet compiler nodes? [17:31:01] andrewbogott: yes it should be, if not can you drop me an email and ill check it tomorrow [17:31:10] great, thanks! [17:31:17] I was just wondering if I could close the bug :) [17:31:49] yues it shold have been deployed when i added the `Hosts: cumin:` addition [19:44:53] when you login at idp.wikimedia.org to get into icinga.wikimedia.org and check the "remember me" box.. what would be an expected kind of time frame until I have to login again? [19:45:19] it seems pretty short, or is it me [19:45:41] felt like lately i keep having to relogin [19:46:44] mutante: maybe https://phabricator.wikimedia.org/T273867 [19:48:58] XioNoX: ah, could be,thanks [19:49:13] no, that has been fixed/reverted [19:49:41] see https://wikitech.wikimedia.org/wiki/CAS-SSO and https://wikitech.wikimedia.org/wiki/CAS-SSO/Administration for a more indepth view [19:50:17] and the session is currently bound to your IP, if it changes you need to relogin [19:51:41] ACK, thanks, that could also explain it, using mobile hotspot [19:52:18] the part on session timeout handling seems relevant.. yep