[00:40:53] PROBLEM - wikidata.org dispatch lag is REALLY high ---4000s- on www.wikidata.org is CRITICAL: CRITICAL - Socket timeout after 10 seconds https://phabricator.wikimedia.org/project/view/71/ [01:37:05] we can ignore that :) [01:37:23] I mean, it's not wrong. [01:37:26] But yeah. [01:39:41] hehe [01:39:47] James_F: it is actually :P [01:40:00] dispatch lag is fine :P v [01:40:00] https://grafana.wikimedia.org/d/000000156/wikidata-dispatch?refresh=1m&orgId=1 [01:40:34] Icinga is indeed timing out. [09:06:56] <[1997kB]> BRPever: https://www.wikidata.org/wiki/Special:Contributions/162.220.59.66 [09:07:40] <[1997kB]> its xwiki, but now they are on wikidata [09:07:42] Hey १९९७ ;) [09:08:25] <[1997kB]> o/ : P [09:08:57] It's an LTA right? [09:09:02] <[1997kB]> yeah [09:09:16] <[1997kB]> had been already reported at SRG [09:12:55] <[1997kB]> moved to fiwiki now :P [12:09:13] * Nemo_bis hates https://en.wikipedia.org/wiki/User:Galobtter/Shortdesc_helper intensely [14:36:00] addshore, James_F: : is the icinga dispatch lag problem still ongoing? I don’t see a RECOVERY message in the logs [14:36:28] (actual lag still seems fine according to grafana, but having a broken alert doesn’t sound good) [14:49:02] [#ops] hi! is that possible that an IP would be denied any http request to Wikimedia servers? my http GET requests to Wikidata or Wikipedia fail from a server with IP 51.15.132.125. I suspect the problem is internal to my VPS provider, but if there was a way to rule out the hypothesis that the problem comes from Wikimedia infrastructures, that would be really helpful :) [14:49:59] Yes [14:51:49] IP was blocked a year ago https://meta.wikimedia.org/wiki/Special:GlobalBlockList?ip=51.15.132.125 [14:52:00] but I would have thought that only affects edits, not GET requests… [14:52:01] Well, that's a slightly different issue :P [14:56:42] * maxlath[m] sent a long message: < https://matrix.org/_matrix/media/v1/download/matrix.org/esdVTEKZNDrlucDgeDsVIUiD > [16:18:11] the insident seems to finally be over, nevermind (unless you know why it's over, I'm interested ^^) [16:21:26] There's been a few issues... There should be some public communications about it later on today [16:26:57] Reedy: which channel should I follow to read it? [16:27:08] It'll be posted to wikitech-l [16:38:21] ok, thanks