[00:23:19] PROBLEM - App Server Main HTTP Response on deployment-mediawiki-07 is CRITICAL: (Service Check Timed Out) [00:28:14] RECOVERY - App Server Main HTTP Response on deployment-mediawiki-07 is OK: HTTP OK: HTTP/1.1 200 OK - 48016 bytes in 5.628 second response time [02:46:42] 10Phabricator, 10I18n, 10User-Nikerabbit: Please add Brazilian Portuguese (pt-br) language to Phabricator - https://phabricator.wikimedia.org/T215697 (10Eduaddad) @mmodell the error still continues translations translated before March and April 2019 are not here https://translatewiki.net/wiki/Phabricator... [08:48:06] PROBLEM - Host deployment-alex-test is DOWN: CRITICAL - Host Unreachable (172.16.6.31) [09:11:55] 10MediaWiki-Releasing, 10Operations, 10Parsoid: signatures were invalid: EXPKEYSIG 90E9F83F22250DD7 MediaWiki releases repository - https://phabricator.wikimedia.org/T225601 (10Misterms735) @fgiunchedi I still have the problem. When I try to install nginx the following error... [10:57:16] (03PS1) 10Zoranzoki21: Add tests for labs/tools/discordwiki [integration/config] - 10https://gerrit.wikimedia.org/r/538419 [11:27:46] (03PS1) 10Zoranzoki21: Edit Project Config [labs/tools/discordwiki] (refs/meta/config) - 10https://gerrit.wikimedia.org/r/538420 [11:27:57] (03Abandoned) 10Zoranzoki21: Edit Project Config [labs/tools/discordwiki] (refs/meta/config) - 10https://gerrit.wikimedia.org/r/538420 (owner: 10Zoranzoki21) [11:32:30] (03CR) 10Acamicamacaraca: [C: 03+1] Add tests for labs/tools/discordwiki [integration/config] - 10https://gerrit.wikimedia.org/r/538419 (owner: 10Zoranzoki21) [11:44:19] PROBLEM - App Server Main HTTP Response on deployment-mediawiki-07 is CRITICAL: (Service Check Timed Out) [11:49:18] RECOVERY - App Server Main HTTP Response on deployment-mediawiki-07 is OK: HTTP OK: HTTP/1.1 200 OK - 48016 bytes in 6.039 second response time [12:47:16] (03PS2) 10Zoranzoki21: Add tests for labs/tools/discordwiki [integration/config] - 10https://gerrit.wikimedia.org/r/538419 [13:27:54] PROBLEM - Host integration-r-lang-01 is DOWN: CRITICAL - Host Unreachable (172.16.3.27) [14:03:59] PROBLEM - Host integration-slave-docker-1041 is DOWN: CRITICAL - Host Unreachable (172.16.1.36) [14:07:11] PROBLEM - Host integration-slave-docker-1040 is DOWN: CRITICAL - Host Unreachable (172.16.3.86) [15:01:33] PROBLEM - Host integration-slave-docker-1043 is DOWN: CRITICAL - Host Unreachable (172.16.6.184) [15:22:34] that's odd [15:23:18] although those hosts don't appear to actually exist in openstack, so maybe it's shinken that's wrong [16:43:09] ah, this is due to shinken still trying to get data from the old puppetmaster [16:43:48] root@shinken-02:~# grep puppet_enc_host /etc/shinkengen.yaml [16:43:49] puppet_enc_host: labs-puppetmaster.wikimedia.org [16:44:22] hieradata/role/common/wmcs/shinken.yaml:profile::wmcs::shinken::puppet_enc_host: puppetmaster.cloudinfra.wmflabs.org [16:44:52] I'm not sure that hieradata/role/ files actually get used in labs... but it's interesting because shinken only exists within labs. [16:49:39] looks like https://gerrit.wikimedia.org/r/#/c/operations/puppet/+/499516/ was the source of the confusion [16:50:35] Notice: /Stage[main]/Shinken::Shinkengen/File[/etc/shinkengen.yaml]/content: content changed '{md5}67d5b5f844a1bf646414d3a365358e05' to '{md5}503e36a91015aeb768ce2eedc9b5d2a9' [16:50:35] Notice: /Stage[main]/Shinken::Shinkengen/Exec[/usr/local/bin/shinkengen]/returns: executed successfully [16:50:35] Info: /Stage[main]/Shinken::Shinkengen/Exec[/usr/local/bin/shinkengen]: Scheduling refresh of Service[shinken] [16:50:35] Notice: /Stage[main]/Shinken/Service[shinken]: Triggered 'refresh' from 1 events [16:51:30] RECOVERY - Host integration-agent-docker-1001 is UP: PING OK - Packet loss = 0%, RTA = 0.76 ms [16:53:10] PROBLEM - Parsoid on deployment-mediawiki-parsoid10 is CRITICAL: connect to address 172.16.0.141 and port 8000: Connection refused [16:54:09] hm, pretty sure that's a new host ^ [17:25:27] 10MediaWiki-Releasing, 10AbuseFilter, 10MW-1.35-release, 10Patch-For-Review, 10User-Daimona: Bundle AbuseFilter extension with MediaWiki - https://phabricator.wikimedia.org/T191740 (10Daimona) [18:36:14] 10Beta-Cluster-Infrastructure: CentralAuth and local account creation are not working on beta cluster wikis - https://phabricator.wikimedia.org/T233489 (10Daimona) My first thought would be that there's something wrong with the tokens. However, if I try to log in with the browser console open, I see: ` [Report... [18:39:47] 10Beta-Cluster-Infrastructure: CentralAuth and local account creation are not working on beta cluster wikis - https://phabricator.wikimedia.org/T233489 (10Krenair) So it looks like we're not properly changing the CSP header to beta.wmflabs.org addresses. That would be bad, except they're listed as Report Only? [18:44:15] 10Beta-Cluster-Infrastructure: CentralAuth and local account creation are not working on beta cluster wikis - https://phabricator.wikimedia.org/T233489 (10Bawolff) >>! In T233489#5513837, @Krenair wrote: > So it looks like we're not properly changing the CSP header to beta.wmflabs.org addresses. That would be ba... [18:45:39] 10Beta-Cluster-Infrastructure: Beta is serving CSP headers allowing prod rather than beta - https://phabricator.wikimedia.org/T233533 (10Krenair) [18:46:08] 10Beta-Cluster-Infrastructure: CentralAuth and local account creation are not working on beta cluster wikis - https://phabricator.wikimedia.org/T233489 (10Daimona) Hah, right, they're report only. Aside from that, the second call to validateSession would be a good candidate. [19:11:45] 10Phabricator (Upstream), 10Upstream: Assign due date to task and have tasks with due dates displayed on a calendar - https://phabricator.wikimedia.org/T76094 (10Aklapper) [19:11:48] 10Phabricator, 10WMF-Design, 10Design: Migration of the Design team to Phabricator - https://phabricator.wikimedia.org/T832 (10Aklapper) [19:11:51] 10Phabricator, 10Research-Archive: Migration of Research & Data to Phabricator - https://phabricator.wikimedia.org/T826 (10Aklapper) [19:45:39] (03CR) 10Hashar: [C: 03+2] "thanks :)" [integration/config] - 10https://gerrit.wikimedia.org/r/538419 (owner: 10Zoranzoki21) [19:47:14] (03Merged) 10jenkins-bot: Add tests for labs/tools/discordwiki [integration/config] - 10https://gerrit.wikimedia.org/r/538419 (owner: 10Zoranzoki21) [19:58:08] (03PS1) 10Umherirrender: [WikibaseMediaInfo] Run phan job [integration/config] - 10https://gerrit.wikimedia.org/r/538440 (https://phabricator.wikimedia.org/T224772) [20:01:24] (03PS1) 10Zoranzoki21: Fix "Add tests for labs/tools/discordwiki" [integration/config] - 10https://gerrit.wikimedia.org/r/538442 [20:02:36] (03PS2) 10Zoranzoki21: Fix "Add tests for labs/tools/discordwiki" [integration/config] - 10https://gerrit.wikimedia.org/r/538442 [20:21:56] 10Phabricator: Add volunteer badge to my account - https://phabricator.wikimedia.org/T233539 (10TheSandDoctor) [20:22:06] 10Phabricator: Add volunteer badge to my account - https://phabricator.wikimedia.org/T233539 (10TheSandDoctor) p:05Triage→03Lowest [20:36:54] 10Phabricator, 10User-DannyS712: Error when attempting to award badges - https://phabricator.wikimedia.org/T233541 (10DannyS712) [20:37:34] 10Phabricator, 10User-DannyS712: Error when attempting to award badges - https://phabricator.wikimedia.org/T233541 (10DannyS712) Sorry, autocomplete. Discovered during {T233539} [20:49:55] 10Phabricator, 10Project-Admins: Unable to create a project - https://phabricator.wikimedia.org/T233542 (10TheSandDoctor) [20:51:21] 10Phabricator, 10Project-Admins: Error when creating a project - https://phabricator.wikimedia.org/T233542 (10TheSandDoctor) [20:51:30] 10Phabricator, 10Project-Admins: Error when creating a project - https://phabricator.wikimedia.org/T233542 (10DannyS712) 05Open→03Invalid Only specific users can create projects on phab; to request that a project be created use #project-admins [20:52:23] 10Phabricator, 10Project-Admins: Error when creating a project - https://phabricator.wikimedia.org/T233542 (10TheSandDoctor) p:05Triage→03Lowest [20:52:30] 10Phabricator: Error when creating a project - https://phabricator.wikimedia.org/T233542 (10TheSandDoctor) [20:54:12] 10Phabricator: Error when creating a project - https://phabricator.wikimedia.org/T233542 (10TheSandDoctor) @DannyS712 Thanks for the response. I would say that this is "resolved" then rather than "invalid"? The latter doesn't seem appropriate to me given the context and that you resolved my query. :) [20:55:56] 10Phabricator: Error when creating a project - https://phabricator.wikimedia.org/T233542 (10DannyS712) >>! In T233542#5514043, @TheSandDoctor wrote: > @DannyS712 Thanks for the response. I would say that this is "resolved" then rather than "invalid"? The latter doesn't seem appropriate to me given the context an... [21:03:14] 10Project-Admins, 10User-DannyS712: Create component tag for GlobalWatchlist - https://phabricator.wikimedia.org/T233543 (10DannyS712) [21:03:49] 10Project-Admins: Create new project User-TheSandDoctor - https://phabricator.wikimedia.org/T233544 (10TheSandDoctor) [21:04:15] 10Project-Admins: Create new project User-TheSandDoctor - https://phabricator.wikimedia.org/T233544 (10TheSandDoctor) [21:04:19] 10Phabricator (Upstream), 10Upstream: Per-user projects for personal work in progress tracking - https://phabricator.wikimedia.org/T555 (10TheSandDoctor) [21:09:09] 10Project-Admins: Create new project User-TheSandDoctor - https://phabricator.wikimedia.org/T233544 (10TheSandDoctor) p:05Triage→03Normal [21:09:33] 10Project-Admins, 10User-DannyS712: Create user board for DannyS712 - https://phabricator.wikimedia.org/T214621 (10DannyS712) [21:09:36] 10Phabricator (Upstream), 10Upstream: Per-user projects for personal work in progress tracking - https://phabricator.wikimedia.org/T555 (10DannyS712) [21:10:05] 10Project-Admins: Create new project User-TheSandDoctor - https://phabricator.wikimedia.org/T233544 (10DannyS712) [21:12:25] 10Project-Admins, 10User-DannyS712: Create component tag for GlobalWatchlist - https://phabricator.wikimedia.org/T233543 (10DannyS712) [21:13:52] 10Phabricator, 10User-DannyS712: Error when attempting to award badges - https://phabricator.wikimedia.org/T233541 (10Reedy) WFM, some bad permission checking/error handling? {F30437283} [21:14:02] 10Phabricator: Add volunteer badge to my account - https://phabricator.wikimedia.org/T233539 (10Reedy) 05Open→03Resolved a:03Reedy Done [21:36:46] 10Phabricator, 10Project-Admins: Create LifeWeb extension tag - https://phabricator.wikimedia.org/T233551 (10TheSandDoctor) [21:36:54] 10Phabricator, 10Project-Admins: Create LifeWeb extension tag - https://phabricator.wikimedia.org/T233551 (10TheSandDoctor) p:05Triage→03Normal [21:37:01] 10Phabricator, 10Project-Admins: Create LifeWeb extension tag - https://phabricator.wikimedia.org/T233551 (10TheSandDoctor) [21:40:47] 10Phabricator, 10Project-Admins: Create Memento extension tag - https://phabricator.wikimedia.org/T233553 (10TheSandDoctor) [21:42:44] 10Phabricator, 10Project-Admins: Create Memento extension tag - https://phabricator.wikimedia.org/T233553 (10Reedy) Please be aware that not every extension needs its own tag. Just because it hasn't got one, doesn't meant it needs to be created, especially if there's not going to be any further work than just... [21:42:49] 10Phabricator, 10User-DannyS712: Error when attempting to award badges - https://phabricator.wikimedia.org/T233541 (10DannyS712) >>! In T233541#5514082, @Reedy wrote: > WFM, some bad permission checking/error handling? What permissions are needed to award a badge? [21:46:53] 10Phabricator, 10User-DannyS712: Error when attempting to award badges - https://phabricator.wikimedia.org/T233541 (10Reedy) >>! In T233541#5514215, @DannyS712 wrote: >>>! In T233541#5514082, @Reedy wrote: >> WFM, some bad permission checking/error handling? > > What permissions are needed to award a badge?... [21:48:10] 10Phabricator, 10User-DannyS712: Error when attempting to award badges - https://phabricator.wikimedia.org/T233541 (10DannyS712) Oh well. In the meanwhile @Reedy can you tag me as a volunteer too? [21:48:22] 10Phabricator, 10Project-Admins: Create Memento extension tag - https://phabricator.wikimedia.org/T233553 (10TheSandDoctor) 05Open→03Invalid Thanks @Reedy . Closed as invalid (I think that is the right one....if not, then please do let me know.) [21:48:53] 10Phabricator, 10Project-Admins: Create Memento extension tag - https://phabricator.wikimedia.org/T233553 (10DannyS712) 05Invalid→03Declined Not invalid, just declined because of the limited use case [21:50:30] 10Phabricator: Add volunteer badge to my account - https://phabricator.wikimedia.org/T233539 (10TheSandDoctor) >>! In T233539#5514084, @Reedy wrote: > Done Thanks! [22:37:50] hmm, i wonder why this "java.util.concurrent.ExecutionException: org.eclipse.jgit.errors.MissingObjectException: Missing unknown 907e2b286082b44b6d01063e286423a77f79bf05 [22:37:50] " happens for WikimediaMaintenance [22:41:31] 10Phabricator, 10User-DannyS712: Error when attempting to award badges - https://phabricator.wikimedia.org/T233541 (10Ammarpad) I added a little note at [[https://www.mediawiki.org/wiki/Phabricator/Help#Phabricator_Badges|Phabricator/Help#Phabricator_Badges]]. Only phabricator admins can award badges, and this... [22:59:41] PROBLEM - App Server Main HTTP Response on deployment-mediawiki-09 is CRITICAL: (Service Check Timed Out) [23:05:44] 10Phabricator, 10User-DannyS712: Error when attempting to award badges - https://phabricator.wikimedia.org/T233541 (10Reedy) >>! In T233541#5514334, @Ammarpad wrote: > I added a little note at [[https://www.mediawiki.org/wiki/Phabricator/Help#Phabricator_Badges|Phabricator/Help#Phabricator_Badges]]. Only phabr...