[00:01:28] <wikibugs>	 (03CR) 10Krinkle: [C: 04-1] Drop mwext-jsduck-publish, no longer used (031 comment) [integration/config] - 10https://gerrit.wikimedia.org/r/496894 (owner: 10Jforrester)
[00:04:31] <wikibugs>	 (03PS8) 10Krinkle: Replace *-jsduck-* jobs with *-node10-docs-* ones [integration/config] - 10https://gerrit.wikimedia.org/r/496887 (owner: 10Jforrester)
[00:04:34] <wikibugs>	 (03CR) 10Krinkle: [C: 03+2] Replace *-jsduck-* jobs with *-node10-docs-* ones [integration/config] - 10https://gerrit.wikimedia.org/r/496887 (owner: 10Jforrester)
[00:06:09] <wikibugs>	 (03Merged) 10jenkins-bot: Replace *-jsduck-* jobs with *-node10-docs-* ones [integration/config] - 10https://gerrit.wikimedia.org/r/496887 (owner: 10Jforrester)
[00:08:41] <Krinkle>	 !log Reloading Zuul to deploy https://gerrit.wikimedia.org/r/496887 
[00:08:42] <stashbot>	 Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL
[03:30:43] <wikibugs>	 10Gerrit: I can't log in to "Gerrit Code Review" for name already in use - https://phabricator.wikimedia.org/T218498 (10AlvaroMolina)
[04:19:22] <wmf-insecte>	 Yippee, build fixed!
[04:19:22] <wmf-insecte>	 Project mediawiki-core-code-coverage-docker build #4129: 09FIXED in 1 hr 19 min: https://integration.wikimedia.org/ci/job/mediawiki-core-code-coverage-docker/4129/
[04:52:02] <wikibugs>	 10Gerrit: I can't log in to "Gerrit Code Review" for name already in use - https://phabricator.wikimedia.org/T218498 (10Peachey88) I suspect it may be related to {T197083}
[11:00:20] <wikibugs>	 10Gerrit, 10Release-Engineering-Team, 10Operations, 10User-greg: gerrit.wikimedia.org is down - https://phabricator.wikimedia.org/T218472 (10JruwJN) #operations #security-team #release-engineering-team  Why you don't tell the people that the real reason for stopping gerrit is the compromising of an ops acc...
[11:21:28] <wikibugs>	 10Gerrit, 10Gerrit-Privilege-Requests, 10wikitech.wikimedia.org: I'm refused to login to Gerrit - https://phabricator.wikimedia.org/T218507 (10thiemowmde)
[11:26:16] <wikibugs>	 10Gerrit, 10Release-Engineering-Team, 10Operations, 10User-greg: gerrit.wikimedia.org is down - https://phabricator.wikimedia.org/T218472 (10thiemowmde) 05Resolved→03Open I can't login to Gerrit any more. I created T218507, not knowing what was going on. Given this ticket doesn't explain much, I still...
[11:28:04] <wikibugs>	 10Gerrit, 10Release-Engineering-Team, 10Operations, 10User-greg: gerrit.wikimedia.org is down - https://phabricator.wikimedia.org/T218472 (10JruwJN2) I repeat my question again:  #operations #security-team #release-engineering-team  Why you don't tell the people that the real reason for stopping gerrit is...
[11:53:38] <wikibugs>	 10Gerrit, 10Release-Engineering-Team, 10Operations: I'm refused to login to Gerrit - https://phabricator.wikimedia.org/T218507 (10MarcoAurelio) Better tags.
[12:23:26] <wikibugs>	 10Gerrit, 10Release-Engineering-Team, 10Operations, 10User-greg: gerrit.wikimedia.org is down - https://phabricator.wikimedia.org/T218472 (10MGChecker) I don't think removing these comments is a good idea, as people subscribed to this task recieve the respective email notifications anyway and are left with...
[12:37:01] <wikibugs>	 10Gerrit, 10Release-Engineering-Team, 10Operations, 10User-greg: gerrit.wikimedia.org is down - https://phabricator.wikimedia.org/T218472 (10Daimona) >>! In T218472#5030487, @MGChecker wrote: > I don't think removing these comments is a good idea, as people subscribed to this task recieve the respective em...
[12:44:21] <wikibugs>	 10Gerrit, 10Release-Engineering-Team, 10Operations, 10User-greg: gerrit.wikimedia.org is down - https://phabricator.wikimedia.org/T218472 (10akosiaris) I think the intention are to (somewhat ?) limit the impact the vandal is trying to achieve (at least by removing the capability to link to those comments)....
[12:46:38] <wikibugs>	 10Gerrit, 10Release-Engineering-Team, 10Operations: I'm refused to login to Gerrit - https://phabricator.wikimedia.org/T218507 (10Dereckson) @thiemowmde Did you try your username in lowercase?
[12:51:43] <wikibugs>	 10Gerrit, 10Release-Engineering-Team, 10Operations: I'm refused to login to Gerrit - https://phabricator.wikimedia.org/T218507 (10MGChecker) >>! In T218507#5030499, @Dereckson wrote: > @thiemowmde Did you try your username in lowercase?  When using git review yesterday, I couldn't authenticate until I wrote...
[12:53:06] <wikibugs>	 10Gerrit, 10Release-Engineering-Team, 10Operations, 10User-greg: gerrit.wikimedia.org is down - https://phabricator.wikimedia.org/T218472 (10MGChecker) I do not really get how this is related to the impact of the vandal. as he basically states a single claim that would have to be denied or confirmed anyway...
[13:08:05] <wikibugs>	 10Gerrit, 10Release-Engineering-Team, 10Operations, 10User-greg: gerrit.wikimedia.org is down - https://phabricator.wikimedia.org/T218472 (10Aklapper) //No need to keep random unconfirmed claims posted by an account with previously zero activity to spread FUD, jump guns, create confusion.  Please refer to...
[13:08:58] <wikibugs>	 10Gerrit, 10Release-Engineering-Team, 10Operations, 10User-greg: gerrit.wikimedia.org is down - https://phabricator.wikimedia.org/T218472 (10MarcoAurelio) IMHO I don't think spreading [[ https://en.wikipedia.org/wiki/Fear,_uncertainty_and_doubt | FUD ]] helps anyone. Wikimedia will let us all know in due t...
[13:28:37] <wikibugs>	 10Gerrit: I can't log in to "Gerrit Code Review" for name already in use - https://phabricator.wikimedia.org/T218498 (10Aklapper) @AlvaroMolina: In addition, can you please also try logging in with lower case spelling of the first character of your username, if you used a capital first letter before?
[13:35:57] <shinken-wm>	 PROBLEM - Puppet errors on integration-slave-docker-1053 is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [3.0]
[13:37:09] <shinken-wm>	 PROBLEM - Puppet errors on deployment-db03 is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [3.0]
[13:37:52] <shinken-wm>	 PROBLEM - Puppet errors on integration-slave-jessie-1002 is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [3.0]
[13:38:56] <shinken-wm>	 PROBLEM - Puppet errors on integration-slave-docker-1034 is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [3.0]
[13:39:37] <shinken-wm>	 PROBLEM - Puppet errors on integration-slave-docker-1048 is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [3.0]
[13:40:25] <shinken-wm>	 PROBLEM - Puppet errors on integration-slave-docker-1049 is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [3.0]
[13:42:48] <shinken-wm>	 PROBLEM - Puppet errors on integration-slave-docker-1043 is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [3.0]
[13:51:13] <shinken-wm>	 PROBLEM - Puppet errors on integration-slave-docker-1050 is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [3.0]
[13:52:31] <shinken-wm>	 PROBLEM - Puppet errors on integration-slave-docker-1052 is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [3.0]
[13:54:26] <shinken-wm>	 PROBLEM - Puppet errors on integration-slave-docker-1041 is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [3.0]
[13:56:53] <shinken-wm>	 PROBLEM - Puppet errors on integration-slave-jessie-1001 is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [3.0]
[13:59:17] <shinken-wm>	 PROBLEM - Puppet errors on integration-slave-docker-1037 is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [3.0]
[13:59:24] <shinken-wm>	 PROBLEM - Puppet errors on integration-slave-jessie-1004 is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [3.0]
[14:00:02] <shinken-wm>	 PROBLEM - Puppet errors on integration-slave-docker-1051 is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [3.0]
[14:36:29] <wikibugs>	 10Gerrit: I can't log in to "Gerrit Code Review" for name already in use - https://phabricator.wikimedia.org/T218498 (10Stryn) Same problem here, can't login there. No matter is the first character "S" or "s".
[14:40:16] <wikibugs>	 10Gerrit: I can't log in to "Gerrit Code Review" for name already in use - https://phabricator.wikimedia.org/T218498 (10Paladox) Similar  to T216605 .  Did both of you login previously within the last week fine?
[14:45:42] <wikibugs>	 10Gerrit: I can't log in to "Gerrit Code Review" for name already in use - https://phabricator.wikimedia.org/T218498 (10Stryn) I didn't use Gerrit for many months. I even forgot my password so I changed it first from wikitech.
[14:46:12] <wikibugs>	 10Gerrit: I can't log in to "Gerrit Code Review" for name already in use - https://phabricator.wikimedia.org/T218498 (10AlvaroMolina) >>! In T218498#5030557, @Aklapper wrote: > @AlvaroMolina: In addition, can you please also try logging in with lower case spelling of the first character of your username, if you...
[14:47:27] <wikibugs>	 10Gerrit: I can't log in to "Gerrit Code Review" for name already in use - https://phabricator.wikimedia.org/T218498 (10AlvaroMolina) >>! In T218498#5030579, @Paladox wrote: > Similar  to T216605 . >  > Did both of you login previously within the last week fine?  I was not logged in since early December 2018.
[14:54:50] <wikibugs>	 10Gerrit: I can't log in to "Gerrit Code Review" for name already in use - https://phabricator.wikimedia.org/T218498 (10thcipriani)
[14:58:53] <wikibugs>	 10Gerrit: I can't log in to "Gerrit Code Review" for name already in use - https://phabricator.wikimedia.org/T218498 (10thcipriani) @AlvaroMolina and @Stryn  I see the problem with your user accounts. The tl;dr is our Gerrit instance has `ldap.localUsernameToLowerCase = true` but both of your accounts are stored...
[16:25:16] <wikibugs>	 10Gerrit, 10Release-Engineering-Team: Upgrade Gerrit to 2.15.12 - https://phabricator.wikimedia.org/T218515 (10Paladox)
[16:25:27] <wikibugs>	 10Gerrit, 10Release-Engineering-Team: Upgrade Gerrit to 2.15.12 - https://phabricator.wikimedia.org/T218515 (10Paladox) p:05Triage→03High
[16:27:32] <Krenair>	 log armed deployment-cumin keyholder
[16:27:34] <Krenair>	 log armed deployment-cumin keyholder
[16:27:35] <Krenair>	 fff
[16:27:38] <Krenair>	 !log armed deployment-cumin keyholder
[16:27:40] <stashbot>	 Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL
[16:27:54] <wikibugs>	 10Gerrit, 10Release-Engineering-Team, 10Operations, 10User-greg: gerrit.wikimedia.org is down - https://phabricator.wikimedia.org/T218472 (10JBennett) Todays updates sent to wikitech-l https://lists.wikimedia.org/pipermail/wikitech-l/2019-March/091769.html
[16:29:31] <Krenair>	 !log deactivated and cleaned certs for deployment-redis3-changeprop02 and deployment-prometheus01 (which no longer appear to exist but were causing cumin to be upset)
[16:29:31] <stashbot>	 Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL
[17:00:58] <wikibugs>	 10Gerrit, 10Release-Engineering-Team, 10Operations: I'm refused to login to Gerrit - https://phabricator.wikimedia.org/T218507 (10thiemowmde) 05Open→03Invalid I'm in contact with the security team. Long story short: It's not me.
[19:36:54] <wikibugs>	 10Gerrit, 10Release-Engineering-Team, 10Operations, 10User-greg: gerrit.wikimedia.org is down - https://phabricator.wikimedia.org/T218472 (10thiemowmde) 05Open→03Resolved Gerrit is not "down" any more, reopening this was a mistake. Sorry.
[20:36:06] <wmf-insecte>	 Project beta-scap-eqiad build #241752: 04FAILURE in 8 min 23 sec: https://integration.wikimedia.org/ci/job/beta-scap-eqiad/241752/
[20:46:56] <wmf-insecte>	 Yippee, build fixed!
[20:46:56] <wmf-insecte>	 Project beta-scap-eqiad build #241753: 09FIXED in 9 min 30 sec: https://integration.wikimedia.org/ci/job/beta-scap-eqiad/241753/
[21:03:28] <shinken-wm>	 PROBLEM - Host integration-slave-docker-1046 is DOWN: CRITICAL - Host Unreachable (172.16.1.115)
[21:10:26] <wmf-insecte>	 Project beta-scap-eqiad build #241756: 04FAILURE in 10 sec: https://integration.wikimedia.org/ci/job/beta-scap-eqiad/241756/
[21:25:01] <wmf-insecte>	 Yippee, build fixed!
[21:25:01] <wmf-insecte>	 Project beta-scap-eqiad build #241757: 09FIXED in 10 min: https://integration.wikimedia.org/ci/job/beta-scap-eqiad/241757/
[21:31:19] <wikibugs>	 10Project-Admins, 10MediaWiki-Comment-backend: Replace tracking task T119681 by creating #MediaWiki-Commenting - https://phabricator.wikimedia.org/T208156 (10MGChecker) This line of thought sounds quite reasonable. I doubt creating an additional tag for these few tasks is warranted, if no additional users requ...
[22:12:59] <wmf-insecte>	 Project beta-scap-eqiad build #241761: 04FAILURE in 9 min 16 sec: https://integration.wikimedia.org/ci/job/beta-scap-eqiad/241761/
[22:23:57] <wmf-insecte>	 Yippee, build fixed!
[22:23:57] <wmf-insecte>	 Project beta-scap-eqiad build #241762: 09FIXED in 9 min 39 sec: https://integration.wikimedia.org/ci/job/beta-scap-eqiad/241762/
[22:36:19] <wmf-insecte>	 Project beta-scap-eqiad build #241764: 04FAILURE in 3 sec: https://integration.wikimedia.org/ci/job/beta-scap-eqiad/241764/
[22:54:01] <wmf-insecte>	 Yippee, build fixed!
[22:54:02] <wmf-insecte>	 Project beta-scap-eqiad build #241765: 09FIXED in 9 min 41 sec: https://integration.wikimedia.org/ci/job/beta-scap-eqiad/241765/
[23:11:29] <wikibugs>	 10Phabricator: Phab presumes ldap account has a wikitech account - https://phabricator.wikimedia.org/T218526 (10Reedy)
[23:13:49] <wikibugs>	 10Phabricator: Phab presumes ldap account has a wikitech account - https://phabricator.wikimedia.org/T218526 (10bd808) There really is no way for Phabricator to know how to deal with this. I think the current behavior is sane for now even if it is confusing for the sub-set of developer accounts which have never...