[00:59:42] RECOVERY - Puppet failure on deployment-elastic06 is OK Less than 1.00% above the threshold [0.0] [00:59:52] RECOVERY - Puppet failure on deployment-apertium01 is OK Less than 1.00% above the threshold [0.0] [01:00:36] RECOVERY - Puppet failure on deployment-cxserver03 is OK Less than 1.00% above the threshold [0.0] [01:01:40] RECOVERY - Puppet failure on deployment-parsoid05 is OK Less than 1.00% above the threshold [0.0] [01:01:40] RECOVERY - Puppet failure on deployment-zookeeper01 is OK Less than 1.00% above the threshold [0.0] [01:02:30] RECOVERY - Puppet failure on deployment-urldownloader is OK Less than 1.00% above the threshold [0.0] [01:02:30] RECOVERY - Puppet failure on deployment-zotero01 is OK Less than 1.00% above the threshold [0.0] [01:04:28] RECOVERY - Puppet failure on deployment-stream is OK Less than 1.00% above the threshold [0.0] [01:04:30] RECOVERY - Puppet failure on deployment-mediawiki02 is OK Less than 1.00% above the threshold [0.0] [01:05:46] RECOVERY - Puppet failure on deployment-mediawiki03 is OK Less than 1.00% above the threshold [0.0] [01:05:54] RECOVERY - Puppet failure on deployment-videoscaler01 is OK Less than 1.00% above the threshold [0.0] [01:06:15] RECOVERY - Puppet failure on deployment-db2 is OK Less than 1.00% above the threshold [0.0] [01:06:55] RECOVERY - Puppet failure on deployment-pdf02 is OK Less than 1.00% above the threshold [0.0] [01:07:23] RECOVERY - Puppet failure on deployment-pdf01 is OK Less than 1.00% above the threshold [0.0] [01:07:50] RECOVERY - Puppet failure on mira is OK Less than 1.00% above the threshold [0.0] [01:07:54] RECOVERY - Puppet failure on deployment-kafka02 is OK Less than 1.00% above the threshold [0.0] [01:08:20] RECOVERY - Puppet failure on deployment-sca01 is OK Less than 1.00% above the threshold [0.0] [01:09:38] RECOVERY - Puppet failure on deployment-memc03 is OK Less than 1.00% above the threshold [0.0] [01:10:16] RECOVERY - Puppet failure on deployment-sca02 is OK Less than 1.00% above the threshold [0.0] [01:10:36] RECOVERY - Puppet failure on deployment-memc04 is OK Less than 1.00% above the threshold [0.0] [01:10:38] RECOVERY - Puppet failure on deployment-memc02 is OK Less than 1.00% above the threshold [0.0] [01:10:56] RECOVERY - Puppet failure on deployment-fluorine is OK Less than 1.00% above the threshold [0.0] [01:12:18] RECOVERY - Puppet failure on deployment-elastic07 is OK Less than 1.00% above the threshold [0.0] [01:13:45] RECOVERY - Puppet failure on deployment-salt is OK Less than 1.00% above the threshold [0.0] [01:13:45] RECOVERY - Puppet failure on deployment-eventlogging02 is OK Less than 1.00% above the threshold [0.0] [01:14:07] RECOVERY - Puppet failure on deployment-test is OK Less than 1.00% above the threshold [0.0] [01:15:07] RECOVERY - Puppet failure on deployment-sentry2 is OK Less than 1.00% above the threshold [0.0] [01:15:33] RECOVERY - Puppet failure on deployment-elastic05 is OK Less than 1.00% above the threshold [0.0] [01:16:51] RECOVERY - Puppet failure on deployment-redis01 is OK Less than 1.00% above the threshold [0.0] [01:17:55] PROBLEM - Puppet failure on deployment-restbase01 is CRITICAL 100.00% of data above the critical threshold [0.0] [01:18:17] RECOVERY - Puppet failure on deployment-jobrunner01 is OK Less than 1.00% above the threshold [0.0] [01:19:39] RECOVERY - Puppet failure on deployment-upload is OK Less than 1.00% above the threshold [0.0] [01:23:04] RECOVERY - Puppet failure on deployment-mediawiki01 is OK Less than 1.00% above the threshold [0.0] [01:31:06] RECOVERY - Puppet failure on deployment-logstash2 is OK Less than 1.00% above the threshold [0.0] [01:31:14] RECOVERY - Puppet failure on deployment-db1 is OK Less than 1.00% above the threshold [0.0] [01:32:28] RECOVERY - Puppet failure on deployment-mathoid is OK Less than 1.00% above the threshold [0.0] [01:32:30] RECOVERY - Puppet failure on deployment-elastic08 is OK Less than 1.00% above the threshold [0.0] [01:33:06] RECOVERY - Puppet failure on deployment-redis02 is OK Less than 1.00% above the threshold [0.0] [01:35:14] RECOVERY - Puppet failure on deployment-bastion is OK Less than 1.00% above the threshold [0.0] [01:49:03] (03CR) 10Polybuildr: "Looks good overall, let's run tests." [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/224648 (https://phabricator.wikimedia.org/T101872) (owner: 10Galorefitz) [01:50:26] (03CR) 10Polybuildr: "recheck" [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/224648 (https://phabricator.wikimedia.org/T101872) (owner: 10Galorefitz) [01:55:01] (03CR) 10jenkins-bot: [V: 04-1] Sniff to check for space in single line comments [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/224648 (https://phabricator.wikimedia.org/T101872) (owner: 10Galorefitz) [02:04:30] (03CR) 10Polybuildr: "Minor indentation issue on line 47 of the sniff." [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/224648 (https://phabricator.wikimedia.org/T101872) (owner: 10Galorefitz) [02:46:11] PROBLEM - Puppet failure on deployment-bastion is CRITICAL 33.33% of data above the critical threshold [0.0] [02:47:07] PROBLEM - Puppet failure on deployment-logstash2 is CRITICAL 44.44% of data above the critical threshold [0.0] [02:47:43] PROBLEM - Puppet failure on deployment-zookeeper01 is CRITICAL 30.00% of data above the critical threshold [0.0] [02:48:29] PROBLEM - Puppet failure on deployment-urldownloader is CRITICAL 33.33% of data above the critical threshold [0.0] [02:48:35] PROBLEM - Puppet failure on deployment-zotero01 is CRITICAL 30.00% of data above the critical threshold [0.0] [02:48:49] PROBLEM - Puppet failure on mira is CRITICAL 40.00% of data above the critical threshold [0.0] [02:50:38] PROBLEM - Puppet failure on deployment-memc03 is CRITICAL 40.00% of data above the critical threshold [0.0] [02:50:42] PROBLEM - Puppet failure on deployment-elastic06 is CRITICAL 50.00% of data above the critical threshold [0.0] [02:50:52] PROBLEM - Puppet failure on deployment-apertium01 is CRITICAL 50.00% of data above the critical threshold [0.0] [02:51:16] PROBLEM - Puppet failure on deployment-sca02 is CRITICAL 33.33% of data above the critical threshold [0.0] [02:51:34] PROBLEM - Puppet failure on deployment-memc02 is CRITICAL 40.00% of data above the critical threshold [0.0] [02:51:34] PROBLEM - Puppet failure on deployment-memc04 is CRITICAL 60.00% of data above the critical threshold [0.0] [02:51:36] PROBLEM - Puppet failure on deployment-cxserver03 is CRITICAL 22.22% of data above the critical threshold [0.0] [02:51:46] PROBLEM - Puppet failure on deployment-mediawiki03 is CRITICAL 30.00% of data above the critical threshold [0.0] [02:52:14] PROBLEM - Puppet failure on deployment-db2 is CRITICAL 33.33% of data above the critical threshold [0.0] [02:52:40] PROBLEM - Puppet failure on deployment-parsoid05 is CRITICAL 60.00% of data above the critical threshold [0.0] [02:52:56] PROBLEM - Puppet failure on deployment-pdf02 is CRITICAL 30.00% of data above the critical threshold [0.0] [02:53:54] PROBLEM - Puppet failure on deployment-kafka02 is CRITICAL 30.00% of data above the critical threshold [0.0] [02:54:22] PROBLEM - Puppet failure on deployment-sca01 is CRITICAL 55.56% of data above the critical threshold [0.0] [02:55:26] PROBLEM - Puppet failure on deployment-stream is CRITICAL 50.00% of data above the critical threshold [0.0] [02:55:32] PROBLEM - Puppet failure on deployment-mediawiki02 is CRITICAL 50.00% of data above the critical threshold [0.0] [02:56:07] PROBLEM - Puppet failure on deployment-sentry2 is CRITICAL 33.33% of data above the critical threshold [0.0] [02:56:57] PROBLEM - Puppet failure on deployment-videoscaler01 is CRITICAL 40.00% of data above the critical threshold [0.0] [02:58:23] PROBLEM - Puppet failure on deployment-pdf01 is CRITICAL 60.00% of data above the critical threshold [0.0] [02:59:45] PROBLEM - Puppet failure on deployment-eventlogging02 is CRITICAL 40.00% of data above the critical threshold [0.0] [03:00:07] PROBLEM - Puppet failure on deployment-test is CRITICAL 66.67% of data above the critical threshold [0.0] [03:01:53] PROBLEM - Puppet failure on deployment-fluorine is CRITICAL 40.00% of data above the critical threshold [0.0] [03:03:17] PROBLEM - Puppet failure on deployment-elastic07 is CRITICAL 55.56% of data above the critical threshold [0.0] [03:05:40] PROBLEM - Puppet failure on deployment-upload is CRITICAL 50.00% of data above the critical threshold [0.0] [03:06:32] PROBLEM - Puppet failure on deployment-elastic05 is CRITICAL 22.22% of data above the critical threshold [0.0] [03:07:52] PROBLEM - Puppet failure on deployment-redis01 is CRITICAL 60.00% of data above the critical threshold [0.0] [03:08:30] PROBLEM - Puppet failure on deployment-mathoid is CRITICAL 20.00% of data above the critical threshold [0.0] [03:09:06] PROBLEM - Puppet failure on deployment-redis02 is CRITICAL 55.56% of data above the critical threshold [0.0] [03:09:22] PROBLEM - Puppet failure on deployment-jobrunner01 is CRITICAL 55.56% of data above the critical threshold [0.0] [03:12:17] PROBLEM - Puppet failure on deployment-db1 is CRITICAL 70.00% of data above the critical threshold [0.0] [03:13:29] PROBLEM - Puppet failure on deployment-elastic08 is CRITICAL 60.00% of data above the critical threshold [0.0] [03:14:05] PROBLEM - Puppet failure on deployment-mediawiki01 is CRITICAL 50.00% of data above the critical threshold [0.0] [05:04:41] PROBLEM - Puppet failure on deployment-salt is CRITICAL 50.00% of data above the critical threshold [0.0] [05:23:12] 10Beta-Cluster, 10Compact-Personal-Bar-(Beta), 10MediaWiki-extensions-VectorBeta, 7Beta-Feature, 7user-notice: Remove Compact Personal Bar from Beta Cluster and Production - https://phabricator.wikimedia.org/T104659#1464596 (10Bugreporter) 5Open>3Resolved a:3Bugreporter {rOMWC953815bf03c2af2c142491... [06:40:32] RECOVERY - Free space - all mounts on deployment-videoscaler01 is OK All targets OK [06:52:43] 10Browser-Tests: Zoom functionality does not work for language screenshots in Mac OS X - https://phabricator.wikimedia.org/T106289#1464623 (10Vikassy) 5Open>3Resolved Resolved and merged in https://github.com/amire80/screenshot/pull/13/files [06:59:02] PROBLEM - Puppet failure on integration-zuul-server is CRITICAL 100.00% of data above the critical threshold [0.0] [07:04:39] 10Beta-Cluster, 10Pywikibot-OAuth: Investigate process for setting up an OAuth client on the Beta cluster - https://phabricator.wikimedia.org/T104764#1464632 (10VcamX) [07:05:58] 10Beta-Cluster, 10Pywikibot-OAuth: Investigate process for setting up an OAuth client on the Beta cluster - https://phabricator.wikimedia.org/T104764#1426391 (10VcamX) [07:21:13] 6Release-Engineering: Prepare Making Translated Screenshots With No Effort talk - https://phabricator.wikimedia.org/T104985#1464663 (10Vikassy) 5Open>3Resolved The slides can be found in commons: https://commons.wikimedia.org/wiki/File:Making_Translated_Screenshots_With_No_Effort.pdf [08:00:34] (03PS3) 10Galorefitz: Sniff to check for space in single line comments [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/224648 (https://phabricator.wikimedia.org/T101872) [08:20:28] (03CR) 10Polybuildr: "recheck" [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/224648 (https://phabricator.wikimedia.org/T101872) (owner: 10Galorefitz) [08:59:06] RECOVERY - Puppet failure on deployment-redis02 is OK Less than 1.00% above the threshold [0.0] [09:00:42] RECOVERY - Puppet failure on deployment-elastic06 is OK Less than 1.00% above the threshold [0.0] [09:00:52] RECOVERY - Puppet failure on deployment-apertium01 is OK Less than 1.00% above the threshold [0.0] [09:01:12] RECOVERY - Puppet failure on deployment-bastion is OK Less than 1.00% above the threshold [0.0] [09:01:36] RECOVERY - Puppet failure on deployment-cxserver03 is OK Less than 1.00% above the threshold [0.0] [09:01:56] RECOVERY - Puppet failure on deployment-videoscaler01 is OK Less than 1.00% above the threshold [0.0] [09:02:14] RECOVERY - Puppet failure on deployment-db2 is OK Less than 1.00% above the threshold [0.0] [09:02:40] RECOVERY - Puppet failure on deployment-parsoid05 is OK Less than 1.00% above the threshold [0.0] [09:02:41] RECOVERY - Puppet failure on deployment-zookeeper01 is OK Less than 1.00% above the threshold [0.0] [09:03:29] RECOVERY - Puppet failure on deployment-urldownloader is OK Less than 1.00% above the threshold [0.0] [09:03:29] RECOVERY - Puppet failure on deployment-zotero01 is OK Less than 1.00% above the threshold [0.0] [09:03:31] RECOVERY - Puppet failure on deployment-elastic08 is OK Less than 1.00% above the threshold [0.0] [09:03:53] RECOVERY - Puppet failure on deployment-kafka02 is OK Less than 1.00% above the threshold [0.0] [09:04:03] RECOVERY - Puppet failure on deployment-mediawiki01 is OK Less than 1.00% above the threshold [0.0] [09:05:25] RECOVERY - Puppet failure on deployment-stream is OK Less than 1.00% above the threshold [0.0] [09:06:12] RECOVERY - Puppet failure on deployment-sca02 is OK Less than 1.00% above the threshold [0.0] [09:06:39] Yippee, build fixed! [09:06:40] Project browsertests-MultimediaViewer-en.wikipedia.beta.wmflabs.org-os_x_10.9-safari-sauce build #666: FIXED in 56 min: https://integration.wikimedia.org/ci/job/browsertests-MultimediaViewer-en.wikipedia.beta.wmflabs.org-os_x_10.9-safari-sauce/666/ [09:07:58] RECOVERY - Puppet failure on deployment-pdf02 is OK Less than 1.00% above the threshold [0.0] [09:08:22] RECOVERY - Puppet failure on deployment-pdf01 is OK Less than 1.00% above the threshold [0.0] [09:09:20] RECOVERY - Puppet failure on deployment-sca01 is OK Less than 1.00% above the threshold [0.0] [09:09:44] RECOVERY - Puppet failure on deployment-salt is OK Less than 1.00% above the threshold [0.0] [09:10:38] RECOVERY - Puppet failure on deployment-memc03 is OK Less than 1.00% above the threshold [0.0] [09:11:28] 10Beta-Cluster, 10Pywikibot-OAuth: Investigate process for setting up an OAuth client on the Beta cluster - https://phabricator.wikimedia.org/T104764#1464714 (10hashar) The deployment.wikimedia wiki is indeed the OAuth. commonsettings-labs.php has: ``` lang=php if ( $wmgUseOAuth ) { $wgMWOAuthCentralWiki =... [09:11:37] RECOVERY - Puppet failure on deployment-memc04 is OK Less than 1.00% above the threshold [0.0] [09:11:37] RECOVERY - Puppet failure on deployment-memc02 is OK Less than 1.00% above the threshold [0.0] [09:11:53] RECOVERY - Puppet failure on deployment-fluorine is OK Less than 1.00% above the threshold [0.0] [09:12:53] RECOVERY - Puppet failure on deployment-redis01 is OK Less than 1.00% above the threshold [0.0] [09:13:18] RECOVERY - Puppet failure on deployment-elastic07 is OK Less than 1.00% above the threshold [0.0] [09:14:46] RECOVERY - Puppet failure on deployment-eventlogging02 is OK Less than 1.00% above the threshold [0.0] [09:15:08] RECOVERY - Puppet failure on deployment-test is OK Less than 1.00% above the threshold [0.0] [09:16:06] RECOVERY - Puppet failure on deployment-sentry2 is OK Less than 1.00% above the threshold [0.0] [09:16:30] RECOVERY - Puppet failure on deployment-elastic05 is OK Less than 1.00% above the threshold [0.0] [09:19:18] RECOVERY - Puppet failure on deployment-jobrunner01 is OK Less than 1.00% above the threshold [0.0] [09:20:40] RECOVERY - Puppet failure on deployment-upload is OK Less than 1.00% above the threshold [0.0] [09:22:15] RECOVERY - Puppet failure on deployment-db1 is OK Less than 1.00% above the threshold [0.0] [09:23:29] RECOVERY - Puppet failure on deployment-mathoid is OK Less than 1.00% above the threshold [0.0] [09:26:05] (03CR) 10Polybuildr: "I was looking through some of the sniff warnings and realised that there's one case that should be accounted for. There are some /// type " [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/224648 (https://phabricator.wikimedia.org/T101872) (owner: 10Galorefitz) [09:26:47] addshore: there? [09:26:55] oh wow, that is a big coincidence [09:27:07] RECOVERY - Puppet failure on deployment-logstash2 is OK Less than 1.00% above the threshold [0.0] [09:28:53] RECOVERY - Puppet failure on mira is OK Less than 1.00% above the threshold [0.0] [09:31:17] polybuildr: yup [09:31:20] Kind of :p [09:31:43] You are only always "kind of" here -.- :P [09:31:44] RECOVERY - Puppet failure on deployment-mediawiki03 is OK Less than 1.00% above the threshold [0.0] [09:31:52] I know :/ [09:32:01] addshore: need your advice on two things at https://gerrit.wikimedia.org/r/224648 [09:32:06] one, what to do with /// docblocks [09:32:23] and two, empty comments, which the sniff currently does address [09:34:07] Either ignore /// comments, or do the same as is done for // comments [09:34:30] And, well, it makes sense to kill empty comments right? :D [09:34:43] alright, awesome :D [09:34:47] but there is an edge case [09:35:03] docblocks written using // or # :P [09:35:24] Oh, whole blocks with // or #? :p [09:35:24] multiline docblocks using // or # :P [09:35:26] yeah! [09:35:30] RECOVERY - Puppet failure on deployment-mediawiki02 is OK Less than 1.00% above the threshold [0.0] [09:35:34] 10Continuous-Integration-Infrastructure, 6operations, 7Blocked-on-Operations, 5Patch-For-Review: Build Debian package ruby-jsduck for Jessie - https://phabricator.wikimedia.org/T95008#1464744 (10fgiunchedi) @hashar still blocked on operations? [09:35:36] The things we find in the code base when looking through codesniffer :P [09:35:38] Is that even a thing? How many occourances are there? [09:35:55] at least one, but I'm not too sure how many [09:35:59] catch and kill? [09:36:09] Yeh, catch and kill sounds like a plan ;) [09:36:15] awesome :D [09:37:09] Wikibase now has loads of voting phpcs rules :) [09:37:35] (03CR) 10Polybuildr: "Spoke to addshore on IRC. Finding and killing empty comments he agrees with, even if there are entire multiline docblocks written using //" [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/224648 (https://phabricator.wikimedia.org/T101872) (owner: 10Galorefitz) [09:38:05] addshore: oh really? :D where where? [09:38:18] also, since it's the first patch I'm reviewing, I should wait for you or legoktm to +2 right? [09:39:14] This is all voting [09:39:17] https://github.com/wikimedia/mediawiki-extensions-Wikibase/blob/master/phpcs.xml [09:39:48] (03CR) 10Galorefitz: "I was thinking of ignoring them too." [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/224648 (https://phabricator.wikimedia.org/T101872) (owner: 10Galorefitz) [09:40:07] And potentially, yeh jut It a +1 and then poke one of us to look at it :) [09:41:15] (03PS4) 10Galorefitz: Sniff to check for space in single line comments [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/224648 (https://phabricator.wikimedia.org/T101872) [09:54:59] addshore: that phpcs.xml file.. does it use any mw-codesniffer sniffs? :P [09:55:06] or just ones from the standard package? [09:56:49] 10Continuous-Integration-Infrastructure, 5Patch-For-Review: Create CI slaves using Debian Jessie (tracking) - https://phabricator.wikimedia.org/T94836#1464772 (10hashar) [09:56:52] 10Continuous-Integration-Infrastructure, 6operations, 7Blocked-on-Operations, 5Patch-For-Review: Build Debian package ruby-jsduck for Jessie - https://phabricator.wikimedia.org/T95008#1464769 (10hashar) 5Open>3declined a:3hashar Nop, we will migrate to provide jsduck via rubygems.org . Saves us the t... [09:57:06] PROBLEM - Puppet failure on deployment-sentry2 is CRITICAL 33.33% of data above the critical threshold [0.0] [09:57:12] PROBLEM - Puppet failure on deployment-sca02 is CRITICAL 22.22% of data above the critical threshold [0.0] [09:57:57] PROBLEM - Puppet failure on deployment-videoscaler01 is CRITICAL 30.00% of data above the critical threshold [0.0] [09:58:11] PROBLEM - Puppet failure on deployment-db2 is CRITICAL 44.44% of data above the critical threshold [0.0] [09:58:34] 10Continuous-Integration-Infrastructure, 5Patch-For-Review: Create CI slaves using Debian Jessie (tracking) - https://phabricator.wikimedia.org/T94836#1173747 (10hashar) [09:58:36] 10Continuous-Integration-Infrastructure, 6operations, 7Blocked-on-Operations, 5Patch-For-Review: Build Debian package ruby-jsduck for Jessie - https://phabricator.wikimedia.org/T95008#1464773 (10hashar) 5declined>3Open Reopening because we need some cleanup actions. We need to remove on our apt for jes... [09:58:53] PROBLEM - Puppet failure on deployment-redis01 is CRITICAL 20.00% of data above the critical threshold [0.0] [09:58:55] PROBLEM - Puppet failure on deployment-pdf02 is CRITICAL 50.00% of data above the critical threshold [0.0] [09:59:25] PROBLEM - Puppet failure on deployment-pdf01 is CRITICAL 44.44% of data above the critical threshold [0.0] [10:00:19] PROBLEM - Puppet failure on deployment-sca01 is CRITICAL 44.44% of data above the critical threshold [0.0] [10:00:23] polybuildr: doesnt use any mw-codesniffer sniffs yet [10:00:28] okay :P [10:00:47] PROBLEM - Puppet failure on deployment-eventlogging02 is CRITICAL 30.00% of data above the critical threshold [0.0] [10:01:10] PROBLEM - Puppet failure on deployment-test is CRITICAL 33.33% of data above the critical threshold [0.0] [10:01:37] PROBLEM - Puppet failure on deployment-memc03 is CRITICAL 30.00% of data above the critical threshold [0.0] [10:01:44] (03CR) 10Galorefitz: "Sorry, forgot to mention the change in the comments." [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/224648 (https://phabricator.wikimedia.org/T101872) (owner: 10Galorefitz) [10:02:15] (03PS5) 10Galorefitz: Sniff to check for space in single line comments [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/224648 (https://phabricator.wikimedia.org/T101872) [10:02:33] PROBLEM - Puppet failure on deployment-elastic05 is CRITICAL 20.00% of data above the critical threshold [0.0] [10:02:33] PROBLEM - Puppet failure on deployment-memc04 is CRITICAL 40.00% of data above the critical threshold [0.0] [10:02:37] PROBLEM - Puppet failure on deployment-memc02 is CRITICAL 50.00% of data above the critical threshold [0.0] [10:02:54] PROBLEM - Puppet failure on deployment-fluorine is CRITICAL 50.00% of data above the critical threshold [0.0] [10:04:19] PROBLEM - Puppet failure on deployment-elastic07 is CRITICAL 55.56% of data above the critical threshold [0.0] [10:04:47] (03PS6) 10Galorefitz: Sniff to check for space in single line comments [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/224648 (https://phabricator.wikimedia.org/T101872) [10:05:41] PROBLEM - Puppet failure on deployment-salt is CRITICAL 60.00% of data above the critical threshold [0.0] [10:06:41] PROBLEM - Puppet failure on deployment-upload is CRITICAL 20.00% of data above the critical threshold [0.0] [10:07:08] (03CR) 10Polybuildr: "recheck" [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/224648 (https://phabricator.wikimedia.org/T101872) (owner: 10Galorefitz) [10:09:28] PROBLEM - Puppet failure on deployment-mathoid is CRITICAL 50.00% of data above the critical threshold [0.0] [10:09:28] PROBLEM - Puppet failure on deployment-elastic08 is CRITICAL 20.00% of data above the critical threshold [0.0] [10:10:06] PROBLEM - Puppet failure on deployment-redis02 is CRITICAL 55.56% of data above the critical threshold [0.0] [10:10:20] PROBLEM - Puppet failure on deployment-jobrunner01 is CRITICAL 66.67% of data above the critical threshold [0.0] [10:11:54] PROBLEM - Puppet failure on deployment-apertium01 is CRITICAL 20.00% of data above the critical threshold [0.0] [10:13:16] PROBLEM - Puppet failure on deployment-db1 is CRITICAL 66.67% of data above the critical threshold [0.0] [10:13:41] PROBLEM - Puppet failure on deployment-zookeeper01 is CRITICAL 50.00% of data above the critical threshold [0.0] [10:14:29] PROBLEM - Puppet failure on deployment-urldownloader is CRITICAL 22.22% of data above the critical threshold [0.0] [10:14:33] PROBLEM - Puppet failure on deployment-zotero01 is CRITICAL 30.00% of data above the critical threshold [0.0] [10:15:03] PROBLEM - Puppet failure on deployment-mediawiki01 is CRITICAL 66.67% of data above the critical threshold [0.0] [10:16:42] PROBLEM - Puppet failure on deployment-elastic06 is CRITICAL 20.00% of data above the critical threshold [0.0] [10:17:10] PROBLEM - Puppet failure on deployment-bastion is CRITICAL 44.44% of data above the critical threshold [0.0] [10:18:08] PROBLEM - Puppet failure on deployment-logstash2 is CRITICAL 55.56% of data above the critical threshold [0.0] [10:18:42] PROBLEM - Puppet failure on deployment-parsoid05 is CRITICAL 60.00% of data above the critical threshold [0.0] [10:19:50] PROBLEM - Puppet failure on mira is CRITICAL 50.00% of data above the critical threshold [0.0] [10:19:54] PROBLEM - Puppet failure on deployment-kafka02 is CRITICAL 50.00% of data above the critical threshold [0.0] [10:21:24] PROBLEM - Puppet failure on deployment-stream is CRITICAL 50.00% of data above the critical threshold [0.0] [10:21:30] PROBLEM - Puppet failure on deployment-mediawiki02 is CRITICAL 20.00% of data above the critical threshold [0.0] [10:22:36] PROBLEM - Puppet failure on deployment-cxserver03 is CRITICAL 44.44% of data above the critical threshold [0.0] [10:22:42] PROBLEM - Puppet failure on deployment-mediawiki03 is CRITICAL 40.00% of data above the critical threshold [0.0] [10:28:28] (03CR) 10Polybuildr: [C: 031] "There are far too many warnings to check manually, but I looked through a sample and they all look legit." [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/224648 (https://phabricator.wikimedia.org/T101872) (owner: 10Galorefitz) [10:28:39] addshore: ready ^ [10:35:47] 10Deployment-Systems, 6operations, 5Patch-For-Review: Trebuchet doesn't like when a deployer server is also a minion, a edge case for scap - https://phabricator.wikimedia.org/T67549#1464811 (10fgiunchedi) @bd808 @arielglenn thoughts on this? [10:44:49] 10Deployment-Systems, 6operations, 5Patch-For-Review: [Trebuchet] Salt times out on parsoid restarts - https://phabricator.wikimedia.org/T63882#1464818 (10fgiunchedi) @arielglenn what's the status? [10:46:13] 10Deployment-Systems, 6operations, 5Patch-For-Review: install/deploy mira as codfw deployment server - https://phabricator.wikimedia.org/T95436#1464820 (10fgiunchedi) a:3Dzahn [10:49:45] 10Beta-Cluster, 6operations, 5Patch-For-Review: Unify ::production / ::beta roles for *oid - https://phabricator.wikimedia.org/T86633#1464823 (10fgiunchedi) @yuvipanda what's left on this task? also is it blocked on anything? [10:59:45] addshore: poke poke? :P [10:59:51] poke poke [11:02:04] the patch be ready for you to review when free [11:02:17] https://gerrit.wikimedia.org/r/224648 [11:36:32] PROBLEM - Free space - all mounts on deployment-videoscaler01 is CRITICAL deployment-prep.deployment-videoscaler01.diskspace._var.byte_percentfree (<40.00%) [12:07:17] PROBLEM - Puppet failure on integration-slave-jessie-1001 is CRITICAL 100.00% of data above the critical threshold [0.0] [12:18:17] addshore: free to review the patch today or caught up in work? [12:55:11] Yippee, build fixed! [12:55:12] Project browsertests-GettingStarted-en.wikipedia.beta.wmflabs.org-linux-firefox-sauce build #539: FIXED in 1 min 10 sec: https://integration.wikimedia.org/ci/job/browsertests-GettingStarted-en.wikipedia.beta.wmflabs.org-linux-firefox-sauce/539/ [13:09:52] 10Continuous-Integration-Infrastructure, 6operations, 7Blocked-on-Operations, 5Patch-For-Review: Build Debian package ruby-jsduck for Jessie - https://phabricator.wikimedia.org/T95008#1465002 (10fgiunchedi) {{done}} ``` root@carbon:~# reprepro remove jessie-wikimedia ruby-jsduck Exporting indices... Delet... [13:17:25] 10Continuous-Integration-Infrastructure, 6Multimedia, 6operations, 5Patch-For-Review: Investigate impact of switching from ffmpeg to libav (ffmpeg is not in Jessie) - https://phabricator.wikimedia.org/T103335#1465010 (10fgiunchedi) from the announcement this might land in stretch, since we were already usi... [13:17:48] PROBLEM - Puppet staleness on deployment-restbase01 is CRITICAL 100.00% of data above the critical threshold [43200.0] [13:20:45] 10Continuous-Integration-Infrastructure, 6Multimedia, 6operations, 5Patch-For-Review: Investigate impact of switching from ffmpeg to libav (ffmpeg is not in Jessie) - https://phabricator.wikimedia.org/T103335#1465013 (10brion) As long as whatever we switch to supports VP9 and Opus in the build I don't care... [13:25:14] 10Continuous-Integration-Infrastructure, 5Patch-For-Review: Create CI slaves using Debian Jessie (tracking) - https://phabricator.wikimedia.org/T94836#1465033 (10hashar) [13:25:16] 10Continuous-Integration-Infrastructure, 6operations, 7Blocked-on-Operations, 5Patch-For-Review: Build Debian package ruby-jsduck for Jessie - https://phabricator.wikimedia.org/T95008#1465031 (10hashar) 5Open>3Resolved It is gone now. Thanks! [13:33:39] (03CR) 10Hashar: [C: 032] Add composer-test to MaintenanceShell [integration/config] - 10https://gerrit.wikimedia.org/r/225693 (owner: 10Paladox) [13:34:59] (03Merged) 10jenkins-bot: Add composer-test to MaintenanceShell [integration/config] - 10https://gerrit.wikimedia.org/r/225693 (owner: 10Paladox) [13:45:52] 10Deployment-Systems, 6operations, 5Patch-For-Review: Trebuchet doesn't like when a deployer server is also a minion, a edge case for scap - https://phabricator.wikimedia.org/T67549#1465060 (10ArielGlenn) fine to test on deployment-prep; if it works there it's good for prod. [13:49:13] 10Beta-Cluster, 10Compact-Personal-Bar-(Beta), 10MediaWiki-extensions-VectorBeta, 7Beta-Feature, 7user-notice: Remove Compact Personal Bar from Beta Cluster and Production - https://phabricator.wikimedia.org/T104659#1465065 (10Ricordisamoa) a:5Bugreporter>3ori [13:58:09] RECOVERY - Puppet failure on deployment-logstash2 is OK Less than 1.00% above the threshold [0.0] [13:58:41] RECOVERY - Puppet failure on deployment-parsoid05 is OK Less than 1.00% above the threshold [0.0] [13:58:41] RECOVERY - Puppet failure on deployment-zookeeper01 is OK Less than 1.00% above the threshold [0.0] [13:59:27] RECOVERY - Puppet failure on deployment-urldownloader is OK Less than 1.00% above the threshold [0.0] [13:59:30] RECOVERY - Puppet failure on deployment-zotero01 is OK Less than 1.00% above the threshold [0.0] [13:59:50] RECOVERY - Puppet failure on mira is OK Less than 1.00% above the threshold [0.0] [14:00:06] RECOVERY - Puppet failure on deployment-mediawiki01 is OK Less than 1.00% above the threshold [0.0] [14:01:40] RECOVERY - Puppet failure on deployment-elastic06 is OK Less than 1.00% above the threshold [0.0] [14:01:52] RECOVERY - Puppet failure on deployment-apertium01 is OK Less than 1.00% above the threshold [0.0] [14:02:08] RECOVERY - Puppet failure on deployment-bastion is OK Less than 1.00% above the threshold [0.0] [14:02:38] RECOVERY - Puppet failure on deployment-cxserver03 is OK Less than 1.00% above the threshold [0.0] [14:02:44] RECOVERY - Puppet failure on deployment-mediawiki03 is OK Less than 1.00% above the threshold [0.0] [14:04:53] RECOVERY - Puppet failure on deployment-kafka02 is OK Less than 1.00% above the threshold [0.0] [14:06:26] RECOVERY - Puppet failure on deployment-stream is OK Less than 1.00% above the threshold [0.0] [14:06:29] RECOVERY - Puppet failure on deployment-mediawiki02 is OK Less than 1.00% above the threshold [0.0] [14:07:14] RECOVERY - Puppet failure on deployment-sca02 is OK Less than 1.00% above the threshold [0.0] [14:07:56] RECOVERY - Puppet failure on deployment-fluorine is OK Less than 1.00% above the threshold [0.0] [14:07:56] RECOVERY - Puppet failure on deployment-videoscaler01 is OK Less than 1.00% above the threshold [0.0] [14:08:00] RECOVERY - Puppet failure on deployment-mediawiki03 is OK Less than 1.00% above the threshold [0.0] [14:08:12] RECOVERY - Puppet failure on deployment-db2 is OK Less than 1.00% above the threshold [0.0] [14:08:54] RECOVERY - Puppet failure on deployment-pdf02 is OK Less than 1.00% above the threshold [0.0] [14:09:22] RECOVERY - Puppet failure on deployment-pdf01 is OK Less than 1.00% above the threshold [0.0] [14:10:18] RECOVERY - Puppet failure on deployment-sca01 is OK Less than 1.00% above the threshold [0.0] [14:10:44] RECOVERY - Puppet failure on deployment-salt is OK Less than 1.00% above the threshold [0.0] [14:11:36] RECOVERY - Puppet failure on deployment-memc03 is OK Less than 1.00% above the threshold [0.0] [14:12:36] RECOVERY - Puppet failure on deployment-memc04 is OK Less than 1.00% above the threshold [0.0] [14:12:37] RECOVERY - Puppet failure on deployment-memc02 is OK Less than 1.00% above the threshold [0.0] [14:13:53] RECOVERY - Puppet failure on deployment-redis01 is OK Less than 1.00% above the threshold [0.0] [14:14:19] RECOVERY - Puppet failure on deployment-elastic07 is OK Less than 1.00% above the threshold [0.0] [14:15:47] RECOVERY - Puppet failure on deployment-eventlogging02 is OK Less than 1.00% above the threshold [0.0] [14:16:09] RECOVERY - Puppet failure on deployment-test is OK Less than 1.00% above the threshold [0.0] [14:17:09] RECOVERY - Puppet failure on deployment-sentry2 is OK Less than 1.00% above the threshold [0.0] [14:17:31] RECOVERY - Puppet failure on deployment-elastic05 is OK Less than 1.00% above the threshold [0.0] [14:20:21] RECOVERY - Puppet failure on deployment-jobrunner01 is OK Less than 1.00% above the threshold [0.0] [14:21:38] RECOVERY - Puppet failure on deployment-upload is OK Less than 1.00% above the threshold [0.0] [14:23:14] RECOVERY - Puppet failure on deployment-db1 is OK Less than 1.00% above the threshold [0.0] [14:24:28] RECOVERY - Puppet failure on deployment-mathoid is OK Less than 1.00% above the threshold [0.0] [14:24:28] RECOVERY - Puppet failure on deployment-elastic08 is OK Less than 1.00% above the threshold [0.0] [14:25:08] RECOVERY - Puppet failure on deployment-redis02 is OK Less than 1.00% above the threshold [0.0] [14:34:12] (03PS1) 10Hashar: Bump GitPython from 0.3.2.RC1 to 0.3.2.1 [integration/zuul] (debian/precise-wikimedia) - 10https://gerrit.wikimedia.org/r/225890 [14:35:04] Yippee, build fixed! [14:35:04] Project browsertests-Echo-en.wikipedia.beta.wmflabs.org-linux-firefox-sauce build #570: FIXED in 9 min 2 sec: https://integration.wikimedia.org/ci/job/browsertests-Echo-en.wikipedia.beta.wmflabs.org-linux-firefox-sauce/570/ [14:36:06] Yippee, build fixed! [14:36:06] Project browsertests-MobileFrontend-SmokeTests-linux-chrome-sauce build #197: FIXED in 8 min 4 sec: https://integration.wikimedia.org/ci/job/browsertests-MobileFrontend-SmokeTests-linux-chrome-sauce/197/ [14:39:14] (03CR) 10Hashar: [C: 032 V: 032] Bump GitPython from 0.3.2.RC1 to 0.3.2.1 [integration/zuul] (debian/precise-wikimedia) - 10https://gerrit.wikimedia.org/r/225890 (owner: 10Hashar) [14:42:33] (03PS5) 10Hashar: Replace python shebang with python2.7 [integration/zuul] (patch-queue/debian/precise-wikimedia) - 10https://gerrit.wikimedia.org/r/195540 [14:42:35] (03PS5) 10Hashar: Merger: ensure_cloned() now looks for '.git' [integration/zuul] (patch-queue/debian/precise-wikimedia) - 10https://gerrit.wikimedia.org/r/195281 [14:42:37] (03PS5) 10Hashar: wmf: soften requirements [integration/zuul] (patch-queue/debian/precise-wikimedia) - 10https://gerrit.wikimedia.org/r/195280 [14:42:39] (03PS5) 10Hashar: Ensure the repository configuration lock is released [integration/zuul] (patch-queue/debian/precise-wikimedia) - 10https://gerrit.wikimedia.org/r/195283 [14:42:41] (03PS5) 10Hashar: Update merge status after merge:merge is submitted [integration/zuul] (patch-queue/debian/precise-wikimedia) - 10https://gerrit.wikimedia.org/r/195282 [14:42:43] (03PS2) 10Hashar: Cloner: Implement cache-no-hardlinks argument [integration/zuul] (patch-queue/debian/precise-wikimedia) - 10https://gerrit.wikimedia.org/r/207438 [14:42:45] (03PS1) 10Hashar: Bump GitPython from 0.3.2.RC1 to 0.3.2.1 [integration/zuul] (patch-queue/debian/precise-wikimedia) - 10https://gerrit.wikimedia.org/r/225894 [14:46:01] 10Deployment-Systems, 6operations, 5Patch-For-Review: Trebuchet doesn't like when a deployer server is also a minion, a edge case for scap - https://phabricator.wikimedia.org/T67549#1465168 (10fgiunchedi) p:5High>3Normal doubtful this is high priority, @thcipriani looks good to test on deployment-prep an... [14:51:16] (03Abandoned) 10Hashar: Update tests for Metrolook [integration/config] - 10https://gerrit.wikimedia.org/r/224834 (owner: 10Paladox) [14:51:20] (03CR) 10Hashar: Update tests for Metrolook (032 comments) [integration/config] - 10https://gerrit.wikimedia.org/r/224834 (owner: 10Paladox) [15:14:13] PROBLEM - Puppet failure on deployment-restbase02 is CRITICAL 100.00% of data above the critical threshold [0.0] [15:17:51] PROBLEM - Puppet failure on deployment-apertium01 is CRITICAL 30.00% of data above the critical threshold [0.0] [15:18:13] PROBLEM - Puppet failure on deployment-bastion is CRITICAL 55.56% of data above the critical threshold [0.0] [15:18:35] PROBLEM - Puppet failure on deployment-memc04 is CRITICAL 30.00% of data above the critical threshold [0.0] [15:18:41] PROBLEM - Puppet failure on deployment-memc02 is CRITICAL 20.00% of data above the critical threshold [0.0] [15:19:39] PROBLEM - Puppet failure on deployment-zookeeper01 is CRITICAL 50.00% of data above the critical threshold [0.0] [15:19:43] PROBLEM - Puppet failure on deployment-parsoid05 is CRITICAL 30.00% of data above the critical threshold [0.0] [15:20:30] PROBLEM - Puppet failure on deployment-urldownloader is CRITICAL 50.00% of data above the critical threshold [0.0] [15:20:34] PROBLEM - Puppet failure on deployment-zotero01 is CRITICAL 50.00% of data above the critical threshold [0.0] [15:20:52] PROBLEM - Puppet failure on mira is CRITICAL 60.00% of data above the critical threshold [0.0] [15:20:54] PROBLEM - Puppet failure on deployment-kafka02 is CRITICAL 40.00% of data above the critical threshold [0.0] [15:22:34] PROBLEM - Puppet failure on deployment-mediawiki02 is CRITICAL 30.00% of data above the critical threshold [0.0] [15:22:40] PROBLEM - Puppet failure on deployment-memc03 is CRITICAL 60.00% of data above the critical threshold [0.0] [15:22:42] PROBLEM - Puppet failure on deployment-elastic06 is CRITICAL 60.00% of data above the critical threshold [0.0] [15:23:06] PROBLEM - Puppet failure on deployment-sentry2 is CRITICAL 33.33% of data above the critical threshold [0.0] [15:23:14] PROBLEM - Puppet failure on deployment-sca02 is CRITICAL 55.56% of data above the critical threshold [0.0] [15:23:36] PROBLEM - Puppet failure on deployment-cxserver03 is CRITICAL 50.00% of data above the critical threshold [0.0] [15:23:46] PROBLEM - Puppet failure on deployment-mediawiki03 is CRITICAL 60.00% of data above the critical threshold [0.0] [15:24:12] PROBLEM - Puppet failure on deployment-db2 is CRITICAL 55.56% of data above the critical threshold [0.0] [15:24:54] PROBLEM - Puppet failure on deployment-pdf02 is CRITICAL 40.00% of data above the critical threshold [0.0] [15:25:24] PROBLEM - Puppet failure on deployment-pdf01 is CRITICAL 30.00% of data above the critical threshold [0.0] [15:26:21] PROBLEM - Puppet failure on deployment-sca01 is CRITICAL 66.67% of data above the critical threshold [0.0] [15:27:25] PROBLEM - Puppet failure on deployment-stream is CRITICAL 60.00% of data above the critical threshold [0.0] [15:28:55] PROBLEM - Puppet failure on deployment-fluorine is CRITICAL 20.00% of data above the critical threshold [0.0] [15:28:55] PROBLEM - Puppet failure on deployment-videoscaler01 is CRITICAL 40.00% of data above the critical threshold [0.0] [15:31:45] PROBLEM - Puppet failure on deployment-eventlogging02 is CRITICAL 40.00% of data above the critical threshold [0.0] [15:32:07] PROBLEM - Puppet failure on deployment-test is CRITICAL 44.44% of data above the critical threshold [0.0] [15:35:17] PROBLEM - Puppet failure on deployment-elastic07 is CRITICAL 55.56% of data above the critical threshold [0.0] [15:36:18] PROBLEM - Puppet failure on deployment-jobrunner01 is CRITICAL 22.22% of data above the critical threshold [0.0] [15:36:44] PROBLEM - Puppet failure on deployment-salt is CRITICAL 60.00% of data above the critical threshold [0.0] [15:37:38] PROBLEM - Puppet failure on deployment-upload is CRITICAL 50.00% of data above the critical threshold [0.0] [15:38:36] PROBLEM - Puppet failure on deployment-elastic05 is CRITICAL 50.00% of data above the critical threshold [0.0] [15:39:16] PROBLEM - Puppet failure on deployment-db1 is CRITICAL 30.00% of data above the critical threshold [0.0] [15:39:52] PROBLEM - Puppet failure on deployment-redis01 is CRITICAL 100.00% of data above the critical threshold [0.0] [15:40:26] PROBLEM - Puppet failure on deployment-mathoid is CRITICAL 60.00% of data above the critical threshold [0.0] [15:40:28] PROBLEM - Puppet failure on deployment-elastic08 is CRITICAL 20.00% of data above the critical threshold [0.0] [15:41:04] PROBLEM - Puppet failure on deployment-mediawiki01 is CRITICAL 22.22% of data above the critical threshold [0.0] [15:41:04] PROBLEM - Puppet failure on deployment-redis02 is CRITICAL 33.33% of data above the critical threshold [0.0] [15:49:07] PROBLEM - Puppet failure on deployment-logstash2 is CRITICAL 66.67% of data above the critical threshold [0.0] [16:55:26] !log restarted puppetmaster on deployment-salt, was acting whacky [16:55:29] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL, Master [17:00:45] ah, heh [17:00:53] thcipriani: ignore my reply to that thread on releng@ then :) [17:01:02] also, welcome home? [17:05:24] RECOVERY - Puppet failure on deployment-pdf01 is OK Less than 1.00% above the threshold [0.0] [17:06:21] RECOVERY - Puppet failure on deployment-sca01 is OK Less than 1.00% above the threshold [0.0] [17:08:12] RECOVERY - Puppet failure on deployment-sca02 is OK Less than 1.00% above the threshold [0.0] [17:08:36] RECOVERY - Puppet failure on deployment-memc02 is OK Less than 1.00% above the threshold [0.0] [17:08:54] RECOVERY - Puppet failure on deployment-fluorine is OK Less than 1.00% above the threshold [0.0] [17:08:54] RECOVERY - Puppet failure on deployment-videoscaler01 is OK Less than 1.00% above the threshold [0.0] [17:11:42] RECOVERY - Puppet failure on deployment-salt is OK Less than 1.00% above the threshold [0.0] [17:12:36] RECOVERY - Puppet failure on deployment-memc03 is OK Less than 1.00% above the threshold [0.0] [17:13:10] RECOVERY - Puppet failure on deployment-bastion is OK Less than 1.00% above the threshold [0.0] [17:13:34] RECOVERY - Puppet failure on deployment-memc04 is OK Less than 1.00% above the threshold [0.0] [17:14:55] RECOVERY - Puppet failure on deployment-redis01 is OK Less than 1.00% above the threshold [0.0] [17:15:02] greg-g: nope in phoenix airport [17:15:17] just had the Monday deployment cabal meeting which probably made me look like a crazy person. [17:15:21] RECOVERY - Puppet failure on deployment-elastic07 is OK Less than 1.00% above the threshold [0.0] [17:16:07] now I've got to find a charging station... [17:16:17] RECOVERY - Puppet failure on deployment-jobrunner01 is OK Less than 1.00% above the threshold [0.0] [17:16:45] RECOVERY - Puppet failure on deployment-eventlogging02 is OK Less than 1.00% above the threshold [0.0] [17:17:09] RECOVERY - Puppet failure on deployment-test is OK Less than 1.00% above the threshold [0.0] [17:18:07] RECOVERY - Puppet failure on deployment-sentry2 is OK Less than 1.00% above the threshold [0.0] [17:18:33] RECOVERY - Puppet failure on deployment-elastic05 is OK Less than 1.00% above the threshold [0.0] [17:21:05] RECOVERY - Puppet failure on deployment-mediawiki01 is OK Less than 1.00% above the threshold [0.0] [17:22:43] RECOVERY - Puppet failure on deployment-upload is OK Less than 1.00% above the threshold [0.0] [17:24:08] RECOVERY - Puppet failure on deployment-logstash2 is OK Less than 1.00% above the threshold [0.0] [17:24:16] RECOVERY - Puppet failure on deployment-db1 is OK Less than 1.00% above the threshold [0.0] [17:25:18] PROBLEM - Puppet failure on nodepool-t105406 is CRITICAL 100.00% of data above the critical threshold [0.0] [17:25:28] RECOVERY - Puppet failure on deployment-elastic08 is OK Less than 1.00% above the threshold [0.0] [17:25:28] RECOVERY - Puppet failure on deployment-urldownloader is OK Less than 1.00% above the threshold [0.0] [17:25:28] RECOVERY - Puppet failure on deployment-mathoid is OK Less than 1.00% above the threshold [0.0] [17:26:06] RECOVERY - Puppet failure on deployment-redis02 is OK Less than 1.00% above the threshold [0.0] [17:27:40] RECOVERY - Puppet failure on deployment-elastic06 is OK Less than 1.00% above the threshold [0.0] [17:27:52] RECOVERY - Puppet failure on deployment-apertium01 is OK Less than 1.00% above the threshold [0.0] [17:29:40] RECOVERY - Puppet failure on deployment-zookeeper01 is OK Less than 1.00% above the threshold [0.0] [17:29:42] RECOVERY - Puppet failure on deployment-parsoid05 is OK Less than 1.00% above the threshold [0.0] [17:30:32] RECOVERY - Puppet failure on deployment-zotero01 is OK Less than 1.00% above the threshold [0.0] [17:30:51] RECOVERY - Puppet failure on mira is OK Less than 1.00% above the threshold [0.0] [17:32:37] RECOVERY - Puppet failure on deployment-mediawiki02 is OK Less than 1.00% above the threshold [0.0] [17:33:36] RECOVERY - Puppet failure on deployment-cxserver03 is OK Less than 1.00% above the threshold [0.0] [17:33:44] RECOVERY - Puppet failure on deployment-mediawiki03 is OK Less than 1.00% above the threshold [0.0] [17:34:16] RECOVERY - Puppet failure on deployment-db2 is OK Less than 1.00% above the threshold [0.0] [17:34:57] thcipriani|afk: :) awesome. Safe travels and thanks for the airport restart [17:35:52] RECOVERY - Puppet failure on deployment-kafka02 is OK Less than 1.00% above the threshold [0.0] [17:37:26] RECOVERY - Puppet failure on deployment-stream is OK Less than 1.00% above the threshold [0.0] [17:39:58] RECOVERY - Puppet failure on deployment-pdf02 is OK Less than 1.00% above the threshold [0.0] [17:52:27] addshore: sorry had to leave earlier [18:14:38] 10Browser-Tests: Rights to create an account needed for page creation in mediawiki selenium gem - https://phabricator.wikimedia.org/T106343#1465574 (10Jdlrobson) 3NEW [18:25:15] 10Browser-Tests: Suddenly user rights needed in mediawiki selenium gem (?) - https://phabricator.wikimedia.org/T106343#1465609 (10Jdlrobson) [18:29:07] 10Browser-Tests: Suddenly user rights needed in mediawiki selenium gem (?) - https://phabricator.wikimedia.org/T106343#1465612 (10Jdlrobson) It looks like a new user is created for the purpose of page creation. We should not do this.. since some pages require certain rights to be edited... and this will result i... [18:33:30] (03PS4) 10Hashar: Remove Mantle from dependency tree for several extensions [integration/config] - 10https://gerrit.wikimedia.org/r/225687 (owner: 10Florianschmidtwelzow) [18:33:56] (03CR) 10Hashar: "Jon, for info, Mantle is being removed from CI dependencies :-)" [integration/config] - 10https://gerrit.wikimedia.org/r/225687 (owner: 10Florianschmidtwelzow) [18:34:28] Does anyone know what's with the .travis.yml file in core? I don't think Travis is used at all and the file itself refers to a Travis URL that doesn't exist because the relevant repo doesn't exist [18:37:05] (03CR) 10Hashar: "The coverage job on labs is at https://integration.wikimedia.org/ci/job/mediawiki-core-code-coverage-2/" [integration/config] - 10https://gerrit.wikimedia.org/r/225063 (https://phabricator.wikimedia.org/T93559) (owner: 10Hashar) [18:53:11] 10Browser-Tests: mediawiki selenium gem creates a new user for every page created - https://phabricator.wikimedia.org/T106343#1465648 (10Jdlrobson) [18:54:53] 10Browser-Tests: mediawiki selenium gem creates a new user for every page created - https://phabricator.wikimedia.org/T106343#1465574 (10Jdlrobson) I've created https://gerrit.wikimedia.org/r/225934 which should fail with the failures I am now getting with Barry [18:56:19] hasharAway: cool :) [19:27:43] 10Beta-Cluster, 6Release-Engineering: Enable image rotation on beta for testing purposes - https://phabricator.wikimedia.org/T105877#1465697 (10hashar) 5Open>3declined a:3hashar There is no image rotation API I know of, so I don't see how we could enable it on beta cluster :( [19:30:22] 10Beta-Cluster, 10MediaWiki-Internationalization, 7Wikimedia-log-errors: Viewing beta's en_rtlwiki just throws a fatal exception - https://phabricator.wikimedia.org/T106125#1465701 (10hashar) That seems to be a localization cache issue which happened from time to time ages ago. I can't remember how it works... [19:30:32] 10Beta-Cluster, 10MediaWiki-Internationalization: Viewing beta's en_rtlwiki just throws a fatal exception - https://phabricator.wikimedia.org/T106125#1465705 (10hashar) [19:30:57] 10Beta-Cluster, 10MediaWiki-Internationalization: Viewing beta's en_rtlwiki just throws a fatal exception - https://phabricator.wikimedia.org/T106125#1465707 (10hashar) p:5Triage>3Normal [19:31:58] 10Beta-Cluster: Lynx warns about invalid cookie for wmflabs.org from Beta Cluster - https://phabricator.wikimedia.org/T104478#1465708 (10hashar) 5Open>3declined a:3hashar Lets close this bug from our bug tracker, we have enough to triage as is and lynx is certainly not a priority. [19:36:26] 10Beta-Cluster, 6Labs, 6operations, 7Monitoring: Setup (simple) catchpoint monitoring for enwiki betacluster just like production - https://phabricator.wikimedia.org/T97865#1465714 (10hashar) Poked our internal ops mailling list. [19:39:44] (03CR) 10Hashar: [C: 032] "Updated jobs:" [integration/config] - 10https://gerrit.wikimedia.org/r/225687 (owner: 10Florianschmidtwelzow) [19:45:14] (03Merged) 10jenkins-bot: Remove Mantle from dependency tree for several extensions [integration/config] - 10https://gerrit.wikimedia.org/r/225687 (owner: 10Florianschmidtwelzow) [20:47:02] 10Beta-Cluster, 6Release-Engineering: Enable image rotation on beta for testing purposes - https://phabricator.wikimedia.org/T105877#1465819 (10Reedy) 5declined>3Open >>! In T105877#1465697, @hashar wrote: > There is no image rotation API I know of, so I don't see how we could enable it on beta cluster :(... [21:51:17] (03PS5) 10Paladox: Update MwEmbedSupport tests [integration/config] - 10https://gerrit.wikimedia.org/r/225239 [21:57:39] (03PS1) 10Paladox: Fix MwEmbedSupport dependance of TimedMediaHandler [integration/config] - 10https://gerrit.wikimedia.org/r/226027 [21:57:55] (03PS2) 10Paladox: Fix MwEmbedSupport dependance of TimedMediaHandler [integration/config] - 10https://gerrit.wikimedia.org/r/226027 [21:59:37] (03PS4) 10Paladox: Add check for json in TwitterLogin [integration/config] - 10https://gerrit.wikimedia.org/r/225711 [21:59:44] (03PS4) 10Paladox: Update TwitterLogin tests [integration/config] - 10https://gerrit.wikimedia.org/r/225712 [22:31:55] 10Browser-Tests: mediawiki selenium gem creates a new user for every page created - https://phabricator.wikimedia.org/T106343#1465969 (10Jdlrobson) [22:36:53] 10Browser-Tests: mediawiki selenium gem creates a new user for every page created - https://phabricator.wikimedia.org/T106343#1465972 (10Jdlrobson) Seems to be caused by the upgrade in mediawiki selenium https://gerrit.wikimedia.org/r/#/c/221313/5/Gemfile In mean time I've made it so Barry doesn't run bundle ins... [22:44:54] (03PS14) 10Paladox: Update tests for Vector skin [integration/config] - 10https://gerrit.wikimedia.org/r/224824 [22:45:03] (03PS13) 10Paladox: Update theme tests [integration/config] - 10https://gerrit.wikimedia.org/r/224838 [22:49:03] (03PS6) 10Paladox: Update tests in vector extension [integration/config] - 10https://gerrit.wikimedia.org/r/225029 [22:50:35] (03PS7) 10Paladox: Update SyntaxHighlight_GeSHi tests [integration/config] - 10https://gerrit.wikimedia.org/r/225035 [22:52:27] (03PS5) 10Paladox: Update farmer tests [integration/config] - 10https://gerrit.wikimedia.org/r/225042 [22:52:56] (03PS5) 10Paladox: Update CheckUser tests [integration/config] - 10https://gerrit.wikimedia.org/r/225182 [22:53:17] (03PS3) 10Paladox: Remove unused mwext-MaintenanceShell test [integration/config] - 10https://gerrit.wikimedia.org/r/225220 [22:53:53] (03PS5) 10Paladox: Update Maintenance extension tests [integration/config] - 10https://gerrit.wikimedia.org/r/225222 [22:54:47] (03Abandoned) 10Paladox: Remove unused mwext-MaintenanceShell test [integration/config] - 10https://gerrit.wikimedia.org/r/225220 (owner: 10Paladox) [22:55:45] (03PS4) 10Paladox: Remove unused mwext-MaintenanceShell [integration/config] - 10https://gerrit.wikimedia.org/r/225293 [22:56:15] (03PS5) 10Paladox: Update AjaxLogin tests [integration/config] - 10https://gerrit.wikimedia.org/r/225289 [22:56:44] (03PS5) 10Paladox: Remove unused mwext-MaintenanceShell test [integration/config] - 10https://gerrit.wikimedia.org/r/225293 [22:56:52] (03PS8) 10Paladox: Update interwiki tests [integration/config] - 10https://gerrit.wikimedia.org/r/225313 [23:08:22] (03PS6) 10Krinkle: Remove unused mwext-MaintenanceShell-jslint job [integration/config] - 10https://gerrit.wikimedia.org/r/225293 (owner: 10Paladox) [23:08:45] (03CR) 10Krinkle: [C: 032] Remove unused mwext-MaintenanceShell-jslint job [integration/config] - 10https://gerrit.wikimedia.org/r/225293 (owner: 10Paladox) [23:10:39] (03CR) 10Paladox: "Thanks." [integration/config] - 10https://gerrit.wikimedia.org/r/225293 (owner: 10Paladox) [23:11:01] (03Merged) 10jenkins-bot: Remove unused mwext-MaintenanceShell-jslint job [integration/config] - 10https://gerrit.wikimedia.org/r/225293 (owner: 10Paladox) [23:11:07] (03PS3) 10Paladox: Fix MwEmbedSupport dependance of TimedMediaHandler [integration/config] - 10https://gerrit.wikimedia.org/r/226027 [23:12:36] (03CR) 10Krinkle: "This doesn't change anything with TimedMediaHandler. It adds a redundant item for MwEmbedSupport which already exists implicitly." [integration/config] - 10https://gerrit.wikimedia.org/r/226027 (owner: 10Paladox) [23:14:03] (03Abandoned) 10Krinkle: Update MwEmbedSupport tests [integration/config] - 10https://gerrit.wikimedia.org/r/225239 (owner: 10Paladox) [23:14:59] (03CR) 10Paladox: "@Krinkle how do I do that since timedmediahandler already has MwEmbedSupport and dependacy." [integration/config] - 10https://gerrit.wikimedia.org/r/226027 (owner: 10Paladox) [23:19:58] 10Browser-Tests, 3Reading-Web: Figure how to get WebDriver to spoof browser geolocation preferences - https://phabricator.wikimedia.org/T59333#1466016 (10Jdlrobson) 5Open>3declined a:3Jdlrobson Doesn't look like this will happen.. [23:20:21] 10Browser-Tests, 5Patch-For-Review, 3Reading-Web, 7Upstream: Upstream: Issue with Chrome driver with resizing window - https://phabricator.wikimedia.org/T88288#1466019 (10Jdlrobson) [23:20:45] 10Browser-Tests, 3Reading-Web: MobileFrontend Selenium tests do not use page object pattern - https://phabricator.wikimedia.org/T65620#1466021 (10Jdlrobson) Is this bug still valid? What needs to be done? [23:21:17] (03CR) 10Paladox: "Hi this should work if the MwEmbedSupport tests are updated to use the new test. For example look at echo tests." [integration/config] - 10https://gerrit.wikimedia.org/r/226027 (owner: 10Paladox) [23:24:04] (03CR) 10Krinkle: "Yes, but in commit 7202072059ee you changed the Jenkins job from extension-unittests to extension-unittests-generic. The generic variant i" [integration/config] - 10https://gerrit.wikimedia.org/r/226027 (owner: 10Paladox) [23:25:12] (03CR) 10Krinkle: "fixme: Please revert back to not using generic. The generic is an optimisation for some extensions that don't have dependencies. That is n" [integration/config] - 10https://gerrit.wikimedia.org/r/225246 (owner: 10Paladox) [23:31:44] PROBLEM - Puppet failure on deployment-cache-text02 is CRITICAL 100.00% of data above the critical threshold [0.0] [23:35:27] (03PS1) 10Paladox: Fixed TimedMediaHandler test [integration/config] - 10https://gerrit.wikimedia.org/r/226034 [23:35:36] (03PS2) 10Paladox: Fixed TimedMediaHandler test [integration/config] - 10https://gerrit.wikimedia.org/r/226034 [23:36:46] (03PS3) 10Paladox: Fixed TimedMediaHandler test [integration/config] - 10https://gerrit.wikimedia.org/r/226034 [23:37:01] (03CR) 10Paladox: "Ok I have uploaded the patch here https://gerrit.wikimedia.org/r/#/c/226034/" [integration/config] - 10https://gerrit.wikimedia.org/r/225246 (owner: 10Paladox) [23:38:57] (03Restored) 10Paladox: Update MwEmbedSupport tests [integration/config] - 10https://gerrit.wikimedia.org/r/225239 (owner: 10Paladox) [23:46:27] (03PS6) 10Paladox: Update MwEmbedSupport tests [integration/config] - 10https://gerrit.wikimedia.org/r/225239 [23:47:23] (03PS5) 10Paladox: Update ConfirmAccount tests [integration/config] - 10https://gerrit.wikimedia.org/r/225311