[00:13:27] 06Release-Engineering-Team, 10Fundraising-Backlog, 10MediaWiki-extensions-CentralNotice: Weekly "misc MediaWiki extensions" deployment window proposal - https://phabricator.wikimedia.org/T148808#2733554 (10Dereckson) [00:14:39] 06Release-Engineering-Team, 10Fundraising-Backlog, 10MediaWiki-extensions-CentralNotice: Weekly "misc MediaWiki extensions" deployment window proposal - https://phabricator.wikimedia.org/T148808#2733571 (10Dereckson) [00:15:05] 06Release-Engineering-Team, 10Fundraising-Backlog, 10MediaWiki-extensions-CentralNotice: Weekly "misc MediaWiki extensions" deployment window proposal - https://phabricator.wikimedia.org/T148808#2733554 (10Dereckson) [00:31:04] 10Beta-Cluster-Infrastructure, 10WikimediaPageViewInfo: Deploy WikimediaPageViewInfo extension to beta cluster - https://phabricator.wikimedia.org/T129602#2733581 (10MZMcBride) >>! In T129602#2733358, @Tgr wrote: > It would defeat the point of beta (even if that point is a somewhat indistinct mix of testing, i... [00:46:23] PROBLEM - Puppet run on integration-slave-precise-1002 is CRITICAL: CRITICAL: 60.00% of data above the critical threshold [0.0] [00:55:27] (03PS2) 10Niedzielski: Android: enable ANSI console coloring & timestamps [integration/config] - 10https://gerrit.wikimedia.org/r/317068 [00:55:29] (03PS4) 10Niedzielski: Android: upgrade emulator to API 24 [integration/config] - 10https://gerrit.wikimedia.org/r/314788 (https://phabricator.wikimedia.org/T133183) [01:21:24] RECOVERY - Puppet run on integration-slave-precise-1002 is OK: OK: Less than 1.00% above the threshold [0.0] [04:15:59] PROBLEM - Puppet run on repository is CRITICAL: CRITICAL: 60.00% of data above the critical threshold [0.0] [04:50:59] RECOVERY - Puppet run on repository is OK: OK: Less than 1.00% above the threshold [0.0] [06:36:03] (03PS4) 10Robert Vogel: [BlueSpiceSMWConnector] Add jenkins tests [integration/config] - 10https://gerrit.wikimedia.org/r/316297 (owner: 10Paladox) [08:41:34] 06Release-Engineering-Team, 06Operations, 10Ops-Access-Requests, 13Patch-For-Review: Add Tyler Cipriani to releasers-mediawiki - https://phabricator.wikimedia.org/T148681#2729869 (10elukey) As far as I can see so sudo is granted for this group, so we'd only need for the usual three days period before proce... [08:42:01] PROBLEM - Puppet run on repository is CRITICAL: CRITICAL: 20.00% of data above the critical threshold [0.0] [09:21:59] PROBLEM - Puppet run on deployment-eventlogging03 is CRITICAL: CRITICAL: 20.00% of data above the critical threshold [0.0] [09:21:59] RECOVERY - Puppet run on repository is OK: OK: Less than 1.00% above the threshold [0.0] [09:42:15] !log decommission of deployment-elastic08 - T147777 [09:42:20] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL, Master [09:42:59] PROBLEM - Puppet run on repository is CRITICAL: CRITICAL: 30.00% of data above the critical threshold [0.0] [09:48:27] PROBLEM - Host deployment-elastic08 is DOWN: CRITICAL - Host Unreachable (10.68.17.188) [10:01:58] RECOVERY - Puppet run on deployment-eventlogging03 is OK: OK: Less than 1.00% above the threshold [0.0] [10:06:39] 10Beta-Cluster-Infrastructure, 05Goal, 07Tracking: Consolidate, remove, and/or downsize Beta Cluster instances to help with [[wikitech:Purge_2016]] - https://phabricator.wikimedia.org/T142288#2734025 (10Gehel) deployment-elastic08 is now dead (see T147777). [10:06:55] 10Beta-Cluster-Infrastructure, 05Goal, 07Tracking: Consolidate, remove, and/or downsize Beta Cluster instances to help with [[wikitech:Purge_2016]] - https://phabricator.wikimedia.org/T142288#2734026 (10Gehel) [10:22:58] RECOVERY - Puppet run on repository is OK: OK: Less than 1.00% above the threshold [0.0] [10:50:31] (03CR) 10Paladox: "@Robert Vogel releng is out this week so most likely this will be seen to next week :)" [integration/config] - 10https://gerrit.wikimedia.org/r/316297 (owner: 10Paladox) [12:01:39] Project selenium-RelatedArticles » chrome,beta-desktop,Linux,contintLabsSlave && UbuntuTrusty build #183: 04FAILURE in 38 sec: https://integration.wikimedia.org/ci/job/selenium-RelatedArticles/BROWSER=chrome,MEDIAWIKI_ENVIRONMENT=beta-desktop,PLATFORM=Linux,label=contintLabsSlave%20&&%20UbuntuTrusty/183/ [13:43:30] PROBLEM - Puppet run on deployment-cache-text04 is CRITICAL: CRITICAL: 30.00% of data above the critical threshold [0.0] [13:43:48] PROBLEM - Puppet run on deployment-kafka04 is CRITICAL: CRITICAL: 22.22% of data above the critical threshold [0.0] [13:44:36] PROBLEM - Puppet run on deployment-redis02 is CRITICAL: CRITICAL: 30.00% of data above the critical threshold [0.0] [13:44:42] PROBLEM - Puppet run on deployment-mathoid is CRITICAL: CRITICAL: 40.00% of data above the critical threshold [0.0] [13:45:52] PROBLEM - Puppet run on deployment-logstash2 is CRITICAL: CRITICAL: 30.00% of data above the critical threshold [0.0] [13:46:49] PROBLEM - Puppet run on deployment-zookeeper01 is CRITICAL: CRITICAL: 22.22% of data above the critical threshold [0.0] [13:47:05] PROBLEM - Puppet run on deployment-zotero01 is CRITICAL: CRITICAL: 22.22% of data above the critical threshold [0.0] [13:48:21] PROBLEM - Puppet run on deployment-salt02 is CRITICAL: CRITICAL: 22.22% of data above the critical threshold [0.0] [13:48:31] PROBLEM - Puppet run on deployment-restbase01 is CRITICAL: CRITICAL: 55.56% of data above the critical threshold [0.0] [13:48:56] PROBLEM - Puppet run on deployment-pdfrender is CRITICAL: CRITICAL: 22.22% of data above the critical threshold [0.0] [13:49:06] PROBLEM - Puppet run on deployment-conf03 is CRITICAL: CRITICAL: 66.67% of data above the critical threshold [0.0] [13:49:28] PROBLEM - Puppet run on deployment-mediawiki05 is CRITICAL: CRITICAL: 55.56% of data above the critical threshold [0.0] [13:49:36] PROBLEM - Puppet run on deployment-parsoid09 is CRITICAL: CRITICAL: 60.00% of data above the critical threshold [0.0] [13:49:46] PROBLEM - Puppet run on deployment-sca03 is CRITICAL: CRITICAL: 30.00% of data above the critical threshold [0.0] [13:50:12] PROBLEM - Puppet run on deployment-elastic06 is CRITICAL: CRITICAL: 55.56% of data above the critical threshold [0.0] [13:50:36] PROBLEM - Puppet run on deployment-jobrunner02 is CRITICAL: CRITICAL: 55.56% of data above the critical threshold [0.0] [13:50:48] PROBLEM - Puppet run on deployment-changeprop is CRITICAL: CRITICAL: 44.44% of data above the critical threshold [0.0] [13:51:11] PROBLEM - Puppet run on deployment-urldownloader is CRITICAL: CRITICAL: 66.67% of data above the critical threshold [0.0] [13:52:31] PROBLEM - Puppet run on deployment-mira is CRITICAL: CRITICAL: 55.56% of data above the critical threshold [0.0] [13:53:39] PROBLEM - Puppet run on deployment-apertium02 is CRITICAL: CRITICAL: 60.00% of data above the critical threshold [0.0] [14:03:12] ehm [14:03:14] jenkins: [14:03:15] 26 [RuntimeException] [14:03:18] 13:59:26 Error Output: PHP Deprecated: Comments starting with '#' are deprecated in /etc/php5/cli/conf.d/20-xhprof.ini on line 2 in Unknown on line 0 [14:12:32] thedj that is known [14:12:37] Shoulden affect anything [14:12:44] has been like that for the last few months [14:14:00] PROBLEM - Puppet run on repository is CRITICAL: CRITICAL: 40.00% of data above the critical threshold [0.0] [14:15:12] ah, i thought it was a problem because it was in the fail of my build, but only because the fail apparantly had no other output, forwarding this as the critical error. [14:15:33] Oh. [14:16:17] thedj https://integration.wikimedia.org/ci/job/composer-php55-trusty/626/console ? [14:16:45] that is a phpcs error so it will fail and it is likly that Error Output: PHP Deprecated: Comments starting with '#' are deprecated in /etc/php5/cli/conf.d/20-xhprof.ini on line 2 in Unknown on line 0 got cought in it [14:18:32] RECOVERY - Puppet run on deployment-restbase01 is OK: OK: Less than 1.00% above the threshold [0.0] [14:23:31] RECOVERY - Puppet run on deployment-cache-text04 is OK: OK: Less than 1.00% above the threshold [0.0] [14:23:49] RECOVERY - Puppet run on deployment-kafka04 is OK: OK: Less than 1.00% above the threshold [0.0] [14:24:05] RECOVERY - Puppet run on deployment-conf03 is OK: OK: Less than 1.00% above the threshold [0.0] [14:24:15] PROBLEM - Puppet run on deployment-ores-redis is CRITICAL: CRITICAL: 33.33% of data above the critical threshold [0.0] [14:24:28] RECOVERY - Puppet run on deployment-mediawiki05 is OK: OK: Less than 1.00% above the threshold [0.0] [14:24:36] RECOVERY - Puppet run on deployment-parsoid09 is OK: OK: Less than 1.00% above the threshold [0.0] [14:24:36] RECOVERY - Puppet run on deployment-redis02 is OK: OK: Less than 1.00% above the threshold [0.0] [14:24:42] RECOVERY - Puppet run on deployment-mathoid is OK: OK: Less than 1.00% above the threshold [0.0] [14:25:36] RECOVERY - Puppet run on deployment-jobrunner02 is OK: OK: Less than 1.00% above the threshold [0.0] [14:25:50] RECOVERY - Puppet run on deployment-changeprop is OK: OK: Less than 1.00% above the threshold [0.0] [14:25:52] RECOVERY - Puppet run on deployment-logstash2 is OK: OK: Less than 1.00% above the threshold [0.0] [14:26:08] RECOVERY - Puppet run on deployment-urldownloader is OK: OK: Less than 1.00% above the threshold [0.0] [14:26:50] RECOVERY - Puppet run on deployment-zookeeper01 is OK: OK: Less than 1.00% above the threshold [0.0] [14:27:04] RECOVERY - Puppet run on deployment-zotero01 is OK: OK: Less than 1.00% above the threshold [0.0] [14:27:32] RECOVERY - Puppet run on deployment-mira is OK: OK: Less than 1.00% above the threshold [0.0] [14:28:18] RECOVERY - Puppet run on deployment-salt02 is OK: OK: Less than 1.00% above the threshold [0.0] [14:28:40] RECOVERY - Puppet run on deployment-apertium02 is OK: OK: Less than 1.00% above the threshold [0.0] [14:28:56] RECOVERY - Puppet run on deployment-pdfrender is OK: OK: Less than 1.00% above the threshold [0.0] [14:29:47] RECOVERY - Puppet run on deployment-sca03 is OK: OK: Less than 1.00% above the threshold [0.0] [14:30:15] RECOVERY - Puppet run on deployment-elastic06 is OK: OK: Less than 1.00% above the threshold [0.0] [14:54:00] RECOVERY - Puppet run on repository is OK: OK: Less than 1.00% above the threshold [0.0] [15:04:13] RECOVERY - Puppet run on deployment-ores-redis is OK: OK: Less than 1.00% above the threshold [0.0] [15:48:30] Yippee, build fixed! [15:48:30] Project selenium-MobileFrontend » chrome,beta,Linux,contintLabsSlave && UbuntuTrusty build #200: 09FIXED in 26 min: https://integration.wikimedia.org/ci/job/selenium-MobileFrontend/BROWSER=chrome,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=Linux,label=contintLabsSlave%20&&%20UbuntuTrusty/200/ [15:55:07] PROBLEM - Long lived cherry-picks on puppetmaster on deployment-puppetmaster is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [0.0] [16:12:26] PROBLEM - Puppet run on integration-slave-precise-1002 is CRITICAL: CRITICAL: 22.22% of data above the critical threshold [0.0] [16:15:30] PROBLEM - Puppet run on integration-slave-trusty-1003 is CRITICAL: CRITICAL: 50.00% of data above the critical threshold [0.0] [16:45:00] PROBLEM - Puppet run on repository is CRITICAL: CRITICAL: 50.00% of data above the critical threshold [0.0] [16:50:34] RECOVERY - Puppet run on integration-slave-trusty-1003 is OK: OK: Less than 1.00% above the threshold [0.0] [16:52:22] RECOVERY - Puppet run on integration-slave-precise-1002 is OK: OK: Less than 1.00% above the threshold [0.0] [17:19:59] RECOVERY - Puppet run on repository is OK: OK: Less than 1.00% above the threshold [0.0] [17:21:19] (03PS1) 10Paladox: Merge [integration/config] - 10https://gerrit.wikimedia.org/r/317176 [17:21:21] (03PS1) 10Paladox: Make operations-puppet-tox-jessie-non-voting job non voting temporarily [integration/config] - 10https://gerrit.wikimedia.org/r/317177 [17:21:42] (03Abandoned) 10Paladox: Make operations-puppet-tox-jessie-non-voting job non voting temporarily [integration/config] - 10https://gerrit.wikimedia.org/r/317177 (owner: 10Paladox) [17:22:00] (03PS2) 10Paladox: Merge [integration/config] - 10https://gerrit.wikimedia.org/r/317176 [17:22:12] (03Restored) 10Paladox: Make operations-puppet-tox-jessie-non-voting job non voting temporarily [integration/config] - 10https://gerrit.wikimedia.org/r/317177 (owner: 10Paladox) [17:23:27] (03PS3) 10Paladox: Merge [integration/config] - 10https://gerrit.wikimedia.org/r/317176 [17:23:42] (03PS4) 10Paladox: Make operations-puppet-tox-jessie-non-voting job non voting temporarily [integration/config] - 10https://gerrit.wikimedia.org/r/317176 [17:24:18] (03CR) 10jenkins-bot: [V: 04-1] Make operations-puppet-tox-jessie-non-voting job non voting temporarily [integration/config] - 10https://gerrit.wikimedia.org/r/317176 (owner: 10Paladox) [17:30:42] (03Abandoned) 10Paladox: Make operations-puppet-tox-jessie-non-voting job non voting temporarily [integration/config] - 10https://gerrit.wikimedia.org/r/317176 (owner: 10Paladox) [17:30:46] (03Abandoned) 10Paladox: Make operations-puppet-tox-jessie-non-voting job non voting temporarily [integration/config] - 10https://gerrit.wikimedia.org/r/317177 (owner: 10Paladox) [17:45:59] PROBLEM - Puppet run on repository is CRITICAL: CRITICAL: 60.00% of data above the critical threshold [0.0] [18:20:58] RECOVERY - Puppet run on repository is OK: OK: Less than 1.00% above the threshold [0.0] [18:24:20] PROBLEM - Host integration-puppetmaster is DOWN: CRITICAL - Host Unreachable (10.68.16.42) [18:57:45] 06Release-Engineering-Team, 07Documentation, 07Easy: Merge Wikimedia's "Deployment checklist for new extensions" doc pages - https://phabricator.wikimedia.org/T142081#2735012 (10Aklapper) @Xephyr826: Thanks a lot! The more I think about this task, the more I think this is not an #easy task, as I don't think... [19:01:04] Project selenium-CentralNotice » firefox,beta,Windows 7,contintLabsSlave && UbuntuTrusty build #186: 15ABORTED in 3 hr 0 min: https://integration.wikimedia.org/ci/job/selenium-CentralNotice/BROWSER=firefox,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=Windows%207,label=contintLabsSlave%20&&%20UbuntuTrusty/186/ [19:01:05] Project selenium-CentralNotice » chrome,beta,Windows 7,contintLabsSlave && UbuntuTrusty build #186: 15ABORTED in 3 hr 0 min: https://integration.wikimedia.org/ci/job/selenium-CentralNotice/BROWSER=chrome,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=Windows%207,label=contintLabsSlave%20&&%20UbuntuTrusty/186/ [19:33:53] PROBLEM - Puppet run on deployment-redis01 is CRITICAL: CRITICAL: 20.00% of data above the critical threshold [0.0] [19:57:15] PROBLEM - Puppet run on integration-slave-trusty-1012 is CRITICAL: CRITICAL: 66.67% of data above the critical threshold [0.0] [20:13:53] RECOVERY - Puppet run on deployment-redis01 is OK: OK: Less than 1.00% above the threshold [0.0] [20:14:03] 06Release-Engineering-Team, 07Documentation, 07Easy: Merge Wikimedia's "Deployment checklist for new extensions" doc pages - https://phabricator.wikimedia.org/T142081#2735198 (10Xephyr826) @Aklapper , No problem. I can take a shot at splitting out the "how to write an extension" parts. By the way, I wanted... [20:32:13] RECOVERY - Puppet run on integration-slave-trusty-1012 is OK: OK: Less than 1.00% above the threshold [0.0] [20:48:49] PROBLEM - Puppet run on deployment-fluorine02 is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [0.0] [20:59:00] legoktm hi, could you merge https://gerrit.wikimedia.org/r/#/c/316908/ please? [22:11:39] (03PS3) 10Ejegg: Enable Python unit tests for the wikimedia/fundraising/tools repo [integration/config] - 10https://gerrit.wikimedia.org/r/314481 (https://phabricator.wikimedia.org/T145012) (owner: 10Awight) [22:12:31] (03CR) 10Paladox: [C: 031] Enable Python unit tests for the wikimedia/fundraising/tools repo [integration/config] - 10https://gerrit.wikimedia.org/r/314481 (https://phabricator.wikimedia.org/T145012) (owner: 10Awight) [22:18:13] thanks paladox! Anyone with +2 want to merge that? ^^^ It's got 4 +1s now [22:18:48] ejegg hi, releng is out this week but will be back next week, the only user left with +2 would be legoktm. [22:18:49] :) [22:19:01] aha, thanks [22:19:20] no rush on it, then, just that ff-only policy makes stuff stale so fast [22:42:32] 10Gerrit: Update gerrit to 2.12.5 - https://phabricator.wikimedia.org/T143089#2735494 (10Paladox) [23:22:33] PROBLEM - Puppet staleness on deployment-prometheus01 is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [43200.0]