[00:00:57] 10Continuous-Integration-Config, 10Gerrit, 10Cleanup, 10MediaWiki-extensions-Nonlinear, and 3 others: Archive the NonLinear extension - https://phabricator.wikimedia.org/T169519#3628863 (10Liuxinyu970226) [00:02:06] 10Continuous-Integration-Config, 10Gerrit, 10Cleanup, 10Diffusion, 10GitHub-Mirrors: Tool to archive extensions (and do related stuff)? - https://phabricator.wikimedia.org/T175499#3628866 (10SamanthaNguyen) @Liuxinyu970226: There's a custom form you can use (instead of just copy-pasting), which is at htt... [00:02:28] 10Gerrit, 10Release-Engineering-Team (Kanban), 10Cleanup, 10MediaWiki-extensions-Other, and 3 others: Archive PageLanguageApi extension - https://phabricator.wikimedia.org/T160371#3628867 (10Liuxinyu970226) [00:03:33] 10Continuous-Integration-Config, 10Gerrit, 10Cleanup, 10Diffusion, 10GitHub-Mirrors: Tool to archive extensions (and do related stuff)? - https://phabricator.wikimedia.org/T175499#3628869 (10Liuxinyu970226) >>! In T175499#3628866, @SamanthaNguyen wrote: > @Liuxinyu970226: There's a custom form you can us... [00:04:48] 10Gerrit, 10Cleanup, 10MediaWiki-extensions-General, 10Repository-Admins: Archive the ShoutBox extension - https://phabricator.wikimedia.org/T155365#3628872 (10Liuxinyu970226) [00:04:54] 10Gerrit, 10Cleanup, 10MediaWiki-extensions-WikibaseQuery, 10Project-Admins, 10Wikidata: Deactivate/archive WikibaseQuery extension - https://phabricator.wikimedia.org/T134091#3628873 (10Liuxinyu970226) [00:06:32] 10Continuous-Integration-Config, 10Gerrit, 10Release-Engineering-Team (Kanban), 10Cleanup, and 3 others: Archive the AccountAudit extension - https://phabricator.wikimedia.org/T163791#3628878 (10Liuxinyu970226) [00:07:54] 10Continuous-Integration-Config, 10Gerrit, 10Cleanup, 10MediaWiki-extensions-OpenSearchXml, 10Patch-For-Review: Archive the OpenSearchXml extensions - https://phabricator.wikimedia.org/T108213#3628883 (10Liuxinyu970226) [00:09:16] 10Continuous-Integration-Config, 10Gerrit, 10Release-Engineering-Team (Kanban), 10Cleanup, and 3 others: Archive the "Wikilog" extension (has moved toGitHub) - https://phabricator.wikimedia.org/T154443#3628886 (10Liuxinyu970226) [00:13:29] 10Continuous-Integration-Config, 10Cleanup, 10MediaWiki-extensions-Narayam, 10Patch-For-Review: Archive extensions Narayam and WebFonts - https://phabricator.wikimedia.org/T110178#3628897 (10Liuxinyu970226) [00:13:39] 10Continuous-Integration-Config, 10Gerrit, 10Release-Engineering-Team (Kanban), 10Cleanup, and 2 others: Archive AWSSDK and WindowsAzureSDK MediaWiki extensions - https://phabricator.wikimedia.org/T167124#3628898 (10Liuxinyu970226) [00:15:16] RECOVERY - Puppet errors on integration-slave-docker-1001 is OK: OK: Less than 1.00% above the threshold [0.0] [00:37:17] 10Gerrit, 10Release-Engineering-Team, 10Operations: Gerrit is failing to start on gerrit2001 - https://phabricator.wikimedia.org/T176532#3628916 (10Paladox) [00:39:09] 10Gerrit, 10Release-Engineering-Team, 10Operations: Gerrit is failing to start on gerrit2001 - https://phabricator.wikimedia.org/T176532#3628931 (10Paladox) [00:39:44] 10Gerrit, 10Release-Engineering-Team, 10Operations: Gerrit is failing to start on gerrit2001 - https://phabricator.wikimedia.org/T176532#3628932 (10Dzahn) Yea, we already tried a whole bunch of things but couldn't get gerrit service to properly start. cobalt (prod gerrit master) is untouched, this is just th... [00:50:04] 10Gerrit, 10Release-Engineering-Team, 10Operations: Gerrit is failing to start on gerrit2001 - https://phabricator.wikimedia.org/T176532#3628936 (10Dzahn) Correction: I can get gerrit.service itself back to state running and have no errors.. just we never get the gerrit-ssh service on port 29418. Now a ques... [00:51:24] 10Gerrit, 10Release-Engineering-Team, 10Operations: Gerrit is failing to start gerrit-ssh on gerrit2001 - https://phabricator.wikimedia.org/T176532#3628937 (10Dzahn) [01:29:17] 10Gerrit, 10Release-Engineering-Team, 10Operations: Gerrit is failing to start gerrit-ssh on gerrit2001 - https://phabricator.wikimedia.org/T176532#3628961 (10Paladox) But it’s not writing to the logs do that is a clue there’s a bigger problem. [01:31:52] 10Continuous-Integration-Infrastructure, 10User-Addshore: Upgrade php-ast for CI nodepool image to ^0.1.4 (currently 0.1.2) - https://phabricator.wikimedia.org/T174338#3558351 (10Legoktm) Hmm, according to https://github.com/oerdnj/deb.sury.org/issues/613 this was already done? [02:36:17] PROBLEM - Puppet errors on integration-slave-docker-1001 is CRITICAL: CRITICAL: 22.22% of data above the critical threshold [0.0] [02:39:19] 10Gerrit, 10Release-Engineering-Team, 10Operations: Gerrit is failing to start gerrit-ssh on gerrit2001 - https://phabricator.wikimedia.org/T176532#3628968 (10Dzahn) and..after a while it dies again just by itself.. [03:16:16] RECOVERY - Puppet errors on integration-slave-docker-1001 is OK: OK: Less than 1.00% above the threshold [0.0] [03:37:19] PROBLEM - Puppet errors on integration-slave-docker-1001 is CRITICAL: CRITICAL: 33.33% of data above the critical threshold [0.0] [04:10:04] Yippee, build fixed! [04:10:05] Project mediawiki-core-code-coverage build #3024: 09FIXED in 1 hr 10 min: https://integration.wikimedia.org/ci/job/mediawiki-core-code-coverage/3024/ [04:47:19] RECOVERY - Puppet errors on integration-slave-docker-1001 is OK: OK: Less than 1.00% above the threshold [0.0] [04:56:50] PROBLEM - Mediawiki Error Rate on graphite-labs is CRITICAL: CRITICAL: 20.00% of data above the critical threshold [10.0] [05:08:20] PROBLEM - Puppet errors on integration-slave-docker-1001 is CRITICAL: CRITICAL: 44.44% of data above the critical threshold [0.0] [05:41:50] PROBLEM - Mediawiki Error Rate on graphite-labs is CRITICAL: CRITICAL: 40.00% of data above the critical threshold [10.0] [05:43:18] RECOVERY - Puppet errors on integration-slave-docker-1001 is OK: OK: Less than 1.00% above the threshold [0.0] [06:22:53] (03PS1) 10Legoktm: Refactor 'operations-puppet-tests-docker' into macros for easy reuse [integration/config] - 10https://gerrit.wikimedia.org/r/379959 [06:23:43] (03CR) 10jerkins-bot: [V: 04-1] Refactor 'operations-puppet-tests-docker' into macros for easy reuse [integration/config] - 10https://gerrit.wikimedia.org/r/379959 (owner: 10Legoktm) [06:28:20] (03PS2) 10Legoktm: Refactor 'operations-puppet-tests-docker' into macros for easy reuse [integration/config] - 10https://gerrit.wikimedia.org/r/379959 [06:40:00] (03PS3) 10Legoktm: Migrate 'mediawiki-core-phpcs' job to docker [integration/config] - 10https://gerrit.wikimedia.org/r/379479 [06:42:30] (03CR) 10jerkins-bot: [V: 04-1] Migrate 'mediawiki-core-phpcs' job to docker [integration/config] - 10https://gerrit.wikimedia.org/r/379479 (owner: 10Legoktm) [06:43:36] (03PS4) 10Legoktm: Migrate 'mediawiki-core-phpcs' job to docker [integration/config] - 10https://gerrit.wikimedia.org/r/379479 [06:57:17] PROBLEM - Puppet errors on deployment-kafka01 is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [0.0] [07:09:20] PROBLEM - Puppet errors on integration-slave-docker-1001 is CRITICAL: CRITICAL: 55.56% of data above the critical threshold [0.0] [08:02:56] 10Release-Engineering-Team (Backlog), 10User-greg: Make a table of access levels per service RelEng maintains per person - https://phabricator.wikimedia.org/T135187#3629030 (10hashar) @greg from a previous comment: > Next is to figure out a programmatic (hopefully) way to get all memberships in Phabricator gr... [08:14:21] RECOVERY - Puppet errors on integration-slave-docker-1001 is OK: OK: Less than 1.00% above the threshold [0.0] [08:56:50] RECOVERY - Mediawiki Error Rate on graphite-labs is OK: OK: Less than 1.00% above the threshold [1.0] [09:00:32] PROBLEM - Puppet errors on deployment-memc05 is CRITICAL: CRITICAL: 40.00% of data above the critical threshold [0.0] [09:02:02] PROBLEM - Puppet errors on deployment-trending01 is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [0.0] [09:05:17] PROBLEM - Puppet errors on integration-slave-docker-1001 is CRITICAL: CRITICAL: 22.22% of data above the critical threshold [0.0] [09:40:34] RECOVERY - Puppet errors on deployment-memc05 is OK: OK: Less than 1.00% above the threshold [0.0] [09:45:17] RECOVERY - Puppet errors on integration-slave-docker-1001 is OK: OK: Less than 1.00% above the threshold [0.0] [10:31:19] PROBLEM - English Wikipedia Main page on beta-cluster is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:36:09] RECOVERY - English Wikipedia Main page on beta-cluster is OK: HTTP OK: HTTP/1.1 200 OK - 47444 bytes in 0.937 second response time [10:36:17] PROBLEM - Puppet errors on integration-slave-docker-1001 is CRITICAL: CRITICAL: 33.33% of data above the critical threshold [0.0] [10:44:32] 10Gerrit, 10Jenkins: jenkins-bot small lating with put verify on gerrit - https://phabricator.wikimedia.org/T176546#3629189 (10Zoranzoki21) [10:47:20] 10Gerrit, 10Jenkins: jenkins-bot small lating with put verify on gerrit - https://phabricator.wikimedia.org/T176546#3629201 (10Zoranzoki21) [11:12:09] PROBLEM - Long lived cherry-picks on puppetmaster on deployment-puppetmaster02 is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [0.0] [11:46:17] RECOVERY - Puppet errors on integration-slave-docker-1001 is OK: OK: Less than 1.00% above the threshold [0.0] [12:22:40] Project selenium-GettingStarted » firefox,beta,Linux,BrowserTests build #534: 04FAILURE in 40 sec: https://integration.wikimedia.org/ci/job/selenium-GettingStarted/BROWSER=firefox,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=Linux,label=BrowserTests/534/ [13:46:32] Yippee, build fixed! [13:46:32] Project selenium-VisualEditor » firefox,beta,Linux,BrowserTests build #531: 09FIXED in 2 min 31 sec: https://integration.wikimedia.org/ci/job/selenium-VisualEditor/BROWSER=firefox,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=Linux,label=BrowserTests/531/ [14:07:16] PROBLEM - Puppet errors on integration-slave-docker-1001 is CRITICAL: CRITICAL: 44.44% of data above the critical threshold [0.0] [15:12:19] RECOVERY - Puppet errors on integration-slave-docker-1001 is OK: OK: Less than 1.00% above the threshold [0.0] [15:34:03] PROBLEM - Free space - all mounts on deployment-kafka01 is CRITICAL: CRITICAL: deployment-prep.deployment-kafka01.diskspace.root.byte_percentfree (<100.00%) [15:38:18] PROBLEM - Puppet errors on integration-slave-docker-1001 is CRITICAL: CRITICAL: 44.44% of data above the critical threshold [0.0] [16:13:19] RECOVERY - Puppet errors on integration-slave-docker-1001 is OK: OK: Less than 1.00% above the threshold [0.0] [16:39:18] PROBLEM - Puppet errors on integration-slave-docker-1001 is CRITICAL: CRITICAL: 55.56% of data above the critical threshold [0.0] [17:06:19] (03PS2) 10Umherirrender: Add sniff for @cover instead of @covers [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/378268 (owner: 10Jforrester) [17:06:24] (03CR) 10Umherirrender: [C: 032] Add sniff for @cover instead of @covers [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/378268 (owner: 10Jforrester) [17:07:38] (03Merged) 10jenkins-bot: Add sniff for @cover instead of @covers [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/378268 (owner: 10Jforrester) [17:16:18] 10Continuous-Integration-Infrastructure, 10Jenkins: Do not take no result from composer test as success for jenkins - https://phabricator.wikimedia.org/T176556#3629520 (10Umherirrender) [17:20:21] 10Continuous-Integration-Infrastructure, 10Jenkins: Do not take no result from composer test as success for jenkins - https://phabricator.wikimedia.org/T176556#3629520 (10Legoktm) Maybe instead of using die for this we can do: ```lang=php echo "This version of the BlueSpiceEditNotifyConnector extension require... [17:22:58] (03PS7) 10Umherirrender: Add sniff to find unused "use" statements [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/375547 (https://phabricator.wikimedia.org/T167694) (owner: 10Legoktm) [17:27:49] (03CR) 10Umherirrender: [C: 032] Add sniff to find unused "use" statements [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/375547 (https://phabricator.wikimedia.org/T167694) (owner: 10Legoktm) [17:28:15] 10MediaWiki-Codesniffer, 10Patch-For-Review: use code sniffer to check for unused imports - https://phabricator.wikimedia.org/T167694#3629558 (10Umherirrender) 05Open>03Resolved p:05Triage>03Normal [17:28:26] (03Merged) 10jenkins-bot: Add sniff to find unused "use" statements [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/375547 (https://phabricator.wikimedia.org/T167694) (owner: 10Legoktm) [17:34:26] 10Continuous-Integration-Infrastructure, 10Jenkins: Do not take no result from composer test as success for jenkins - https://phabricator.wikimedia.org/T176556#3629564 (10Umherirrender) That sounds not for a generic solution. When composer ends with a "normally" exit code of 0, there is no way to detect. Only... [17:44:19] RECOVERY - Puppet errors on integration-slave-docker-1001 is OK: OK: Less than 1.00% above the threshold [0.0] [18:20:50] 10MediaWiki-Codesniffer: phpcs fails to put space between require_once and __DIR__ - https://phabricator.wikimedia.org/T175371#3629594 (10Umherirrender) a:03Umherirrender The sniff does not add a space in this case, but when having require_once followed by a string, the whitespace is added magically, so this c... [18:53:03] (03PS1) 10Umherirrender: Add space after keyword require_once, if needed [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/379996 (https://phabricator.wikimedia.org/T175371) [19:50:20] (03CR) 10Legoktm: [C: 032] "Thanks :)" [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/379996 (https://phabricator.wikimedia.org/T175371) (owner: 10Umherirrender) [19:51:18] (03Merged) 10jenkins-bot: Add space after keyword require_once, if needed [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/379996 (https://phabricator.wikimedia.org/T175371) (owner: 10Umherirrender) [20:00:42] 10MediaWiki-Codesniffer, 10Patch-For-Review: phpcs fails to put space between require_once and __DIR__ - https://phabricator.wikimedia.org/T175371#3629662 (10Umherirrender) 05Open>03Resolved p:05Triage>03Normal [20:18:36] (03PS2) 10Umherirrender: Make unit tests voting [integration/config] - 10https://gerrit.wikimedia.org/r/379776 [20:40:16] PROBLEM - Puppet errors on integration-slave-docker-1001 is CRITICAL: CRITICAL: 66.67% of data above the critical threshold [0.0] [20:42:48] Project selenium-Echo » firefox,beta,Linux,BrowserTests build #526: 04FAILURE in 1 min 48 sec: https://integration.wikimedia.org/ci/job/selenium-Echo/BROWSER=firefox,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=Linux,label=BrowserTests/526/ [21:10:21] 10Release-Engineering-Team (Backlog), 10User-greg: Make a table of access levels per service RelEng maintains per person - https://phabricator.wikimedia.org/T135187#3629687 (10greg) hah, well then... meh for now :) [21:15:17] RECOVERY - Puppet errors on integration-slave-docker-1001 is OK: OK: Less than 1.00% above the threshold [0.0]