[00:00:47] PROBLEM - Puppet staleness on integration-cumin-02 is CRITICAL: (Service Check Timed Out) [00:00:54] PROBLEM - Puppet errors on integration-puppetmaster-02 is CRITICAL: (Service Check Timed Out) [01:00:57] 10Beta-Cluster-Infrastructure, 10Release-Engineering-Team-TODO (2020-01 to 2020-03 (Q3)), 10Parsoid, 10Patch-For-Review: Replace deployment-mediawiki-parsoid10 with a "purer" deployment-parsoid11 box - https://phabricator.wikimedia.org/T246854 (10ssastry) p:05Triage→03High [01:01:01] 10Beta-Cluster-Infrastructure, 10Core Platform Team, 10Parsoid, 10User-Ryasmeen: Parsoid/RESTbase seems to be unavailable in Beta - https://phabricator.wikimedia.org/T246833 (10ssastry) p:05Triage→03High [02:13:21] thcipriani: hey, gerrit-replica looks down again :( [02:15:59] 10Gerrit: gerrit-replica seems down - https://phabricator.wikimedia.org/T247182 (10Legoktm) p:05Triage→03High [02:33:57] 10Gerrit: gerrit-replica seems down - https://phabricator.wikimedia.org/T247182 (10Legoktm) [04:53:25] 10Gerrit, 10Mail: Some emails coming from Gerrit are being tagged as suspicious by Gmail - https://phabricator.wikimedia.org/T226884 (10bd808) [05:15:54] legoktm: gah, I don't know why I don't get paged about the replica. [05:17:20] (03PS1) 1020after4: WIP: Scap3 deploy repo for zuul [integration/zuul/deploy] - 10https://gerrit.wikimedia.org/r/577846 [05:18:43] just noticed the restart in logs on mastodon, of all places. [05:19:06] (03PS2) 1020after4: WIP: Scap3 deploy repo for zuul [integration/zuul/deploy] - 10https://gerrit.wikimedia.org/r/577846 [05:21:23] 10Gerrit, 10Release-Engineering-Team-TODO (2020-01 to 2020-03 (Q3)): check gerrit-replica healthcheck alerts - https://phabricator.wikimedia.org/T247186 (10thcipriani) [05:21:40] 10Gerrit, 10Release-Engineering-Team-TODO (2020-01 to 2020-03 (Q3)): check gerrit-replica healthcheck alerts - https://phabricator.wikimedia.org/T247186 (10thcipriani) p:05Triage→03High [05:22:08] 10Gerrit: gerrit-replica seems down - https://phabricator.wikimedia.org/T247182 (10thcipriani) 05Open→03Resolved a:03thcipriani Back after restart. I didn't get an alert aside from this task. Filed as T247186 [05:23:31] after a restart, gerrit-replica looks fine. Instance obviously still needs some tuning, but concerned also about lack of alerting :\ [05:23:45] * thcipriani wanders back afk [05:25:10] afk sounds like a nice place. i think i will also go there. [09:31:18] 10Beta-Cluster-Infrastructure, 10MediaWiki-Cache, 10User-zeljkofilipin: Main pages of several Beta Cluster wikis redirect to other production wikis - https://phabricator.wikimedia.org/T247078 (10dom_walden) >>! In T247078#5950988, @zeljkofilipin wrote: > @dom_walden you've noticed this yesterday, right? I d... [09:37:29] Hello, can someone requeue gate-and-submit for my patches: https://gerrit.wikimedia.org/r/#/projects/mediawiki/extensions/IframePage,dashboards/default [11:31:30] 10Project-Admins, 10User-DannyS712: Create #TrackingCategories tag - https://phabricator.wikimedia.org/T247192 (10DannyS712) [11:32:12] 10Project-Admins, 10User-DannyS712: Create #mediawiki-TrackingCategories tag - https://phabricator.wikimedia.org/T247192 (10DannyS712) [11:32:37] 10Project-Admins, 10User-DannyS712: Create #MediaWiki-TrackingCategories tag - https://phabricator.wikimedia.org/T247192 (10DannyS712) [13:01:57] 10Project-Admins, 10User-DannyS712: Create #MediaWiki-TrackingCategories tag - https://phabricator.wikimedia.org/T247192 (10Aklapper) Also see https://www.mediawiki.org/wiki/Phabricator/Project_management/Tracking_tasks [18:13:42] 10Beta-Cluster-Infrastructure: Commons Beta-Cluster pages frequently don't save - https://phabricator.wikimedia.org/T246650 (10AlexisJazz) [18:18:57] 10Beta-Cluster-Infrastructure: deployment-mediawiki-07 socket timeout 2020-03-01/02 - https://phabricator.wikimedia.org/T246577 (10AlexisJazz) Request from 84.26.196.15 via deployment-cache-text05 frontend, Varnish XID 44694694 Error: 503, Backend fetch failed at Sun, 08 Mar 2020 18:17:41 GMT I **really** hope... [18:19:07] PROBLEM - English Wikipedia Main page on beta-cluster is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:19:16] PROBLEM - English Wikipedia Mobile Main page on beta-cluster is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:19:55] PROBLEM - App Server Main HTTP Response on deployment-mediawiki-07 is CRITICAL: (Service Check Timed Out) [18:20:48] 10Beta-Cluster-Infrastructure: deployment-mediawiki-07 socket timeout 2020-03-01/02 - https://phabricator.wikimedia.org/T246577 (10RhinosF1) Known. [18:27:25] 10Beta-Cluster-Infrastructure: internal_api_error_DBQueryError when mass undeleting files on betacommons - https://phabricator.wikimedia.org/T247207 (10AlexisJazz) [18:28:59] 10Project-Admins: Requests for addition to the #acl*Project-Admins group (in comments) - https://phabricator.wikimedia.org/T706 (10Querl.dox.0000x) I would like to be added to the project-admins to evaluate the options available to contributing to wikiversity community. [18:31:06] 10Beta-Cluster-Infrastructure: internal_api_error_DBQueryError when mass undeleting files on betacommons - https://phabricator.wikimedia.org/T247207 (10DannyS712) [18:31:26] 10Beta-Cluster-Infrastructure: internal_api_error_DBQueryError when mass undeleting files on betacommons - https://phabricator.wikimedia.org/T247207 (10AlexisJazz) [18:34:38] 10Project-Admins: Requests for addition to the #acl*Project-Admins group (in comments) - https://phabricator.wikimedia.org/T706 (10Aklapper) @Querl.dox.0000x: Hi, that is quite vague and does not require any project-admins permissions. Feel free to [use the test instance](https://www.mediawiki.org/wiki/Phabricat... [18:35:51] 10Project-Admins: Requests for addition to the #acl*Project-Admins group (in comments) - https://phabricator.wikimedia.org/T706 (10Aklapper) Hi @Samantha_Alipio_WMDE, I have added you. [18:36:38] 10Project-Admins: Requests for addition to the #acl*Project-Admins group (in comments) - https://phabricator.wikimedia.org/T706 (10Zoranzoki21) Hello, I'd like to request this also. I want to help with creating projects when requested and etc. [19:09:46] RECOVERY - App Server Main HTTP Response on deployment-mediawiki-07 is OK: HTTP OK: HTTP/1.1 200 OK - 91993 bytes in 0.937 second response time [19:13:56] RECOVERY - English Wikipedia Main page on beta-cluster is OK: HTTP OK: HTTP/1.1 200 OK - 92460 bytes in 0.971 second response time [19:14:07] RECOVERY - English Wikipedia Mobile Main page on beta-cluster is OK: HTTP OK: HTTP/1.1 200 OK - 57245 bytes in 1.063 second response time [19:21:10] 10Project-Admins: Requests for addition to the #acl*Project-Admins group (in comments) - https://phabricator.wikimedia.org/T706 (10MGChecker) >>! In T706#5952355, @Zoranzoki21 wrote: > Hello, I would like to request this also. I want to help with creating projects when requested and etc. I support this request.... [20:01:49] (03CR) 10Umherirrender: [C: 03+1] build: Updating acorn to 7.1.1 [integration/docroot] - 10https://gerrit.wikimedia.org/r/578096 (owner: 10Libraryupgrader) [20:03:31] (03CR) 10Jforrester: [C: 03+2] build: Updating acorn to 7.1.1 [integration/docroot] - 10https://gerrit.wikimedia.org/r/578096 (owner: 10Libraryupgrader) [20:16:01] 10Project-Admins: Requests for addition to the #acl*Project-Admins group (in comments) - https://phabricator.wikimedia.org/T706 (10Querl.dox.0000x) I would like the ability to create projects to evaluate the tools available in the wikimedia community (VPS/toolforge/etc) vs outside resources. [20:30:05] 10Beta-Cluster-Infrastructure: internal_api_error_DBQueryError when mass undeleting files on betacommons - https://phabricator.wikimedia.org/T247207 (10AlexisJazz) [21:44:18] 10Beta-Cluster-Infrastructure, 10Cloud-VPS (Debian Jessie Deprecation): Migrate deployment-prep away from Debian Jessie to Debian Stretch/Buster - https://phabricator.wikimedia.org/T218729 (10Krenair) [21:45:29] 10Beta-Cluster-Infrastructure: Migrate deployment-zookeeper02 from jessie to stretch - https://phabricator.wikimedia.org/T222461 (10Krenair) If this is all done, can possibly be marked resolved? [21:48:11] 10Beta-Cluster-Infrastructure, 10Cloud-VPS (Debian Jessie Deprecation): Migrate deployment-prep away from Debian Jessie to Debian Stretch/Buster - https://phabricator.wikimedia.org/T218729 (10Krenair) [21:51:53] 10Beta-Cluster-Infrastructure: Decommission deployment-logstash2 - https://phabricator.wikimedia.org/T243049 (10Krenair) Isn't this basically the same task as {T238707}? [22:06:34] 10Release-Engineering-Team (Deployment services), 10Release-Engineering-Team-TODO, 10Parsoid-PHP, 10Patch-For-Review: Installing composer modules for deployment - https://phabricator.wikimedia.org/T213494 (10ssastry) 05Open→03Resolved a:03cscott [23:14:59] 10Release-Engineering-Team-TODO (2020-01 to 2020-03 (Q3)), 10MediaWiki-General, 10MW-1.34-notes (1.34.0-wmf.23; 2019-09-17), 10MW-1.35-notes (1.35.0-wmf.10; 2019-12-10), and 3 others: Make MediaWiki core compatible with PHP 7.4 - https://phabricator.wikimedia.org/T233012 (10Reedy) [23:15:04] 10Continuous-Integration-Config, 10MediaWiki-General, 10PHP 7.4 support: Re-enable PHP74 in gate - https://phabricator.wikimedia.org/T247214 (10Reedy) [23:15:18] (03PS1) 10Reedy: Revert "layout: [skin-quibble] Disable PHP74 in gate for now" [integration/config] - 10https://gerrit.wikimedia.org/r/578150 (https://phabricator.wikimedia.org/T247214) [23:15:26] (03PS2) 10Reedy: Revert "layout: [skin-quibble] Disable PHP74 in gate for now" [integration/config] - 10https://gerrit.wikimedia.org/r/578150 (https://phabricator.wikimedia.org/T247214) [23:16:04] 10Continuous-Integration-Config, 10MediaWiki-General, 10PHP 7.4 support, 10Patch-For-Review: Re-enable PHP74 in gate for skin-quibble - https://phabricator.wikimedia.org/T247214 (10Reedy) [23:25:49] 10Release-Engineering-Team-TODO (2020-01 to 2020-03 (Q3)), 10MediaWiki-General, 10MW-1.34-notes (1.34.0-wmf.23; 2019-09-17), 10MW-1.35-notes (1.35.0-wmf.10; 2019-12-10), and 3 others: Make MediaWiki core compatible with PHP 7.4 - https://phabricator.wikimedia.org/T233012 (10Reedy) [23:25:52] 10Continuous-Integration-Config, 10MediaWiki-General, 10PHP 7.4 support, 10Patch-For-Review: Re-enable PHP74 in gate for skin-quibble - https://phabricator.wikimedia.org/T247214 (10Reedy)