[03:00:46] 10Release-Engineering-Team, 10Operations, 10serviceops, 10Performance-Team (Radar), and 2 others: All debug hosts give (likely spurious) message: PHP Fatal error: The UdpSocket to 127.0.0.1:10514 has been closed (from Monolog/SyslogUdp) - https://phabricator.wikimedia.org/T214734 (10Krinkle) [03:03:51] 10Release-Engineering-Team-TODO, 10Performance-Team, 10Core Platform Team Workboards (Clinic Duty Team), 10PHP 7.2 support, 10Wikimedia-Incident: Performance regression from Apcu/ExtensionRegistry::loadFromQueue on PHP7 - https://phabricator.wikimedia.org/T187154 (10Krinkle) [03:04:26] 10Continuous-Integration-Config, 10Release-Engineering-Team (Pipeline), 10Release-Engineering-Team-TODO, 10Scap, and 4 others: Define variant Wikimedia production config in compiled, static files - https://phabricator.wikimedia.org/T223602 (10Krinkle) [06:34:15] 10Gerrit, 10DBA: Investigate Gerrit troubles to reach the MariaDB database - https://phabricator.wikimedia.org/T247591 (10Marostegui) As Jaime pointed out, we have the upgrade in a few days, and if we keep observing this, we can also consider failing over the proxy itself to another host too. [07:29:51] 10Beta-Cluster-Infrastructure, 10ContentSecurityPolicy, 10Maps, 10MW-1.35-notes (1.35.0-wmf.24; 2020-03-17): Beta Cluster points to maps-beta.wmflabs.org instead of maps.wikimedia.org, which CSP blocks - https://phabricator.wikimedia.org/T240960 (10Bawolff) 05Open→03Resolved a:03Bawolff [10:33:29] 10Phabricator, 10Project-Admins, 10CommRel-Design, 10WMF-Communications: Archive #CommRel-Design and related Phabricator Form? - https://phabricator.wikimedia.org/T246853 (10Aklapper) >>! In T246853#5968136, @hdothiduc wrote: > I can't tell you yet when all the ongoing and to do tasks will be completed! N... [11:45:14] 10Phabricator-Bot-Requests: Please create Phabricator bot - QutieBot - https://phabricator.wikimedia.org/T247041 (10Aklapper) 05Open→03Invalid This already exists as @Qutiebot? (Though as I wrote in a private email, its email address might be non-working) [12:07:54] 10Release-Engineering-Team (Pipeline), 10Analytics, 10Analytics-Kanban, 10Release Pipeline, and 2 others: Migrate EventStreams to k8s deployment pipeline - https://phabricator.wikimedia.org/T238658 (10fgiunchedi) >>! In T238658#5964111, @Ottomata wrote: >> Perhaps using a single metric name e.g. 'express_r... [12:08:17] 10Project-Admins, 10PM: Mass-migrate project tags for parsing team - https://phabricator.wikimedia.org/T245868 (10Aklapper) @ssastry: Ping. Could you please fix the two remaining issues? [12:09:53] 10Project-Admins: tag phab task once it is deployed - https://phabricator.wikimedia.org/T228960 (10Aklapper) 05Stalled→03Declined No reply from @KartikMistry, hence declining. Feel free to reopen once you have replied / if this is feasible. Thanks! [13:10:44] (03PS1) 10Jbond: operations-puppet: bump changelog to force a rebuild with new gems [integration/config] - 10https://gerrit.wikimedia.org/r/579924 [13:15:41] Hello, can someone +2 my patches related to replacing jshint/jsonlint with eslint? [13:15:44] List is here https://gerrit.wikimedia.org/r/#/q/owner:%22Zoranzoki21+%253Czorandori4444%2540gmail.com%253E%22+status:open+jshint [13:15:55] Task: T195542 [13:15:57] T195542: Convert all Wikimedia-deployed extensions and skins to lint JavaScript via eslint, not jshint/jscs - https://phabricator.wikimedia.org/T195542 [13:33:59] (03CR) 10Hashar: [C: 03+2] operations-puppet: bump changelog to force a rebuild with new gems [integration/config] - 10https://gerrit.wikimedia.org/r/579924 (owner: 10Jbond) [13:35:21] (03Merged) 10jenkins-bot: operations-puppet: bump changelog to force a rebuild with new gems [integration/config] - 10https://gerrit.wikimedia.org/r/579924 (owner: 10Jbond) [13:38:47] (03PS1) 10Hashar: jjb: bump operations-puppet container [integration/config] - 10https://gerrit.wikimedia.org/r/579950 [13:53:11] 10Release-Engineering-Team (Pipeline), 10Analytics, 10Analytics-Kanban, 10Release Pipeline, and 2 others: Migrate EventStreams to k8s deployment pipeline - https://phabricator.wikimedia.org/T238658 (10Ottomata) > service from service-runner isn't very useful as a tag and we could key dashboards on app inst... [13:55:40] 10Release-Engineering-Team (Pipeline), 10Analytics, 10Analytics-Kanban, 10Release Pipeline, and 2 others: Migrate EventStreams to k8s deployment pipeline - https://phabricator.wikimedia.org/T238658 (10Ottomata) > While things do indeed look way better, the memory leak is most certainly still there. Indeed.... [13:56:32] 10Release-Engineering-Team (Pipeline), 10Analytics, 10Analytics-Kanban, 10Release Pipeline, and 2 others: Migrate EventStreams to k8s deployment pipeline - https://phabricator.wikimedia.org/T238658 (10akosiaris) > That's why I mentioned that IMHO `service` from service-runner isn't very useful as a tag and... [14:01:36] 10Release-Engineering-Team (Pipeline), 10Analytics, 10Analytics-Kanban, 10Release Pipeline, and 2 others: Migrate EventStreams to k8s deployment pipeline - https://phabricator.wikimedia.org/T238658 (10Ottomata) > service isn't from service-runner. It's from the sidecar prometheus-statsd-exporter in most se... [14:10:04] 10Release-Engineering-Team (Unit & Int & System Tooling), 10Release-Engineering-Team-TODO, 10MediaWiki-Core-Testing, 10MediaWiki-Vagrant: Running selenium inside Vagrant with xvfb or X11 does not work - https://phabricator.wikimedia.org/T196646 (10zeljkofilipin) [14:12:25] 10Release-Engineering-Team (Unit & Int & System Tooling), 10Release-Engineering-Team-TODO, 10MediaWiki-Core-Testing, 10Quality-and-Test-Engineering-Team (QTE), 10User-zeljkofilipin: Run Selenium tests using Firefox - https://phabricator.wikimedia.org/T161697 (10zeljkofilipin) [14:13:01] 10Release-Engineering-Team (Unit & Int & System Tooling), 10Release-Engineering-Team-TODO, 10MediaWiki-Core-Testing, 10Quality-and-Test-Engineering-Team (QTE), and 2 others: Port Selenium tests from Ruby to Node.js - https://phabricator.wikimedia.org/T139740 (10zeljkofilipin) [14:34:50] 10Release-Engineering-Team (Pipeline), 10Analytics, 10Analytics-Kanban, 10Release Pipeline, and 2 others: Migrate EventStreams to k8s deployment pipeline - https://phabricator.wikimedia.org/T238658 (10akosiaris) >>! In T238658#5972100, @Ottomata wrote: >> service isn't from service-runner. It's from the si... [14:37:23] 10Release-Engineering-Team (Pipeline), 10Analytics, 10Analytics-Kanban, 10Release Pipeline, and 2 others: Migrate EventStreams to k8s deployment pipeline - https://phabricator.wikimedia.org/T238658 (10akosiaris) >>! In T238658#5972092, @Ottomata wrote: >> While things do indeed look way better, the memory... [14:44:09] (03CR) 10Hashar: [C: 03+2] "Jobs deployed!" [integration/config] - 10https://gerrit.wikimedia.org/r/579950 (owner: 10Hashar) [14:45:52] (03Merged) 10jenkins-bot: jjb: bump operations-puppet container [integration/config] - 10https://gerrit.wikimedia.org/r/579950 (owner: 10Hashar) [14:47:33] 10Release-Engineering-Team (Pipeline), 10Analytics, 10Analytics-Kanban, 10Release Pipeline, and 2 others: Migrate EventStreams to k8s deployment pipeline - https://phabricator.wikimedia.org/T238658 (10fgiunchedi) Thanks for the context on `service` @akosiaris , now it is much more clear in my mind what the... [15:34:06] 10Project-Admins, 10Multimedia: Clarify confusion between Multimedia and Structured Data team and update docs accordingly - https://phabricator.wikimedia.org/T240281 (10Sarahmarie1981) [15:40:49] I think we have a spammer going wild on Phabricator… can someone block Sarahmarie1981? [15:41:33] 10Project-Admins, 10Multimedia, 10Structured-Data-Backlog: Clarify confusion between Multimedia and Structured Data team and update docs accordingly - https://phabricator.wikimedia.org/T240281 (10RhinosF1) [15:41:42] blocked on mw.org for now, though I don’t think that does much [15:42:06] Lucas_WMDE: disabled user. [15:42:23] thcipriani: can you mass revert them? I’m too lazy [15:42:55] I don't know how to do that, actually; although that'd be a good thing for me to learn to do :) [15:43:06] thcipriani: thanks [15:43:07] thcipriani: there is a script [15:43:07] * thcipriani searches wikitech for instructions [15:43:12] I think last time some community ppl built a script [15:43:17] not sure how versatile it is [15:43:18] RhinosF1: do you have a link to docs? [15:43:22] No [15:43:26] * RhinosF1 looks [15:44:11] found this: https://wikitech.wikimedia.org/wiki/Phabricator#Revert_all_activity_of_a_given_user [15:44:17] looks like the kind of thing I want [15:44:34] I think https://phabricator.wikimedia.org/p/Community_Tech_bot/ was the bot I was thinking of, but that wikitech link sounds better [15:46:46] thcipriani: that sounds good [15:46:52] Lucas_WMDE: that was used last time [15:47:21] RhinosF1: cool, thanks, now I just need to figure out if I've got the right powers to run it (/me thinks I do) [15:47:52] I knew mmodel had a script, manual revert would have taken me ages [16:04:24] 10MediaWiki-Codesniffer: Avoid assignment in return statements - https://phabricator.wikimedia.org/T170332 (10thiemowmde) I don't know, but what is bad about being enforced to split something like `lang=php return $this->cache = $this->queryDatabase(); ` into `lang=php $this->cache = $this->queryDatabase(); retu... [16:49:55] 10Release-Engineering-Team-TODO (2020-04 to 2020-06 (Q4)), 10Release, 10Train Deployments: 1.35.0-wmf.26 deployment blockers - https://phabricator.wikimedia.org/T247773 (10thcipriani) p:05Triage→03Medium a:03dduvall [16:50:43] 10Release-Engineering-Team-TODO (2020-04 to 2020-06 (Q4)), 10Release, 10Train Deployments: 1.35.0-wmf.27 deployment blockers - https://phabricator.wikimedia.org/T247774 (10thcipriani) p:05Triage→03Medium a:03jeena [16:52:18] 10Release-Engineering-Team-TODO (2020-04 to 2020-06 (Q4)), 10Release, 10Train Deployments: 1.36.0-wmf.1 deployment blockers - https://phabricator.wikimedia.org/T247775 (10thcipriani) p:05Triage→03Medium a:03Jdforrester-WMF [16:53:06] 10Release-Engineering-Team-TODO (2020-04 to 2020-06 (Q4)), 10Release, 10Train Deployments: 1.36.0-wmf.2 deployment blockers - https://phabricator.wikimedia.org/T247776 (10thcipriani) p:05Triage→03Medium a:03LarsWirzenius [17:06:03] 10Project-Admins: Create Project: Section-Name-Diff - https://phabricator.wikimedia.org/T246484 (10DannyS712) >>! In T246484#5930944, @Aklapper wrote: > @ifried: If I understand correctly, this is a subset of #mediawiki-page-diffs ? So it could either be a [subproject](https://www.mediawiki.org/wiki/Phabricator/... [17:06:11] 10Project-Admins: Create Project: Named-References-VE - https://phabricator.wikimedia.org/T246485 (10DannyS712) >>! In T246485#5929207, @Aklapper wrote: > In any case, for naming consistency, could this be called `VisualEditor-Named-References` instead of the slightly cryptic `Named-References-VE`? > > If this... [17:41:13] 10Beta-Cluster-Infrastructure, 10ContentSecurityPolicy, 10Maps, 10MW-1.35-notes (1.35.0-wmf.24; 2020-03-17): Beta Cluster points to maps-beta.wmflabs.org instead of maps.wikimedia.org, which CSP blocks - https://phabricator.wikimedia.org/T240960 (10Jdforrester-WMF) [17:41:16] 10Beta-Cluster-Infrastructure, 10ContentSecurityPolicy, 10MediaWiki-extensions-CentralAuth, 10Security-Team, and 3 others: Beta Cluster cross-wiki login request would be blocked by CSP - https://phabricator.wikimedia.org/T211539 (10Jdforrester-WMF) [17:41:20] 10Release-Engineering-Team (Development services), 10Release-Engineering-Team-TODO, 10Developer-Advocacy, 10MediaWiki-API, and 2 others: Standardise procedures for deprecating public-facing code - https://phabricator.wikimedia.org/T114384 (10Anomie) [18:45:16] (03PS1) 10Hashar: Stop supporting python2 [integration/zuul] (patch-queue/debian/jessie-wikimedia) - 10https://gerrit.wikimedia.org/r/580108 [18:46:47] (03CR) 10Hashar: "That shows up when using ./venv/bin/zuul --help" [integration/zuul] (patch-queue/debian/jessie-wikimedia) - 10https://gerrit.wikimedia.org/r/580108 (owner: 10Hashar) [18:50:21] (03PS7) 10Hashar: Scap3 deploy repo for zuul [integration/zuul/deploy] - 10https://gerrit.wikimedia.org/r/577846 (https://phabricator.wikimedia.org/T215458) (owner: 1020after4) [18:55:32] (03CR) 10Hashar: "Some more tweaks. I have managed to get a virtualenv with zuul deployed!" (033 comments) [integration/zuul/deploy] - 10https://gerrit.wikimedia.org/r/577846 (https://phabricator.wikimedia.org/T215458) (owner: 1020after4) [18:57:11] 10Release-Engineering-Team-TODO (2020-01 to 2020-03 (Q3)), 10MediaWiki-General, 10MW-1.34-notes (1.34.0-wmf.23; 2019-09-17), 10MW-1.35-notes (1.35.0-wmf.24; 2020-03-17), and 3 others: Make MediaWiki core compatible with PHP 7.4 - https://phabricator.wikimedia.org/T233012 (10Jdforrester-WMF) 05Open→03Res... [18:59:37] (03CR) 10Hashar: "And we will need https://gerrit.wikimedia.org/r/#/c/integration/zuul/+/580108/ :)" [integration/zuul/deploy] - 10https://gerrit.wikimedia.org/r/577846 (https://phabricator.wikimedia.org/T215458) (owner: 1020after4) [19:17:43] 10Release-Engineering-Team (Pipeline), 10Analytics, 10Analytics-Kanban, 10Release Pipeline, and 2 others: Migrate EventStreams to k8s deployment pipeline - https://phabricator.wikimedia.org/T238658 (10colewhite) >>! In T238658#5972237, @akosiaris wrote: > Sure it might very well be. I am fine with dropping... [19:21:52] 10Beta-Cluster-Infrastructure: Simple English UI/sidebar language on betacommons - https://phabricator.wikimedia.org/T247695 (10AlexisJazz) I see "English AJ Alerts (0) Notices (0) Talk My settings Beta Watchlist Uploads My changes Log out" and "Read Change View history" again. [19:35:19] (03CR) 1020after4: [C: 03+1] Stop supporting python2 [integration/zuul] (patch-queue/debian/jessie-wikimedia) - 10https://gerrit.wikimedia.org/r/580108 (owner: 10Hashar) [19:38:13] (03CR) 10Hashar: [V: 03+2 C: 03+2] Stop supporting python2 [integration/zuul] (patch-queue/debian/jessie-wikimedia) - 10https://gerrit.wikimedia.org/r/580108 (owner: 10Hashar) [19:46:21] (03PS8) 10Hashar: Scap3 deploy repo for zuul [integration/zuul/deploy] - 10https://gerrit.wikimedia.org/r/577846 (https://phabricator.wikimedia.org/T215458) (owner: 1020after4) [20:07:54] PROBLEM - App Server Main HTTP Response on deployment-mediawiki-07 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [20:12:52] RECOVERY - App Server Main HTTP Response on deployment-mediawiki-07 is OK: HTTP OK: HTTP/1.1 200 OK - 91798 bytes in 5.750 second response time [20:36:06] PROBLEM - English Wikipedia Main page on beta-cluster is CRITICAL: CRITICAL - Socket timeout after 10 seconds [20:37:56] hmmmmmmmm [20:38:15] API is ok [20:38:23] UI looks okay now too [20:38:26] wonder what happened [20:38:56] PROBLEM - App Server Main HTTP Response on deployment-mediawiki-07 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [20:40:27] The last Puppet run was at Mon Feb 24 18:26:55 UTC 2020 (30373 minutes ago). Puppet is disabled. reason not specified [20:40:28] ugh [20:41:01] RECOVERY - English Wikipedia Main page on beta-cluster is OK: HTTP OK: HTTP/1.1 200 OK - 92259 bytes in 3.837 second response time [20:43:48] RECOVERY - App Server Main HTTP Response on deployment-mediawiki-07 is OK: HTTP OK: HTTP/1.1 200 OK - 91804 bytes in 0.975 second response time [20:45:08] 10Scap, 10MediaWiki-Debug-Logger, 10Performance-Team, 10observability, and 2 others: Standardise on Logstash channel for fatal exceptions (fatal, exception, DeferredUpdates) - https://phabricator.wikimedia.org/T247113 (10Krinkle) 05Open→03Resolved [20:57:24] 10Beta-Cluster-Infrastructure: Simple English UI/sidebar language on betacommons - https://phabricator.wikimedia.org/T247695 (10matmarex) This is also broken on beta English Wikipedia. https://en.wikipedia.beta.wmflabs.org/wiki/Dog * There is a "Change" link where "Edit" should be * Page title says "Simple Engl... [21:57:40] (03PS9) 10Hashar: Scap3 deploy repo for zuul [integration/zuul/deploy] - 10https://gerrit.wikimedia.org/r/577846 (https://phabricator.wikimedia.org/T215458) (owner: 1020after4) [22:01:31] (03CR) 10Hashar: "Based on python 2. Setuptools is at 0.44.0, the last version to support py2." [integration/zuul/deploy] - 10https://gerrit.wikimedia.org/r/577846 (https://phabricator.wikimedia.org/T215458) (owner: 1020after4) [22:02:12] 10phan, 10Upstream: Phan should handle always-throw-function like ApiBase::dieWithError better - https://phabricator.wikimedia.org/T240141 (10cscott) >>! In T240141#5842808, @thiemowmde wrote: > 4. Turn dieWithError() into something like `throw $this->makeError()`. **Issues:** We need to deprecate the old, bad... [23:06:06] 10Release-Engineering-Team-TODO (2020-01 to 2020-03 (Q3)), 10Release, 10Train Deployments: 1.35.0-wmf.24 deployment blockers - https://phabricator.wikimedia.org/T233872 (10thcipriani) [23:06:08] 10Release-Engineering-Team-TODO (2020-01 to 2020-03 (Q3)), 10Release, 10Train Deployments, 10User-brennen: 1.35.0-wmf.23 deployment blockers - https://phabricator.wikimedia.org/T233871 (10thcipriani) [23:07:54] 10Release-Engineering-Team-TODO (2020-01 to 2020-03 (Q3)), 10Release, 10Train Deployments: 1.35.0-wmf.24 deployment blockers - https://phabricator.wikimedia.org/T233872 (10thcipriani) Added wmf.23 as a blocker for wmf.24. If wmf.23 isn't fully deployed by the wmf.24 Tuesday train window then we should go ahe... [23:23:54] 10Release-Engineering-Team, 10MediaWiki-User-management, 10MediaWiki-extensions-FlaggedRevs, 10Regression, 10User-DannyS712: Pending changes: autoreview randomly fails - https://phabricator.wikimedia.org/T233561 (10DannyS712) Another failure: Some users are automatically checked that shouldn't be: https:... [23:33:57] 10Release-Engineering-Team-TODO (2020-01 to 2020-03 (Q3)), 10Release, 10Train Deployments, 10User-brennen: 1.35.0-wmf.23 deployment blockers - https://phabricator.wikimedia.org/T233871 (10brennen) Still blocked as of this writing, not likely to move forward during this US workday. I'll see where things ar... [23:34:57] PROBLEM - App Server Main HTTP Response on deployment-mediawiki-07 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [23:39:48] RECOVERY - App Server Main HTTP Response on deployment-mediawiki-07 is OK: HTTP OK: HTTP/1.1 200 OK - 91800 bytes in 1.072 second response time