[00:02:12] (03PS1) 10Jforrester: jjb: Add special jobs for Fundraising extensions using PHP70/REL1_31 [integration/config] - 10https://gerrit.wikimedia.org/r/586477 [00:02:14] (03PS1) 10Jforrester: layout: Add special jobs for Fundraising extensions using PHP70/REL1_31 [integration/config] - 10https://gerrit.wikimedia.org/r/586478 [00:08:04] 10Beta-Cluster-Infrastructure, 10Security-Team, 10Wikimedia-Site-requests, 10ContentSecurityPolicy: Change Content Security Policy on betacommons to allow api.flickr.com - https://phabricator.wikimedia.org/T249486 (10Bawolff) CSP is still being tested. Its enforced on beta for testing purposes, in prod it... [00:25:37] (03PS2) 10Jforrester: layout: Add special jobs for Fundraising extensions using PHP70/REL1_31 [integration/config] - 10https://gerrit.wikimedia.org/r/586478 [00:25:39] (03PS1) 10Jforrester: layout: Add experimental jobs for Fundraising extensions using PHP70/REL1_31 [integration/config] - 10https://gerrit.wikimedia.org/r/586482 [00:26:19] (03CR) 10Jforrester: [C: 03+2] jjb: Add special jobs for Fundraising extensions using PHP70/REL1_31 [integration/config] - 10https://gerrit.wikimedia.org/r/586477 (owner: 10Jforrester) [00:26:33] (03CR) 10jerkins-bot: [V: 04-1] layout: Add experimental jobs for Fundraising extensions using PHP70/REL1_31 [integration/config] - 10https://gerrit.wikimedia.org/r/586482 (owner: 10Jforrester) [00:27:13] (03Merged) 10jenkins-bot: jjb: Add special jobs for Fundraising extensions using PHP70/REL1_31 [integration/config] - 10https://gerrit.wikimedia.org/r/586477 (owner: 10Jforrester) [00:29:26] (03PS2) 10Jforrester: layout: Add experimental jobs for Fundraising extensions using PHP70/REL1_31 [integration/config] - 10https://gerrit.wikimedia.org/r/586482 [00:29:53] (03PS3) 10Jforrester: layout: Add special jobs for Fundraising extensions using PHP70/REL1_31 [integration/config] - 10https://gerrit.wikimedia.org/r/586478 [00:33:44] 10Phabricator, 10I18n, 10User-Nikerabbit: Please add Brazilian Portuguese (pt-br) language to Phabricator - https://phabricator.wikimedia.org/T215697 (10Eduaddad) 05Stalled→03Resolved [00:33:47] 10Phabricator, 10I18n: Translation of phabricator is outdated in Brazilian Portuguese - https://phabricator.wikimedia.org/T248902 (10Eduaddad) >>! Em T248902#6029912, @Aklapper escreveu: > @Eduaddad: Okay. Could you answer my question in T248902#6013616, please? Thanks :) task T215697 was to deploy the language [00:54:01] (03CR) 10Jforrester: [C: 03+2] layout: Add experimental jobs for Fundraising extensions using PHP70/REL1_31 [integration/config] - 10https://gerrit.wikimedia.org/r/586482 (owner: 10Jforrester) [00:54:57] (03Merged) 10jenkins-bot: layout: Add experimental jobs for Fundraising extensions using PHP70/REL1_31 [integration/config] - 10https://gerrit.wikimedia.org/r/586482 (owner: 10Jforrester) [00:57:08] !log Zuul: Add experimental jobs for Fundraising extensions using PHP70/REL1_31 [00:57:09] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [01:09:29] (03CR) 10Jforrester: "Passing: FundraisingEmailUnsubscribe, ContributionTracking" [integration/config] - 10https://gerrit.wikimedia.org/r/586478 (owner: 10Jforrester) [01:12:56] 10Release-Engineering-Team-TODO (2020-04 to 2020-06 (Q4)), 10Release, 10Train Deployments: 1.35.0-wmf.27 deployment blockers - https://phabricator.wikimedia.org/T247774 (10Jdforrester-WMF) [01:14:20] 10Release-Engineering-Team (CI & Testing services), 10Release-Engineering-Team-TODO, 10CirrusSearch, 10Discovery-Search: Build failures for Elastica and CirrusSearch on REL1_32 - https://phabricator.wikimedia.org/T216612 (10Reedy) 05Open→03Declined [01:15:53] (03PS1) 10Jforrester: layout: FR voting for ContributionTracking & FundraisingEmailUnsubscribe [integration/config] - 10https://gerrit.wikimedia.org/r/586483 [01:16:04] (03PS4) 10Jforrester: layout: Add special jobs for Fundraising extensions using PHP70/REL1_31 [integration/config] - 10https://gerrit.wikimedia.org/r/586478 [01:16:47] (03PS5) 10Jforrester: layout: FR voting for cldr & ParserFunctions [integration/config] - 10https://gerrit.wikimedia.org/r/586478 [01:17:03] (03CR) 10Jforrester: [C: 04-1] "These don't pass." [integration/config] - 10https://gerrit.wikimedia.org/r/586478 (owner: 10Jforrester) [01:17:05] (03CR) 10Jforrester: [C: 03+2] layout: FR voting for ContributionTracking & FundraisingEmailUnsubscribe [integration/config] - 10https://gerrit.wikimedia.org/r/586483 (owner: 10Jforrester) [01:17:53] (03Merged) 10jenkins-bot: layout: FR voting for ContributionTracking & FundraisingEmailUnsubscribe [integration/config] - 10https://gerrit.wikimedia.org/r/586483 (owner: 10Jforrester) [01:19:24] !log Zuul: FR voting for ContributionTracking & FundraisingEmailUnsubscribe [01:19:25] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [01:28:46] 10Continuous-Integration-Config, 10MediaWiki-extensions-CLDR, 10ParserFunctions, 10Wikimedia-Fundraising: Decide what to do about MW 1.31 / PHP 7.0 incompatible extensions in Wikimedia Fundraising production - https://phabricator.wikimedia.org/T249576 (10Jdforrester-WMF) [01:29:09] 10Continuous-Integration-Config, 10MediaWiki-extensions-CLDR, 10ParserFunctions, 10Wikimedia-Fundraising: Decide what to do about MW 1.31 / PHP 7.0 incompatible extensions in Wikimedia Fundraising production - https://phabricator.wikimedia.org/T249576 (10Jdforrester-WMF) Making it voting is https://gerrit.... [01:47:45] (03PS1) 10Jforrester: layout: [mediawiki/extensions/FundraisingEmailUnsubscribe] Disable MW-master testing; MW1.31-only for now [integration/config] - 10https://gerrit.wikimedia.org/r/586485 [01:48:13] (03CR) 10Jforrester: [C: 03+2] layout: [mediawiki/extensions/FundraisingEmailUnsubscribe] Disable MW-master testing; MW1.31-only for now [integration/config] - 10https://gerrit.wikimedia.org/r/586485 (owner: 10Jforrester) [01:49:01] (03CR) 10jerkins-bot: [V: 04-1] layout: [mediawiki/extensions/FundraisingEmailUnsubscribe] Disable MW-master testing; MW1.31-only for now [integration/config] - 10https://gerrit.wikimedia.org/r/586485 (owner: 10Jforrester) [01:49:43] (03PS2) 10Jforrester: layout: [FundraisingEmailUnsubscribe] Disable MW-master testing [integration/config] - 10https://gerrit.wikimedia.org/r/586485 [01:49:49] (03CR) 10Jforrester: [C: 03+2] "…" [integration/config] - 10https://gerrit.wikimedia.org/r/586485 (owner: 10Jforrester) [01:50:38] (03CR) 10jerkins-bot: [V: 04-1] layout: [FundraisingEmailUnsubscribe] Disable MW-master testing [integration/config] - 10https://gerrit.wikimedia.org/r/586485 (owner: 10Jforrester) [01:52:51] (03PS3) 10Jforrester: layout: [FundraisingEmailUnsubscribe] Disable MW-master testing [integration/config] - 10https://gerrit.wikimedia.org/r/586485 [01:52:56] (03CR) 10Jforrester: [C: 03+2] layout: [FundraisingEmailUnsubscribe] Disable MW-master testing [integration/config] - 10https://gerrit.wikimedia.org/r/586485 (owner: 10Jforrester) [01:58:25] 10LibUp: Puppetize setup on upgrader-06.wmflabs - https://phabricator.wikimedia.org/T173478 (10Reedy) [01:58:57] 10LibUp: When bumping devDeps but everything already passes, add a positive message - https://phabricator.wikimedia.org/T195934 (10Reedy) [01:59:38] (03CR) 10jerkins-bot: [V: 04-1] layout: [FundraisingEmailUnsubscribe] Disable MW-master testing [integration/config] - 10https://gerrit.wikimedia.org/r/586485 (owner: 10Jforrester) [02:10:57] 10LibUp, 10MediaWiki-General: `composer lint` doesn't actually work in libraryupgrader on mw core - https://phabricator.wikimedia.org/T249554 (10Reedy) >>! In T249554#6034160, @Reedy wrote: > If we call `composer test .`... and it results in `parallel-lint . --exclude vendor --exclude node_modules '.'` in exte... [03:28:41] (03PS4) 10Jforrester: layout: [FundraisingEmailUnsubscribe] Disable MW-master testing [integration/config] - 10https://gerrit.wikimedia.org/r/586485 [03:31:53] (03CR) 10jerkins-bot: [V: 04-1] layout: [FundraisingEmailUnsubscribe] Disable MW-master testing [integration/config] - 10https://gerrit.wikimedia.org/r/586485 (owner: 10Jforrester) [03:34:30] (03PS5) 10Jforrester: layout: [FundraisingEmailUnsubscribe] Disable MW-master testing [integration/config] - 10https://gerrit.wikimedia.org/r/586485 [03:37:41] (03CR) 10jerkins-bot: [V: 04-1] layout: [FundraisingEmailUnsubscribe] Disable MW-master testing [integration/config] - 10https://gerrit.wikimedia.org/r/586485 (owner: 10Jforrester) [03:40:55] (03PS6) 10Jforrester: layout: [FundraisingEmailUnsubscribe] Disable MW-master testing [integration/config] - 10https://gerrit.wikimedia.org/r/586485 [03:44:40] (03CR) 10Jforrester: [C: 03+2] layout: [FundraisingEmailUnsubscribe] Disable MW-master testing [integration/config] - 10https://gerrit.wikimedia.org/r/586485 (owner: 10Jforrester) [03:45:38] (03Merged) 10jenkins-bot: layout: [FundraisingEmailUnsubscribe] Disable MW-master testing [integration/config] - 10https://gerrit.wikimedia.org/r/586485 (owner: 10Jforrester) [03:46:25] !log Zuul: [FundraisingEmailUnsubscribe] Disable MW-master testing [03:46:26] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [05:05:02] PROBLEM - Free space - all mounts on deployment-snapshot01 is CRITICAL: CRITICAL: deployment-prep.deployment-snapshot01.diskspace._data.byte_percentfree (No valid datapoints found)deployment-prep.deployment-snapshot01.diskspace.root.byte_percentfree (<10.00%) [05:15:03] RECOVERY - Free space - all mounts on deployment-snapshot01 is OK: OK: deployment-prep.deployment-snapshot01.diskspace._data.byte_percentfree (No valid datapoints found) [05:27:10] 10Deployments, 10Phabricator, 10Developer Productivity, 10User-MModell, 10User-Majavah: Create a permalink which always redirects to the current week's train blocker task - https://phabricator.wikimedia.org/T207669 (10Majavah) a:03Majavah Working on a tool that solves this. [05:38:14] 10Release-Engineering-Team-TODO (2020-04 to 2020-06 (Q4)), 10Release, 10Train Deployments: 1.35.0-wmf.27 deployment blockers - https://phabricator.wikimedia.org/T247774 (10Ladsgroup) [06:33:51] 10Release-Engineering-Team-TODO (2020-04 to 2020-06 (Q4)), 10Release, 10Train Deployments: 1.35.0-wmf.27 deployment blockers - https://phabricator.wikimedia.org/T247774 (10Nikerabbit) [07:13:08] PROBLEM - Work requests waiting in Zuul Gearman server on contint1001 is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [150.0] https://www.mediawiki.org/wiki/Continuous_integration/Zuul https://grafana.wikimedia.org/dashboard/db/zuul-gearman?panelId=10&fullscreen&orgId=1 [07:19:35] 10Continuous-Integration-Config, 10MathSearch, 10MW-1.35-notes (1.35.0-wmf.27; 2020-04-07): mwext-testextension-zend should load extension mathsearch after math - https://phabricator.wikimedia.org/T117659 (10Physikerwelt) 05Open→03Resolved a:03Physikerwelt Yes. Thank you. [07:30:06] 10Phabricator, 10I18n: Translation of phabricator is outdated in Brazilian Portuguese - https://phabricator.wikimedia.org/T248902 (10Aklapper) p:05Triage→03Low ...and that task was open until a few hours ago. Thanks for clarifying! [07:31:16] PROBLEM - Free space - all mounts on deployment-deploy02 is CRITICAL: CRITICAL: deployment-prep.deployment-deploy02.diskspace._srv.byte_percentfree (<11.11%) [07:31:40] RECOVERY - Work requests waiting in Zuul Gearman server on contint1001 is OK: OK: Less than 100.00% above the threshold [90.0] https://www.mediawiki.org/wiki/Continuous_integration/Zuul https://grafana.wikimedia.org/dashboard/db/zuul-gearman?panelId=10&fullscreen&orgId=1 [07:46:47] 10Beta-Cluster-Infrastructure, 10Security-Team, 10Wikimedia-Site-requests, 10ContentSecurityPolicy: Change Content Security Policy on betacommons to allow api.flickr.com - https://phabricator.wikimedia.org/T249486 (10AlexisJazz) >>! In T249486#6034777, @Bawolff wrote: > CSP is still being tested. Its enfor... [07:58:41] (03CR) 10Thiemo Kreuz (WMDE): [C: 04-1] "Almost +2. Thanks a lot for splitting this off! This is really helpful. I think I was able to follow all code paths and confirm the new co" (034 comments) [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/586430 (owner: 10Umherirrender) [08:17:39] 10Beta-Cluster-Infrastructure: Request for interface admin permission on zh beta cluster - https://phabricator.wikimedia.org/T249592 (10WhitePhosphorus) [08:42:00] (03PS1) 10Thiemo Kreuz (WMDE): Streamline a few minor details in FunctionComment sniff [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/587201 [08:45:12] (03CR) 10jerkins-bot: [V: 04-1] Streamline a few minor details in FunctionComment sniff [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/587201 (owner: 10Thiemo Kreuz (WMDE)) [08:54:57] 10Deployments, 10Phabricator, 10Developer Productivity, 10User-MModell, 10User-Majavah: Create a permalink which always redirects to the current week's train blocker task - https://phabricator.wikimedia.org/T207669 (10Majavah) I created a tool (https://toolsadmin.wikimedia.org/tools/id/train-blockers, ht... [09:13:43] twentyafterfour: i am looking at the phab cert situation for aphlict. We already have a cert with these alt names on it: [09:13:49] alt_names: ["phabricator.discovery.wmnet","phabricator.svc.eqiad.wmnet","phabricator.svc.codfw.wmnet","phabricator.wikimedia.org","phab.wmfuserconten t.org","bugs.wikimedia.org","bugzilla.wikimedia.org","git.wikimedia.org"] [09:14:25] that is used by envoy for TLS termination [09:15:16] 14 - certificate_chain: { filename: "/etc/ssl/localcerts/phabricator.discovery.wmnet.crt" } [09:15:19] 15 private_key: { filename: "/etc/ssl/private/phabricator.discovery.wmnet.key" } [09:15:46] twentyafterfour: ^ can we just tell aphlict to find it in that place ? [09:15:57] then there is nothing else to do [09:25:28] 10Phabricator, 10Release-Engineering-Team-TODO (2020-04 to 2020-06 (Q4)), 10Operations, 10Traffic, and 2 others: Phabricator downtime due to aphlict and websockets (aphlict current disabled) - https://phabricator.wikimedia.org/T238593 (10Dzahn) The aphlict service has been re-enabled on phab1001. The plan... [10:11:15] !log manually killed a Jenkins job for a gate-and-submit of a non-latest patch set [10:11:16] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [10:29:00] 10Phabricator, 10Release-Engineering-Team-TODO (2020-04 to 2020-06 (Q4)), 10Operations, 10Traffic, and 2 others: Phabricator downtime due to aphlict and websockets (aphlict current disabled) - https://phabricator.wikimedia.org/T238593 (10mmodell) So we have just one last remaining issue to deal with: ` Un... [11:20:16] RECOVERY - Free space - all mounts on deployment-deploy02 is OK: OK: All targets OK [12:06:58] 10Phabricator, 10Release-Engineering-Team-TODO (2020-04 to 2020-06 (Q4)), 10Operations, 10Traffic, and 2 others: Phabricator downtime due to aphlict and websockets (aphlict current disabled) - https://phabricator.wikimedia.org/T238593 (10Dzahn) The new plan is to do TLS termination in envoy rather than in... [12:16:35] 10Release-Engineering-Team-TODO (2020-04 to 2020-06 (Q4)), 10Release, 10Train Deployments: 1.35.0-wmf.27 deployment blockers - https://phabricator.wikimedia.org/T247774 (10Nikerabbit) [12:17:44] zeljkof: new branch was not cut? [12:19:12] Not seemingly yet [12:19:37] also, the train status update email talks about Friday and Monday! [12:19:45] is that just delayed delivery or a mistake? [12:28:19] Nikerabbit: longma is the train conductor, branch is usually cut on Tuesday, and it didn't start for her yet :) T247774 [12:28:20] T247774: 1.35.0-wmf.27 deployment blockers - https://phabricator.wikimedia.org/T247774 [12:30:37] zeljkof: okay so it's just surprising/confusing email [12:43:01] 10Release-Engineering-Team, 10MediaWiki-User-management, 10User-DannyS712: User rights validation is sometimes malfunctioning (with FlaggedRevs only?) - https://phabricator.wikimedia.org/T234743 (10Huji) >>! In T234743#6033557, @QEDK wrote: >>>! In T234743#6033372, @Huji wrote: >> I, and at least two other f... [12:47:25] Nikerabbit: that's an e-mail template that a train conductor usually uses [12:47:43] but I guess it's confusing if it's sent on Monday :) [13:02:21] 10Beta-Cluster-Infrastructure, 10User-DannyS712: Request for interface admin permission on zh beta cluster - https://phabricator.wikimedia.org/T249592 (10DannyS712) a:03DannyS712 [13:04:26] 10Beta-Cluster-Infrastructure, 10User-DannyS712: Request for interface admin permission on zh beta cluster - https://phabricator.wikimedia.org/T249592 (10DannyS712) 05Open→03Resolved Granted indefinitely [13:34:51] 10Release-Engineering-Team, 10MediaWiki-User-management, 10User-DannyS712: User rights validation is sometimes malfunctioning (with FlaggedRevs only?) - https://phabricator.wikimedia.org/T234743 (10QEDK) >>! In T234743#6035999, @Huji wrote: >>>! In T234743#6033557, @QEDK wrote: >>>>! In T234743#6033372, @Huj... [13:42:21] 10Release-Engineering-Team, 10MediaWiki-User-management, 10User-DannyS712: User rights validation is sometimes malfunctioning (with FlaggedRevs only?) - https://phabricator.wikimedia.org/T234743 (10Ammarpad) >>! In T234743#6035999, @Huji wrote: > Can you point me to the WMF setting file in which a similar gr... [13:49:19] 10Release-Engineering-Team, 10MediaWiki-User-management, 10User-DannyS712: User rights validation is sometimes malfunctioning (with FlaggedRevs only?) - https://phabricator.wikimedia.org/T234743 (10Huji) >>! In T234743#6036226, @Ammarpad wrote: >>>! In T234743#6035999, @Huji wrote: >> Can you point me to the... [14:09:32] 10Continuous-Integration-Infrastructure, 10Release-Engineering-Team (CI & Testing services), 10Release-Engineering-Team-TODO (2020-04 to 2020-06 (Q4)), 10Patch-For-Review: Investigate Docker slowness between 18.06.2 and 18.09.7 - https://phabricator.wikimedia.org/T236675 (10hashar) Docker seccomp profile h... [14:13:57] 10phan, 10phan-taint-check-plugin: phan and taint-check weird interactions: PhanUndeclaredThis, part 3 - https://phabricator.wikimedia.org/T249619 (10Daimona) [14:14:03] 10phan, 10phan-taint-check-plugin: phan and taint-check weird interactions: PhanUndeclaredThis, part 3 - https://phabricator.wikimedia.org/T249619 (10Daimona) p:05Triage→03High [14:14:38] 10phan, 10phan-taint-check-plugin: phan and taint-check weird interactions: PhanUndeclaredThis - https://phabricator.wikimedia.org/T249491 (10Daimona) 05Open→03Resolved [14:14:40] 10Continuous-Integration-Config, 10LibUp, 10Release-Engineering-Team-TODO (2020-04 to 2020-06 (Q4)), 10phan, and 2 others: Upgrade phan to 0.10.2 and remove phan-taint-check-plugin - https://phabricator.wikimedia.org/T248630 (10Daimona) [14:14:44] 10phan, 10phan-taint-check-plugin: phan and taint-check weird interactions: PhanUndeclaredThis - https://phabricator.wikimedia.org/T249491 (10Daimona) [14:14:57] 10phan, 10phan-taint-check-plugin: Weird interaction between phan and taint-check: PhanUndeclaredVariable - https://phabricator.wikimedia.org/T248742 (10Daimona) 05Open→03Resolved [14:15:01] 10Continuous-Integration-Config, 10LibUp, 10Release-Engineering-Team-TODO (2020-04 to 2020-06 (Q4)), 10phan, and 2 others: Upgrade phan to 0.10.2 and remove phan-taint-check-plugin - https://phabricator.wikimedia.org/T248630 (10Daimona) [14:15:15] 10phan, 10phan-taint-check-plugin: phan and taint-check weird interactions: PhanUndeclaredThis, part 3 - https://phabricator.wikimedia.org/T249619 (10Daimona) [14:15:19] 10Continuous-Integration-Config, 10LibUp, 10Release-Engineering-Team-TODO (2020-04 to 2020-06 (Q4)), 10phan, and 2 others: Upgrade phan to 0.10.2 and remove phan-taint-check-plugin - https://phabricator.wikimedia.org/T248630 (10Daimona) [14:34:56] PROBLEM - App Server Main HTTP Response on deployment-mediawiki-07 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [14:35:07] PROBLEM - English Wikipedia Main page on beta-cluster is CRITICAL: CRITICAL - Socket timeout after 10 seconds [14:35:41] 10Continuous-Integration-Config, 10LibUp, 10Release-Engineering-Team-TODO (2020-04 to 2020-06 (Q4)), 10phan, and 2 others: Upgrade phan to 0.10.2 and remove phan-taint-check-plugin - https://phabricator.wikimedia.org/T248630 (10Daimona) (FTR, there are other showstoppers popping up. In addition to the subt... [14:36:14] PROBLEM - English Wikipedia Mobile Main page on beta-cluster is CRITICAL: (Service Check Timed Out) [15:01:41] 10Continuous-Integration-Config, 10Release-Engineering-Team, 10Quality-and-Test-Engineering-Team (QTE), 10CPT Initiatives (API Integration Tests), and 2 others: Create and run a suite of end-to-end tests for the Wikimedia environment - https://phabricator.wikimedia.org/T248683 (10zeljkofilipin) >>! In T248... [15:07:39] 10Continuous-Integration-Config, 10Release-Engineering-Team, 10Quality-and-Test-Engineering-Team (QTE), 10CPT Initiatives (API Integration Tests), and 2 others: Create and run a suite of end-to-end tests for the Wikimedia environment - https://phabricator.wikimedia.org/T248683 (10zeljkofilipin) > * While d... [15:24:48] RECOVERY - App Server Main HTTP Response on deployment-mediawiki-07 is OK: HTTP OK: HTTP/1.1 200 OK - 93355 bytes in 1.088 second response time [15:24:59] RECOVERY - English Wikipedia Main page on beta-cluster is OK: HTTP OK: HTTP/1.1 200 OK - 93658 bytes in 0.933 second response time [15:26:04] RECOVERY - English Wikipedia Mobile Main page on beta-cluster is OK: HTTP OK: HTTP/1.1 200 OK - 52117 bytes in 0.966 second response time [15:35:46] 10Release-Engineering-Team, 10MediaWiki-User-management, 10User-DannyS712: User rights validation is sometimes malfunctioning (with FlaggedRevs only?) - https://phabricator.wikimedia.org/T234743 (10QEDK) >>! In T234743#6036270, @Huji wrote: >>>! In T234743#6036226, @Ammarpad wrote: >>>>! In T234743#6035999,... [15:45:28] 10phan, 10phan-taint-check-plugin: phan and taint-check weird interactions: PhanUndeclaredThis, part 2 - https://phabricator.wikimedia.org/T249519 (10Daimona) 05Open→03Resolved [15:45:30] 10Continuous-Integration-Config, 10LibUp, 10Release-Engineering-Team-TODO (2020-04 to 2020-06 (Q4)), 10phan, and 2 others: Upgrade phan to 0.10.2 and remove phan-taint-check-plugin - https://phabricator.wikimedia.org/T248630 (10Daimona) [15:52:08] Nikerabbit: sorry about the email. I wasn't sure if I should send it yet but I thought it would be better than sending it right before I am supposed to deploy on Tues [15:58:51] although I did send it on Tuesday... [16:00:57] PROBLEM - App Server Main HTTP Response on deployment-mediawiki-07 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [16:05:45] RECOVERY - App Server Main HTTP Response on deployment-mediawiki-07 is OK: HTTP OK: HTTP/1.1 200 OK - 93353 bytes in 0.901 second response time [16:12:58] longma: :D [16:13:07] longma: well, at least it triggered me to close one blocker [16:13:26] :D [16:18:22] Jenkins CI restarted for a plugin update [16:19:47] 10Release-Engineering-Team, 10MediaWiki-User-management, 10User-DannyS712: User rights validation is sometimes malfunctioning (with FlaggedRevs only?) - https://phabricator.wikimedia.org/T234743 (10Ammarpad) I am talking about the internal `review` and `autoreview` rights that the groups share in common. I d... [16:20:14] hashar: Thanks for doing that. [16:24:32] Yippee, build fixed! [16:24:33] Project beta-code-update-eqiad build #291253: 09FIXED in 1 min 31 sec: https://integration.wikimedia.org/ci/job/beta-code-update-eqiad/291253/ [16:36:56] PROBLEM - App Server Main HTTP Response on deployment-mediawiki-07 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [16:37:13] PROBLEM - English Wikipedia Mobile Main page on beta-cluster is CRITICAL: CRITICAL - Socket timeout after 10 seconds [16:41:07] PROBLEM - English Wikipedia Main page on beta-cluster is CRITICAL: CRITICAL - Socket timeout after 10 seconds [16:50:58] RECOVERY - English Wikipedia Main page on beta-cluster is OK: HTTP OK: HTTP/1.1 200 OK - 93658 bytes in 0.979 second response time [16:51:48] RECOVERY - App Server Main HTTP Response on deployment-mediawiki-07 is OK: HTTP OK: HTTP/1.1 200 OK - 93354 bytes in 1.014 second response time [16:52:05] RECOVERY - English Wikipedia Mobile Main page on beta-cluster is OK: HTTP OK: HTTP/1.1 200 OK - 52121 bytes in 0.994 second response time [17:35:02] 10Release-Engineering-Team, 10MediaWiki-User-management, 10User-DannyS712: User rights validation is sometimes malfunctioning (with FlaggedRevs only?) - https://phabricator.wikimedia.org/T234743 (10Huji) The similarities of their names (review and reviewe//**r**//) confused me. Thanks for clarifying. [17:54:57] (03PS1) 10Hashar: Disable seccomp in Docker [integration/config] - 10https://gerrit.wikimedia.org/r/587304 (https://phabricator.wikimedia.org/T236675) [17:56:12] (03CR) 10Hashar: "I just can't believe the overhead is so large when using seccomp. That is definitely noticeable when using "firejail --seccomp" though :-(" [integration/config] - 10https://gerrit.wikimedia.org/r/587304 (https://phabricator.wikimedia.org/T236675) (owner: 10Hashar) [18:03:56] (03PS2) 10Umherirrender: Reduce code duplication in FunctionCommentSniff about short type checks [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/586430 [18:04:04] (03CR) 10Umherirrender: Reduce code duplication in FunctionCommentSniff about short type checks (034 comments) [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/586430 (owner: 10Umherirrender) [18:16:56] 10phan, 10phan-taint-check-plugin: phan and taint-check weird interactions: PhanTypeInvalidDimOffset with list() - https://phabricator.wikimedia.org/T249647 (10Daimona) [18:17:10] 10phan, 10phan-taint-check-plugin: phan and taint-check weird interactions: PhanTypeInvalidDimOffset with list() - https://phabricator.wikimedia.org/T249647 (10Daimona) [18:17:14] 10Continuous-Integration-Config, 10LibUp, 10Release-Engineering-Team-TODO (2020-04 to 2020-06 (Q4)), 10phan, and 2 others: Upgrade phan to 0.10.2 and remove phan-taint-check-plugin - https://phabricator.wikimedia.org/T248630 (10Daimona) [18:23:16] (03CR) 10Jforrester: "Is this safe?" [integration/config] - 10https://gerrit.wikimedia.org/r/587304 (https://phabricator.wikimedia.org/T236675) (owner: 10Hashar) [19:02:44] 10Release-Engineering-Team-TODO (2020-04 to 2020-06 (Q4)), 10Release, 10Train Deployments: 1.35.0-wmf.27 deployment blockers - https://phabricator.wikimedia.org/T247774 (10Jdforrester-WMF) [19:19:00] 10Project-Admins: Requests for addition to the #acl*Project-Admins group (in comments) - https://phabricator.wikimedia.org/T706 (10ARamirez_WMF) Hi. I would like to ask to be added to acl*Project-Admins because I'm the technical program manager for CommTech and Anti Harrassment Tools. I need to frequently create... [19:20:14] (03CR) 10Jforrester: [C: 03+1] "Leaving C+2 to Thiemo to confirm that they are happy their concerns have been met." [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/586430 (owner: 10Umherirrender) [19:38:01] (03CR) 10Jforrester: [C: 03+1] Add problematic values 1 and 1.0 to PHPUnitAssertEqualsSniff [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/576045 (https://phabricator.wikimedia.org/T246662) (owner: 10Thiemo Kreuz (WMDE)) [19:50:13] legoktm: If you're OK with https://gerrit.wikimedia.org/r/c/labs/libraryupgrader/+/581664 it'd be lovely to merge that. [20:14:31] (03CR) 10Hashar: "I have added Alexandros / Giuseppe as reviewers since they manage the k8s cluster and might have faced the seccomp related slowdown previo" [integration/config] - 10https://gerrit.wikimedia.org/r/587304 (https://phabricator.wikimedia.org/T236675) (owner: 10Hashar) [20:56:28] James_F: I thought we were waiting for https://github.com/php-parallel-lint/PHP-Console-Highlighter/issues/1 as well so both migrate at the same time? Or do we need the new parallel-lint version now basically? [20:56:53] legoktm: They published? [20:57:06] Or did I get confused? [20:57:25] Its a different package, I don't see a new release [20:59:02] https://packagist.org/packages/php-parallel-lint/php-console-highlighter but no release, right. :-( [21:00:19] * James_F sighs. [21:16:27] 10Project-Admins, 10MSSQL: Archive MSSQL project - https://phabricator.wikimedia.org/T230583 (10Zoranzoki21) Which is status of this task? Description of project says: "Support for using this backend was removed in 1.34 (see T230418)." Can we archive project? [21:18:00] 10Project-Admins, 10Oracle Database: Archive Oracle Database project - https://phabricator.wikimedia.org/T230582 (10Zoranzoki21) Same question as in T230583#6037985. [21:26:57] (03PS1) 10Thcipriani: deployment-calendar: more train time [tools/release] - 10https://gerrit.wikimedia.org/r/587343 [21:27:49] 10LibUp, 10MediaWiki-General: `composer lint` doesn't actually work in libraryupgrader on mw core - https://phabricator.wikimedia.org/T249554 (10Reedy) 05Open→03Resolved a:03Reedy [21:36:22] (03CR) 10Jforrester: [C: 03+1] deployment-calendar: more train time [tools/release] - 10https://gerrit.wikimedia.org/r/587343 (owner: 10Thcipriani) [21:42:36] (03CR) 10Thcipriani: [C: 03+2] deployment-calendar: more train time [tools/release] - 10https://gerrit.wikimedia.org/r/587343 (owner: 10Thcipriani) [21:45:46] (03Merged) 10jenkins-bot: deployment-calendar: more train time [tools/release] - 10https://gerrit.wikimedia.org/r/587343 (owner: 10Thcipriani) [21:51:47] PROBLEM - Work requests waiting in Zuul Gearman server on contint1001 is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [150.0] https://www.mediawiki.org/wiki/Continuous_integration/Zuul https://grafana.wikimedia.org/dashboard/db/zuul-gearman?panelId=10&fullscreen&orgId=1 [21:59:51] (03CR) 10Hashar: [C: 04-1] "I have to try it again and add the associated jenkins job." [integration/config] - 10https://gerrit.wikimedia.org/r/584998 (https://phabricator.wikimedia.org/T210271) (owner: 10Hashar) [22:00:53] RECOVERY - Work requests waiting in Zuul Gearman server on contint1001 is OK: OK: Less than 100.00% above the threshold [90.0] https://www.mediawiki.org/wiki/Continuous_integration/Zuul https://grafana.wikimedia.org/dashboard/db/zuul-gearman?panelId=10&fullscreen&orgId=1 [22:31:24] (03CR) 10Hashar: "I asked on the internal ops list about how seccom can introduces such a performance penalty." [integration/config] - 10https://gerrit.wikimedia.org/r/587304 (https://phabricator.wikimedia.org/T236675) (owner: 10Hashar) [22:31:32] 10Continuous-Integration-Infrastructure, 10Release-Engineering-Team (CI & Testing services), 10Release-Engineering-Team-TODO (2020-04 to 2020-06 (Q4)), 10Patch-For-Review: Investigate Docker slowness between 18.06.2 and 18.09.7 - https://phabricator.wikimedia.org/T236675 (10hashar) I asked on the internal... [22:38:31] (03CR) 10Awight: "This is a good idea and looks safe to merge. Just one suggestion for cleanup." (031 comment) [integration/quibble] - 10https://gerrit.wikimedia.org/r/581629 (owner: 10Jforrester) [22:43:24] 10Release-Engineering-Team (Deployment services), 10Release-Engineering-Team-TODO (2020-04 to 2020-06 (Q4)), 10Scap, 10User-brennen: Investigate duration of scap sync for 1.35.0-wmf.23 train deploy - https://phabricator.wikimedia.org/T247426 (10hashar) >>! In T247426#6027986, @thcipriani wrote: ... > It wo... [22:53:24] 10Release-Engineering-Team (Local Dev), 10Release-Engineering-Team-TODO (2020-04 to 2020-06 (Q4)), 10MediaWiki-Docker, 10dev-images, 10User-brennen: ffmpeg in MW-Docker lacks -row-mt option for improved multithreaded VP9 encoding - https://phabricator.wikimedia.org/T247153 (10hashar) @MoritzMuehlenhoff s... [23:21:26] 10Continuous-Integration-Config, 10MathSearch, 10MW-1.35-notes (1.35.0-wmf.27; 2020-04-07): mwext-testextension-zend should load extension mathsearch after math - https://phabricator.wikimedia.org/T117659 (10hashar) ` lang=diff "requires": { "MediaWiki": ">= 1.32.0", + "extensions": { + "Math": ">= 3.0... [23:24:33] 10Project-Admins, 10MSSQL: Archive MSSQL project - https://phabricator.wikimedia.org/T230583 (10Aklapper) @Zoranzoki21: See https://www.mediawiki.org/wiki/Download for supported MediaWiki versions. [23:25:04] 10Project-Admins, 10Oracle Database: Archive Oracle Database project - https://phabricator.wikimedia.org/T230582 (10Aklapper) @Zoranzoki21: See https://www.mediawiki.org/wiki/Download for supported MediaWiki versions.