[00:02:05] litharge replaces eir on libera [00:17:57] 10MediaWiki-Releasing, 10MediaWiki-Installer, 10MediaWiki-Stakeholders-Group, 10Epic, 10MW-1.37-release: Expand the set of bundled extensions and skins in MediaWiki 1.37 - https://phabricator.wikimedia.org/T279842 (10Tgr) >>! In T279842#7350011, @Jdforrester-WMF wrote: > The run up to the branch point is... [00:19:39] 10MediaWiki-Releasing, 10MediaWiki-Installer, 10MediaWiki-Stakeholders-Group, 10Epic, 10MW-1.38-release: Expand the set of bundled extensions and skins in MediaWiki 1.38 - https://phabricator.wikimedia.org/T290934 (10Tgr) [00:20:42] 10MediaWiki-Releasing, 10MediaWiki-Installer, 10MediaWiki-Stakeholders-Group, 10Epic, 10MW-1.37-release: Expand the set of bundled extensions and skins in MediaWiki 1.37 - https://phabricator.wikimedia.org/T279842 (10Tgr) [00:20:45] 10MediaWiki-Releasing, 10MediaWiki-Installer, 10MediaWiki-Stakeholders-Group, 10Epic, 10MW-1.38-release: Expand the set of bundled extensions and skins in MediaWiki 1.38 - https://phabricator.wikimedia.org/T290934 (10Tgr) [00:20:51] 10MediaWiki-Releasing, 10MediaWiki-Installer, 10MediaWiki-Stakeholders-Group, 10Tracking-Neverending: Expand the set of bundled extensions and skins to achieve a default MediaWiki experience that's comparable to Wikimedia sites - https://phabricator.wikimedia.org/T178349 (10Tgr) [00:21:25] 10MediaWiki-Releasing, 10MW-1.37-notes, 10MW-1.37-release: Branch REL1_37 for MediaWiki and all extensions and skins - https://phabricator.wikimedia.org/T289586 (10Jdforrester-WMF) [00:25:41] 10MediaWiki-Releasing, 10MediaWiki-Installer, 10MediaWiki-Stakeholders-Group, 10Epic, 10MW-1.38-release: Expand the set of bundled extensions and skins in MediaWiki 1.38 - https://phabricator.wikimedia.org/T290934 (10Tgr) [00:27:03] 10MediaWiki-Releasing, 10MediaWiki-Installer, 10MediaWiki-Stakeholders-Group, 10Epic, 10MW-1.38-release: Expand the set of bundled extensions and skins in MediaWiki 1.38 - https://phabricator.wikimedia.org/T290934 (10Jdforrester-WMF) [00:27:08] 10MediaWiki-Releasing, 10MediaWiki-Installer, 10MediaWiki-Stakeholders-Group, 10Tracking-Neverending: Expand the set of bundled extensions and skins to achieve a default MediaWiki experience that's comparable to Wikimedia sites - https://phabricator.wikimedia.org/T178349 (10Jdforrester-WMF) [00:27:37] 10MediaWiki-Releasing, 10MediaWiki-Installer, 10MediaWiki-Stakeholders-Group, 10Epic, 10MW-1.38-release: Expand the set of bundled extensions and skins in MediaWiki 1.38 - https://phabricator.wikimedia.org/T290934 (10Jdforrester-WMF) Let's not keep pushing the tracker task concept, it's dead. :-) [00:27:39] 10MediaWiki-Releasing, 10MediaWiki-Installer, 10MediaWiki-Stakeholders-Group, 10Tracking-Neverending: Expand the set of bundled extensions and skins to achieve a default MediaWiki experience that's comparable to Wikimedia sites - https://phabricator.wikimedia.org/T178349 (10Jdforrester-WMF) [00:27:47] 10MediaWiki-Releasing, 10MediaWiki-Installer, 10MediaWiki-Stakeholders-Group, 10Epic, 10MW-1.38-release: Expand the set of bundled extensions and skins in MediaWiki 1.38 - https://phabricator.wikimedia.org/T290934 (10Tgr) [00:29:13] 10MediaWiki-Releasing, 10MW-1.38-release, 10MinervaNeue (Tracking), 10Readers-Web-Backlog (Tracking): Bundle MinervaNeue skin with MediaWiki - https://phabricator.wikimedia.org/T191743 (10Tgr) [00:29:30] 10MediaWiki-Releasing, 10MW-1.38-release, 10MobileFrontend (Tracking), 10Readers-Web-Backlog (Tracking): Bundle MobileFrontend extension with MediaWiki - https://phabricator.wikimedia.org/T191734 (10Tgr) [00:29:39] 10MediaWiki-Releasing, 10Reference Previews, 10MW-1.38-release: Bundle Popups extension with MediaWiki - https://phabricator.wikimedia.org/T231797 (10Tgr) [00:29:49] 10MediaWiki-Releasing, 10MediaWiki-extensions-LoginNotify, 10MW-1.38-release: Bundle LoginNotify extension with MediaWiki - https://phabricator.wikimedia.org/T191746 (10Tgr) [00:29:59] 10MediaWiki-Releasing, 10Growth-Team, 10Growth-Team-Filtering, 10Thanks, 10MW-1.38-release: Bundle Thanks extension with MediaWiki - https://phabricator.wikimedia.org/T191739 (10Tgr) [00:30:08] 10MediaWiki-Releasing, 10Growth-Team, 10Growth-Team-Filtering, 10Notifications, and 2 others: Bundle Echo extension with MediaWiki - https://phabricator.wikimedia.org/T191738 (10Tgr) [00:30:16] 10MediaWiki-Releasing, 10AntiSpoof, 10MW-1.38-release: Bundle AntiSpoof extension with MediaWiki - https://phabricator.wikimedia.org/T191736 (10Tgr) [00:30:22] 10MediaWiki-Releasing, 10MediaWiki-extensions-OATHAuth, 10MW-1.38-release: Bundle WebAuthn extension with MediaWiki - https://phabricator.wikimedia.org/T258007 (10Tgr) [00:30:28] 10MediaWiki-Releasing, 10MediaWiki-Installer, 10MediaWiki-Stakeholders-Group, 10Epic, 10MW-1.38-release: Expand the set of bundled extensions and skins in MediaWiki 1.38 - https://phabricator.wikimedia.org/T290934 (10Jdforrester-WMF) [00:30:44] 10MediaWiki-Releasing, 10MediaWiki-Installer, 10MediaWiki-Stakeholders-Group, 10Epic, 10MW-1.38-release: Expand the set of bundled extensions and skins in MediaWiki 1.38 - https://phabricator.wikimedia.org/T290934 (10Tgr) [00:30:50] 10MediaWiki-Releasing, 10MediaWiki-extensions-OATHAuth, 10MW-1.38-release: Bundle WebAuthn extension with MediaWiki - https://phabricator.wikimedia.org/T258007 (10Tgr) [00:31:00] 10MediaWiki-Releasing, 10Reference Previews, 10MW-1.38-release: Bundle Popups extension with MediaWiki - https://phabricator.wikimedia.org/T231797 (10Tgr) [00:31:10] 10MediaWiki-Releasing, 10MediaWiki-extensions-LoginNotify, 10MW-1.38-release: Bundle LoginNotify extension with MediaWiki - https://phabricator.wikimedia.org/T191746 (10Tgr) [00:31:16] 10MediaWiki-Releasing, 10AntiSpoof, 10MW-1.38-release: Bundle AntiSpoof extension with MediaWiki - https://phabricator.wikimedia.org/T191736 (10Tgr) [00:31:22] 10MediaWiki-Releasing, 10Growth-Team, 10Growth-Team-Filtering, 10Thanks, 10MW-1.38-release: Bundle Thanks extension with MediaWiki - https://phabricator.wikimedia.org/T191739 (10Tgr) [00:31:30] 10MediaWiki-Releasing, 10MW-1.38-release, 10MobileFrontend (Tracking), 10Readers-Web-Backlog (Tracking): Bundle MobileFrontend extension with MediaWiki - https://phabricator.wikimedia.org/T191734 (10Tgr) [00:31:36] 10MediaWiki-Releasing, 10Growth-Team, 10Growth-Team-Filtering, 10Notifications, and 2 others: Bundle Echo extension with MediaWiki - https://phabricator.wikimedia.org/T191738 (10Tgr) [00:31:44] 10MediaWiki-Releasing, 10AbuseFilter (Overhaul-2020), 10MW-1.38-release, 10Patch-For-Review: Bundle AbuseFilter extension with MediaWiki - https://phabricator.wikimedia.org/T191740 (10Tgr) [00:31:50] 10MediaWiki-Releasing, 10MediaWiki-Installer, 10MediaWiki-Stakeholders-Group, 10Epic, 10MW-1.38-release: Expand the set of bundled extensions and skins in MediaWiki 1.38 - https://phabricator.wikimedia.org/T290934 (10Jdforrester-WMF) [00:42:32] 10MediaWiki-Releasing, 10MW-1.38-release, 10MobileFrontend (Tracking), 10Readers-Web-Backlog (Tracking): Bundle MobileFrontend extension with MediaWiki - https://phabricator.wikimedia.org/T191734 (10Tgr) >>! In T191734#7309783, @Jdlrobson wrote: > It would be really nice to bundle this as this should have... [00:50:25] (03CR) 10Gergő Tisza: [C: 04-2] "Holding back while 1.37 is being released, possibly longer depending on the discussion in T290464." [tools/release] - 10https://gerrit.wikimedia.org/r/720490 (https://phabricator.wikimedia.org/T290464) (owner: 10Gergő Tisza) [00:50:54] 10MediaWiki-Releasing, 10MW-1.38-release, 10MobileFrontend (Tracking), 10Readers-Web-Backlog (Tracking): Bundle MobileFrontend extension with MediaWiki - https://phabricator.wikimedia.org/T191734 (10Legoktm) I don't really see the point of bundling MobileFrontend, given that we already bundle multiple resp... [00:55:20] 10MediaWiki-Releasing, 10MW-1.38-release, 10MobileFrontend (Tracking), 10Readers-Web-Backlog (Tracking): Bundle MobileFrontend extension with MediaWiki - https://phabricator.wikimedia.org/T191734 (10Tgr) None of them are particularly great IMO. Minerva is great on mobile, not so great on desktop. MobileFro... [02:15:10] 10MediaWiki-Releasing, 10MW-1.37-notes, 10MW-1.37-release, 10Patch-For-Review: Branch REL1_37 for MediaWiki and all extensions and skins - https://phabricator.wikimedia.org/T289586 (10Jdforrester-WMF) 05Open→03Resolved [02:15:16] 10MediaWiki-Releasing, 10MW-1.37-notes, 10MW-1.37-release: Release MW 1.37.0 - https://phabricator.wikimedia.org/T289585 (10Jdforrester-WMF) [02:15:57] 10Release-Engineering-Team (Seen), 10MediaWiki-Release-Tools: Branch script doesn't respect `branchpoint` when creating submodules, resulting in "implicit merges" error from gerrit - https://phabricator.wikimedia.org/T279718 (10Jdforrester-WMF) OK, so I changed the command from giving an explicit branch point... [05:04:23] 10Phabricator, 10Patch-For-Review: Evaluate adding "In progress" status to Phabricator. - https://phabricator.wikimedia.org/T288956 (10mmodell) >>! In T288956#7350410, @Jdforrester-WMF wrote: > Should we delete it from Puppet then? Some of the values in that file are still used but many are overridden in phab... [05:09:46] 10Release-Engineering-Team, 10MediaWiki-Release-Tools: Branch script doesn't respect `branchpoint` when creating submodules, resulting in "implicit merges" error from gerrit - https://phabricator.wikimedia.org/T279718 (10mmodell) p:05Low→03Medium >>! In T279718#7350528, @thcipriani wrote: > That's a good q... [06:04:29] 10Release-Engineering-Team (Doing), 10Release, 10Train Deployments: 1.38.0-wmf.1 deployment blockers - https://phabricator.wikimedia.org/T281165 (10Zabe) [06:08:08] 10Release-Engineering-Team (Doing), 10Release, 10Train Deployments: 1.37.0-wmf.23 deployment blockers - https://phabricator.wikimedia.org/T281164 (10Zabe) FYI: Title::getBacklinkCache has been hard deprecated while there were still multiple usages left. So there are going to be a few new deprecation warnings... [06:25:25] 10Release-Engineering-Team (Doing), 10Release, 10Train Deployments: 1.37.0-wmf.23 deployment blockers - https://phabricator.wikimedia.org/T281164 (10RhinosF1) >>! In T281164#7350925, @Zabe wrote: > FYI: Title::getBacklinkCache has been hard deprecated while there were still multiple usages left. So there are... [06:35:28] @zabe: are there other backlinkscache patches needing review that those marked as next weeks blockers? I have an hour or so free and will try to review them all [07:22:54] (03CR) 10Kosta Harlan: "Thanks for doing this. A couple of questions about some lingering usages of EU/US/European/American but otherwise LGTM" [tools/release] - 10https://gerrit.wikimedia.org/r/720826 (https://phabricator.wikimedia.org/T290859) (owner: 10Thcipriani) [07:30:02] 10Release-Engineering-Team, 10LDAP, 10cloud-services-team (Kanban): Reference to missing/unknown user gerrit2 on LDAP group labsadminbots - https://phabricator.wikimedia.org/T290944 (10jcrespo) [07:33:28] 10Release-Engineering-Team, 10LDAP, 10cloud-services-team (Kanban): Reference to missing/unknown user gerrit2 on LDAP group labsadminbots - https://phabricator.wikimedia.org/T290944 (10jcrespo) CC @jbond for awareness, although I think it is not actionable by SRE until an actionable is decided. [07:52:43] 10Release-Engineering-Team (Radar), 10Quality-and-Test-Engineering-Team (QTE), 10serviceops-radar, 10CommRel-Specialists-Support (Jul-Sep-2021), and 2 others: Expand the list of group 1 wikis to contain at least one (preferably 2) smaller "top ten size" wikis - https://phabricator.wikimedia.org/T286664 (10A... [08:12:56] 10MediaWiki-Releasing, 10MediaWiki-Installer, 10MediaWiki-Stakeholders-Group, 10Epic, 10MW-1.38-release: Expand the set of bundled extensions and skins in MediaWiki 1.38 - https://phabricator.wikimedia.org/T290934 (10Krabina) Sorry, I am quite lost here. Is this task now for bundling for MW 1.37 (this wa... [08:31:50] 10MediaWiki-Releasing, 10MediaWiki-Installer, 10MediaWiki-Stakeholders-Group, 10Epic, 10MW-1.38-release: Expand the set of bundled extensions and skins in MediaWiki 1.38 - https://phabricator.wikimedia.org/T290934 (10Aklapper) @Krabina: See the task title - this task is about 1.38. For 1.37, see T279842... [08:53:11] 10Gerrit, 10Wikidata, 10Wikidata-Campsite, 10wdwb-tech: wikidata-dev instances causing git "Internal error during upload-pack" every 5 minutes - https://phabricator.wikimedia.org/T287459 (10Addshore) Is this one still an issue? [08:55:48] 10MediaWiki-Releasing, 10MediaWiki-Installer, 10MediaWiki-Stakeholders-Group, 10Epic, 10MW-1.38-release: Expand the set of bundled extensions and skins in MediaWiki 1.38 - https://phabricator.wikimedia.org/T290934 (10Tgr) The first line of the task description is a navigation header, maybe that caused th... [10:37:05] 10Release-Engineering-Team (Radar), 10MW-on-K8s, 10SRE, 10serviceops: The restricted/mediawiki-webserver image should include skins and resources - https://phabricator.wikimedia.org/T285232 (10Joe) >>! In T285232#7349608, @dancy wrote: > Still not working: https://foundation.wikimedia.org/static/current/sk... [10:39:12] 10Release-Engineering-Team (Doing), 10Release, 10Train Deployments: 1.37.0-wmf.23 deployment blockers - https://phabricator.wikimedia.org/T281164 (10hashar) 1.37.0-wmf.23 is now deployed to https://test.wikipedia.org/ . group0 wikis will be promoted later today at 19:00 UTC / 21:00 PST [10:44:53] 10Phabricator: Phabricator failed to generate thumbnails - https://phabricator.wikimedia.org/T290959 (10jijiki) [11:06:56] 10Phabricator, 10Developer Productivity: Make it easier to track tasks which are stalled pending a MediaWiki release - https://phabricator.wikimedia.org/T290960 (10Majavah) [11:44:06] 10Phabricator, 10Developer Productivity: Make it easier to track tasks which are stalled pending a MediaWiki release - https://phabricator.wikimedia.org/T290960 (10Peachey88) For example #mw-1.37-release/#mw-1.38-release (haven't checked others) has a "To deprecate or remove" column on it's work board, Is some... [11:55:13] 10Phabricator, 10Developer Productivity: Make it easier to track tasks which are stalled pending a MediaWiki release - https://phabricator.wikimedia.org/T290960 (10Majavah) >>! In T290960#7351654, @Peachey88 wrote: > For example #mw-1.37-release/#mw-1.38-release (haven't checked others) has a "To deprecate or... [13:10:50] 10Phabricator: Phabricator failed to generate thumbnails for some 800-900KB files - https://phabricator.wikimedia.org/T290959 (10Aklapper) [13:26:16] 10Beta-Cluster-Infrastructure, 10MediaWiki-Uploading, 10Beta-Cluster-reproducible: Undefined variable: wgFileBlacklist - https://phabricator.wikimedia.org/T290640 (10Joe) p:05Triage→03High This happens with every request to test wikis, see https://logstash.wikimedia.org/goto/b49f81b5ed5d9d5a4ab5f248fa1a9... [13:27:00] 10Beta-Cluster-Infrastructure, 10MediaWiki-Uploading, 10Beta-Cluster-reproducible: Undefined variable: wgFileBlacklist - https://phabricator.wikimedia.org/T290640 (10Joe) [13:27:02] 10Release-Engineering-Team (Doing), 10Release, 10Train Deployments: 1.37.0-wmf.23 deployment blockers - https://phabricator.wikimedia.org/T281164 (10Joe) [13:27:33] 10Beta-Cluster-Infrastructure, 10MediaWiki-Uploading, 10Beta-Cluster-reproducible: Undefined variable: wgFileBlacklist - https://phabricator.wikimedia.org/T290640 (10Majavah) p:05High→03Unbreak! [13:29:52] 10Phabricator, 10Developer Productivity, 10MediaWiki-Releasing (Workflow Improvements): Make it easier to track tasks which are stalled pending a MediaWiki release - https://phabricator.wikimedia.org/T290960 (10Aklapper) This idea makes a lot of sense and I've also wondered a bunch of times, between random `... [13:55:35] (03CR) 10Hashar: [C: 03+2] "Indeed and we already do the same in the debian-glue jobs." [integration/config] - 10https://gerrit.wikimedia.org/r/720781 (https://phabricator.wikimedia.org/T273896) (owner: 10Ahmon Dancy) [13:57:02] (03Merged) 10jenkins-bot: jjb: set DEBEMAIL in beta-build-scap-deb job [integration/config] - 10https://gerrit.wikimedia.org/r/720781 (https://phabricator.wikimedia.org/T273896) (owner: 10Ahmon Dancy) [14:47:43] 10Release-Engineering-Team, 10MediaWiki-extensions-VipsScaler, 10Structured Data Engineering, 10Structured-Data-Backlog, and 2 others: Undeploy VipsScaler from Wikimedia wikis - https://phabricator.wikimedia.org/T290759 (10hashar) After VipsScaler has been disabled on all wikis, we started seeing errors fe... [14:50:31] 10Release-Engineering-Team (Radar), 10MW-on-K8s, 10SRE, 10serviceops: The restricted/mediawiki-webserver image should include skins and resources - https://phabricator.wikimedia.org/T285232 (10dancy) @Joe I propose decoupling the webserver and app images by eliminating all uses of the 'php' symlink in oper... [14:56:01] 10Phabricator: Phabricator failed to generate thumbnails for some 800-900KB files - https://phabricator.wikimedia.org/T290959 (10mmodell) I've seen a few alerts for the phabricator phd process. It always recovers immediately but there might be something going on with the queue processing. I'll look into it. [14:56:06] 10Phabricator: Phabricator failed to generate thumbnails for some 800-900KB files - https://phabricator.wikimedia.org/T290959 (10mmodell) a:03mmodell [15:00:00] 10Beta-Cluster-Infrastructure, 10MediaWiki-Uploading, 10Beta-Cluster-reproducible: Undefined variable: wgFileBlacklist - https://phabricator.wikimedia.org/T290640 (10hashar) That comes from https://gerrit.wikimedia.org/r/c/mediawiki/core/+/680806 which renamed some global variables: | Before | After |--|--... [15:23:36] (03PS1) 10Ahmon Dancy: Pass http_proxy and https_proxy env when building auto-stage image [tools/release] - 10https://gerrit.wikimedia.org/r/721009 [15:25:40] 10Beta-Cluster-Infrastructure, 10MediaWiki-Uploading, 10Beta-Cluster-reproducible: Undefined variable: wgFileBlacklist - https://phabricator.wikimedia.org/T290640 (10Jdforrester-WMF) Yeah, sorry, forgot to write the transition config patch. [15:27:27] (03PS2) 10Ahmon Dancy: Pass http_proxy and https_proxy env when building auto-stage image [tools/release] - 10https://gerrit.wikimedia.org/r/721009 [15:29:01] (03PS3) 10Ahmon Dancy: Pass http_proxy and https_proxy env when building auto-stage image [tools/release] - 10https://gerrit.wikimedia.org/r/721009 [15:30:20] (03CR) 10Ahmon Dancy: [C: 03+2] Pass http_proxy and https_proxy env when building auto-stage image [tools/release] - 10https://gerrit.wikimedia.org/r/721009 (owner: 10Ahmon Dancy) [15:31:20] (03Merged) 10jenkins-bot: Pass http_proxy and https_proxy env when building auto-stage image [tools/release] - 10https://gerrit.wikimedia.org/r/721009 (owner: 10Ahmon Dancy) [15:34:53] (03PS1) 10Ahmon Dancy: Pass http_proxy and https_proxy env when building multiversion-base image [tools/release] - 10https://gerrit.wikimedia.org/r/721015 [15:37:54] (03CR) 10Ahmon Dancy: [C: 03+2] Pass http_proxy and https_proxy env when building multiversion-base image [tools/release] - 10https://gerrit.wikimedia.org/r/721015 (owner: 10Ahmon Dancy) [15:39:41] (03Merged) 10jenkins-bot: Pass http_proxy and https_proxy env when building multiversion-base image [tools/release] - 10https://gerrit.wikimedia.org/r/721015 (owner: 10Ahmon Dancy) [16:01:30] twentyafterfour: for train I have cloned the code / applied security and pushed the result on the servers [16:02:05] the testwiki is the sole promoted right now (that caused some tiny log spam due to a config setting that got renamed but got fixed on spot) [16:02:26] so it is all ready for the next window, just have to switch wikiversion.json. That should make that a fast operation [16:02:57] I am off for dinner prep etc. See you all in 3 hours [16:17:15] what's going on with https://integration.wikimedia.org/ci/job/mwgate-node12-docker/32379/console? It's been hanging for 15 years [16:18:13] 19 minutes* [16:18:25] probably npm / npmjs.org is hanging [16:18:34] it'll hit a 30 minute jenkins timeout and fail [17:17:03] !log delete from wb_changes_dispatch where chd_db = 'enwiki'; (T290985) [17:17:07] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [17:17:07] T290985: Enable new dispatching mechanism on beta - https://phabricator.wikimedia.org/T290985 [17:39:06] 10Release-Engineering-Team (Doing), 10Release, 10Train Deployments: 1.38.0-wmf.1 deployment blockers - https://phabricator.wikimedia.org/T281165 (10Zabe) [17:41:45] zabe: ty ty! [17:44:50] yw [17:46:28] zabe: seriously, anything that makes updating easier is good [17:51:45] zabe: I think that's all the backlinkcache patches merged on both amster and REL1_37? [17:51:49] 10Release-Engineering-Team (Doing), 10Release, 10Train Deployments: 1.38.0-wmf.1 deployment blockers - https://phabricator.wikimedia.org/T281165 (10Zabe) [17:52:16] majavah: yes, thanks for your help [17:54:53] 10Release-Engineering-Team (Doing), 10Release, 10Train Deployments: 1.38.0-wmf.1 deployment blockers - https://phabricator.wikimedia.org/T281165 (10Zabe) [18:57:54] (03PS1) 10Ahmon Dancy: build-deb-in-environment: Make clear when operation succeeds [tools/scap] - 10https://gerrit.wikimedia.org/r/721045 [18:58:14] (03CR) 10Ahmon Dancy: [C: 03+2] build-deb-in-environment: Make clear when operation succeeds [tools/scap] - 10https://gerrit.wikimedia.org/r/721045 (owner: 10Ahmon Dancy) [19:00:26] (03Merged) 10jenkins-bot: build-deb-in-environment: Make clear when operation succeeds [tools/scap] - 10https://gerrit.wikimedia.org/r/721045 (owner: 10Ahmon Dancy) [19:01:40] 10Beta-Cluster-Infrastructure, 10MediaWiki-Uploading, 10Beta-Cluster-reproducible: Undefined variable: wgFileBlacklist - https://phabricator.wikimedia.org/T290640 (10hashar) p:05Unbreak!→03High Kunal added a back compatibility fix in operations/mediawiki-config which we can remove once 1.37.0-wmf.23 is f... [19:01:43] 10Beta-Cluster-Infrastructure, 10MediaWiki-Uploading, 10Beta-Cluster-reproducible: Undefined variable: wgFileBlacklist - https://phabricator.wikimedia.org/T290640 (10hashar) [19:01:45] 10Release-Engineering-Team (Doing), 10Release, 10Train Deployments: 1.37.0-wmf.23 deployment blockers - https://phabricator.wikimedia.org/T281164 (10hashar) [19:02:02] 10Beta-Cluster-Infrastructure, 10MediaWiki-Uploading, 10Beta-Cluster-reproducible: Undefined variable: wgFileBlacklist - https://phabricator.wikimedia.org/T290640 (10hashar) [19:02:04] 10Release-Engineering-Team (Doing), 10Release, 10Train Deployments: 1.37.0-wmf.23 deployment blockers - https://phabricator.wikimedia.org/T281164 (10hashar) [19:04:03] 10Release-Engineering-Team (Doing), 10Release, 10Train Deployments: 1.37.0-wmf.23 deployment blockers - https://phabricator.wikimedia.org/T281164 (10mmodell) @hashar I guess I can take over from here since I'm assigned. Looks like it's clear for deployment... [19:27:05] 10Release-Engineering-Team (Radar), 10MW-on-K8s, 10SRE, 10serviceops: The restricted/mediawiki-webserver image should include skins and resources - https://phabricator.wikimedia.org/T285232 (10dancy) @Krinkle Timo, is what I propose above feasible? [19:30:39] (03PS1) 10Ahmon Dancy: Release 4.0.0-1 [tools/scap] - 10https://gerrit.wikimedia.org/r/721049 [19:32:03] 10Release-Engineering-Team (Doing), 10Release, 10Train Deployments: 1.37.0-wmf.23 deployment blockers - https://phabricator.wikimedia.org/T281164 (10matmarex) [19:33:03] dancy: scap 4 ?!!! \o/ [19:33:17] scap 4.. now featuring Python 3. :- [19:33:20] :-) [19:33:27] oh yeah [19:34:39] (03PS2) 10Ahmon Dancy: Release 4.0.0-1 [tools/scap] - 10https://gerrit.wikimedia.org/r/721049 [19:34:47] there is an `-- old shit ---` left in RELEASE.md [19:34:56] (I need an IRC to gerrit bridge) [19:35:05] just cleaned that out. Wasn't ready to include that file. [19:35:59] at some point we messed up with the .py files shebang when building the deb package [19:36:03] but I guess all that is long gone [19:38:24] dancy: should I +2 it or do you need someone else to look at it ? [19:39:24] checking... [19:40:40] yes, Ready for +2 [19:51:17] 10Release-Engineering-Team (Radar), 10MW-on-K8s, 10SRE, 10serviceops: The restricted/mediawiki-webserver image should include skins and resources - https://phabricator.wikimedia.org/T285232 (10Krinkle) >>! In T285232#7350176, @dancy wrote: > Can someone give me an example of a curl command that exercises t... [19:55:45] (03CR) 10Hashar: [C: 03+2] "Major version bump is for python 2 being dropped." [tools/scap] - 10https://gerrit.wikimedia.org/r/721049 (owner: 10Ahmon Dancy) [19:56:01] {done} [19:56:20] dancy: I have no clue how the deb package get build. I am assuming that goes through SRE [19:56:57] (03Merged) 10jenkins-bot: Release 4.0.0-1 [tools/scap] - 10https://gerrit.wikimedia.org/r/721049 (owner: 10Ahmon Dancy) [19:57:08] Yeah, SRE deploys new debs. Before that, I'll deploy to beta cluster (which builds its own deb) [19:57:28] great [20:10:31] dancy: scap 4.0.0-1 commit got merged, don't forget to push the tag [20:10:51] Thanks hashar. I'll update the tag once testing in beta has completed. [20:11:57] okk [20:16:00] FYI: I just now broke CI for all service-runner based services, but I'll fix it in a moment. [20:22:21] Pchelolo: thanks for the notice, good luck on the fix [20:23:24] hashar: maybe you can help me - do you know how do we publish @wikimedia scoped packages to npm these days? npm wants me to pay up, I guess I'm not a part of some group [20:27:25] Pchelolo: I have absolutely no idea :-\ [20:28:10] me too... I reverted my thing and fixed tthe build back for now [20:28:55] it might worth a shoot at engineering-all channel [20:29:36] or I would typically ask James_F how a npm package can be added as @wikimedia :D [20:30:12] Pchelolo: I can add you to the org. [20:30:19] thank you James_F [20:30:31] I have 2fa and all that [20:30:39] and it's pchelolo on npm [20:31:00] Invite sent. [20:31:12] magic! [20:32:26] James_F is like a superman. Whenever there's trouble James_F flies in and solves the problem [20:32:37] Ha. [20:32:49] Half the time the trouble is something I broke. ;-) [20:33:17] who cares about those details [20:34:54] Oh! Speaking of, Pchelolo did you see https://phabricator.wikimedia.org/T290618 ? :-( [20:35:17] James_F: not yet. but I'll look now [20:35:45] I have https://github.com/wikimedia/service-runner/pull/236 but (a) it doesn't pass CI for some reason, and (b) it drops Node 6 which is not great news for RESTbase or 3d2png apparently. [20:36:33] I was thinking about this, I think we should just make service-runner 3.0 or whatever's the next major vesion and drop node 6 [20:36:45] restbase can live on 2.x [20:37:34] Yeah, my patch makes it 3.0 [20:37:51] But if Security will want us to bump to the new stuff and it all requires Node 10… [20:38:09] we can move restbase to node 10 no problem [20:38:33] sorry I haven't been on top of your PR, I've been on a month long vacation.. [20:38:48] No no no, it's fine. :-) [20:39:07] We need more people, not to make the people we have feel guilty for taking much-needed rest. [20:39:10] btw, it seems like being added to the org didn't solve the problem - npm still wants me to have a fancy paid account to publish under @wikimedia [20:39:43] Hmm. Just publish it globally then? [20:40:28] Pchelolo: could it be the package is marked private? [20:41:12] yeah.. I'll figure it out from this point. Thanks all! [20:41:35] Good luck. [20:50:54] hey releng we've got a small patch to install shellcheck on labs ci slaves - https://gerrit.wikimedia.org/r/c/operations/puppet/+/720402 - but I was just wondering, is it possible to run PCC on labs hosts? [20:51:04] I seem to recall that it's not possible but wanted to check [20:52:10] yep, it works [20:52:22] https://wikitech.wikimedia.org/wiki/Help:Puppet-compiler#Catalog_compiler_for_CloudVPS [21:24:20] James_F: what did you do merging the branch commit [21:24:26] git hates me [21:26:09] Oh? [21:26:20] Shouldn’t have broken things. [21:26:41] James_F: I'm trying a reclone in case i typed something stupid [21:26:56] It's vendor it hates for me [21:27:05] let me generate errors [21:27:07] Ah, yeah, that got updated I see. [21:27:10] Let me dig. [21:27:28] it just wouldn't rebase [21:37:21] RhinosF1: FWIW `git submodule foreach --recursive 'git log --oneline -n1'` shows everything as on origin/REL1_37 for me. [21:38:14] James_F: let me see if i can make it fail again [21:44:31] James_F: apparenly git wanted a reclone [21:44:34] it's happy now [21:48:30] Huh. Sorry for the disruption. If it happens again I'd love to know what we can do to avoid it breaking for you and others. [21:52:00] James_F: no idea, i really should document what I actually do [21:52:07] :-) [21:52:47] our 'branch cut' is copy REL1_36 and then merge 1.37 into it [21:52:59] because we have no master branch [21:55:16] 10Release-Engineering-Team, 10MediaWiki-extensions-VipsScaler, 10Structured Data Engineering, 10Structured-Data-Backlog, and 2 others: Undeploy VipsScaler from Wikimedia wikis - https://phabricator.wikimedia.org/T290759 (10Jdforrester-WMF) 05Resolved→03Open [21:55:44] (03PS1) 10Jforrester: Revert "Stop branching VipsScaler for Wikimedia production" [tools/release] - 10https://gerrit.wikimedia.org/r/721068 [21:55:49] (03CR) 10Jforrester: [C: 03+2] Revert "Stop branching VipsScaler for Wikimedia production" [tools/release] - 10https://gerrit.wikimedia.org/r/721068 (owner: 10Jforrester) [21:57:31] RhinosF1: Ah, yeah, that's going to be a disaster whatever we do, sorry. Have you considered, err, not doing that? [21:57:41] 10Release-Engineering-Team, 10MediaWiki-extensions-VipsScaler, 10Structured Data Engineering, 10Structured-Data-Backlog, and 2 others: Undeploy VipsScaler from Wikimedia wikis - https://phabricator.wikimedia.org/T290759 (10Legoktm) Because of {T291010} and {T290973} we're going to put VipsScaler back for n... [21:58:06] James_F: yes I have, it's a long proccess to trash this much tech debt [21:58:18] that's hopefully coming in time for 1.38 [21:58:25] (03Merged) 10jenkins-bot: Revert "Stop branching VipsScaler for Wikimedia production" [tools/release] - 10https://gerrit.wikimedia.org/r/721068 (owner: 10Jforrester) [21:58:35] Ack. [21:59:01] 10Release-Engineering-Team (Doing), 10Release, 10Train Deployments: 1.37.0-wmf.23 deployment blockers - https://phabricator.wikimedia.org/T281164 (10Jdlrobson) [22:15:25] 10Phabricator, 10Developer Productivity, 10MediaWiki-Releasing (Workflow Improvements): Make it easier to track tasks which are stalled pending a MediaWiki release - https://phabricator.wikimedia.org/T290960 (10DannyS712) Perhaps: Add a new phab task status (stalled until after next MW release) Run a batch c... [22:44:41] 10MediaWiki-Releasing, 10MW-1.38-release, 10MobileFrontend (Tracking), 10Readers-Web-Backlog (Tracking): Bundle MobileFrontend extension with MediaWiki - https://phabricator.wikimedia.org/T191734 (10Jdlrobson) >>! In T191734#7350773, @Tgr wrote: > None of them are particularly great IMO. Minerva is great o... [23:00:47] anyone in releng every looked at backstage.io ?