[00:19:55] I guess I can add "DBA for Beta Cluster" to my resume now. [00:20:02] (24h stint) [00:41:14] (03PS1) 10Dave Pifke: Edit Project Config [performance/debs/prometheus-ebpf-exporter] (refs/meta/config) - 10https://gerrit.wikimedia.org/r/597660 [01:10:19] 10Gerrit, 10Release-Engineering-Team (Development services), 10Release-Engineering-Team-TODO, 10Striker, 10Tools: Add Gerrit support to Striker (toolsadmin) - https://phabricator.wikimedia.org/T224676 (10Paladox) a:05Paladox→03None [02:06:22] 10Release-Engineering-Team-TODO, 10Core Platform Team, 10CPT Initiatives (API Gateway), 10User-Ladsgroup, and 3 others: New Public Wiki for the API Portal - https://phabricator.wikimedia.org/T246945 (10Ladsgroup) >>! In T246945#6152504, @CCicalese_WMF wrote: >>>! In T246945#6150813, @Ladsgroup wrote: >> An... [03:53:36] PROBLEM - Free space - all mounts on deployment-logstash2 is CRITICAL: CRITICAL: deployment-prep.deployment-logstash2.diskspace._mnt.byte_percentfree (No valid datapoints found) deployment-prep.deployment-logstash2.diskspace._var_lib_elasticsearch.byte_percentfree (No valid datapoints found)deployment-prep.deployment-logstash2.diskspace.root.byte_percentfree (<100.00%) [06:37:20] 10Gerrit, 10Phabricator, 10Release-Engineering-Team (Development services), 10Release-Engineering-Team-TODO: Stop using Differential for code review - https://phabricator.wikimedia.org/T191182 (10Dzahn) >>! In T191182#6153918, @bd808 wrote: > @dzahn's explanation ignores all of T191182#4935787 and the lit... [07:42:59] 10Continuous-Integration-Config, 10BlueSpice, 10Patch-For-Review: Enable unit tests on BlueSpice* repos - https://phabricator.wikimedia.org/T130811 (10Osnard) [07:43:15] 10Continuous-Integration-Config, 10BlueSpice, 10Patch-For-Review: Enable unit tests on BlueSpice* repos - https://phabricator.wikimedia.org/T130811 (10Osnard) [08:40:12] (03CR) 10Filippo Giunchedi: [C: 03+1] "> Patch Set 1: Code-Review-1" [integration/config] - 10https://gerrit.wikimedia.org/r/597227 (https://phabricator.wikimedia.org/T251869) (owner: 10Filippo Giunchedi) [09:11:48] (03CR) 10Giuseppe Lavagetto: [C: 03+1] "As stated in the task, we should probably at some point split the puppet CI job in multiple jobs with leaner images." [integration/config] - 10https://gerrit.wikimedia.org/r/597227 (https://phabricator.wikimedia.org/T251869) (owner: 10Filippo Giunchedi) [09:39:01] 10Continuous-Integration-Infrastructure, 10Release-Engineering-Team (CI & Testing services), 10Release-Engineering-Team-TODO (2020-04 to 2020-06 (Q4)), 10Zuul: Add a second Gerrit connection in Zuul config - https://phabricator.wikimedia.org/T253263 (10Dzahn) @QChris @hashar Do you see a new for a DNS name... [09:45:17] 10Phabricator, 10EngProd-Virtual-Hackathon: Extract data for burn down charts - https://phabricator.wikimedia.org/T253109 (10dom_walden) >>! In T253109#6147986, @Aklapper wrote: > [Burndown charts already exist](https://phabricator.wikimedia.org/project/reports/1274/). [Random unmaintained external stuff](http... [11:43:30] 10Release-Engineering-Team-TODO, 10Core Platform Team, 10CPT Initiatives (API Gateway), 10User-Ladsgroup, and 3 others: New Public Wiki for the API Portal - https://phabricator.wikimedia.org/T246945 (10CCicalese_WMF) Sorry for the confusion. We do want it to be connected to SUL, but we want to configure ac... [11:55:56] 10Release-Engineering-Team-TODO (2020-04 to 2020-06 (Q4)), 10Patch-For-Review, 10Release Pipeline (Blubber): Automate Deployment of Blubber - https://phabricator.wikimedia.org/T253264 (10akosiaris) >>! In T253264#6153839, @jeena wrote: > @akosiaris Before I get started, do you know if anyone is working on so... [11:57:35] 10Release-Engineering-Team-TODO, 10Core Platform Team, 10CPT Initiatives (API Gateway), 10User-Ladsgroup, and 3 others: New Public Wiki for the API Portal - https://phabricator.wikimedia.org/T246945 (10Dzahn) >>! In T246945#5945175, @CCicalese_WMF wrote: > potential confusion between those and dev.wikime... [13:15:16] (03PS1) 10Lars Wirzenius: fix(debian/control): update Uploaders field [tools/scap] - 10https://gerrit.wikimedia.org/r/597775 [13:20:27] (03CR) 10Lars Wirzenius: "Tiny update to debian/control. Big update symbolically: I'm formally adding myself to the package as a maintainer." [tools/scap] - 10https://gerrit.wikimedia.org/r/597775 (owner: 10Lars Wirzenius) [13:37:59] 10Release-Engineering-Team-TODO (2020-04 to 2020-06 (Q4)), 10Scap, 10EngProd-Virtual-Hackathon: Rename `scap sync` to `scap sync-world` - https://phabricator.wikimedia.org/T250302 (10LarsWirzenius) Possibly it would be OK to just make "scap sync" error at once, rather than have a transition period. How often... [13:54:06] addshore: i’m off today for the public holiday here but can catch up with you another day about mw cli stuff if you like, I see you’ll be in the local dev sync meeting today, yeah? [13:56:31] (03CR) 10Jforrester: [C: 03+1] fix(debian/control): update Uploaders field [tools/scap] - 10https://gerrit.wikimedia.org/r/597775 (owner: 10Lars Wirzenius) [14:00:33] kostajh: yup, another day sounds good, I'll probably look at it more in this coming week [14:08:06] https://usercontent.irccloud-cdn.com/file/itlzjwyK/hackathon.jpg [14:08:36] sorry, wrong channel 😬 [14:21:28] 10Release-Engineering-Team-TODO (2020-04 to 2020-06 (Q4)), 10Scap, 10EngProd-Virtual-Hackathon: Rename `scap sync` to `scap sync-world` - https://phabricator.wikimedia.org/T250302 (10Jdforrester-WMF) At the very least, the scripts on Beta Cluster blindly run `sync` and will need changing. A cut-over seems best. [14:55:09] addshore: thanks for the demo - this all seems pretty promising. [14:55:29] <3 I hope so. I'm gonna grab a beer and start writing some go..... [14:55:36] its a bank holiday here... soooo.... :P [14:55:49] 10Release-Engineering-Team, 10Wikimedia-Extension-setup, 10CPT Initiatives (API Gateway): Determine how to host Chameleon skin and Bootstrap extension in gerrit while primary development happens in github - https://phabricator.wikimedia.org/T252463 (10Reedy) So, to unblock this slightly and a few other thing... [14:56:47] brennen, longma, addshore, twentyafterfour [14:56:49] Bbah. [14:57:03] … ": Great meeting, thanks all." [14:57:09] * James_F glares at his keyboard. [14:58:03] What does the "Exclusive" checkbox on the Gerrit access pages mean? [14:58:33] Over-ride inheritance, I think. [14:58:36] (03PS1) 10Reedy: Removing rights inheritance to prevent accidental CR/merging [extensions/Bootstrap] (refs/meta/config) - 10https://gerrit.wikimedia.org/r/597798 [14:59:08] Reedy: https://gerrit-review.googlesource.com/Documentation/access-control.html#__block_and_allow_rules_in_the_same_project_with_the_exclusive_flag [14:59:26] "When a project contains a 'BLOCK' and 'ALLOW' that uses the Exclusive flag in a more specific reference, the 'ALLOW' rule with the Exclusive flag will override the 'BLOCK' rule" [14:59:52] (03PS1) 10Reedy: Removing rights inheritance to prevent accidental CR/merging [skins/chameleon] (refs/meta/config) - 10https://gerrit.wikimedia.org/r/597799 [14:59:57] Reedy: If the skin repo in gerrit is read-only, we won't be able to branch it for production release, so we need it to be writeable but only for special people, right? [15:00:16] James_F: Eventually, yeah [15:00:22] Also we're going to need to test it against vendor, so can't rely on quibble-composer variants. Joy. [15:00:29] https://gerrit-review.googlesource.com/Documentation/access-control.html#reference [15:00:32] I'm just trying to get an up to date version in Gerrit to start unblocking shit [15:00:40] * James_F nods. [15:00:51] But also removing the C+2/merging rights to prevent repo screw ups for the moment [15:01:05] Sure. [15:01:14] "For allowing access, all ALLOW/DENY rules that might apply to a ref are tested until one granting access is found, or until either an "exclusive" rule ends the search, or all rules have been tested." [15:01:21] Maybe change the repo display name to "READ-ONLY" [15:01:31] so exclusive ends the evaluation of further rules [15:01:32] Can a gerrit admin merge the two patches above? [15:02:12] Sure. [15:02:16] (03CR) 10Jforrester: [V: 03+2 C: 03+2] Removing rights inheritance to prevent accidental CR/merging [extensions/Bootstrap] (refs/meta/config) - 10https://gerrit.wikimedia.org/r/597798 (owner: 10Reedy) [15:02:41] Oh, huh, apparently it needs an actual gerrit admin? [15:03:01] As in, SRE root sign-off after endless discussion. [15:03:21] Isn't it great how we locked things down? [15:03:32] lol [15:04:47] James_F: does that just need a submit? [15:05:14] yeh [15:06:27] 10Release-Engineering-Team-TODO, 10MediaWiki-Docker, 10Developer Productivity, 10User-Addshore: Mock up the mediawiki-docker-dev "mwdd" cli in go - https://phabricator.wikimedia.org/T253313 (10mmodell) [15:07:32] (03CR) 10Brennen Bearnes: [V: 03+2 C: 03+2] Removing rights inheritance to prevent accidental CR/merging [skins/chameleon] (refs/meta/config) - 10https://gerrit.wikimedia.org/r/597799 (owner: 10Reedy) [15:07:42] James_F, Reedy: merged those 2. [15:07:46] Thanks! [15:07:47] brennen: Thanks. [15:08:16] i am a gerrit admin per an earlier moment when i narrowly avoided becoming responsible for actual gerrit maintenance [15:08:27] Reedy: I re-worked https://gerrit.wikimedia.org/r/#/c/mediawiki/core/+/597784 to show off line justification (and tweak the wording to be blunter). Can you C+1? [15:08:33] brennen: Ha. Good dodge? ;-) [15:08:35] mostly by virtue of having no idea what i was doing, i think [15:08:48] James_F: "Shit broke. TOO BAD BRAH" [15:08:59] Was the having-no-idea how you nearly became in charge, or how you avoided it? :-) [15:09:04] both [15:09:10] * James_F grins. [15:10:26] * twentyafterfour needs to get better at pretending to have no idea what I'm doing [15:11:26] Please can someone add me to https://gerrit.wikimedia.org/r/#/admin/groups/487,members and https://gerrit.wikimedia.org/r/#/admin/groups/486,members so I can continue poking? [15:12:02] reedy: sure [15:12:14] done [15:12:38] thanks [15:13:19] Reedy: Must… maintain… justification: https://gerrit.wikimedia.org/r/c/mediawiki/core/+/597784/3..4 [15:17:34] 10Release-Engineering-Team-TODO, 10MediaWiki-Docker, 10Developer Productivity, 10User-Addshore: Provide a way to import or discover new mw cli commands and docker-compose files from multiple sources - https://phabricator.wikimedia.org/T253315 (10mmodell) [15:17:46] 10Release-Engineering-Team-TODO, 10MediaWiki-Docker, 10Developer Productivity, 10User-Addshore: Provide a way to import or discover new mw cli commands and docker-compose files from multiple sources - https://phabricator.wikimedia.org/T253315 (10mmodell) a:05Addshore→03None [15:18:40] Reedy: Huh, just got GitHub notifications for Bootstrap and Chameleon being "new"… [15:18:49] I re-created the mirrors [15:19:50] Ah, because the old repos exist in a different namespace on GitHub? [15:20:08] And we're double-mirroring from real-GH->gerrit->fake-GH? [15:20:21] Something like that :) [15:20:39] https://github.com/ProfessionalWiki/chameleon vs. https://github.com/wikimedia/mediawiki-skins-Chameleon [15:21:08] * James_F wonders if we have more "Google juice" for our GH repos. [15:21:49] But not https://github.com/ProfessionalWiki/Bootstrap -> https://github.com/wikimedia/mediawiki-extensions-Bootstrap yet? [15:23:15] I'm multi tasking [15:23:16] I'm in a meeting [15:23:18] And doing it :P [15:23:22] I didn't make gerrit force replication [15:24:01] * James_F grins. [15:24:02] I saw the task come in about this, but I didn't really have the context for this [15:24:10] it's there now :P [15:24:32] thcipriani: TLDR is basically CPT want to deploy extensions to WMF prod that aren't canonically maintained in gerrit [15:24:55] thcipriani: Context is that we're forking the API documentation on MW.org into a new read-only wiki instance with fun extensions and skins we don't currently have in prod. [15:25:51] a documentation wiki using chameleon (and whatever extensions it needs), is that right? [15:25:59] Yeah.. [15:26:04] There's quite a dependancy tree though [15:27:19] and is development moving to gerrit or staying on github? [15:27:45] I imagine the latter [15:27:50] It was in gerrit a few years ago [15:28:38] We might want to fork with review/security assessment rather than mirror. [15:28:58] That's a Security Team call, I guess? [15:28:59] i.e., have a human mirror? [15:29:03] Yes. [15:29:11] It depends how amenable upstream are to changes [15:29:12] Human-in-the-loop. [15:29:29] Or how free-and-easy upstream are with novel code. [15:29:45] E.g. we'd need to assert that they don't add new composer demands that aren't in vendor yet. [15:29:46] Etc. [15:30:06] Plus how we deal with having to patch in production... [15:30:11] There's a reason we don't allow non-gerrit-mastered code into production. [15:30:32] Always a way to make it work, but the cost/benefit assessment isn't going to be pretty. [15:31:03] Indeed. Which is what needs hashing out [15:31:49] Anyway. Something for the security assessment. [15:32:32] (03CR) 10Jforrester: "Dare I ask for tests? :-)" [tools/scap] - 10https://gerrit.wikimedia.org/r/595983 (https://phabricator.wikimedia.org/T247075) (owner: 10Lars Wirzenius) [15:34:33] from a releng perspective developing in gerrit is easiest for us, since there aren't weird permissions to maintain, or strange mirroring to monitor; but the composer piece, anything fiddly that's manually maintained, mostly happens outside what I'm watching for: who else needs to get dragged in? [15:35:07] (03CR) 10Lars Wirzenius: "> Patch Set 2:" [tools/scap] - 10https://gerrit.wikimedia.org/r/595983 (https://phabricator.wikimedia.org/T247075) (owner: 10Lars Wirzenius) [15:37:53] (03CR) 10Jforrester: "> Patch Set 2:" [tools/scap] - 10https://gerrit.wikimedia.org/r/595983 (https://phabricator.wikimedia.org/T247075) (owner: 10Lars Wirzenius) [15:39:34] (03PS1) 10Reedy: Add chameleon and Bootstrap [integration/config] - 10https://gerrit.wikimedia.org/r/597810 [15:39:56] (03PS2) 10Reedy: Add chameleon and Bootstrap [integration/config] - 10https://gerrit.wikimedia.org/r/597810 [15:40:04] Project beta-scap-eqiad build #301613: 04FAILURE in 5 min 33 sec: https://integration.wikimedia.org/ci/job/beta-scap-eqiad/301613/ [15:40:25] 10Release-Engineering-Team, 10Wikimedia-Extension-setup, 10CPT Initiatives (API Gateway): Determine how to host Chameleon skin and Bootstrap extension in gerrit while primary development happens in github - https://phabricator.wikimedia.org/T252463 (10Reedy) Bootstrap and Chameleon repos re-synced to gerrit... [15:40:38] 16:39:58 15:39:58 sudo -u mwdeploy -n -- /usr/bin/rsync -l deployment-deploy01.deployment-prep.eqiad.wmflabs::common/wikiversions*.{json,php} /srv/mediawiki on deployment-parsoid11.deployment-prep.eqiad.wmflabs returned [255]: Authentication failed. [15:40:39] (03CR) 10jerkins-bot: [V: 04-1] Add chameleon and Bootstrap [integration/config] - 10https://gerrit.wikimedia.org/r/597810 (owner: 10Reedy) [15:45:03] (03CR) 10jerkins-bot: [V: 04-1] Add chameleon and Bootstrap [integration/config] - 10https://gerrit.wikimedia.org/r/597810 (owner: 10Reedy) [15:45:44] (03PS7) 10Jforrester: 🚢🍾 Archive this repository; unused [integration/jenkins] - 10https://gerrit.wikimedia.org/r/596847 (https://phabricator.wikimedia.org/T252466) (owner: 10Krinkle) [15:45:53] (03PS4) 10Reedy: Add chameleon and Bootstrap [integration/config] - 10https://gerrit.wikimedia.org/r/597810 [15:45:56] (03CR) 10jerkins-bot: [V: 04-1] 🚢🍾 Archive this repository; unused [integration/jenkins] - 10https://gerrit.wikimedia.org/r/596847 (https://phabricator.wikimedia.org/T252466) (owner: 10Krinkle) [15:47:59] Yippee, build fixed! [15:48:00] Project beta-scap-eqiad build #301614: 09FIXED in 3 min 26 sec: https://integration.wikimedia.org/ci/job/beta-scap-eqiad/301614/ [15:48:11] (03PS5) 10Reedy: Add chameleon and Bootstrap [integration/config] - 10https://gerrit.wikimedia.org/r/597810 [15:50:01] (03PS1) 10Jforrester: layout: [integration/jenkins] Mark as archived [integration/config] - 10https://gerrit.wikimedia.org/r/597811 (https://phabricator.wikimedia.org/T252466) [15:52:27] James_F: ^ I'll merge that as is.. I left some TODO comments about syncing the templates [15:53:06] anyone any idea how i can actually package yml files with this go thing and refer to them at executaiton time? :P [15:53:36] (03CR) 10Reedy: [C: 03+2] Add chameleon and Bootstrap [integration/config] - 10https://gerrit.wikimedia.org/r/597810 (owner: 10Reedy) [15:53:42] Reedy: Almost none of those jobs run post-merge. [15:53:57] Reedy: So all that gets you is `recheck` on bad code to find out how bad it is. ;-) [15:54:19] Incremental progress! [15:54:26] That's one way of putting it. [15:54:27] (03Merged) 10jenkins-bot: Add chameleon and Bootstrap [integration/config] - 10https://gerrit.wikimedia.org/r/597810 (owner: 10Reedy) [15:54:44] It's not like we're going to be merging to master (at least at the moment) in those repos etc [15:55:08] !log Reloading Zuul to deploy https://gerrit.wikimedia.org/r/597810 [15:55:10] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [15:55:24] 10Continuous-Integration-Infrastructure, 10Release-Engineering-Team-TODO, 10Patch-For-Review, 10Technical-Debt: Archive integration/jenkins.git - https://phabricator.wikimedia.org/T252955 (10Jdforrester-WMF) [15:58:10] 10Continuous-Integration-Infrastructure, 10Release-Engineering-Team (CI & Testing services), 10Release-Engineering-Team-TODO: Fix partitions on CI slaves , some are missing /var/lib/docker - https://phabricator.wikimedia.org/T221040 (10Jdforrester-WMF) 05Open→03Resolved a:03hashar This got fixed in the... [16:00:07] addshore: for blubber we ended up using a go generator to pull yaml into a go string. It's not pretty, but it's an option. There are libraries for this as well IIRC. [16:00:40] 10Continuous-Integration-Infrastructure, 10Release-Engineering-Team (CI & Testing services), 10Release-Engineering-Team-TODO, 10Patch-For-Review, 10Technical-Debt: Clear /srv/.git on contint1001; move integration.wikimedia.org docroot to new location - https://phabricator.wikimedia.org/T149924 (10Jdforre... [16:00:41] hmmmmmmm, could work and doesnt sound too totally evil [16:01:16] https://golang.org/pkg/text/template/ [16:01:31] addshore: or ^ [16:03:56] * addshore reads a bit of https://github.com/gobuffalo/packr [16:04:11] * addshore >> v [16:04:12] https://github.com/markbates/pkger [16:04:59] What's the magic sauce to make CI install the random (not in mw-vendor) vendor dependancies? [16:05:09] quibble-composer [16:05:13] Which I said before. [16:05:28] But you ignored me and merged your patch anyway. :-P [16:05:42] You said where? [16:06:04] Not on the patch... [16:06:25] And not in here that I can see ;) [16:06:49] "08:00:22 Also we're going to need to test it against vendor, so can't rely on quibble-composer variants. Joy." [16:07:03] that was before my patch existed :P [16:07:10] And like an hour ago? ;) [16:07:25] I know, I know, I'm psychic. You're welcome. ;-) [16:08:50] 10Release-Engineering-Team, 10Wikimedia-Extension-setup, 10CPT Initiatives (API Gateway): Determine how to host Chameleon skin and Bootstrap extension in gerrit while primary development happens in github - https://phabricator.wikimedia.org/T252463 (10CCicalese_WMF) Thank you! That's great progress! The que... [16:09:13] (03PS1) 10Reedy: Add extension-quibble-composer to Bootstrap templates [integration/config] - 10https://gerrit.wikimedia.org/r/597814 [16:09:38] heh https://github.com/golang/go/issues/35950 [16:10:20] (03CR) 10Jforrester: Add extension-quibble-composer to Bootstrap templates (031 comment) [integration/config] - 10https://gerrit.wikimedia.org/r/597814 (owner: 10Reedy) [16:12:21] (03PS2) 10Reedy: Add extension-quibble-composer to Bootstrap templates [integration/config] - 10https://gerrit.wikimedia.org/r/597814 [16:15:16] Reedy: Does Chameleon have composer deps as well? [16:15:42] Technically it has mediawiki/bootstrap [16:15:47] But that is provided by installing it as an extension [16:15:59] because it needs the wfLoadExtension(), so no point composer including it [16:16:32] And I've already added it in zuul_parameters [16:17:04] * James_F nods. [16:17:15] (03CR) 10Jforrester: [C: 03+2] Add extension-quibble-composer to Bootstrap templates [integration/config] - 10https://gerrit.wikimedia.org/r/597814 (owner: 10Reedy) [16:18:07] (03Merged) 10jenkins-bot: Add extension-quibble-composer to Bootstrap templates [integration/config] - 10https://gerrit.wikimedia.org/r/597814 (owner: 10Reedy) [16:18:20] Shall I deploy are you? :) [16:18:56] (03CR) 10Jforrester: "This change is ready for review." [integration/jenkins] - 10https://gerrit.wikimedia.org/r/596847 (https://phabricator.wikimedia.org/T252466) (owner: 10Krinkle) [16:19:04] (03CR) 10Jforrester: "Let's do this?" [integration/jenkins] - 10https://gerrit.wikimedia.org/r/596847 (https://phabricator.wikimedia.org/T252466) (owner: 10Krinkle) [16:19:20] Oh, sorry, should !log [16:19:44] !log Zuul: [mediawiki/extensions/Bootstrap] Switch down to quibble-composer for now. [16:19:46] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [16:19:59] Reedy: Sorry, too many meetings. [16:20:15] heh [16:20:18] thanks [16:25:59] 10Release-Engineering-Team, 10Wikimedia-Extension-setup, 10CPT Initiatives (API Gateway): Determine how to host Chameleon skin and Bootstrap extension in gerrit while primary development happens in github - https://phabricator.wikimedia.org/T252463 (10Reedy) >>! In T252463#6155814, @CCicalese_WMF wrote: > Th... [16:27:57] Hello! I'm hitting a weird issue with deployment-prep. I'm configuring a host via horizon and it looks like my changes are getting into git https://gerrit.wikimedia.org/r/plugins/gitiles/cloud/instance-puppet/+log/master/deployment-prep/deployment-docker-changeprop01.deployment-prep.eqiad.wmflabs.yaml [16:28:20] but on horizon the config is truncated, and I'm getting missing key errors when I run puppet on the host (those keys are missing from the horizon UI) https://horizon.wikimedia.org/project/instances/39317231-7710-4973-8cb6-50c05bf6ac79/ [16:32:57] (03PS1) 10Reedy: Make WikimediaApiPortal depend on skins/chameleon [integration/config] - 10https://gerrit.wikimedia.org/r/597820 [16:33:07] (03CR) 10Reedy: [C: 03+2] Make WikimediaApiPortal depend on skins/chameleon [integration/config] - 10https://gerrit.wikimedia.org/r/597820 (owner: 10Reedy) [16:33:56] (03Merged) 10jenkins-bot: Make WikimediaApiPortal depend on skins/chameleon [integration/config] - 10https://gerrit.wikimedia.org/r/597820 (owner: 10Reedy) [16:34:24] !log Reloading Zuul to deploy https://gerrit.wikimedia.org/r/597820 [16:34:25] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [16:36:46] 10Continuous-Integration-Infrastructure, 10Release-Engineering-Team-TODO, 10Patch-For-Review, 10Technical-Debt: Archive integration/jenkins.git - https://phabricator.wikimedia.org/T252955 (10Krinkle) [16:37:03] (03CR) 10Krinkle: [C: 03+1] 🚢🍾 Archive this repository; unused [integration/jenkins] - 10https://gerrit.wikimedia.org/r/596847 (https://phabricator.wikimedia.org/T252466) (owner: 10Krinkle) [16:37:25] (03CR) 10Jforrester: [V: 03+2 C: 03+2] 🚢🍾 Archive this repository; unused [integration/jenkins] - 10https://gerrit.wikimedia.org/r/596847 (https://phabricator.wikimedia.org/T252466) (owner: 10Krinkle) [16:37:30] (03PS1) 10Reedy: Add basic CI for WikimediaApiPortalOAuth [integration/config] - 10https://gerrit.wikimedia.org/r/597825 [16:38:16] 10Continuous-Integration-Infrastructure, 10Release-Engineering-Team-TODO, 10Patch-For-Review, 10Technical-Debt: Archive integration/jenkins.git - https://phabricator.wikimedia.org/T252955 (10Jdforrester-WMF) 05Open→03Resolved [16:38:19] 10Continuous-Integration-Infrastructure, 10Jenkins, 10Patch-For-Review: 404 link in README file in integration/jenkins repository - https://phabricator.wikimedia.org/T252466 (10Jdforrester-WMF) [16:38:22] 10Continuous-Integration-Infrastructure, 10Jenkins, 10Patch-For-Review: 404 link in README file in integration/jenkins repository - https://phabricator.wikimedia.org/T252466 (10Jdforrester-WMF) 05Open→03Resolved [16:39:12] (03PS1) 10Brennen Bearnes: add stretch-php72-videoscaler for TimedMediaHandler [releng/dev-images] - 10https://gerrit.wikimedia.org/r/597826 (https://phabricator.wikimedia.org/T247153) [16:39:55] (03CR) 10Reedy: [C: 03+2] Add basic CI for WikimediaApiPortalOAuth [integration/config] - 10https://gerrit.wikimedia.org/r/597825 (owner: 10Reedy) [16:40:45] (03Merged) 10jenkins-bot: Add basic CI for WikimediaApiPortalOAuth [integration/config] - 10https://gerrit.wikimedia.org/r/597825 (owner: 10Reedy) [16:42:04] !log Reloading Zuul to deploy https://gerrit.wikimedia.org/r/597825 [16:42:06] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [16:44:11] 10Release-Engineering-Team-TODO (2020-04 to 2020-06 (Q4)), 10Scap, 10EngProd-Virtual-Hackathon, 10Python3-Porting: Port scap to Python 3.4 - https://phabricator.wikimedia.org/T246025 (10LarsWirzenius) Checking all call sites of py_djb_hash so they give a correct byte string. [16:51:07] https://www.irccloud.com/pastebin/MiEmq7oq/ [16:51:35] (03PS1) 10Lars Wirzenius: feat: rename sync to sync-world [tools/scap] - 10https://gerrit.wikimedia.org/r/597828 (https://phabricator.wikimedia.org/T250302) [16:53:45] (03CR) 10Thcipriani: [C: 03+2] feat: rename sync to sync-world [tools/scap] - 10https://gerrit.wikimedia.org/r/597828 (https://phabricator.wikimedia.org/T250302) (owner: 10Lars Wirzenius) [16:55:57] (03Merged) 10jenkins-bot: feat: rename sync to sync-world [tools/scap] - 10https://gerrit.wikimedia.org/r/597828 (https://phabricator.wikimedia.org/T250302) (owner: 10Lars Wirzenius) [16:57:55] (03PS2) 10Brennen Bearnes: add stretch-php72-videoscaler for TimedMediaHandler [releng/dev-images] - 10https://gerrit.wikimedia.org/r/597826 (https://phabricator.wikimedia.org/T247153) [17:05:17] 10Continuous-Integration-Infrastructure: Consider if CI images should use Wikimedia production ffmpeg version - https://phabricator.wikimedia.org/T253328 (10Jdforrester-WMF) [17:06:07] (03PS1) 10Thcipriani: beta-scap-eqiad: scap sync -> scap sync-world [integration/config] - 10https://gerrit.wikimedia.org/r/597832 (https://phabricator.wikimedia.org/T250302) [17:07:25] (03CR) 10Thcipriani: [C: 04-1] "Waiting on new scap version with Ief955c0e282136490ea96625e6a1bc724f465801" [integration/config] - 10https://gerrit.wikimedia.org/r/597832 (https://phabricator.wikimedia.org/T250302) (owner: 10Thcipriani) [17:12:18] Bleugh. chameleon vs Chameleon [17:14:02] and gerrit isn't case insensitive [17:15:01] And we can't rename repos, right? [17:15:50] No. [17:16:21] I'm just wondering if it's worth creating the uppercased version before we get much deper into this [17:16:31] as the name in skin.json is capitalised etc [17:17:16] 10Release-Engineering-Team, 10Wikimedia-Extension-setup, 10CPT Initiatives (API Gateway): Determine how to host Chameleon skin and Bootstrap extension in gerrit while primary development happens in github - https://phabricator.wikimedia.org/T252463 (10Reedy) Just noticed a bit of a gotcha. The existing Chame... [17:21:31] (03PS2) 10Jforrester: jjb: [beta-scap-eqiad]: scap sync -> scap sync-world [integration/config] - 10https://gerrit.wikimedia.org/r/597832 (https://phabricator.wikimedia.org/T250302) (owner: 10Thcipriani) [17:23:38] Do we actually use delete project? [17:24:03] 10Release-Engineering-Team, 10Wikimedia-Extension-setup, 10CPT Initiatives (API Gateway): Determine how to host Chameleon skin and Bootstrap extension in gerrit while primary development happens in github - https://phabricator.wikimedia.org/T252463 (10CCicalese_WMF) It looks like the github repo also is lowe... [17:24:36] Reedy: Don't think so, but I'm not a gerrit-is-a-monster-from-the-Deep expert. [17:28:50] 10Release-Engineering-Team, 10Wikimedia-Extension-setup, 10CPT Initiatives (API Gateway): Determine how to host Chameleon skin and Bootstrap extension in gerrit while primary development happens in github - https://phabricator.wikimedia.org/T252463 (10Reedy) Oh, is it? It's hard to tell with GitHub as it is... [17:30:41] 10Release-Engineering-Team, 10Wikimedia-Extension-setup, 10CPT Initiatives (API Gateway): Determine how to host Chameleon skin and Bootstrap extension in gerrit while primary development happens in github - https://phabricator.wikimedia.org/T252463 (10Reedy) Aha, I see the emphasis and mentions in https://gi... [17:33:57] (03PS1) 10Lars Wirzenius: fix(deploy-promote): add set -eu, fix things found by shellcheck [tools/release] - 10https://gerrit.wikimedia.org/r/597836 [17:42:11] well i mean technically repos can be renamed due to NoteDB, but needs reindexes. So it's probably just best to create a new repo with the capitalisation, make the other read only read only/hidden. [17:43:12] (03CR) 10Thcipriani: [C: 03+2] fix(deploy-promote): add set -eu, fix things found by shellcheck (031 comment) [tools/release] - 10https://gerrit.wikimedia.org/r/597836 (owner: 10Lars Wirzenius) [17:43:43] (03Merged) 10jenkins-bot: fix(deploy-promote): add set -eu, fix things found by shellcheck [tools/release] - 10https://gerrit.wikimedia.org/r/597836 (owner: 10Lars Wirzenius) [17:45:02] https://integration.wikimedia.org/ci/job/quibble-vendor-mysql-php72-docker/67292/console and https://integration.wikimedia.org/ci/job/quibble-vendor-mysql-php72-docker/67291/console seem to have stalled [17:47:54] (03PS2) 10Lars Wirzenius: fix(debian/control): update Uploaders field [tools/scap] - 10https://gerrit.wikimedia.org/r/597775 [17:48:20] (03CR) 10Thcipriani: [C: 03+2] fix(debian/control): update Uploaders field [tools/scap] - 10https://gerrit.wikimedia.org/r/597775 (owner: 10Lars Wirzenius) [17:53:33] (03Merged) 10jenkins-bot: fix(debian/control): update Uploaders field [tools/scap] - 10https://gerrit.wikimedia.org/r/597775 (owner: 10Lars Wirzenius) [17:57:28] (03PS3) 10Thcipriani: fix(py_djb_hash): change code to work in both Python 2 and 3 [tools/scap] - 10https://gerrit.wikimedia.org/r/596191 (owner: 10Lars Wirzenius) [17:57:56] (03CR) 10Thcipriani: [C: 03+2] fix(py_djb_hash): change code to work in both Python 2 and 3 [tools/scap] - 10https://gerrit.wikimedia.org/r/596191 (owner: 10Lars Wirzenius) [18:00:49] (03Merged) 10jenkins-bot: fix(py_djb_hash): change code to work in both Python 2 and 3 [tools/scap] - 10https://gerrit.wikimedia.org/r/596191 (owner: 10Lars Wirzenius) [18:05:05] 18:48:27 mmap() failed: [12] Cannot allocate memory [18:05:05] 18:48:27 [18:05:05] 18:48:27 mmap() failed: [12] Cannot allocate memory [18:05:05] 18:48:27 PHP Fatal error: Out of memory (allocated 21854420992) (tried to allocate 20480 bytes) in /workspace/src/includes/registration/ExtensionRegistry.php on line 306 [18:05:09] That can't be good [18:05:22] What job? [18:05:31] quibble-vendor-mysql-php72-docker [18:05:49] https://gerrit.wikimedia.org/r/#/c/mediawiki/skins/WikimediaApiPortal/+/588671/ [18:06:38] line 306 is [18:06:39] 'shell' => ( new ShellDisabledError() )->getMessage(), [18:07:15] (03PS3) 10Brennen Bearnes: add stretch-php72-jobrunner for TimedMediaHandler [releng/dev-images] - 10https://gerrit.wikimedia.org/r/597826 (https://phabricator.wikimedia.org/T247153) [18:09:41] Could well be your new dependencies make us hit the limit. [18:10:06] We "only" allocate 24GB of RAM, as it says. [18:10:50] It's certainly possible [18:10:58] But rather concerning if actually the csae [18:11:02] (03PS1) 10Jforrester: fabfile: Rely on DNS to point to contint primary, rather than hardcode [releng/dev-images] - 10https://gerrit.wikimedia.org/r/597840 [18:11:04] (03PS1) 10Jforrester: [stretch-php72] Stop using local fork of composer [releng/dev-images] - 10https://gerrit.wikimedia.org/r/597841 [18:11:14] We've been bumping along at ~20GB for a while, ISTR. [18:12:21] in install.php fun [18:12:26] and that is after running for 14 minutes [18:12:47] Reedy: my guess is that there is some kind of infinite loop in the extension registry which is caused by that patch [18:13:12] Aye [18:13:25] and there is no debug log saved for install.php [18:13:29] I wonder if some of the magic loading code is still in one of their dependancies [18:13:32] cause LocalSettings.php is not there yet [18:13:44] but one should be able to reproduce the issue locally I guess [18:13:58] * James_F runs away. [18:14:15] and how does that skin requires another skin? ;D [18:14:39] See the previous comment of skin but not a skin [18:14:49] skin depends on a skin depends on an extension depends on a library... [18:15:04] oh, which depends on another library, ofc [18:15:24] * Reedy checks that in his head [18:16:16] skins/WikimediaApiPortal -> skins/chameleon -> extensions/Bootstrap -> mediawiki/scss -> scssphp/scssphp [18:16:58] :D [18:17:02] anyway that change is broken somehow [18:17:11] and one would have to debug it locally to find the actual cause [18:17:18] mmm [18:17:27] I don't see it actually loading the composer libraries it needs either [18:17:45] maybe because some class got renamed Skin [18:17:53] 10Phabricator, 10Wikimedia-Phabricator-Extensions, 10Developer Productivity: Link from "Related Gerrit patches" header directly to gerrit search results - https://phabricator.wikimedia.org/T253088 (10mmodell) 05Open→03Resolved a:03mmodell [18:17:54] i don't know really ;D one has to first reproduce [18:17:56] 10Phabricator, 10EngProd-Virtual-Hackathon, 10Epic: Virtual Offsite: Phabricator hacking session - https://phabricator.wikimedia.org/T253090 (10mmodell) [18:17:58] I'll have a look [18:18:06] just waiting for my laptop to finish an update [18:19:41] (03CR) 10Thcipriani: [C: 04-1] "Nice! Couple config variables available for use here and some inline nits for you." (036 comments) [tools/scap] - 10https://gerrit.wikimedia.org/r/595983 (https://phabricator.wikimedia.org/T247075) (owner: 10Lars Wirzenius) [18:20:38] (03PS4) 10Dduvall: add stretch-php72-jobrunner for TimedMediaHandler [releng/dev-images] - 10https://gerrit.wikimedia.org/r/597826 (https://phabricator.wikimedia.org/T247153) (owner: 10Brennen Bearnes) [18:20:58] 10Continuous-Integration-Config, 10CPT Initiatives (API Gateway): WikimediaApiPortal results in CI OOM-ing - https://phabricator.wikimedia.org/T253331 (10Reedy) [18:21:33] (03PS2) 10Jforrester: [stretch-php72] Stop using local fork of composer [releng/dev-images] - 10https://gerrit.wikimedia.org/r/597841 [18:22:12] (03CR) 10Hashar: [C: 03+1] fabfile: Rely on DNS to point to contint primary, rather than hardcode [releng/dev-images] - 10https://gerrit.wikimedia.org/r/597840 (owner: 10Jforrester) [18:26:36] 10Phabricator: Collapse "Related Gerrit Patches" when there are too many - https://phabricator.wikimedia.org/T237816 (10mmodell) 05Open→03Resolved a:03mmodell [18:26:39] 10Phabricator, 10EngProd-Virtual-Hackathon, 10Epic: Virtual Offsite: Phabricator hacking session - https://phabricator.wikimedia.org/T253090 (10mmodell) [18:27:59] 10Phabricator (Upstream), 10Upstream: Disable parent task metadata by default for new sub tasks - https://phabricator.wikimedia.org/T239378 (10mmodell) Ok it's fairly simple to implement this, I've got a commit ready to go but I want to be sure that there is broad consensus that this is wanted before I go ahea... [18:51:33] 10Continuous-Integration-Config, 10MediaWiki-Core-Testing: Add a spellchecker to CI - https://phabricator.wikimedia.org/T253332 (10Reedy) [18:52:53] 10Continuous-Integration-Config, 10MediaWiki-Core-Testing: Add a spellchecker to CI - https://phabricator.wikimedia.org/T253332 (10Jdforrester-WMF) You can use grunt-tyops I guess? [18:56:43] (03PS5) 10Dduvall: add stretch-php72-jobrunner for TimedMediaHandler [releng/dev-images] - 10https://gerrit.wikimedia.org/r/597826 (https://phabricator.wikimedia.org/T247153) (owner: 10Brennen Bearnes) [19:00:47] (03CR) 10Jforrester: [C: 03+1] "Looks roughly right, but I can't build locally. The demo was convincing, however." [releng/dev-images] - 10https://gerrit.wikimedia.org/r/597826 (https://phabricator.wikimedia.org/T247153) (owner: 10Brennen Bearnes) [19:04:40] 10Release-Engineering-Team-TODO (2020-04 to 2020-06 (Q4)), 10EngProd-Virtual-Hackathon: Make deploy-promote more robust against failures - https://phabricator.wikimedia.org/T251750 (10thcipriani) 05Open→03Resolved [19:07:38] 10Release-Engineering-Team, 10Wikimedia-Extension-setup, 10CPT Initiatives (API Gateway): Determine how to host Chameleon skin and Bootstrap extension in gerrit while primary development happens in github - https://phabricator.wikimedia.org/T252463 (10Reedy) >>! In T252463#6156045, @Reedy wrote: > IMHO, then... [19:16:45] [a01bbc7baa7d8f5d4a178ae0] [no req] Error from line 529 of /var/www/wiki/mediawiki/core/vendor/composer/semver/src/VersionParser.php: Maximum function nesting level of '256' reached, aborting! [19:17:29] 10Continuous-Integration-Config, 10CPT Initiatives (API Gateway): WikimediaApiPortal results in CI OOM-ing - https://phabricator.wikimedia.org/T253331 (10Reedy) Trying to get the skin working locally... (haven't tried install.php yet) `lines=15 ( ! ) Fatal error: Uncaught TypeError: Argument 1 passed to Title... [19:17:31] 10Continuous-Integration-Config, 10CPT Initiatives (API Gateway): WikimediaApiPortal results in CI OOM-ing - https://phabricator.wikimedia.org/T253331 (10Reedy) Running install.php... `lines=15 [a01bbc7baa7d8f5d4a178ae0] [no req] Error from line 529 of /var/www/wiki/mediawiki/core/vendor/composer/semver/src... [19:20:31] wtf [19:20:36] Why does it need PageForms [19:22:28] 10Continuous-Integration-Config, 10CPT Initiatives (API Gateway): WikimediaApiPortal results in CI OOM-ing - https://phabricator.wikimedia.org/T253331 (10Reedy) Dumping a var_dump in... `lang=diff diff --git a/includes/installer/Installer.php b/includes/installer/Installer.php index c06d6d4138..51498e5050 100... [19:24:16] Oh, the installer is trying to load all of the extensions? [19:26:28] Reedy: Do you have a full extensions.git directly inside your MW check out? That'll go bang, yes. [19:26:50] Well, especially when other extensions don't define their dependancies correctly [19:26:53] patches incoming for those [19:29:14] 10Continuous-Integration-Infrastructure: Archive integration/jenkinsci/postbuildscript-plugin - https://phabricator.wikimedia.org/T253335 (10Jdforrester-WMF) [19:29:42] 10Continuous-Integration-Infrastructure, 10Release-Engineering-Team (CI & Testing services), 10Release-Engineering-Team-TODO (2020-04 to 2020-06 (Q4)): Archive integration/jenkinsci/postbuildscript-plugin - https://phabricator.wikimedia.org/T253335 (10Jdforrester-WMF) Ping @hashar in case we shouldn't have m... [19:31:28] 10Continuous-Integration-Config, 10CPT Initiatives (API Gateway): WikimediaApiPortal results in CI OOM-ing - https://phabricator.wikimedia.org/T253331 (10Reedy) Ok, so this is a red herring. Because I have all of the extensions checked out, and what I've filed at {T253336}, it tries to load all of the extensio... [19:34:48] 10Continuous-Integration-Infrastructure, 10Release-Engineering-Team (CI & Testing services): Evaluate if we still need our local fork of the jenkins xunit-plugin - https://phabricator.wikimedia.org/T253337 (10Jdforrester-WMF) [19:51:57] 10Continuous-Integration-Config, 10Code-Health, 10Readers-Web-Backlog (Kanbanana-2019-20-Q4), 10Vue.js (Vue.js-Search): Configure ESLint and stylelint for Vue.js search development ahead of it being done for all repos - https://phabricator.wikimedia.org/T249304 (10Niedzielski) [19:57:37] 10Continuous-Integration-Config, 10Vue.js (Vue.js-Search): Install Jest for unit tests for Vue.js search - https://phabricator.wikimedia.org/T249301 (10Niedzielski) [19:58:02] 10Continuous-Integration-Config, 10CPT Initiatives (API Gateway): WikimediaApiPortal results in CI OOM-ing - https://phabricator.wikimedia.org/T253331 (10Reedy) Using this for reference ` 18:29:52 DEBUG:quibble.cmd:Zuul clone with parameters {"cache_dir": "/srv/git", "zuul_branch": "master", "zuul_url": "git:... [20:01:50] 10Continuous-Integration-Config, 10CPT Initiatives (API Gateway): WikimediaApiPortal results in CI OOM-ing - https://phabricator.wikimedia.org/T253331 (10Reedy) I don't see any sign of CI checking out the scss related dependacies either though in https://integration.wikimedia.org/ci/job/quibble-vendor-mysql-ph... [20:07:27] 10Continuous-Integration-Config, 10CPT Initiatives (API Gateway): WikimediaApiPortal results in CI OOM-ing - https://phabricator.wikimedia.org/T253331 (10Reedy) [20:57:50] 10Phabricator: Collapse "Related Gerrit Patches" when there are too many - https://phabricator.wikimedia.org/T237816 (10DannyS712) @mmodell once you expand it, its impossible to collapse again as far as I can see - is this intentional? [21:11:18] hi releng folks, is there any doc you follow when you're updating docker image versions like https://phabricator.wikimedia.org/source/integration-config/browse/master/jjb/operations-puppet.yaml$158 ? [21:11:39] it would be nice if we also updated operations/puppet/utils/run_ci_locally.sh, or could make that script DTRT programmatically [21:18:02] Reedy: is there any point changing the one remaining task where Fundraising Backlog are a subscriber rather than project tag (https://phabricator.wikimedia.org/maniphest/query/KMa9dkh1YeS7/#R) ? [21:18:24] * RhinosF1 wonders how many projects are subscribers rather than tag on objects [21:18:35] You can [21:18:38] Almost always it's wrong [21:19:59] cdanis: https://wikitech.wikimedia.org/wiki/Docker#Updating_CI_docker_images [21:20:04] thx Reedy ! [21:20:27] you can do some fancy-ness with docker-pkg seemingly [21:20:39] Reedy: there's https://phabricator.wikimedia.org/maniphest/query/xkuS8MidXpot/#R with fundraising backlog a subscriber but always tagged? Shall I go and remove them from them tasks as subscriber? or would batch do it quicker? [21:21:08] They're all closed tags [21:21:10] *tasks [21:21:13] I wouldn't bother [21:21:27] Reedy: ok, I left a comment on one from today [21:33:45] 10Release-Engineering-Team, 10Release-Engineering-Team-TODO (2020-04 to 2020-06 (Q4)), 10User-brennen: Review RelEng onboarding documentation - https://phabricator.wikimedia.org/T253350 (10brennen) [21:42:05] James_F: well, the base components work. But the decision now is, to include all of the files that I was randomly mounting into the images in the go binary, or actually use and build custom images [21:42:14] I'll probably opt for #1 for the prototype [21:42:46] At least for the prototype, sure. [21:43:05] I was about to write something on the phab ticket but then my browser combusted [21:43:26] * James_F laughs. [21:43:30] Maybe that's a sign. [21:43:31] I think I should be able to finish it to the same level of functionality as mwdd v1 tommorrow [21:43:39] Yeah, it's a sign its time for bed [21:44:28] Happy to help out tomrrow. [21:44:40] golint is rather opinionated, isn't it? [21:45:01] Yes, I did not try to make it pass the linter at all at this stage :) [21:45:15] Indeed, you went out of your way to make it madder. ;-) [21:45:33] I did a quick fix-up at least making it happy with your package declarations. [21:46:01] There is one evil hack in there right now, the package I'm using to manipulate a .env file always quotes everything. And docker compose doesn't like that, so now everytime I write to the file I replace all " with blank before saving xD [21:46:07] Hack hack hack hack hack [21:46:13] Fun [21:46:13] Anyway, till tommorrow o/ [21:46:17] See you. [22:01:12] 10Continuous-Integration-Config, 10Vue.js (Vue.js-Search): Install Jest for unit tests for Vue.js search - https://phabricator.wikimedia.org/T249301 (10Niedzielski) [22:32:30] (03PS6) 10Dduvall: add stretch-php72-jobrunner for TimedMediaHandler [releng/dev-images] - 10https://gerrit.wikimedia.org/r/597826 (https://phabricator.wikimedia.org/T247153) (owner: 10Brennen Bearnes) [22:34:10] (03CR) 10Dduvall: [C: 03+1] add stretch-php72-jobrunner for TimedMediaHandler (031 comment) [releng/dev-images] - 10https://gerrit.wikimedia.org/r/597826 (https://phabricator.wikimedia.org/T247153) (owner: 10Brennen Bearnes) [22:36:40] 10Release-Engineering-Team, 10Wikimedia-Extension-setup, 10CPT Initiatives (API Gateway): Determine how to host Chameleon skin and Bootstrap extension in gerrit while primary development happens in github - https://phabricator.wikimedia.org/T252463 (10thcipriani) >>! In T252463#6155869, @Reedy wrote: >>>! In... [22:39:38] (03CR) 10Jforrester: [C: 03+1] add stretch-php72-jobrunner for TimedMediaHandler (031 comment) [releng/dev-images] - 10https://gerrit.wikimedia.org/r/597826 (https://phabricator.wikimedia.org/T247153) (owner: 10Brennen Bearnes) [23:33:55] 10LibUp: Puppetize setup on upgrader-06.wmflabs - https://phabricator.wikimedia.org/T173478 (10Legoktm) a:05Legoktm→03None [23:58:17] 10Phabricator, 10Wikipedia-iOS-App-Backlog: Update Herald (H187) to include project 4574 - https://phabricator.wikimedia.org/T253359 (10LGoto) [23:59:24] 10Phabricator, 10Wikipedia-iOS-App-Backlog: Update Herald (H187) to include project 4661 - https://phabricator.wikimedia.org/T253360 (10LGoto)