[02:20:46] 06Project-Admins: Create project tag for PlaceNewSection extension - https://phabricator.wikimedia.org/T351776#10026070 (10Ernstkm) @Aklapper I'd like to update the README at GitHub to mention the source code's new home before archiving it. Is https://gerrit.wikimedia.org/g/mediawiki/extensions/PlaceNewSection... [03:29:54] Project mwcore-phpunit-coverage-master build #3747: 04STILL FAILING in 29 min: https://integration.wikimedia.org/ci/job/mwcore-phpunit-coverage-master/3747/ [05:59:36] 10Beta-Cluster-Infrastructure, 10Add-Link, 10Growth-Team (FY2024-25 Q1 Sprint 2): refreshLinkRecommendation script fails in Beta cluster with FileNotFoundError - https://phabricator.wikimedia.org/T370792#10026204 (10Michael) And I can confirm that I'm seeing the same pattern again on [[ https://grafana-rw.wi... [06:44:49] 10Phabricator, 07PM: Decrease issues created many years ago with no recent activity (aka stale tickets) - https://phabricator.wikimedia.org/T248034#10026259 (10Bugreporter) I strongly oppose this task for the following reason: * Phabricator is not just a bug tracker but also a place for feature requests and an... [07:10:19] 10Scap, 06serviceops: Reimage deploy2002 as bullseye - https://phabricator.wikimedia.org/T371282#10026280 (10ops-monitoring-bot) Cookbook cookbooks.sre.hosts.reimage was started by akosiaris@cumin1002 for host deploy2002.codfw.wmnet with OS bullseye [07:25:57] 10Phabricator, 06Project-Admins: Convert GrowthExperiments-Community-Updates to be a subproject of GrowthExperiments - https://phabricator.wikimedia.org/T369077#10026333 (10Aklapper) Also updated H26 accordingly, as Pppery pointed out in T371303 [08:07:10] (03PS1) 10Hashar: dockerfiles: logstash-filter-verifier to Bullseye [integration/config] - 10https://gerrit.wikimedia.org/r/1057926 (https://phabricator.wikimedia.org/T371285) [08:07:11] (03CR) 10Hashar: [C:03+2] "The logstash-filter-verifier Debian package has been pushed to buster-wikimedia main" [integration/config] - 10https://gerrit.wikimedia.org/r/1057926 (https://phabricator.wikimedia.org/T371285) (owner: 10Hashar) [08:08:17] (03PS2) 10Hashar: dockerfiles: logstash-filter-verifier to Bullseye [integration/config] - 10https://gerrit.wikimedia.org/r/1057926 (https://phabricator.wikimedia.org/T371285) [08:08:27] (03CR) 10Hashar: [C:03+2] dockerfiles: logstash-filter-verifier to Bullseye [integration/config] - 10https://gerrit.wikimedia.org/r/1057926 (https://phabricator.wikimedia.org/T371285) (owner: 10Hashar) [08:08:43] 10Scap: scap broken on deploy1002 / deploy2002 (buster) - https://phabricator.wikimedia.org/T371261#10026420 (10jnuche) The problem is caused by the scap installer. It erroneously assumes all deployment servers are on the same distro. I think I should be able to change the installer to take the actual distro (a... [08:10:08] (03Merged) 10jenkins-bot: dockerfiles: logstash-filter-verifier to Bullseye [integration/config] - 10https://gerrit.wikimedia.org/r/1057926 (https://phabricator.wikimedia.org/T371285) (owner: 10Hashar) [08:10:46] 10Scap: scap broken on deploy1002 / deploy2002 (buster) - https://phabricator.wikimedia.org/T371261#10026425 (10akosiaris) >>! In T371261#10026420, @jnuche wrote: > The problem is caused by the scap installer. It erroneously assumes all deployment servers are on the same distro. Yeah, that's not a bad assumptio... [08:11:23] 10Scap, 06serviceops: Reimage deploy2002 as bullseye - https://phabricator.wikimedia.org/T371282#10026434 (10ops-monitoring-bot) Cookbook cookbooks.sre.hosts.reimage started by akosiaris@cumin1002 for host deploy2002.codfw.wmnet with OS bullseye completed: - deploy2002 (**PASS**) - Downtimed on Icinga/Alertm... [08:14:42] 10Scap: scap broken on deploy1002 / deploy2002 (buster) - https://phabricator.wikimedia.org/T371261#10026439 (10jnuche) > Thanks! I 'd suggest to not waste too much time. If you can get it working quickly, yay! Otherwise, it's probably not worth it. That's a good point. The installer already checks the distro o... [08:18:20] (03PS1) 10Hashar: jjb: logstash-filter-verifier to Bullseye [integration/config] - 10https://gerrit.wikimedia.org/r/1058084 (https://phabricator.wikimedia.org/T371285) [08:21:37] (03CR) 10Aklapper: [C:03+1] Allow Jenkins-bot to submit changes [phabricator/translations] (refs/meta/config) - 10https://gerrit.wikimedia.org/r/1055251 (owner: 10Pppery) [08:21:52] 10Scap, 06serviceops: Reimage deploy2002 as bullseye - https://phabricator.wikimedia.org/T371282#10026445 (10akosiaris) 05Open→03Resolved Reimage done, /home synced, keyholder armed. [08:22:38] (03CR) 10Hashar: [C:03+2] "Verified on https://gerrit.wikimedia.org/r/c/operations/puppet/+/1058085" [integration/config] - 10https://gerrit.wikimedia.org/r/1058084 (https://phabricator.wikimedia.org/T371285) (owner: 10Hashar) [08:23:44] (03Merged) 10jenkins-bot: jjb: logstash-filter-verifier to Bullseye [integration/config] - 10https://gerrit.wikimedia.org/r/1058084 (https://phabricator.wikimedia.org/T371285) (owner: 10Hashar) [08:27:59] 10Scap: scap broken on deploy1002 / deploy2002 (buster) - https://phabricator.wikimedia.org/T371261#10026478 (10akosiaris) As a heads up I 've re-imaged deploy2002 T371282 already to bullseye, to avoid finding ourselves in a situation where we can't deploy in case of something happening and deploy1003 being una... [08:33:05] 10Phabricator, 07PM: Decrease issues created many years ago with no recent activity (aka stale tickets) - https://phabricator.wikimedia.org/T248034#10026498 (10Aklapper) 1) You can still have all discussions in one place when a ticket is closed, thus not an argument 2) It will not be confusing if you also clos... [08:34:39] 06Project-Admins: Create project tag for PlaceNewSection extension - https://phabricator.wikimedia.org/T351776#10026501 (10Aklapper) >>! In T351776#10026070, @Ernstkm wrote: > Is https://gerrit.wikimedia.org/g/mediawiki/extensions/PlaceNewSection a good point-of-entry for that, roughly analogous to the GitHub pr... [08:34:40] 10Scap: scap broken on deploy1002 / deploy2002 (buster) - https://phabricator.wikimedia.org/T371261#10026502 (10jnuche) > I have filed T371283 for decom of deploy1002, but I 'll stall it so you have something to test against. Thanks, appreciate it :) I'll keep you posted. [08:47:21] 10Phabricator, 07PM: Decrease issues created many years ago with no recent activity (aka stale tickets) - https://phabricator.wikimedia.org/T248034#10026537 (10Bugreporter) > 1) You can still have all discussions in one place when a ticket is closed, thus not an argument Example: T371302 - I will rather like m... [10:07:01] 10Release-Engineering-Team (Priority Backlog 📥), 05Release, 05Train Deployments: 1.43.0-wmf.16 deployment blockers - https://phabricator.wikimedia.org/T366961#10026817 (10Clement_Goubert) [11:31:58] (03open) 10jnuche: install_world: use wheels to install scap on secondary deployment servers [repos/releng/scap] - 10https://gitlab.wikimedia.org/repos/releng/scap/-/merge_requests/393 (https://phabricator.wikimedia.org/T371261) [11:35:18] 10Scap, 10MW-on-K8s, 06serviceops, 13Patch-For-Review: Evaluate the performance improvements brought in by prefetching MW images on WikiKube hosts - https://phabricator.wikimedia.org/T366778#10026982 (10akosiaris) [11:39:31] (03merge) 10jnuche: install_world: use wheels to install scap on secondary deployment servers [repos/releng/scap] - 10https://gitlab.wikimedia.org/repos/releng/scap/-/merge_requests/393 (https://phabricator.wikimedia.org/T371261) [11:41:13] (03open) 10jnuche: Release 4.95.0-1 [repos/releng/scap] - 10https://gitlab.wikimedia.org/repos/releng/scap/-/merge_requests/394 [11:42:58] (03merge) 10jnuche: Release 4.95.0-1 [repos/releng/scap] - 10https://gitlab.wikimedia.org/repos/releng/scap/-/merge_requests/394 [12:25:20] (03CR) 10Hashar: [C:03+2] "Ah I thought it was reverted as if the archival had been made by mistake." [integration/config] - 10https://gerrit.wikimedia.org/r/1057881 (owner: 10Ssingh) [12:26:58] (03Merged) 10jenkins-bot: Revert "Archive operations/debs/trafficserver" [integration/config] - 10https://gerrit.wikimedia.org/r/1057881 (owner: 10Ssingh) [12:28:22] (03CR) 10Hashar: [C:03+2] "I have sent `recheck` for the two open changes:" [integration/config] - 10https://gerrit.wikimedia.org/r/1057881 (owner: 10Ssingh) [12:44:25] 10Continuous-Integration-Config, 06Traffic: Migrate docker-registry.wikimedia.org/releng/operations-dnslint from Buster to Bookworm - https://phabricator.wikimedia.org/T371001#10027378 (10hashar) [12:44:26] 10Continuous-Integration-Config, 10Continuous-Integration-Infrastructure: Migrate all CI jobs from buster to bullseye or later and drop buster testing support - https://phabricator.wikimedia.org/T335765#10027379 (10hashar) [12:48:21] (03PS1) 10Hashar: dockerfiles: ecs to Bullseye [integration/config] - 10https://gerrit.wikimedia.org/r/1058155 (https://phabricator.wikimedia.org/T335765) [12:49:27] (03PS1) 10Hashar: jjb: ecs jobs to Bullseye [integration/config] - 10https://gerrit.wikimedia.org/r/1058157 (https://phabricator.wikimedia.org/T335765) [12:49:42] (03CR) 10Hashar: [C:03+2] dockerfiles: ecs to Bullseye [integration/config] - 10https://gerrit.wikimedia.org/r/1058155 (https://phabricator.wikimedia.org/T335765) (owner: 10Hashar) [12:50:48] (03Merged) 10jenkins-bot: dockerfiles: ecs to Bullseye [integration/config] - 10https://gerrit.wikimedia.org/r/1058155 (https://phabricator.wikimedia.org/T335765) (owner: 10Hashar) [12:56:26] 10Continuous-Integration-Config, 10Continuous-Integration-Infrastructure, 13Patch-For-Review: Migrate all CI jobs from buster to bullseye or later and drop buster testing support - https://phabricator.wikimedia.org/T335765#10027450 (10hashar) [13:07:39] hashar: curious what you think RE: https://phabricator.wikimedia.org/T370380 [13:08:04] thinking if we can have the ENV apply to both? [13:08:14] or maybe it's working arond something that I'm forgetting [13:16:27] 10GitLab (Pipeline Services Migration🐤), 06collaboration-services, 06Data-Platform-SRE, 10Wikidata, and 3 others: move commons-query.wikimedia.org and query.wikidata.org to kubernetes - https://phabricator.wikimedia.org/T350793#10027550 (10Jelto) [13:19:30] 10GitLab (Pipeline Services Migration🐤), 06collaboration-services, 06Data-Platform-SRE, 10Wikidata, and 3 others: move commons-query.wikimedia.org and query.wikidata.org to kubernetes - https://phabricator.wikimedia.org/T350793#10027570 (10Jelto) [13:20:33] 10GitLab (Pipeline Services Migration🐤), 06collaboration-services, 06Data-Platform-SRE, 10Wikidata, and 3 others: move commons-query.wikimedia.org and query.wikidata.org to kubernetes - https://phabricator.wikimedia.org/T350793#10027567 (10Jelto) @BTullis, if I remember correctly, you loosely committed to... [13:29:52] 10Scap: scap broken on deploy1002 / deploy2002 (buster) - https://phabricator.wikimedia.org/T371261#10027620 (10jnuche) Got scap working on `deploy1002` again: ` [jnuche@deploy1002 ~]$ scap version 4.95.0-1 ` That's made the `sync-masters` errors disappear and backports are back to normal. The new scap version... [13:50:17] 10Release-Engineering-Team (Seen), 06collaboration-services, 10Data Pipelines, 06Data-Engineering, and 2 others: Upgrade Airflow to 2.9.3 - https://phabricator.wikimedia.org/T365449#10027707 (10Stevemunene) With the tags work around we have been able to release the airflow 2.9.3 upgrade, I don't think we s... [14:11:23] 10Release-Engineering-Team (Seen), 06collaboration-services, 10Data Pipelines, 06Data-Engineering, and 2 others: Upgrade Airflow to 2.9.3 - https://phabricator.wikimedia.org/T365449#10027832 (10Stevemunene) The airflow v2.9.3 is ready to be deployed for testing on the `an-test-client1002` [14:21:42] I'm working on this task, https://phabricator.wikimedia.org/T367399, but struggling to understand how exactly the voting is configured, would anyone be able to shed some light, or point me to docs? [14:34:55] 10Scap: scap broken on deploy1002 / deploy2002 (buster) - https://phabricator.wikimedia.org/T371261#10028042 (10jnuche) @akosiaris there is some kind of issue with the ssh config for user `scap` in deploy2002. When the scap installer tried to update scap there I got: ` 14:21:00 ['/usr/bin/rsync', '--archive', '... [14:46:35] (03open) 10jnuche: install_world: remove deploy master from list to install only if present [repos/releng/scap] - 10https://gitlab.wikimedia.org/repos/releng/scap/-/merge_requests/395 [14:47:14] (03update) 10jnuche: install_world: remove deploy master from list to install only if present [repos/releng/scap] - 10https://gitlab.wikimedia.org/repos/releng/scap/-/merge_requests/395 [15:00:35] Krinkle: I don't know ;) [15:01:19] Krinkle: when I processed your last comment I stopped at "good news" :D [15:10:14] 10Beta-Cluster-Infrastructure, 10[DEPRECATED] wdwb-tech, 06serviceops, 06SRE, 10Wikidata: Run mediawiki::maintenance scripts in Beta Cluster - https://phabricator.wikimedia.org/T125976#10028314 (10Krinkle) @Urbanecm_WMF Do you mind uploading it to Gerrit under 10Continuous-Integration-Config, 06MediaWiki-Platform-Team, 10MediaWiki-Vendor, 10Quibble, 07Developer Productivity: mediawiki/core and mediawiki/vendor both skip composer.lock checks - https://phabricator.wikimedia.org/T370380#10028320 (10Krinkle) @hashar Do you remember why we control these separately?... [15:13:57] hashar: any chance you would be able to answer my above question? [15:14:04] 10Continuous-Integration-Config, 06MediaWiki-Platform-Team, 10MediaWiki-Vendor, 10Quibble, 07Developer Productivity: mediawiki/core and mediawiki/vendor both skip composer.lock checks - https://phabricator.wikimedia.org/T370380#10028341 (10hashar) > The bad news: The output also still contains this messa... [15:14:55] 10Beta-Cluster-Infrastructure, 06serviceops, 06SRE, 10Wikidata, 10wmde-wikidata-tech: Run mediawiki::maintenance scripts in Beta Cluster - https://phabricator.wikimedia.org/T125976#10028317 (10Krinkle) [15:14:57] Krinkle: the code that emits the message you reported is from `InstallMediaWiki` which uses `use_vendor` and my guess is you want to adjust it to use `is_vendor` instead similar to the other patch: https://phabricator.wikimedia.org/T370380#10028341 [15:15:14] Krinkle: but I must say my brain is frying whenever I hear "mediawiki/vendor" :D [15:15:22] jhathaway: yeah you are next in line ;] [15:15:33] woohoo, thanks [15:15:36] holy shit [15:15:41] puppet 5 is gone? ;) [15:15:48] no not yet [15:15:52] :-( [15:16:07] we still have puppet 5 hosts, but we want to make puppet 7 pcc the voting one [15:16:13] ahh [15:16:18] soo *cough* [15:16:20] it is easy [15:17:42] there is one set of jobs triggered by commenting `check experimental` or clicking the [RUN PCC] link from the web UI, but those jobs do not vote [15:18:34] there is puppet `utils/pcc.py` which does vote verified [15:18:42] ok, that mirrors my experience [15:19:16] so making it vote, would be a change in discussion, that probably warrants a little more discussion [15:19:23] as I'm not sure of the ramifications [15:20:17] there is another thing which is that I wrote a Gerrit javascript plugin which process the first kind of job (the one triggers by commenting `check experimental) [15:20:31] and show some colored chipset below the commit message [15:20:47] and I guess some change do fail Puppet 5 and would thus show a red or yellow chipset below [15:20:56] but that is not voting verified +1 / -1 [15:21:28] got it, as in this example, https://gerrit.wikimedia.org/r/c/operations/puppet/+/1057967 [15:22:46] yes [15:22:48] exactly [15:23:06] I have encountered the issue last week with a change affecting cumin* hosts [15:23:18] which have been migrated to Puppet 7 and eventually broke Puppet 5 [15:23:29] and that red chipset is just puppet 5 failing [15:24:09] I guess I can change the name from `Puppet Compiler [CI]` to simply `Puppet 5` [15:24:17] and name the other `Puppet 7` [15:24:29] 10Continuous-Integration-Config, 06MediaWiki-Platform-Team, 10MediaWiki-Vendor, 10Quibble, 07Developer Productivity: mediawiki/core and mediawiki/vendor both skip composer.lock checks - https://phabricator.wikimedia.org/T370380#10028387 (10Krinkle) Yeah, if there's no reason to skip this in other repos w... [15:24:38] and looking at the Check tab https://gerrit.wikimedia.org/r/c/operations/puppet/+/1057967?tab=checks [15:24:40] I think that would improve clarity [15:24:51] there are four results showing: the two jenkins jobs [15:25:16] and the enhanced `Puppet Compiler [CI]` which has two results [15:25:19] so yeah refactoring is needed ;) [15:25:51] I also wanted to somehow reflect the ongoing processing [15:26:19] well your recent changes have been very helpful, so thanks for your efforts thus far [15:26:53] if we did want to make PCC voting, is that difficult? [15:27:43] in the zuul definition at https://gerrit.wikimedia.org/g/integration/config/+/refs/heads/master/zuul/layout.yaml#3630 [15:27:58] the job `operations-puppet-catalog-compiler-puppet7-test` could be moved up to `test-prio` [15:28:07] and it will then run for any patchset being sent [15:28:12] but that is slow ;) [15:28:25] and the `experimental` Pipeline does not vote at all [15:28:31] + it is shared by a bunch of other repositories [15:29:10] so I guess I'll need a new Pipeline in Zuul in order to be able to run the PCC in parallel with the current jobs in test-prio [15:29:13] or well [15:29:28] not make it voting but rely on the yellow/red chipset to inform the user that something is off [15:30:02] Project mwcore-phpunit-coverage-master build #3748: 04STILL FAILING in 30 min: https://integration.wikimedia.org/ci/job/mwcore-phpunit-coverage-master/3748/ [15:31:03] thanks that is helpful, I think leaving it as non-voting for now makes sense, if we decide we want to make it voting, I'll open a phab task so some of this discussion can be captured, since there are performance considerations to make as you point out [15:31:47] I am filing a task already ;) [15:32:00] and making it running for any patchset can be another task for sure [15:32:19] I think the best would be to create a new kind of vote in Gerrit for operations/puppet such as `Puppet compile` [15:32:37] create a new Pipeline in the Zuul layout.yaml named `puppet-compiler` that trigger whatever job [15:32:51] the pipeline would vote -1 +1 for the `Puppet compile` vote [15:33:05] and whenever a -1 is cast there, that would prevent people from having the change merged [15:33:08] something like that [15:33:37] but I am filing a different task to split the Puppet 5 and 7 results under two different names in the check tab [15:33:38] awesome, thanks hashar [15:34:12] remembers me I need to update the documentation to test the javascript changes :D [15:34:17] 10Beta-Cluster-Infrastructure, 06serviceops, 06SRE, 10Wikidata, 10wmde-wikidata-tech: Run mediawiki::maintenance scripts in Beta Cluster - https://phabricator.wikimedia.org/T125976#10028409 (10Urbanecm_WMF) >>! In T125976#10028314, @Krinkle wrote: > @Urbanecm_WMF Do you mind uploading it to Gerrit under... [15:34:23] :) [15:39:34] 10Gerrit, 06Infrastructure-Foundations, 10Puppet CI: wmf-checks-api: Puppet compiler integration is confusing when Puppet 5 support is dropped - https://phabricator.wikimedia.org/T371407 (10hashar) 03NEW [15:39:43] jhathaway: https://phabricator.wikimedia.org/T371407 and I have subscribed you to the task [15:39:51] great [15:40:57] Krinkle: "I'm wondering why we implemented it in two different ways." [15:41:02] Krinkle: man, it is OPEN SOURCE! :) [15:41:17] honestly I don't know, the codes must have been written some years apart [15:45:00] 10Gerrit, 06Infrastructure-Foundations, 10Puppet CI: wmf-checks-api: Puppet compiler integration is confusing when Puppet 5 support is dropped - https://phabricator.wikimedia.org/T371407#10028450 (10hashar) [15:46:31] oh I know [15:46:44] * hashar tries tdd again [15:55:16] 10Scap: scap broken on deploy1002 / deploy2002 (buster) - https://phabricator.wikimedia.org/T371261#10028473 (10jnuche) So the problem with deploy2002 was the user didn't have a login specified in puppet and that defaulted to `/usr/sbin/nologin` that disables login for the account. Fixed with https://gerrit... [15:55:21] 10Gerrit, 06Infrastructure-Foundations, 10Puppet CI: wmf-pcc: Puppet compiler integration is confusing when Puppet 5 support is dropped - https://phabricator.wikimedia.org/T371407#10028476 (10hashar) [15:55:23] 10Scap: scap broken on deploy1002 / deploy2002 (buster) - https://phabricator.wikimedia.org/T371261#10028474 (10jnuche) 05Open→03Resolved a:03jnuche [15:57:28] 10Gerrit, 06Infrastructure-Foundations, 10Puppet CI: wmf-pcc: Puppet compiler integration is confusing when Puppet 5 support is dropped - https://phabricator.wikimedia.org/T371407#10028483 (10hashar) The Gerrit Checks API has two layers: {nav Runs} and {nav Results}. Each of the Jenkins jobs are results of... [15:59:52] hashar thanks for following up on T368033 , I think we are good. Going to email Tyler just to be sure everyone is on the same page (I'll CC you as well) [15:59:53] T368033: Design a suitable DAG deployment method - https://phabricator.wikimedia.org/T368033 [16:00:44] inflatador: yeah sorry I guess I was entirely too paranoid a few weeks ago ;) [16:01:18] I guess if your team is aware of some of the drawbacks introduced by continuous deployment, it is good to me [16:02:02] not at all, you raised some important questions. It got me digging back thru those tickets and the airflow CD stuff seems very similar to concerns raised in T365659 (which Andrew already linked) [16:02:03] T365659: Implement automatic sync of refinery HQL files to HDFS - https://phabricator.wikimedia.org/T365659 [16:02:26] yup [16:02:29] devil is in the details ;) [16:02:52] for the Jenkins jobs, we never point to the `latest` Docker image [16:03:12] but painfully and manually bump the images version in the jenkins jobs [16:03:30] and really I should automatize that with sed [16:04:46] * hashar learns about Array.prototype.flatMap() [16:04:50] Solutionize and automatize ;P [16:05:15] it is more like seek & destroy :D [16:05:25] ALL YOUR BUGS ARE BELONG TO US [16:05:28] but yeah [16:05:33] I should automatize more :/ [16:33:41] 10Release-Engineering-Team (Priority Backlog 📥), 05Release, 05Train Deployments: 1.43.0-wmf.16 deployment blockers - https://phabricator.wikimedia.org/T366961#10028613 (10cscott) [16:41:25] 10Release-Engineering-Team (Priority Backlog 📥), 05Release, 05Train Deployments: 1.43.0-wmf.16 deployment blockers - https://phabricator.wikimedia.org/T366961#10028679 (10cscott) T371376 is a regression in the parsoid. I've cherry-picked two patches to wmf.16 with a new parsoid release to address this: http... [16:53:29] 10Phabricator, 07PM: Decrease issues created many years ago with no recent activity (aka stale tickets) - https://phabricator.wikimedia.org/T248034#10028781 (10Jdlrobson) FWIW as someone who has worked in Phabricator for a decade now, with some confidence I can say that any ticket older than 2 years is already... [17:01:46] 10Phabricator, 07PM: Decrease issues created many years ago with no recent activity (aka stale tickets) - https://phabricator.wikimedia.org/T248034#10028812 (10Pppery) I decided to submit a patch for the oldest open bug on Phabricator (T2005) on a lark a few weeks ago. Prior to that it hadn't been touched sinc... [17:07:43] (03PS1) 10Hashar: wm-pcc: separate v5 and v7 in two runs [software/gerrit] (deploy/wmf/stable-3.10) - 10https://gerrit.wikimedia.org/r/1058219 (https://phabricator.wikimedia.org/T371407) [17:10:28] 10Phabricator, 07PM: Decrease issues created many years ago with no recent activity (aka stale tickets) - https://phabricator.wikimedia.org/T248034#10028852 (10Bugreporter) >I can say that any ticket older than 2 years is already being filtered out of team work boards (or the workboard is too big that it is be... [17:12:09] (03PS1) 10Dreamy Jazz: Add MediaModeration to the gated extensions list [integration/config] - 10https://gerrit.wikimedia.org/r/1058221 (https://phabricator.wikimedia.org/T371324) [17:12:50] (03PS2) 10Dreamy Jazz: Add MediaModeration to the gated extensions list [integration/config] - 10https://gerrit.wikimedia.org/r/1058221 (https://phabricator.wikimedia.org/T371324) [17:13:08] 10Release-Engineering-Team (Priority Backlog 📥), 05Release, 05Train Deployments: 1.43.0-wmf.16 deployment blockers - https://phabricator.wikimedia.org/T366961#10028866 (10brennen) > T371376 is a regression in the parsoid. I've cherry-picked two patches to wmf.16 with a new parsoid release to address this: ht... [17:13:24] 10Gerrit, 06Infrastructure-Foundations, 10Puppet CI, 13Patch-For-Review: wmf-pcc: Puppet compiler integration is confusing when Puppet 5 support is dropped - https://phabricator.wikimedia.org/T371407#10028859 (10hashar) I went to split the version 5 and version 7 into two {nav Runs} so that they show up as... [17:14:15] 10Phabricator, 07PM: Decrease issues created many years ago with no recent activity (aka stale tickets) - https://phabricator.wikimedia.org/T248034#10028868 (10Dzahn) >>! In T248034#10028781, @Jdlrobson wrote: > FWIW as someone who has worked in Phabricator for a decade now, with some confidence I can say that... [17:14:38] (03CR) 10CI reject: [V:04-1] Add MediaModeration to the gated extensions list [integration/config] - 10https://gerrit.wikimedia.org/r/1058221 (https://phabricator.wikimedia.org/T371324) (owner: 10Dreamy Jazz) [17:15:46] jhathaway: I think I will deploy the patch I crafted ( https://gerrit.wikimedia.org/r/c/operations/software/gerrit/+/1058219 ) [17:15:54] like right now [17:15:55] ;) [17:16:04] I think it is probably fine, at least it works for me locally [17:17:14] 10Gerrit, 06Infrastructure-Foundations, 10Puppet CI, 13Patch-For-Review: wmf-pcc: Puppet compiler integration is confusing when Puppet 5 support is dropped - https://phabricator.wikimedia.org/T371407#10028874 (10hashar) For a change that did not have the PCC to run, the runnable is still named {nav Puppet... [17:23:07] Project beta-update-databases-eqiad build #77821: 04FAILURE in 3 min 6 sec: https://integration.wikimedia.org/ci/job/beta-update-databases-eqiad/77821/ [17:28:04] 10Gerrit, 06Infrastructure-Foundations, 10Puppet CI, 13Patch-For-Review: wmf-pcc: Puppet compiler integration is confusing when Puppet 5 support is dropped - https://phabricator.wikimedia.org/T371407#10028916 (10jhathaway) nice improvement, thanks @hashar [17:28:08] (03PS3) 10Dreamy Jazz: Add MediaModeration to the gated extensions list [integration/config] - 10https://gerrit.wikimedia.org/r/1058221 (https://phabricator.wikimedia.org/T371324) [17:37:59] (03CR) 10Hashar: [C:03+2] wm-pcc: separate v5 and v7 in two runs [software/gerrit] (deploy/wmf/stable-3.10) - 10https://gerrit.wikimedia.org/r/1058219 (https://phabricator.wikimedia.org/T371407) (owner: 10Hashar) [17:38:29] (03Merged) 10jenkins-bot: wm-pcc: separate v5 and v7 in two runs [software/gerrit] (deploy/wmf/stable-3.10) - 10https://gerrit.wikimedia.org/r/1058219 (https://phabricator.wikimedia.org/T371407) (owner: 10Hashar) [17:45:51] (03PS4) 10Dreamy Jazz: Add MediaModeration to the gated extensions list [integration/config] - 10https://gerrit.wikimedia.org/r/1058221 (https://phabricator.wikimedia.org/T371324) [17:46:55] (03PS5) 10Dreamy Jazz: Add MediaModeration to the gated extensions list [integration/config] - 10https://gerrit.wikimedia.org/r/1058221 (https://phabricator.wikimedia.org/T371324) [17:51:53] jhathaway: done, you might have to force reload the gerrit web page due to outdated javascript [17:52:06] very cool, thanks! [17:52:10] I used your test change for my code: https://gerrit.wikimedia.org/r/c/operations/puppet/+/1057967?tab=checks [17:52:11] ); [17:52:14] :) [17:52:57] and I will see what I can do to overhaul the documentation regarding testing Gerrit javascript plugin [17:53:07] sounds good [17:53:09] it is easier now [17:53:23] and eventually frontend development with vanilla javascript turns out to be almost plesant [17:53:25] pleasant [17:55:02] I am off for dinner! [17:58:43] 10Gerrit, 06Infrastructure-Foundations, 10Puppet CI, 13Patch-For-Review: wmf-pcc: Puppet compiler integration is confusing when Puppet 5 support is dropped - https://phabricator.wikimedia.org/T371407#10029002 (10hashar) 05Open→03Resolved a:03hashar Self note: that also disambiguate the PCC failur... [17:59:06] enjoy! [18:32:26] Yippee, build fixed! [18:32:26] Project beta-update-databases-eqiad build #77822: 09FIXED in 12 min: https://integration.wikimedia.org/ci/job/beta-update-databases-eqiad/77822/ [18:50:34] 10Phabricator maintenance bot, 10SectionTranslation, 10LPL Essential (LPL Essential 2024 Jul-Sep): Complete enablement Section Translation in new wikis and make the process less manual for the future - https://phabricator.wikimedia.org/T371420#10029195 (10Pppery) [19:20:35] 10Release-Engineering-Team (Seen), 10Scap, 06serviceops-radar: Transient httpbb errors from on mwdebug boxes - https://phabricator.wikimedia.org/T371427 (10thcipriani) 03NEW [19:20:47] 10Release-Engineering-Team (Seen), 10Scap, 06serviceops-radar: Transient httpbb errors from on mwdebug boxes - https://phabricator.wikimedia.org/T371427#10029437 (10thcipriani) p:05Triage→03Low [19:59:39] 10Release-Engineering-Team (Seen), 10Scap, 06serviceops-radar: Transient httpbb errors from on mwdebug boxes - https://phabricator.wikimedia.org/T371427#10029671 (10RLazarus) From -serviceops IRC logs, I think this was during the time @Ottomata was working on an unrelated Apache config change, and testing it... [20:13:44] 10Beta-Cluster-Infrastructure, 06cloud-services-team, 10Cloud-VPS (Debian Buster Deprecation): Remove or replace deployment-restbase04.deployment-prep.eqiad1.wikimedia.cloud (Buster deprecation) - https://phabricator.wikimedia.org/T370460#10029734 (10Andrew) @Jgiannelos do you have any suggestions about this... [20:32:13] (03CR) 10Hashar: [C:03+2] Add MediaModeration to the gated extensions list [integration/config] - 10https://gerrit.wikimedia.org/r/1058221 (https://phabricator.wikimedia.org/T371324) (owner: 10Dreamy Jazz) [20:33:09] (03CR) 10Hashar: [C:03+2] "I have deployed and tested it earlier today but failed to +2!" [integration/config] - 10https://gerrit.wikimedia.org/r/1058157 (https://phabricator.wikimedia.org/T335765) (owner: 10Hashar) [20:33:23] (03Merged) 10jenkins-bot: Add MediaModeration to the gated extensions list [integration/config] - 10https://gerrit.wikimedia.org/r/1058221 (https://phabricator.wikimedia.org/T371324) (owner: 10Dreamy Jazz) [20:34:13] (03CR) 10Hashar: [C:03+2] "Deployed, thank you for having taken the time to write an extended commit message." [integration/config] - 10https://gerrit.wikimedia.org/r/1058221 (https://phabricator.wikimedia.org/T371324) (owner: 10Dreamy Jazz) [20:34:15] (03Merged) 10jenkins-bot: jjb: ecs jobs to Bullseye [integration/config] - 10https://gerrit.wikimedia.org/r/1058157 (https://phabricator.wikimedia.org/T335765) (owner: 10Hashar) [20:41:32] 10Release-Engineering-Team (Seen), 10Scap, 06serviceops-radar: Transient httpbb errors from on mwdebug boxes - https://phabricator.wikimedia.org/T371427#10029865 (10Ottomata) Hi! yes I'm sure that was me! I was coordinating in #wikimedia-serviceops on IRC with @Scott_French following these instructions: h... [20:56:44] 10Phabricator, 06Release-Engineering-Team, 06collaboration-services: Update SQL output for Phabricator WMF QLS report mails - https://phabricator.wikimedia.org/T370947#10029934 (10Dzahn) @Aklapper You should have a test mail now. [21:49:25] 10Release-Engineering-Team (Seen), 10Scap, 06serviceops-radar: Transient httpbb errors from on mwdebug boxes - https://phabricator.wikimedia.org/T371427#10030123 (10RLazarus) Yeah, the usual standard, for any time you change something on a debug host, is a note in #wikimedia-operations to say something like... [22:08:01] 10Phabricator, 10Release-Engineering-Team (Priority Backlog 📥), 06collaboration-services: Update SQL output for Phabricator WMF QLS report mails - https://phabricator.wikimedia.org/T370947#10030165 (10Aklapper) 05Open→03Resolved Thanks a lot, email looks as expected! I wish good luck to the folks wh... [23:07:25] 10Diffusion, 10Phabricator, 10Release-Engineering-Team (Radar), 06collaboration-services, 13Patch-For-Review: Make https://git.wikimedia.org not redirect to Phabricator Diffusion - https://phabricator.wikimedia.org/T323073#10030231 (10Dzahn) 05Open→03Resolved [23:43:02] 10Diffusion, 10Phabricator, 10Release-Engineering-Team (Radar), 06collaboration-services: Make https://git.wikimedia.org not redirect to Phabricator Diffusion but remove it - https://phabricator.wikimedia.org/T323073#10030279 (10Aklapper)