[03:34:22] <icinga-wm>	 PROBLEM - gerrit process on gerrit2002 is CRITICAL: PROCS CRITICAL: 0 processes with regex args ^/usr/lib/jvm/java-11-openjdk-amd64/bin/java .*-jar /var/lib/gerrit2/review_site/bin/gerrit.war daemon -d /var/lib/gerrit2/review_site https://wikitech.wikimedia.org/wiki/Gerrit
[03:39:06] <icinga-wm>	 RECOVERY - gerrit process on gerrit2002 is OK: PROCS OK: 1 process with regex args ^/usr/lib/jvm/java-11-openjdk-amd64/bin/java .*-jar /var/lib/gerrit2/review_site/bin/gerrit.war daemon -d /var/lib/gerrit2/review_site https://wikitech.wikimedia.org/wiki/Gerrit
[05:00:32] <icinga-wm>	 PROBLEM - gerrit process on gerrit2002 is CRITICAL: PROCS CRITICAL: 0 processes with regex args ^/usr/lib/jvm/java-11-openjdk-amd64/bin/java .*-jar /var/lib/gerrit2/review_site/bin/gerrit.war daemon -d /var/lib/gerrit2/review_site https://wikitech.wikimedia.org/wiki/Gerrit
[05:08:00] <wikibugs>	 (03CR) 10Krinkle: zuul: Run non-voting phpbench job for MW core patches (031 comment) [integration/config] - 10https://gerrit.wikimedia.org/r/813194 (https://phabricator.wikimedia.org/T291549) (owner: 10Kosta Harlan)
[05:09:58] <icinga-wm>	 RECOVERY - gerrit process on gerrit2002 is OK: PROCS OK: 1 process with regex args ^/usr/lib/jvm/java-11-openjdk-amd64/bin/java .*-jar /var/lib/gerrit2/review_site/bin/gerrit.war daemon -d /var/lib/gerrit2/review_site https://wikitech.wikimedia.org/wiki/Gerrit
[05:33:24] <icinga-wm>	 PROBLEM - gerrit process on gerrit2002 is CRITICAL: PROCS CRITICAL: 0 processes with regex args ^/usr/lib/jvm/java-11-openjdk-amd64/bin/java .*-jar /var/lib/gerrit2/review_site/bin/gerrit.war daemon -d /var/lib/gerrit2/review_site https://wikitech.wikimedia.org/wiki/Gerrit
[05:35:48] <icinga-wm>	 RECOVERY - gerrit process on gerrit2002 is OK: PROCS OK: 1 process with regex args ^/usr/lib/jvm/java-11-openjdk-amd64/bin/java .*-jar /var/lib/gerrit2/review_site/bin/gerrit.war daemon -d /var/lib/gerrit2/review_site https://wikitech.wikimedia.org/wiki/Gerrit
[06:26:20] <wikibugs>	 10Project-Admins, 10Discovery-Search, 10User-AKlapper: Clarify / clean up Discovery/Search related team project tags in Phabricator - https://phabricator.wikimedia.org/T314431 (10Aklapper) @MPhamWMF: Apart from what Reedy added, > and that declining means that the ticket is invalid.  Status `invalid` is used...
[06:49:22] <wikibugs>	 10Project-Admins, 10Design-Innovation-Team: Archive #Design-Innovation-Team project tag? - https://phabricator.wikimedia.org/T312831 (10Aklapper) @MNovotny_WMF / @JTannerWMF : Does someone know? TIA!
[07:46:03] <wmf-insecte>	 Project beta-scap-sync-world build #62447: 04FAILURE in 1 min 9 sec: https://integration.wikimedia.org/ci/job/beta-scap-sync-world/62447/
[07:56:57] <wmf-insecte>	 Yippee, build fixed!
[07:56:57] <wmf-insecte>	 Project beta-scap-sync-world build #62448: 09FIXED in 2 min 2 sec: https://integration.wikimedia.org/ci/job/beta-scap-sync-world/62448/
[08:13:30] <elukey>	 thcipriani, bd808 o/ - IIUC ORES (that my team manages) only needs git-lfs, we worked in the past months with scap tools to support it for buster (see https://gerrit.wikimedia.org/r/c/mediawiki/tools/scap/+/785154). In theory we shouldn't be affected by git-fat disappearing, but I may miss something in the picture (in case lemme know!)
[08:32:16] <wikibugs>	 10Beta-Cluster-Infrastructure, 10Epic: 502 errors on beta cluster - https://phabricator.wikimedia.org/T312253 (10Aklapper) 05Open→03Stalled
[08:53:27] <wikibugs>	 10Project-Admins: Create User-eakinloose project - https://phabricator.wikimedia.org/T313800 (10Aklapper) 05Open→03Resolved a:03Aklapper Requested public project #user-eakinloose has been created: https://phabricator.wikimedia.org/project/view/6072/  (In case you need to edit the project or project workboa...
[08:56:56] <wikibugs>	 10Project-Admins: Create component for product infrastructure orphaned project tickets - https://phabricator.wikimedia.org/T311246 (10Aklapper) @SLopes-WMF / @Jgiannelos: Could you please answer the last comments? Thanks in advance! :)
[08:57:42] <wikibugs>	 10Project-Admins: Create project tag for Json5Config - https://phabricator.wikimedia.org/T308199 (10Aklapper) 05Stalled→03Declined Closing for the time being as this isn't actionable, but please do reopen once this is ready! Thanks! :)
[09:16:54] <icinga-wm>	 PROBLEM - gerrit process on gerrit2002 is CRITICAL: PROCS CRITICAL: 0 processes with regex args ^/usr/lib/jvm/java-11-openjdk-amd64/bin/java .*-jar /var/lib/gerrit2/review_site/bin/gerrit.war daemon -d /var/lib/gerrit2/review_site https://wikitech.wikimedia.org/wiki/Gerrit
[09:21:36] <icinga-wm>	 RECOVERY - gerrit process on gerrit2002 is OK: PROCS OK: 1 process with regex args ^/usr/lib/jvm/java-11-openjdk-amd64/bin/java .*-jar /var/lib/gerrit2/review_site/bin/gerrit.war daemon -d /var/lib/gerrit2/review_site https://wikitech.wikimedia.org/wiki/Gerrit
[09:47:10] <wikibugs>	 10Project-Admins: Create project tag for <Event Streams> - https://phabricator.wikimedia.org/T314406 (10EChetty) @Ottomata -> You sure? Event Platform seems like the work done with the MEP, Eventgate, Kafka work? The event streams works seems to mostly been on the generated data platform board with Flink and Co?...
[10:39:06] <Lucas_WMDE>	 are there any plans / timeline for moving “most” CI jobs (e.g. `extension-quibble` template) from Node 14 to 16?
[10:39:23] <Lucas_WMDE>	 or are we staying on Node 14 for now?
[10:39:46] <Lucas_WMDE>	 I see that some Node 16 images and jobs exist, and T313075 was closed, but I can’t find a task for the rest
[10:39:47] <stashbot>	 T313075: Create WMF CI images and jobs for Node.js 16 - https://phabricator.wikimedia.org/T313075
[10:44:19] <icinga-wm>	 PROBLEM - gerrit process on gerrit2002 is CRITICAL: PROCS CRITICAL: 0 processes with regex args ^/usr/lib/jvm/java-11-openjdk-amd64/bin/java .*-jar /var/lib/gerrit2/review_site/bin/gerrit.war daemon -d /var/lib/gerrit2/review_site https://wikitech.wikimedia.org/wiki/Gerrit
[10:47:41] <icinga-wm>	 RECOVERY - gerrit process on gerrit2002 is OK: PROCS OK: 1 process with regex args ^/usr/lib/jvm/java-11-openjdk-amd64/bin/java .*-jar /var/lib/gerrit2/review_site/bin/gerrit.war daemon -d /var/lib/gerrit2/review_site https://wikitech.wikimedia.org/wiki/Gerrit
[11:05:49] <wikibugs>	 10Continuous-Integration-Infrastructure: Migrate all mwgate-node14-docker jobs to mwgate-node16-docker - https://phabricator.wikimedia.org/T314470 (10Michael)
[11:06:37] <wikibugs>	 10Continuous-Integration-Infrastructure: Migrate all mwgate-node14-docker jobs to mwgate-node16-docker - https://phabricator.wikimedia.org/T314470 (10Michael)
[11:07:43] <wikibugs>	 10Continuous-Integration-Infrastructure: Migrate all mwgate-node14-docker jobs to mwgate-node16-docker - https://phabricator.wikimedia.org/T314470 (10Michael)
[11:07:45] <wikibugs>	 10Continuous-Integration-Infrastructure: Create WMF CI images and jobs for Node.js 16 - https://phabricator.wikimedia.org/T313075 (10Michael)
[11:08:36] <wikibugs>	 10Continuous-Integration-Infrastructure: Migrate all mwgate-node14-docker jobs to mwgate-node16-docker - https://phabricator.wikimedia.org/T314470 (10Michael) (I created this task mainly so that we have something to point to as the blocker for T314468)
[11:47:19] <wikibugs>	 (03PS6) 10Jaime Nuche: debian package: remove from codebase [tools/scap] - 10https://gerrit.wikimedia.org/r/819039
[11:48:05] <wikibugs>	 (03CR) 10Jaime Nuche: debian package: remove from codebase (031 comment) [tools/scap] - 10https://gerrit.wikimedia.org/r/819039 (owner: 10Jaime Nuche)
[11:48:07] <wikibugs>	 (03CR) 10Jforrester: [C: 03+2] Zuul: Run publish jobs on branches called 'main' too [integration/config] - 10https://gerrit.wikimedia.org/r/819702 (owner: 10Jforrester)
[11:50:52] <wikibugs>	 (03Merged) 10jenkins-bot: Zuul: Run publish jobs on branches called 'main' too [integration/config] - 10https://gerrit.wikimedia.org/r/819702 (owner: 10Jforrester)
[11:54:16] <icinga-wm>	 PROBLEM - gerrit process on gerrit2002 is CRITICAL: PROCS CRITICAL: 0 processes with regex args ^/usr/lib/jvm/java-11-openjdk-amd64/bin/java .*-jar /var/lib/gerrit2/review_site/bin/gerrit.war daemon -d /var/lib/gerrit2/review_site https://wikitech.wikimedia.org/wiki/Gerrit
[11:56:18] <icinga-wm>	 RECOVERY - gerrit process on gerrit2002 is OK: PROCS OK: 1 process with regex args ^/usr/lib/jvm/java-11-openjdk-amd64/bin/java .*-jar /var/lib/gerrit2/review_site/bin/gerrit.war daemon -d /var/lib/gerrit2/review_site https://wikitech.wikimedia.org/wiki/Gerrit
[11:58:24] <wikibugs>	 (03CR) 10Jaime Nuche: [C: 03+2] debian package: remove from codebase [tools/scap] - 10https://gerrit.wikimedia.org/r/819039 (owner: 10Jaime Nuche)
[11:58:56] <James_F>	 !log Zuul: Run publish jobs on branches called 'main' too
[11:58:57] <stashbot>	 Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL
[12:00:50] <James_F>	 !log Ran `zuul-test-repo design/codex postmerge` on contint2001 to finally run coverage for Codex
[12:00:51] <stashbot>	 Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL
[12:01:57] <wikibugs>	 (03CR) 10Jforrester: "Submitted for consideration." [integration/config] - 10https://gerrit.wikimedia.org/r/819705 (owner: 10Jforrester)
[12:02:07] <wikibugs>	 (03PS2) 10Jforrester: Zuul: [integration/config] Switch to test-prio [integration/config] - 10https://gerrit.wikimedia.org/r/819705
[12:07:10] <wikibugs>	 (03Merged) 10jenkins-bot: debian package: remove from codebase [tools/scap] - 10https://gerrit.wikimedia.org/r/819039 (owner: 10Jaime Nuche)
[12:20:11] <wikibugs>	 10Release-Engineering-Team (Seen), 10Scap: Rethink beta scap deployment - https://phabricator.wikimedia.org/T184628 (10jnuche)
[12:20:17] <wikibugs>	 10Beta-Cluster-Infrastructure, 10Release-Engineering-Team (Seen), 10Scap: scap package installed by CI breaks apt and thus puppet - https://phabricator.wikimedia.org/T184118 (10jnuche) 05Open→03Resolved a:03jnuche Not needed anymore after https://gerrit.wikimedia.org/r/c/mediawiki/tools/scap/+/819039
[12:21:32] <wikibugs>	 10Continuous-Integration-Config, 10MW-1.39-notes (1.39.0-wmf.25; 2022-08-15), 10Patch-For-Review: Upgrade primary branch of all Wikimedia-deployed repos to a version of mediawiki-tools-phan including T270553 - https://phabricator.wikimedia.org/T295285 (10Jdforrester-WMF) 05Open→03Resolved
[12:21:34] <wikibugs>	 10Continuous-Integration-Config, 10MW-1.39-notes (1.39.0-wmf.6; 2022-04-04): Also run PHP 7.4 jobs on wmf branch patches - https://phabricator.wikimedia.org/T293924 (10Jdforrester-WMF)
[12:23:47] <wikibugs>	 10Release-Engineering-Team (Deployment Autopilot 🛩️), 10Scap, 10Infrastructure-Foundations, 10serviceops, 10Patch-For-Review: Use scap to deploy itself to scap targets - https://phabricator.wikimedia.org/T303559 (10jnuche)
[12:23:52] <wikibugs>	 10Release-Engineering-Team (Deployment Autopilot 🛩️), 10Scap, 10Infrastructure-Foundations, 10serviceops, 10Patch-For-Review: Use scap to deploy itself to scap targets - https://phabricator.wikimedia.org/T303559 (10jnuche) 05Open→03Resolved
[12:23:54] <wikibugs>	 10Release-Engineering-Team (Doing), 10SRE, 10serviceops: Reduce latency of new Scap releases - https://phabricator.wikimedia.org/T292646 (10jnuche)
[12:23:59] <wikibugs>	 10Release-Engineering-Team, 10Scap, 10Patch-For-Review: scap-o-scap: Bootstrapping a new host fails - https://phabricator.wikimedia.org/T310740 (10jnuche) 05In progress→03Resolved a:03jnuche
[12:31:13] <wikibugs>	 10Project-Admins, 10Discovery-Search, 10User-AKlapper: Clarify / clean up Discovery/Search related team project tags in Phabricator - https://phabricator.wikimedia.org/T314431 (10TheDJ) >>! In T314431#8126270, @MPhamWMF wrote: > In other words, the tickets we want to address are a subset of the valid tickets...
[12:31:30] <wikibugs>	 10Continuous-Integration-Config: Migrate all mwgate-node14-docker jobs to mwgate-node16-docker - https://phabricator.wikimedia.org/T314470 (10Jdforrester-WMF) This is a CI config task. We're probably not going to do it very soon, and certainly not as-written; if we're going to switch one CI job's environment, we...
[12:32:33] <wikibugs>	 10Continuous-Integration-Config, 10Release-Engineering-Team (Seen), 10User-zeljkofilipin: Upgrade all CI jobs for WMF-deployed projects from Node 12 to Node 14 LTS - https://phabricator.wikimedia.org/T267890 (10Jdforrester-WMF)
[12:33:10] <wikibugs>	 10Continuous-Integration-Config: Upgrade all CI jobs for WMF-deployed projects from Node 14 to Node 16 - https://phabricator.wikimedia.org/T314470 (10Jdforrester-WMF)
[12:33:40] <wikibugs>	 10Continuous-Integration-Config: Upgrade all CI jobs for WMF-deployed projects from Node 14 to Node 16 - https://phabricator.wikimedia.org/T314470 (10Jdforrester-WMF)
[12:33:48] <wikibugs>	 10Continuous-Integration-Config: Upgrade all CI jobs for WMF-deployed projects from Node 14 to Node 16 - https://phabricator.wikimedia.org/T314470 (10Jdforrester-WMF)
[12:56:04] <wikibugs>	 10Project-Admins: Create project tag for <Event Streams> - https://phabricator.wikimedia.org/T314406 (10Ottomata) @Echetty I'd hope so.  Most of that work is described in the original Modern Event Platform epic: https://phabricator.wikimedia.org/T185233  (Which I think should not be closed.)
[12:57:03] <wikibugs>	 10Project-Admins: Create project tag for <Event Streams> - https://phabricator.wikimedia.org/T314406 (10Ottomata) In either case, using 'eventstreams' will be confusing.  There is a project tag for this, and it refers to the public  EventStreams http service at stream.wikimedia.org.  https://phabricator.wikimedi...
[13:00:43] <wikibugs>	 10Project-Admins: Create project tag for <Event Streams> - https://phabricator.wikimedia.org/T314406 (10JArguello-WMF) Thanks for your input. I'll create a subproject in #Event-Platform with an adequate name to avoid confusion. Very thankful for your guidance @Ottomata and @Aklapper
[13:24:12] <wmf-insecte>	 Project mediawiki-core-doxygen-docker build #36231: 04FAILURE in 19 min: https://integration.wikimedia.org/ci/job/mediawiki-core-doxygen-docker/36231/
[13:39:58] <wmf-insecte>	 Yippee, build fixed!
[13:39:59] <wmf-insecte>	 Project mediawiki-core-doxygen-docker build #36232: 09FIXED in 15 min: https://integration.wikimedia.org/ci/job/mediawiki-core-doxygen-docker/36232/
[13:59:25] <wikibugs>	 10Continuous-Integration-Config: Upgrade all CI jobs for WMF-deployed projects from Node 14 to Node 16 - https://phabricator.wikimedia.org/T314470 (10Michael) Thank you. I'll look into that both termbox and vuejs-components are on our radar with the right priorities.  This came up, because the docker release in...
[14:00:14] <icinga-wm>	 PROBLEM - gerrit process on gerrit2002 is CRITICAL: PROCS CRITICAL: 0 processes with regex args ^/usr/lib/jvm/java-11-openjdk-amd64/bin/java .*-jar /var/lib/gerrit2/review_site/bin/gerrit.war daemon -d /var/lib/gerrit2/review_site https://wikitech.wikimedia.org/wiki/Gerrit
[14:02:24] <icinga-wm>	 RECOVERY - gerrit process on gerrit2002 is OK: PROCS OK: 1 process with regex args ^/usr/lib/jvm/java-11-openjdk-amd64/bin/java .*-jar /var/lib/gerrit2/review_site/bin/gerrit.war daemon -d /var/lib/gerrit2/review_site https://wikitech.wikimedia.org/wiki/Gerrit
[14:03:13] <wikibugs>	 (03PS1) 10Jforrester: Zuul: [wikimedia/vuejs-components] Mark as archived [integration/config] - 10https://gerrit.wikimedia.org/r/820140 (https://phabricator.wikimedia.org/T309872)
[14:03:15] <wikibugs>	 (03PS1) 10Jforrester: jjb: Drop (trigger-)?wikibase-vuejs-components-pipeline-test, unused [integration/config] - 10https://gerrit.wikimedia.org/r/820141 (https://phabricator.wikimedia.org/T309872)
[14:08:07] <wikibugs>	 (03CR) 10Jforrester: [C: 03+2] Zuul: [wikimedia/vuejs-components] Mark as archived [integration/config] - 10https://gerrit.wikimedia.org/r/820140 (https://phabricator.wikimedia.org/T309872) (owner: 10Jforrester)
[14:10:16] <wikibugs>	 (03Merged) 10jenkins-bot: Zuul: [wikimedia/vuejs-components] Mark as archived [integration/config] - 10https://gerrit.wikimedia.org/r/820140 (https://phabricator.wikimedia.org/T309872) (owner: 10Jforrester)
[14:11:35] <James_F>	 !log Zuul: [wikimedia/vuejs-components] Mark as archived for T309872
[14:11:37] <stashbot>	 Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL
[14:11:39] <stashbot>	 T309872: Archive wikibase-vuejs-components library repository - https://phabricator.wikimedia.org/T309872
[14:13:27] <wikibugs>	 (03CR) 10Jforrester: [C: 03+2] "Deployed." [integration/config] - 10https://gerrit.wikimedia.org/r/820141 (https://phabricator.wikimedia.org/T309872) (owner: 10Jforrester)
[14:15:35] <wikibugs>	 (03Merged) 10jenkins-bot: jjb: Drop (trigger-)?wikibase-vuejs-components-pipeline-test, unused [integration/config] - 10https://gerrit.wikimedia.org/r/820141 (https://phabricator.wikimedia.org/T309872) (owner: 10Jforrester)
[14:46:49] <wikibugs>	 10Continuous-Integration-Config, 10Codex, 10Design-Systems-Team, 10Patch-For-Review, and 2 others: Publish the codex code coverage report - https://phabricator.wikimedia.org/T303899 (10Jdforrester-WMF)
[14:48:09] <wikibugs>	 10Continuous-Integration-Config, 10Codex, 10Design-Systems-Team, 10Patch-For-Review, and 2 others: Publish the codex code coverage report - https://phabricator.wikimedia.org/T303899 (10Jdforrester-WMF) OK, so good news / bad news; [[https://integration.wikimedia.org/ci/job/generic-node16-browser-direct-cov...
[14:57:33] <brennen>	 !log gitlab: flipping admin bit for bd808 for API testing purposes
[14:57:34] <stashbot>	 Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL
[15:01:48] <wikibugs>	 10Gerrit, 10GitLab (Administration, Settings & Policy), 10Phabricator, 10Release-Engineering-Team, 10User-brennen: Create a form for tracking administrative privilege requests for GitLab, Phabricator, Gerrit, etc.? - https://phabricator.wikimedia.org/T314495 (10brennen)
[15:02:47] <wikibugs>	 10Release-Engineering-Team, 10Discovery-Search, 10Elasticsearch, 10Developer Productivity: Developer productivity: Shared ElasticSearch instance for local development environments, Quibble CI, and Patch Demo - https://phabricator.wikimedia.org/T312198 (10Gehel) Note that this is related to T313732 (which d...
[15:04:14] <bd808>	 brennen: w00t. thanks. I can see more data from my https://gitlab.wikimedia.org/api/v4/users/14 test query now.
[15:04:21] <wikibugs>	 10Gerrit, 10GitLab (Administration, Settings & Policy), 10Phabricator, 10Release-Engineering-Team, 10User-brennen: Create a form for tracking administrative privilege requests for GitLab, Phabricator, Gerrit, etc.? - https://phabricator.wikimedia.org/T314495 (10brennen)
[15:32:37] <wikibugs>	 10Release-Engineering-Team (Priority Backlog 📥), 10Patch-For-Review, 10Release, 10Train Deployments: 1.39.0-wmf.21 deployment blockers - https://phabricator.wikimedia.org/T308074 (10dancy) 05Open→03Resolved
[15:33:55] <wikibugs>	 10Phabricator, 10Release-Engineering-Team (The Decommission Mission 💀), 10Patch-For-Review: Move Phabricator configuration into deployment repo - https://phabricator.wikimedia.org/T313950 (10dduvall) We need to address file ownership of some of these config files following scap deployment to ensure that only...
[15:41:25] <wikibugs>	 10Phabricator, 10Release-Engineering-Team (The Decommission Mission 💀), 10Patch-For-Review: Move Phabricator configuration into deployment repo - https://phabricator.wikimedia.org/T313950 (10brennen) > Make the deploy user a member of these groups, allowing it to chgrp {group} the files during the promote st...
[15:43:29] <wikibugs>	 10Release-Engineering-Team, 10Discovery-Search, 10Elasticsearch, 10Developer Productivity: Developer productivity: Shared ElasticSearch instance for local development environments, Quibble CI, and Patch Demo - https://phabricator.wikimedia.org/T312198 (10Gehel) Some random notes from our discussion:  * the...
[15:52:36] <wikibugs>	 10Phabricator, 10Release-Engineering-Team (The Decommission Mission 💀), 10Patch-For-Review: Move Phabricator configuration into deployment repo - https://phabricator.wikimedia.org/T313950 (10dduvall) >>! In T313950#8128668, @brennen wrote: > Puppet already provides `/usr/local/sbin/phab_deploy_finalize`. May...
[16:48:12] <mutante>	 16:47 <mutante> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on gerrit2002.wikimedia.org with reason: in setup / flapping
[16:48:32] <mutante>	 ^ in respose to icinga alerts for gerrit service on new machine
[16:48:39] <mutante>	 sigh that it is flapping
[17:31:58] <wikibugs>	 10Continuous-Integration-Config, 10Metrics-Platform: Changes to composer.json don't trigger CI - https://phabricator.wikimedia.org/T314508 (10Reedy)
[17:37:19] <wikibugs>	 10Continuous-Integration-Config, 10Metrics-Platform: Changes to composer.json doesn't trigger CI - https://phabricator.wikimedia.org/T314508 (10Reedy)
[17:37:22] <wikibugs>	 (03PS1) 10Reedy: layout.yaml: trigger-metrics-platform-pipeline-test-php include composer.json [integration/config] - 10https://gerrit.wikimedia.org/r/820171 (https://phabricator.wikimedia.org/T314508)
[17:41:11] <wikibugs>	 (03CR) 10Reedy: [C: 03+2] layout.yaml: trigger-metrics-platform-pipeline-test-php include composer.json [integration/config] - 10https://gerrit.wikimedia.org/r/820171 (https://phabricator.wikimedia.org/T314508) (owner: 10Reedy)
[17:43:38] <wikibugs>	 (03Merged) 10jenkins-bot: layout.yaml: trigger-metrics-platform-pipeline-test-php include composer.json [integration/config] - 10https://gerrit.wikimedia.org/r/820171 (https://phabricator.wikimedia.org/T314508) (owner: 10Reedy)
[17:44:25] <Reedy>	 !log Reloading Zuul to deploy https://gerrit.wikimedia.org/r/c/integration/config/+/820171
[17:44:26] <stashbot>	 Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL
[17:48:08] <wikibugs>	 10Continuous-Integration-Config, 10Metrics-Platform: Changes to composer.json doesn't trigger CI - https://phabricator.wikimedia.org/T314508 (10Reedy) 05Open→03Resolved a:03Reedy Tested on https://gerrit.wikimedia.org/r/c/mediawiki/libs/metrics-platform/+/820189  Which triggered https://integration.wikim...
[18:29:08] <wikibugs>	 10Project-Admins, 10Design-Innovation-Team: Archive #Design-Innovation-Team project tag? - https://phabricator.wikimedia.org/T312831 (10MNovotny_WMF) You can archive it, thank you!
[20:05:58] <wikibugs>	 (03PS1) 10Urbanecm: zuul: Add Daniel Souza to the CI allowlist [integration/config] - 10https://gerrit.wikimedia.org/r/820212
[20:10:34] <wikibugs>	 (03CR) 10Majavah: [C: 03+2] zuul: Add Daniel Souza to the CI allowlist [integration/config] - 10https://gerrit.wikimedia.org/r/820212 (owner: 10Urbanecm)
[20:10:41] <urbanecm>	 that was quick, thanks taavi 
[20:13:13] <wikibugs>	 (03Merged) 10jenkins-bot: zuul: Add Daniel Souza to the CI allowlist [integration/config] - 10https://gerrit.wikimedia.org/r/820212 (owner: 10Urbanecm)
[20:13:35] <taavi>	 !log reloading zuul for https://gerrit.wikimedia.org/r/820212
[20:13:36] <stashbot>	 Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL
[20:13:48] <taavi>	 urbanecm: and deployed :-)
[20:14:40] <urbanecm>	 thanks
[20:30:32] <icinga-wm>	 PROBLEM - Work requests waiting in Zuul Gearman server on contint2001 is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [400.0] https://www.mediawiki.org/wiki/Continuous_integration/Zuul https://grafana.wikimedia.org/d/000000322/zuul-gearman?orgId=1&viewPanel=10
[20:36:58] <James_F>	 CI looks a bit starved right now.
[20:37:29] <James_F>	 Oh, right, someone's pushed a massive chain in core. :-(
[21:03:35] <James_F>	 Might need to restart zuul (and lose in-flight CI jobs). :-(
[21:05:06] <James_F>	 !log Zuul: Doing a graceful restart to see if this clears the fork-bombed CI jobs.
[21:05:07] <stashbot>	 Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL
[21:08:02] <icinga-wm>	 RECOVERY - Work requests waiting in Zuul Gearman server on contint2001 is OK: OK: Less than 100.00% above the threshold [200.0] https://www.mediawiki.org/wiki/Continuous_integration/Zuul https://grafana.wikimedia.org/d/000000322/zuul-gearman?orgId=1&viewPanel=10
[21:09:43] <jinxer-wm>	 (Queue (Jenkins jobs + Zuul functions) alert) firing: (2) Queue (Jenkins jobs + Zuul functions) alert   - https://alerts.wikimedia.org/?q=alertname%3DQueue+%28Jenkins+jobs+%2B+Zuul+functions%29+alert
[21:09:50] <James_F>	 Tah-dah.
[21:13:30] <wikibugs>	 10Continuous-Integration-Config, 10Codex, 10Design-Systems-Team, 10Patch-For-Review, and 2 others: Publish the codex code coverage report - https://phabricator.wikimedia.org/T303899 (10Jdforrester-WMF) 05Open→03Resolved And it is live: https://doc.wikimedia.org/cover/codex/lcov-report/
[21:29:43] <jinxer-wm>	 (Queue (Jenkins jobs + Zuul functions) alert) resolved: Queue (Jenkins jobs + Zuul functions) alert   - https://alerts.wikimedia.org/?q=alertname%3DQueue+%28Jenkins+jobs+%2B+Zuul+functions%29+alert
[22:34:26] <wikibugs>	 (03PS1) 10Thcipriani: Calendar: branch train 2am UTC [tools/release] - 10https://gerrit.wikimedia.org/r/820241
[23:11:17] <wikibugs>	 10Project-Admins, 10Data-Persistence (Consultation), 10Developer Productivity: Fold Phab tags for optimizer-bug and Slow-DB-Query tag under Wikimedia-database-issue - https://phabricator.wikimedia.org/T305639 (10Krinkle) >>! In T305639#7838866, @Ladsgroup wrote: > If you want to organize the tickets, maybe w...
[23:44:35] <wikibugs>	 10GitLab (Project Migration), 10Release-Engineering-Team (The Decommission Mission 💀), 10Striker, 10Tools: Figure out workflow for programatically adding GitLab users - https://phabricator.wikimedia.org/T313366 (10bd808) I wrote this horrible POC client for creating accounts via the API: `lang=python,name=...
[23:55:54] <wikibugs>	 10GitLab (Project Migration), 10Release-Engineering-Team (The Decommission Mission 💀), 10Striker, 10Tools: Figure out workflow for programatically adding GitLab users - https://phabricator.wikimedia.org/T313366 (10bd808) As another test, I created an account directly via CAS login. This allowed me to confi...