[03:03:34] <wikibugs>	 10Continuous-Integration-Config, 10Continuous-Integration-Infrastructure, 07Zuul: [Request] Add me to trusted contributor in integration/config - https://phabricator.wikimedia.org/T432791#12144154 (10Les4353)
[03:55:45] <wikibugs>	 10Continuous-Integration-Config, 10Continuous-Integration-Infrastructure, 07Zuul: [Request] Add me to trusted contributor in integration/config - https://phabricator.wikimedia.org/T432791#12144206 (10Les4353)
[07:36:09] <codders>	 I've seen this a couple of times this morning: https://integration.wikimedia.org/ci/job/quibble-vendor-mysql-php83-selenium/69128/console
[07:36:19] <codders>	 exit status 133 from selenium-test although everything seems to have gone well
[07:36:22] <codders>	 has anyone else seen that?
[07:42:36] <wikibugs>	 10GitLab (Account Approval), 06Release-Engineering-Team: Requesting GitLab account activation for lmedley - https://phabricator.wikimedia.org/T432823 (10ppenloglou) 03NEW
[07:48:54] <codders>	 https://integration.wikimedia.org/ci/job/quibble-vendor-mysql-php83-selenium/69135/consoleFull
[07:52:29] <wikibugs>	 10GitLab (Account Approval), 06Release-Engineering-Team: Requesting GitLab account activation for lmedley - https://phabricator.wikimedia.org/T432823#12144588 (10Peachey88) The best way is to request the `wmf` group in bitu which will grant access to all the other tools mentioned here: https://wikitech.wikimed...
[08:10:19] <codders>	 filed as https://phabricator.wikimedia.org/T432826
[08:10:20] <wikibugs>	 06Release-Engineering-Team, 10Wikidata, 06Wikidata-Omega: quibble-vendor-mysql-php83-selenium selenium-test failing with exit status 133 without obvious reason - https://phabricator.wikimedia.org/T432826 (10ArthurTaylor) 03NEW
[08:10:42] <wikibugs>	 06Release-Engineering-Team, 10Wikidata, 06Wikidata-Omega (The Board): quibble-vendor-mysql-php83-selenium selenium-test failing with exit status 133 without obvious reason - https://phabricator.wikimedia.org/T432826#12144636 (10ArthurTaylor)
[08:17:15] <codders>	 also https://integration.wikimedia.org/ci/job/quibble-vendor-mysql-php83-selenium/69147/consoleFull
[08:17:19] <wikibugs>	 06Release-Engineering-Team, 10Wikidata, 06Wikidata-Omega (The Board): quibble-vendor-mysql-php83-selenium selenium-test failing with exit status 133 without obvious reason - https://phabricator.wikimedia.org/T432826#12144651 (10ArthurTaylor) https://integration.wikimedia.org/ci/job/quibble-vendor-mysql-php83...
[08:45:15] <wikibugs>	 06Release-Engineering-Team (Priority Backlog 📥), 10dev-images, 06Infrastructure-Foundations, 06SRE: Rebuild dev-images using a base image without mirrors.wikimedia.org in the apt sources - https://phabricator.wikimedia.org/T423972#12144734 (10SomeRandomDeveloper)
[09:21:32] <wikibugs>	 10GitLab (Account Approval), 06Release-Engineering-Team: Requesting GitLab account activation for Les4353 - https://phabricator.wikimedia.org/T432831 (10Les4353) 03NEW
[09:54:34] <James_F>	 !log ssh integration-castor06.integration.eqiad1.wikimedia.cloud sudo -u jenkins-deploy rm -rf /srv/castor/castor-mw-ext-and-skins/master/mediawiki-node24 # fix failure for 1313321, per Lucas_WMDE.
[09:54:35] <stashbot>	 Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL
[09:58:29] <wikibugs>	 (03update) 10jforrester: branches: REL1_44 is EOL [repos/ci-tools/libup-config] - 10https://gitlab.wikimedia.org/repos/ci-tools/libup-config/-/merge_requests/135 (owner: 10taavi)
[09:58:33] <wikibugs>	 (03merge) 10jforrester: branches: REL1_44 is EOL [repos/ci-tools/libup-config] - 10https://gitlab.wikimedia.org/repos/ci-tools/libup-config/-/merge_requests/135 (owner: 10taavi)
[09:59:32] <wikibugs>	 (03update) 10jforrester: releases: Add pinia @ 3.0.4 and @pinia/testing @ 1.0.3 [repos/ci-tools/libup-config] - 10https://gitlab.wikimedia.org/repos/ci-tools/libup-config/-/merge_requests/133 (https://phabricator.wikimedia.org/T386086)
[09:59:43] <wikibugs>	 (03merge) 10jforrester: releases: Add pinia @ 3.0.4 and @pinia/testing @ 1.0.3 [repos/ci-tools/libup-config] - 10https://gitlab.wikimedia.org/repos/ci-tools/libup-config/-/merge_requests/133 (https://phabricator.wikimedia.org/T386086)
[10:41:27] <wikibugs>	 (03update) 10taavi: build: Stop publishing a web image [repos/ci-tools/libup] - 10https://gitlab.wikimedia.org/repos/ci-tools/libup/-/merge_requests/119
[10:41:28] <wikibugs>	 (03update) 10taavi: runner: stylelint: Handle slightly different unknown rule errors [repos/ci-tools/libup] - 10https://gitlab.wikimedia.org/repos/ci-tools/libup/-/merge_requests/120
[10:41:36] <wikibugs>	 (03open) 10taavi: runner: stylelint: Handle slightly different unknown rule errors [repos/ci-tools/libup] - 10https://gitlab.wikimedia.org/repos/ci-tools/libup/-/merge_requests/120
[10:41:37] <wikibugs>	 (03open) 10taavi: build: Stop publishing a web image [repos/ci-tools/libup] - 10https://gitlab.wikimedia.org/repos/ci-tools/libup/-/merge_requests/119
[10:41:40] <wikibugs>	 (03update) 10taavi: build: Stop publishing a web image [repos/ci-tools/libup] - 10https://gitlab.wikimedia.org/repos/ci-tools/libup/-/merge_requests/119
[10:41:44] <wikibugs>	 (03update) 10taavi: runner: stylelint: Handle slightly different unknown rule errors [repos/ci-tools/libup] - 10https://gitlab.wikimedia.org/repos/ci-tools/libup/-/merge_requests/120
[11:13:14] <wikibugs>	 (03update) 10taavi: runner: stylelint: Handle slightly different unknown rule errors [repos/ci-tools/libup] - 10https://gitlab.wikimedia.org/repos/ci-tools/libup/-/merge_requests/120
[11:22:24] <wikibugs>	 06Project-Admins, 06Quality-and-Test-Engineering-Team: Archive the #Quality-and-Test-Engineering-Team project(?) - https://phabricator.wikimedia.org/T423518#12145256 (10AMarkossyan-WMF) >>! In T423518#12116685, @Aklapper wrote: >>>! In T423518#11835091, @SLong-WMF wrote: >> Assigning this to Armen and myself f...
[11:23:53] <wikibugs>	 (03approved) 10jforrester: build: Stop publishing a web image [repos/ci-tools/libup] - 10https://gitlab.wikimedia.org/repos/ci-tools/libup/-/merge_requests/119 (owner: 10taavi)
[11:23:59] <wikibugs>	 (03merge) 10jforrester: build: Stop publishing a web image [repos/ci-tools/libup] - 10https://gitlab.wikimedia.org/repos/ci-tools/libup/-/merge_requests/119 (owner: 10taavi)
[11:24:05] <wikibugs>	 (03update) 10jforrester: runner: stylelint: Handle slightly different unknown rule errors [repos/ci-tools/libup] - 10https://gitlab.wikimedia.org/repos/ci-tools/libup/-/merge_requests/120 (owner: 10taavi)
[11:24:30] <wikibugs>	 (03approved) 10jforrester: runner: stylelint: Handle slightly different unknown rule errors [repos/ci-tools/libup] - 10https://gitlab.wikimedia.org/repos/ci-tools/libup/-/merge_requests/120 (owner: 10taavi)
[11:33:13] <wikibugs>	 10Continuous-Integration-Infrastructure, 07Jenkins, 10Castor, 07Upstream: castor-save-workspace-cache aborted during postbuild - https://phabricator.wikimedia.org/T352319#12145323 (10Peter) I also looked into this today since we potentially have a goal of making castor async/not affect the job time. I digg...
[12:19:30] <wmf-insecte>	 Project mediawiki-core-doxygen build #21676: 04FAILURE in 1 min 29 sec: https://integration.wikimedia.org/ci/job/mediawiki-core-doxygen/21676/
[12:20:39] <wikibugs>	 (03merge) 10taavi: runner: stylelint: Handle slightly different unknown rule errors [repos/ci-tools/libup] - 10https://gitlab.wikimedia.org/repos/ci-tools/libup/-/merge_requests/120
[12:33:49] <wikibugs>	 (03CR) 10SomeRandomDeveloper: "I think this makes sense in general, but according to https://www.mediawiki.org/wiki/Extension:GlobalContributions, the extension is "not " [integration/config] - 10https://gerrit.wikimedia.org/r/1311525 (owner: 10Fomafix)
[12:55:08] <wikibugs>	 10GitLab (Account Approval), 06Release-Engineering-Team: Requesting GitLab account activation for lmedley - https://phabricator.wikimedia.org/T432823#12145684 (10Aklapper) 05Open→03Declined @ppenloglou: Boldly declining; please update your team's onboarding docs accordingly - thanks!  Posting the banne...
[13:04:28] <wikibugs>	 10GitLab (Account Approval), 06Release-Engineering-Team: Requesting GitLab account activation for lmedley - https://phabricator.wikimedia.org/T432823#12145719 (10ppenloglou) Got it, thank you @Aklapper we'll try and make it work via the method above 👍  Just want to point out this [[ https://www.mediawiki.o...
[13:24:12] <wikibugs>	 10Phabricator: Potentially disable H488 - https://phabricator.wikimedia.org/T431737#12145884 (10Aklapper) Thanks!
[13:34:57] <wmf-insecte>	 Yippee, build fixed!
[13:34:57] <wmf-insecte>	 Project mediawiki-core-doxygen build #21677: 09FIXED in 16 min: https://integration.wikimedia.org/ci/job/mediawiki-core-doxygen/21677/
[14:03:18] <ecarg>	 Hello! Could someone help me with this issue here, I am in my team's deploy window at the moment and am unable to ssh
[14:03:21] <ecarg>	 ssh deployment.eqiad.wmnet
[14:03:22] <ecarg>	 @@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@
[14:03:22] <ecarg>	 @    WARNING: REMOTE HOST IDENTIFICATION HAS CHANGED!     @
[14:03:23] <ecarg>	 @@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@
[14:03:23] <ecarg>	 IT IS POSSIBLE THAT SOMEONE IS DOING SOMETHING NASTY!
[14:03:24] <ecarg>	 Someone could be eavesdropping on you right now (man-in-the-middle attack)!
[14:03:24] <ecarg>	 It is also possible that a host key has just been changed.
[14:03:25] <ecarg>	 The fingerprint for the ED25519 key sent by the remote host is
[14:03:25] <ecarg>	 SHA256:8NqxuGU928VyS+BE6U1rZXOt8xOaTqHIdB6w3sH2aqI.
[14:03:26] <ecarg>	 Please contact your system administrator.
[14:03:26] <ecarg>	 Add correct host key in /Users/ecarg/.ssh/known_hosts to get rid of this message.
[14:03:27] <ecarg>	 Offending ECDSA key in /Users/ecarg/.ssh/known_hosts:20
[14:03:27] <ecarg>	 Host key for deployment.eqiad.wmnet has changed and you have requested strict checking.
[14:03:28] <ecarg>	 Host key verification failed.
[14:03:41] <ecarg>	 pls let me know if i need to ping a different channel
[14:07:38] <brennen>	 ecarg: please see wikitech-l posting from raine re: "Temporary deployment server switchover to deploy2003.codfw.wmnet"
[14:08:13] <brennen>	 if you have wmf-update-known-hosts-production, you'll want to run that
[14:12:37] <ecarg>	 thank you
[15:59:31] <dancy>	 !log Restarting Gerrit (T240266)
[15:59:32] <stashbot>	 Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL
[16:10:03] <wmf-insecte>	 maintenance-disconnect-full-disks build 826482 integration-agent-docker-1078 (/: 28%, /srv: 97%, /var/lib/docker: 52%): OFFLINE due to disk space
[16:14:21] <wikibugs>	 10Continuous-Integration-Config, 10SonarQube Bot: Upgrade SonarQube / codehealth jobs to use Java 21 - https://phabricator.wikimedia.org/T432886 (10pwangai) 03NEW
[16:15:03] <wmf-insecte>	 maintenance-disconnect-full-disks build 826483 integration-agent-docker-1078 (/: 28%, /srv: 10%, /var/lib/docker: 52%): RECOVERY disk space OK
[16:20:52] <wikibugs>	 10Phabricator, 06Release-Engineering-Team (Priority Backlog 📥): Add a sentence about [[mw:Phabricator/Bots]] to the user account creation form - https://phabricator.wikimedia.org/T432888 (10Aklapper) 03NEW p:05Triage→03Medium
[16:21:14] <wikibugs>	 10Continuous-Integration-Config, 10Continuous-Integration-Infrastructure: [Request] Add me to trusted contributor in integration/config - https://phabricator.wikimedia.org/T432791#12146964 (10Aklapper)
[16:26:30] <wikibugs>	 (03PS1) 10Pwangai: dockerfiles: sonar-scanner: upgrade from Java 17 to 21 [integration/config] - 10https://gerrit.wikimedia.org/r/1314014 (https://phabricator.wikimedia.org/T432886)
[16:40:48] <wikibugs>	 (03PS1) 10Pwangai: jjb: Bump codehealth jobs to sonar-scanner with Java 21 [integration/config] - 10https://gerrit.wikimedia.org/r/1314025 (https://phabricator.wikimedia.org/T432886)
[16:58:31] <dancy>	 !log Restarting Gerrit (T240266) (again)
[16:58:32] <stashbot>	 Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL
[17:19:17] <wikibugs>	 (03CR) 10Brennen Bearnes: [C:03+2] dockerfiles: sonar-scanner: upgrade from Java 17 to 21 [integration/config] - 10https://gerrit.wikimedia.org/r/1314014 (https://phabricator.wikimedia.org/T432886) (owner: 10Pwangai)
[17:21:00] <wikibugs>	 (03Merged) 10jenkins-bot: dockerfiles: sonar-scanner: upgrade from Java 17 to 21 [integration/config] - 10https://gerrit.wikimedia.org/r/1314014 (https://phabricator.wikimedia.org/T432886) (owner: 10Pwangai)
[17:24:27] <brennen>	 !log Updating docker-pkg files on contint primary for https://gerrit.wikimedia.org/r/c/integration/config/+/1314014/1 (T432886)
[17:24:29] <stashbot>	 Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL
[17:24:29] <stashbot>	 T432886: Upgrade SonarQube / codehealth jobs to use Java 21 - https://phabricator.wikimedia.org/T432886
[17:26:49] <wikibugs>	 10Continuous-Integration-Config, 10SonarQube Bot, 13Patch-For-Review: Upgrade SonarQube / codehealth jobs to use Java 21 - https://phabricator.wikimedia.org/T432886#12147316 (10brennen) Image published:  ` == Step 0: scanning /etc/zuul/wikimedia/dockerfiles == Will build the following images: * docker-regist...
[17:38:56] <icinga-wm>	 PROBLEM - gerrit process on gerrit1003 is CRITICAL: PROCS CRITICAL: 0 processes with regex args ^/usr/lib/jvm/java-17-openjdk-amd64/bin/java .*-jar /srv/gerrit/site_path/review_site/bin/gerrit.war daemon -d /srv/gerrit/site_path/review_site https://wikitech.wikimedia.org/wiki/Gerrit
[17:50:27] <mutante>	 ^ spare host, coming back up
[17:50:56] <icinga-wm>	 RECOVERY - gerrit process on gerrit1003 is OK: PROCS OK: 1 process with regex args ^/usr/lib/jvm/java-17-openjdk-amd64/bin/java .*-jar /srv/gerrit/site_path/review_site/bin/gerrit.war daemon -d /srv/gerrit/site_path/review_site https://wikitech.wikimedia.org/wiki/Gerrit
[17:56:03] <wikibugs>	 10Continuous-Integration-Config, 10SonarQube Bot, 13Patch-For-Review: Upgrade SonarQube / codehealth jobs to use Java 21 - https://phabricator.wikimedia.org/T432886#12147426 (10brennen) Apologies, I do this once or twice a year at most, need to untangle running the tooling on my current machine, and have to...
[17:57:31] <jinxer-wm>	 FIRING: [2x] ProbeDown: Service gerrit2003:443 has failed probes (http_gerrit_tls_ip4) - https://wikitech.wikimedia.org/wiki/Runbook#gerrit2003:443 - https://grafana.wikimedia.org/d/O0nHhdhnz/network-probes-overview?var-job=probes/custom&var-module=All - https://alerts.wikimedia.org/?q=alertname%3DProbeDown
[17:57:39] <wikibugs>	 06Release-Engineering-Team, 06collaboration-services: ProbeDown - https://phabricator.wikimedia.org/T432903 (10phaultfinder) 03NEW
[17:58:58] <wikibugs>	 10Continuous-Integration-Config, 10SonarQube Bot, 13Patch-For-Review: Upgrade SonarQube / codehealth jobs to use Java 21 - https://phabricator.wikimedia.org/T432886#12147451 (10pwangai) No worries @brennen . Thanks for your help so far. Once the jjb part is deployed, I will be around to test if the pipeline...
[18:02:31] <jinxer-wm>	 RESOLVED: [2x] ProbeDown: Service gerrit2003:443 has failed probes (http_gerrit_tls_ip4) - https://wikitech.wikimedia.org/wiki/Runbook#gerrit2003:443 - https://grafana.wikimedia.org/d/O0nHhdhnz/network-probes-overview?var-job=probes/custom&var-module=All - https://alerts.wikimedia.org/?q=alertname%3DProbeDown
[18:14:32] <wikibugs>	 06Project-Admins, 07Tracking-Neverending: Requests for addition to the #acl*Project-Admins group (in comments) - https://phabricator.wikimedia.org/T706#12147508 (10Rsilvola) Hello! Could you add me as well? As the EM for PSI Security and Privacy I need to manage milestones and projects regularly.
[18:25:24] <dancy>	 !log Zuul is currently broken due to the Gerrit SSH key update.  I'm investigating
[18:25:24] <stashbot>	 Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL
[18:41:18] <wikibugs>	 (03CR) 10Dduvall: [C:03+2] jjb: Bump codehealth jobs to sonar-scanner with Java 21 [integration/config] - 10https://gerrit.wikimedia.org/r/1314025 (https://phabricator.wikimedia.org/T432886) (owner: 10Pwangai)
[18:41:39] <dancy>	 !log Zuul dependencies upgraded and Zuul restarted.
[18:41:40] <stashbot>	 Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL
[18:42:59] <wikibugs>	 (03Merged) 10jenkins-bot: jjb: Bump codehealth jobs to sonar-scanner with Java 21 [integration/config] - 10https://gerrit.wikimedia.org/r/1314025 (https://phabricator.wikimedia.org/T432886) (owner: 10Pwangai)
[19:08:23] <wikibugs>	 (03PS1) 10Ahmon Dancy: deploy: Upgrade paramiko to 2.12.0 and repoint apt at deb.debian.org [integration/zuul/deploy] - 10https://gerrit.wikimedia.org/r/1314096 (https://phabricator.wikimedia.org/T240266)
[19:09:50] <wikibugs>	 (03CR) 10Ahmon Dancy: [C:03+2] deploy: Upgrade paramiko to 2.12.0 and repoint apt at deb.debian.org [integration/zuul/deploy] - 10https://gerrit.wikimedia.org/r/1314096 (https://phabricator.wikimedia.org/T240266) (owner: 10Ahmon Dancy)
[19:10:28] <wikibugs>	 (03Merged) 10jenkins-bot: deploy: Upgrade paramiko to 2.12.0 and repoint apt at deb.debian.org [integration/zuul/deploy] - 10https://gerrit.wikimedia.org/r/1314096 (https://phabricator.wikimedia.org/T240266) (owner: 10Ahmon Dancy)
[19:16:27] <wikibugs>	 10GitLab (Project and group requests), 06Release-Engineering-Team: GitLab Private Repository Request for: - https://phabricator.wikimedia.org/T432913 (10Rscout) 03NEW
[19:19:53] <wikibugs>	 10GitLab (Project and group requests), 06Release-Engineering-Team: GitLab Private Repository Request for email-confirmation-statistics - https://phabricator.wikimedia.org/T432913#12147686 (10Pppery)
[19:48:25] <wikibugs>	 06Release-Engineering-Team, 06collaboration-services: ProbeDown - gerrit2003 - https://phabricator.wikimedia.org/T432903#12147730 (10Dzahn)
[19:48:55] <wikibugs>	 06Release-Engineering-Team, 06collaboration-services: ProbeDown - gerrit2003 - https://phabricator.wikimedia.org/T432903#12147734 (10Dzahn) 05Open→03Resolved a:03Dzahn service restarts were needed for T240266
[19:49:54] <mutante>	 success. Gerrit-SSH now serves a new ed25519 key but ALSO the old RSA key. (ssh-keyscan -p 29418 gerrit.wikimedia.org)
[19:50:04] <mutante>	 on August 4th the old key will be removed
[20:34:55] <MatmaRex>	 hi folks, i'm seeing some build failures which look to be caused by cache corruption in Jenkins. see the last 3 fails on https://gerrit.wikimedia.org/r/c/mediawiki/extensions/OAuth/+/1306665
[20:35:18] <MatmaRex>	 npm error enoent Invalid response body while trying to fetch https://registry.npmjs.org/react-is: ENOENT: no such file or directory, stat '/cache/npm/_cacache/content-v2/sha512/72/92/6c47f090648ba36ccf3e52f3cade10fd5b5a01a307e3453957ffa7004aab74207adb2609a3a26bcf70f3f1210658e929dc0e3ac817c6758e9333f8cb5a95'
[20:35:44] <MatmaRex>	 is this something you've seen before and can easily fix? if not, i'll file a task
[21:19:42] <dancy>	 MatmaRex: Taking a look
[21:32:44] <dancy>	 !log Moved /srv/castor/castor-mw-ext-and-skins/master/quibble-vendor-mysql-php83-selenium/npm to /srv/castor-debug-T20260722-npm-torn-cacache/ on integration-castor06
[21:32:44] <stashbot>	 Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL
[21:38:32] <dancy>	 MatmaRex: Fixed
[21:51:40] <sbassett>	 Just FYI, scap (via spiderpig) is pretty slow on prod k8s deployments right now.  It actually just failed for me and I’m retrying…
[21:52:04] <sbassett>	 …and now it rather quickly completed
[22:02:43] <MatmaRex>	 dancy: thank you!
[22:17:37] <wikibugs>	 10Beta-Cluster-Infrastructure, 10Observability-Logging: scap on deployment-deploy04 failing to reach logging-logstash-04.logging.eqiad1.wikimedia.cloud - https://phabricator.wikimedia.org/T432254#12148202 (10bd808) This is blowing up again right now: ` [22:13:37] 22:13:37 The canary error rate checker failed:...
[22:23:28] <wikibugs>	 10Beta-Cluster-Infrastructure, 10Observability-Logging: scap on deployment-deploy04 failing to reach logging-logstash-04.logging.eqiad1.wikimedia.cloud - https://phabricator.wikimedia.org/T432254#12148221 (10bd808) logging-logstash-04 Instance Console Log via Horizon: ` ?2004hroot@logging-logstash-04:~# [   24...
[22:42:25] <wikibugs>	 10Continuous-Integration-Infrastructure (Zuul upgrade), 06collaboration-services, 13Patch-For-Review: zuul-client encrypt fails to retrieve public key - https://phabricator.wikimedia.org/T431003#12148250 (10Dzahn) @hashar I have a new fix!  This does it:  https://gerrit.wikimedia.org/r/c/operations/puppet/+/...
[22:56:39] <wikibugs>	 (03CR) 10Mhurd: [C:03+1] castor: measure cache-load rsync [integration/config] - 10https://gerrit.wikimedia.org/r/1313076 (https://phabricator.wikimedia.org/T432685) (owner: 10Phedenskog)
[22:59:46] <wikibugs>	 (03PS1) 10Ahmon Dancy: castor: Skip cache save when a concurrent build saved first [integration/config] - 10https://gerrit.wikimedia.org/r/1314124 (https://phabricator.wikimedia.org/T295351)
[23:01:35] <dancy>	 phedenskog: Interesting coincidence.
[23:01:42] <wikibugs>	 06Project-Admins, 07Tracking-Neverending: Requests for addition to the #acl*Project-Admins group (in comments) - https://phabricator.wikimedia.org/T706#12148309 (10brennen) > Hello! Could you add me as well? As the EM for PSI Security and Privacy I need to manage milestones and projects regularly.  Done.  //St...
[23:56:50] <wikibugs>	 10Continuous-Integration-Infrastructure, 06Release-Engineering-Team, 10Castor, 13Patch-For-Review: npm cache saved by castor get corrupted for unknown reason - https://phabricator.wikimedia.org/T295351#12148383 (10dancy) This problem happened again today.  The conclusion in today's case is that the `react-...