[00:04:22] 06serviceops, 06collaboration-services, 10MW-on-K8s, 06SRE, 13Patch-For-Review: Use encrypted rsync for releases - https://phabricator.wikimedia.org/T289858#11453380 (10Dzahn) There are several different "rsyncs" involved here. This is now resolved, using stunnel, for those data transfers from one relea... [10:56:45] 06serviceops: Move EXCLUDED_SERVICES attribute from sre.discovery.datacentre to service catalog - https://phabricator.wikimedia.org/T412211#11454208 (10Blake) I've reverted the change to the service catalog, and will wait to re-submit until the change is in Spicerack. It would be good to enforce this requirement... [12:23:41] 06serviceops, 10MW-on-K8s, 06SRE: Pushing to the docker registry fails with 500 Internal Server Error - https://phabricator.wikimedia.org/T412265#11454363 (10Michael) Let's make this a train blocker for the next train. If there is somehow an issue in our code that makes deployments likely to fail (though I c... [12:23:50] 06serviceops, 10MW-on-K8s, 06SRE: Pushing to the docker registry fails with 500 Internal Server Error - https://phabricator.wikimedia.org/T412265#11454364 (10Michael) [13:05:48] 06serviceops, 07OKR-Work: rest gateway: Record x-trusted-request and x-provenance headers in access logs - https://phabricator.wikimedia.org/T411250#11454504 (10daniel) 05Open→03Resolved [13:07:49] 06serviceops, 06MediaWiki-Platform-Team (Kanban Board), 07OKR-Work, 13Patch-For-Review: api rate limiting: Assign ratelimit class based on IP range - https://phabricator.wikimedia.org/T410273#11454510 (10daniel) 05In progress→03Declined It looks like exempting local traffic and relying on `x-truste... [18:36:23] 06serviceops, 06Connection-Team: MediaWiki periodic job campaignevents-aggregateanswers-metawiki failed - https://phabricator.wikimedia.org/T411417#11455537 (10Daimona) @Clement_Goubert This just happened again for the testwiki job: T412544. I posted all the logs I could get there, but they don't seem useful.