[00:16:23] 10Release-Engineering-Team (Priority Backlog πŸ“₯), 07Essential-Work, 10MW-1.44-notes (1.44.0-wmf.27; 2025-04-29), 05Release, 05Train Deployments: 1.44.0-wmf.28 deployment blockers - https://phabricator.wikimedia.org/T386223#10806252 (10thcipriani) 05Openβ†’03Resolved [00:18:22] 06Release-Engineering-Team, 06Content-Transform-Team, 07ci-test-error, 07Essential-Work: Mobileapps CI is broken because of docker error - https://phabricator.wikimedia.org/T393373#10806253 (10thcipriani) [00:19:08] 10Release-Engineering-Team (Yak Shaving πŸƒπŸͺ’), 10Scap (SpiderPig πŸ•ΈοΈ), 07OKR-Work: Integrate SpiderPig with the Deployment calendar - https://phabricator.wikimedia.org/T392507#10806254 (10thcipriani) [00:19:45] 10Phabricator, 10Release-Engineering-Team (Doing 😎), 07Essential-Work: The global UBN Maniphest queries don't show In Progress tasks - https://phabricator.wikimedia.org/T393690#10806255 (10thcipriani) [00:20:06] 10Release-Engineering-Team (Yak Shaving πŸƒπŸͺ’), 10Scap (SpiderPig πŸ•ΈοΈ), 07OKR-Work, 13Patch-For-Review: Automatically select first backport search match - https://phabricator.wikimedia.org/T392508#10806256 (10thcipriani) [00:20:38] 10Continuous-Integration-Infrastructure (Zuul upgrade), 10Release-Engineering-Team (Doing 😎), 07Essential-Work: Stand up Zuul 11 experiment environment in zuul3 cloud VPS project - https://phabricator.wikimedia.org/T391374#10806258 (10thcipriani) [00:20:53] 10Release-Engineering-Team (Doing 😎), 10Scap (SpiderPig πŸ•ΈοΈ), 10Codex, 07Epic, 07OKR-Work: [EPIC] scap web interface: Create SpiderPig web UI - https://phabricator.wikimedia.org/T375782#10806260 (10thcipriani) [00:21:38] 10Continuous-Integration-Infrastructure, 10Release-Engineering-Team (Doing 😎), 07Essential-Work: CI is overwhelmed, 2025-05-06 edition - https://phabricator.wikimedia.org/T393485#10806261 (10thcipriani) [00:22:07] 10Continuous-Integration-Infrastructure, 07Jenkins, 10Release-Engineering-Team (Doing 😎), 07Essential-Work: Recently created Jenkins agents use the wrong credential (jenkins-deploy-toolforge) - https://phabricator.wikimedia.org/T393543#10806262 (10thcipriani) [00:22:21] 10Continuous-Integration-Infrastructure, 10Release-Engineering-Team (Doing 😎), 07Essential-Work: integration-agent-docker-1061 is offline - https://phabricator.wikimedia.org/T393542#10806263 (10thcipriani) [01:55:03] 10GitLab (Account Approval), 06Release-Engineering-Team: Requesting GitLab account activation for [Sirchanmp] - https://phabricator.wikimedia.org/T393748 (10Sirchanmp) 03NEW [01:55:48] 10GitLab (Account Approval), 06Release-Engineering-Team: Requesting GitLab account activation for [Sirchanmp] - https://phabricator.wikimedia.org/T393748#10806317 (10Sirchanmp) [02:00:56] 10GitLab (Account Approval), 06Release-Engineering-Team: Requesting GitLab account activation for [Sirchanmp] - https://phabricator.wikimedia.org/T393748#10806329 (10Pppery) β†’14Duplicate dup:03T391434 [02:00:57] 10GitLab (Account Approval), 06Release-Engineering-Team: Requesting GitLab account activation for [Sirchanmp] - https://phabricator.wikimedia.org/T391434#10806331 (10Pppery) [02:01:10] 10GitLab (Account Approval), 06Release-Engineering-Team: Requesting GitLab account activation for [Sirchanmp] - https://phabricator.wikimedia.org/T391434#10806333 (10Pppery) Please stop filing duplicate tasks. That only annoys us. And you still haven't answered Aklapper's question. [06:38:21] 10GitLab (Pipeline Services Migration🐀), 06collaboration-services: move os-reports.wikimedia.org to kubernetes - https://phabricator.wikimedia.org/T350794#10806495 (10Jelto) [06:57:31] FIRING: [2x] ProbeDown: Service gerrit1003:443 has failed probes (http_gerrit_tls_ip4) - https://wikitech.wikimedia.org/wiki/Runbook#gerrit1003:443 - https://grafana.wikimedia.org/d/O0nHhdhnz/network-probes-overview?var-job=probes/custom&var-module=All - https://alerts.wikimedia.org/?q=alertname%3DProbeDown [06:57:35] 06Release-Engineering-Team, 06collaboration-services: ProbeDown - https://phabricator.wikimedia.org/T393743#10806529 (10phaultfinder) [07:02:31] RESOLVED: [2x] ProbeDown: Service gerrit1003:443 has failed probes (http_gerrit_tls_ip4) - https://wikitech.wikimedia.org/wiki/Runbook#gerrit1003:443 - https://grafana.wikimedia.org/d/O0nHhdhnz/network-probes-overview?var-job=probes/custom&var-module=All - https://alerts.wikimedia.org/?q=alertname%3DProbeDown [09:32:24] 06Release-Engineering-Team, 06collaboration-services: ProbeDown - gerrit1003 - https://phabricator.wikimedia.org/T393743#10806798 (10LSobanski) [09:46:16] 10Gerrit, 06Release-Engineering-Team, 06collaboration-services, 07Privacy: Gerrit API docs loads fonts from Google - https://phabricator.wikimedia.org/T393763 (10taavi) 03NEW [10:05:26] 10Gerrit, 06Release-Engineering-Team, 06collaboration-services, 07Privacy, 07Upstream: Gerrit API docs loads fonts from Google - https://phabricator.wikimedia.org/T393763#10806855 (10Peachey88) [10:23:38] 10Gerrit, 10LPL Essential (LPL Essential 2025 Apr-Jun: CX), 07Unplanned-Sprint-Work: Delete two branches from mediawiki/extensions/Translate Gerrit extension - https://phabricator.wikimedia.org/T392787#10806877 (10hashar) 05Openβ†’03Resolved a:03hashar Ah indeed sorry. Looks like by default we might... [10:25:51] GitLab needs a short maintenance break in 30 minutes [11:06:50] GitLab maintenance done [11:40:56] 10Phabricator-Bot-Requests: Request a bot for a Slack integration - https://phabricator.wikimedia.org/T393773 (10DSantamaria) 03NEW [11:54:49] 10Phabricator-Bot-Requests: Request a bot for a Slack integration - https://phabricator.wikimedia.org/T393773#10807123 (10Aklapper) Doesn't this already exist?: https://phabricator.wikimedia.org/p/Slack_connector_for_Editing_team_triage/ Also I'm afraid the email address is not unique as your Phab accout might... [11:56:57] 10Release-Engineering-Team (Radar), 06SRE, 13Patch-Needs-Improvement: Requesting exec access to pods in 'ci' namespace staging kubernetes - https://phabricator.wikimedia.org/T290360#10807127 (10JMeybohm) 05Stalledβ†’03Invalid Given the changes done in the parent task have been reverted and CI systems n... [12:54:09] 10Gerrit, 06Release-Engineering-Team, 06collaboration-services, 07Privacy, 07Upstream: Gerrit API docs loads fonts from Google - https://phabricator.wikimedia.org/T393763#10807260 (10Reedy) Not dissimilar to {T239122} [13:42:24] 10GitLab (Account Approval), 06Release-Engineering-Team: Requesting GitLab account activation for [Kiril kovachev] - https://phabricator.wikimedia.org/T393781#10807448 (10Aklapper) Hi, there is no such user. Is this about https://gitlab.wikimedia.org/kiril ? Also, can you please [connect your wiki account to y... [13:49:48] 10GitLab (Account Approval), 06Release-Engineering-Team: Requesting GitLab account activation for [Kiril kovachev] - https://phabricator.wikimedia.org/T393781#10807494 (10Kiril_kovachev) @Aklapper Sorry, I think so – was that account made just recently? I should have made a Dev Account and Phabricator account... [13:58:44] 10Phabricator-Bot-Requests: Request a bot for a Slack integration - https://phabricator.wikimedia.org/T393773#10807502 (10DSantamaria) And the email is this one: phabricator-slack-bot@wikimedia.org [14:55:26] 10GitLab (CI & Job Runners), 06Release-Engineering-Team: buildkit v0.21.1 released - https://phabricator.wikimedia.org/T393731#10807743 (10dancy) [14:58:29] (03open) 10dancy: blubber.yaml: Use buildkit:wmf-v0.21.1 [repos/releng/kokkuri] - 10https://gitlab.wikimedia.org/repos/releng/kokkuri/-/merge_requests/122 (https://phabricator.wikimedia.org/T393731) [14:58:30] (03update) 10dancy: blubber.yaml: Use buildkit:wmf-v0.21.1 [repos/releng/kokkuri] - 10https://gitlab.wikimedia.org/repos/releng/kokkuri/-/merge_requests/122 (https://phabricator.wikimedia.org/T393731) [15:02:16] (03update) 10dancy: blubber.yaml: Use buildkit:wmf-v0.21.1 [repos/releng/kokkuri] - 10https://gitlab.wikimedia.org/repos/releng/kokkuri/-/merge_requests/122 (https://phabricator.wikimedia.org/T393731) [15:04:51] 10Release-Engineering-Team (Yak Shaving πŸƒπŸͺ’), 10Scap (SpiderPig πŸ•ΈοΈ), 07OKR-Work: Integrate SpiderPig with the Deployment calendar - https://phabricator.wikimedia.org/T392507#10807797 (10dancy) Looks great Bryan! [15:09:39] (03close) 10dancy: Draft: scap mediawiki-status command [repos/releng/scap] - 10https://gitlab.wikimedia.org/repos/releng/scap/-/merge_requests/385 [16:12:42] 06Release-Engineering-Team: Clean up old php- dirs on deploy1003 - https://phabricator.wikimedia.org/T389833#10808030 (10thcipriani) 05Openβ†’03Resolved a:03hashar deploy1003 and deploy2002 have the same `php-*` folders there now. @hashar did some work on cleanup a while back, hope we're all good now. [16:39:25] 06Release-Engineering-Team: Block/cancel PCC jobs without a "hosts" line in commit message? - https://phabricator.wikimedia.org/T393801 (10bking) 03NEW [16:39:37] 10GitLab (Account Approval), 06Release-Engineering-Team, 07Essential-Work: Requesting GitLab account activation for [Kiril kovachev] - https://phabricator.wikimedia.org/T393781#10808096 (10thcipriani) 05Openβ†’03Resolved a:03thcipriani @Kiril_kovachev Thanks for linking those your phab and ldap accou... [16:41:20] 06Release-Engineering-Team: Block/cancel PCC jobs without a "hosts" line in commit message? - https://phabricator.wikimedia.org/T393801#10808101 (10thcipriani) β†’14Duplicate dup:03T369270 [16:41:21] 10Gerrit, 06Infrastructure-Foundations, 10Puppet CI: Avoid running PCC compiler on CRs without a Hosts footer - https://phabricator.wikimedia.org/T369270#10808103 (10thcipriani) [17:48:08] 10GitLab (Account Approval), 06Release-Engineering-Team, 07Essential-Work: Requesting GitLab account activation for [Kiril kovachev] - https://phabricator.wikimedia.org/T393781#10808246 (10Kiril_kovachev) @thcipriani – thank you very much! [17:58:03] 10Gerrit, 06Release-Engineering-Team, 06collaboration-services, 07Privacy, 07Upstream: Gerrit API docs loads fonts from Google - https://phabricator.wikimedia.org/T393763#10808256 (10Paladox) It seems it is being added with https://github.com/GerritCodeReview/gerrit/blob/9a4495266202363e5ba92abddea72b555... [19:30:29] (03open) 10addshore: Draft: Rewrite (maybe version 1)? [repos/releng/cli] - 10https://gitlab.wikimedia.org/repos/releng/cli/-/merge_requests/628 [20:01:13] (03open) 10dancy: spiderpig: Accept unconsumed TOTP tokens from the T-1, T+0, and T+1 windows [repos/releng/scap] - 10https://gitlab.wikimedia.org/repos/releng/scap/-/merge_requests/794 (https://phabricator.wikimedia.org/T392815 https://phabricator.wikimedia.org/T393651) [20:01:13] (03update) 10dancy: spiderpig: Accept unconsumed TOTP tokens from the T-1, T+0, and T+1 windows [repos/releng/scap] - 10https://gitlab.wikimedia.org/repos/releng/scap/-/merge_requests/794 (https://phabricator.wikimedia.org/T392815 https://phabricator.wikimedia.org/T393651) [20:03:49] (03update) 10dancy: spiderpig: Accept unconsumed TOTP tokens from the T-1, T+0, and T+1 windows [repos/releng/scap] - 10https://gitlab.wikimedia.org/repos/releng/scap/-/merge_requests/794 (https://phabricator.wikimedia.org/T392815 https://phabricator.wikimedia.org/T393651) [20:05:21] 10Scap (SpiderPig πŸ•ΈοΈ), 13Patch-For-Review: Accept unconsumed TOTP tokens from the T-1, T+0, and T+1 windows - https://phabricator.wikimedia.org/T393651#10808533 (10dancy) 05Openβ†’03In progress p:05Triageβ†’03Low a:03dancy [20:25:55] 10Beta-Cluster-Infrastructure, 06Traffic: Add allowlist to make poking holes in abuse_networks:blocked_nets:networks easier - https://phabricator.wikimedia.org/T393481#10808600 (10bd808) `lang=irc [21:25:31] Before I waste energy with a poor implementation, could some of you fine folks look at my idea... [21:02:27] (03update) 10addshore: Draft: Rewrite (maybe version 1)? [repos/releng/cli] - 10https://gitlab.wikimedia.org/repos/releng/cli/-/merge_requests/628 [21:04:45] 10Beta-Cluster-Infrastructure, 06Traffic: Add allowlist to make poking holes in abuse_networks:blocked_nets:networks easier - https://phabricator.wikimedia.org/T393481#10808662 (10bd808) The `wikimedia_nets` acl mentioned by @Vgutierrez is an interesting option. The current code creating that acl includes a se... [21:26:06] (03open) 10swfrench: Draft: Allow deployments to specify custom k8s clusters [repos/releng/scap] - 10https://gitlab.wikimedia.org/repos/releng/scap/-/merge_requests/795 (https://phabricator.wikimedia.org/T388761) [21:45:58] 06Release-Engineering-Team, 10Scap, 10Dumps-Generation, 13Patch-For-Review: scap needs to be k8s-cluster aware - https://phabricator.wikimedia.org/T388761#10808757 (10Scott_French) Finally had a chance to polish my MR a bit and post it today (draft). I'll take one more look on Monday before sending it for... [21:46:37] 10MediaWiki-Releasing, 10MediaWiki-Docker, 05MW-1.44-notes, 10MW-1.45-notes (1.45.0-wmf.1; 2025-05-13): Remove docker-compose.yml from MediaWiki archive releases - https://phabricator.wikimedia.org/T393183#10808759 (10Douginamug) @Jdforrester-WMF I realise now that this change reversed your last commit... [22:34:36] (03update) 10brennen: SpiderPig log view [repos/releng/scap] - 10https://gitlab.wikimedia.org/repos/releng/scap/-/merge_requests/767 (https://phabricator.wikimedia.org/T391005)