[01:21:28] FIRING: CloudVPSDesignateLeaks: Detected 4 stray dns records - https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/Designate_record_leaks - https://grafana.wikimedia.org/d/ebJoA6VWz/wmcs-openstack-eqiad-nova-fullstack - https://alerts.wikimedia.org/?q=alertname%3DCloudVPSDesignateLeaks [02:07:20] FIRING: PuppetZeroResources: Puppet has failed generate resources on cloudweb2002-dev:9100 - https://puppetboard.wikimedia.org/nodes?status=failed - https://grafana.wikimedia.org/d/yOxVDGvWk/puppet - https://alerts.wikimedia.org/?q=alertname%3DPuppetZeroResources [04:25:40] 10wikitech.wikimedia.org: ☂ Wikitech account linking and SUL error reporting - https://phabricator.wikimedia.org/T376267#10232376 (10CanonNi) |**Wikitech account/LDAP:**| CanonNi| |**SUL account**| CanonNi| |**Account linked on [[ https://idm.wikimedia.org/ | IDM ]]** |Y| |**I have visited [[ https://wikitech.w... [05:21:28] FIRING: CloudVPSDesignateLeaks: Detected 4 stray dns records - https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/Designate_record_leaks - https://grafana.wikimedia.org/d/ebJoA6VWz/wmcs-openstack-eqiad-nova-fullstack - https://alerts.wikimedia.org/?q=alertname%3DCloudVPSDesignateLeaks [06:07:20] FIRING: PuppetZeroResources: Puppet has failed generate resources on cloudweb2002-dev:9100 - https://puppetboard.wikimedia.org/nodes?status=failed - https://grafana.wikimedia.org/d/yOxVDGvWk/puppet - https://alerts.wikimedia.org/?q=alertname%3DPuppetZeroResources [07:59:52] 06cloud-services-team, 10Cloud-VPS: openstack: clarify IPv6 firewalling - https://phabricator.wikimedia.org/T374714#10232602 (10aborrero) >>! In T374714#10228685, @aborrero wrote: > problem detected: `remote_group_name` parameter in tofu-infra security group rules is not getting resolved. fixed with this http... [08:14:14] 06cloud-services-team, 10Toolforge, 06Language and Product Localization: https://cxdebugger.toolforge.org/ has become very slow - https://phabricator.wikimedia.org/T367022#10232622 (10Nikerabbit) [08:52:08] !log sstefanova@cloudcumin1001 toolsbeta START - Cookbook wmcs.toolforge.component.deploy for component jobs-api [08:56:18] 10wikitech.wikimedia.org, 06Trust-and-Safety: Account recovery help needed for Developer account jgiannelos - https://phabricator.wikimedia.org/T377117#10232793 (10Jgiannelos) * I managed to authenticate to gerrit/horizon so that works fine. * I still need 2fa reset for phabricator/gitlab/npm [08:56:22] 10wikitech.wikimedia.org, 06Trust-and-Safety: Account recovery help needed for Developer account jgiannelos - https://phabricator.wikimedia.org/T377117#10232794 (10Jgiannelos) [08:57:57] !log sstefanova@cloudcumin1001 toolsbeta END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component jobs-api [09:00:49] !log sstefanova@cloudcumin1001 tools START - Cookbook wmcs.toolforge.component.deploy for component jobs-api [09:07:17] !log sstefanova@cloudcumin1001 tools END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component jobs-api [09:17:13] !log sstefanova@cloudcumin1001 toolsbeta START - Cookbook wmcs.toolforge.component.deploy for component api-gateway [09:21:28] FIRING: CloudVPSDesignateLeaks: Detected 4 stray dns records - https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/Designate_record_leaks - https://grafana.wikimedia.org/d/ebJoA6VWz/wmcs-openstack-eqiad-nova-fullstack - https://alerts.wikimedia.org/?q=alertname%3DCloudVPSDesignateLeaks [09:21:48] !log sstefanova@cloudcumin1001 toolsbeta END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component api-gateway [09:24:25] !log sstefanova@cloudcumin1001 tools START - Cookbook wmcs.toolforge.component.deploy for component api-gateway [09:31:52] 10wikitech.wikimedia.org, 10Phabricator, 06Trust-and-Safety: Account recovery help needed for Developer account jgiannelos - https://phabricator.wikimedia.org/T377117#10232985 (10Jgiannelos) [09:33:00] 10wikitech.wikimedia.org, 10Phabricator, 06Trust-and-Safety, 10GitLab (Auth & Access): Account recovery help needed for Developer account jgiannelos - https://phabricator.wikimedia.org/T377117#10232988 (10Jgiannelos) [09:37:01] !log sstefanova@cloudcumin1001 tools START - Cookbook wmcs.toolforge.component.deploy for component api-gateway [09:41:45] !log sstefanova@cloudcumin1001 tools END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component api-gateway [09:55:21] 10wikitech.wikimedia.org, 10Phabricator, 06Trust-and-Safety, 10GitLab (Auth & Access): Account recovery help needed for Developer account jgiannelos - https://phabricator.wikimedia.org/T377117#10233048 (10Aklapper) > I still need 2fa reset for phabricator See the Phabricator frontpage linking to https://w... [10:07:20] FIRING: PuppetZeroResources: Puppet has failed generate resources on cloudweb2002-dev:9100 - https://puppetboard.wikimedia.org/nodes?status=failed - https://grafana.wikimedia.org/d/yOxVDGvWk/puppet - https://alerts.wikimedia.org/?q=alertname%3DPuppetZeroResources [10:20:19] 10wikitech.wikimedia.org, 10Phabricator, 06Trust-and-Safety, 10GitLab (Auth & Access): Account recovery help needed for Developer account jgiannelos - https://phabricator.wikimedia.org/T377117#10233098 (10Jgiannelos) >> gitlab > > You may have recovery codes? If not, https://docs.gitlab.com/ee/user/profil... [10:42:26] 10wikitech.wikimedia.org, 10Phabricator, 06Trust-and-Safety, 10GitLab (Auth & Access): Account recovery help needed for Developer account jgiannelos - https://phabricator.wikimedia.org/T377117#10233139 (10Jgiannelos) @Aklapper I found my old 2fa that is already registered in my phabricator (i have 2 regist... [11:52:38] 10wikitech.wikimedia.org, 10Phabricator, 06Trust-and-Safety, 10GitLab (Auth & Access): Account recovery help needed for Developer account jgiannelos - https://phabricator.wikimedia.org/T377117#10233259 (10Aklapper) @Jgiannelos: Not sure I can follow; you could check if https://phabricator.wikimedia.org/set... [13:21:28] FIRING: CloudVPSDesignateLeaks: Detected 4 stray dns records - https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/Designate_record_leaks - https://grafana.wikimedia.org/d/ebJoA6VWz/wmcs-openstack-eqiad-nova-fullstack - https://alerts.wikimedia.org/?q=alertname%3DCloudVPSDesignateLeaks [14:07:20] FIRING: PuppetZeroResources: Puppet has failed generate resources on cloudweb2002-dev:9100 - https://puppetboard.wikimedia.org/nodes?status=failed - https://grafana.wikimedia.org/d/yOxVDGvWk/puppet - https://alerts.wikimedia.org/?q=alertname%3DPuppetZeroResources [14:39:43] !log aborrero@cloudcumin1001 admin START - Cookbook wmcs.openstack.tofu running tofu plan+apply for main branch [14:40:52] !log aborrero@cloudcumin1001 admin END (PASS) - Cookbook wmcs.openstack.tofu (exit_code=0) running tofu plan+apply for main branch [14:53:28] 06cloud-services-team, 10Cloud-VPS, 06Infrastructure-Foundations, 10netops, 06SRE: cloudgw: add support and enable IPv6 - https://phabricator.wikimedia.org/T374716#10233918 (10aborrero) 05Open→03Resolved We got it all working on 2024-10-11. [14:54:29] 10cloud-services-team (Hardware), 06DC-Ops, 10ops-eqiad, 06SRE: cloudgw1002: network interface problem - https://phabricator.wikimedia.org/T376589#10233943 (10Jclark-ctr) Firmware applied for nic and bios [14:56:47] FIRING: NodeDown: The node cloudgw1002 is unreachable. - https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/NodeDown - https://grafana.wikimedia.org/d/000000377/host-overview?orgId=1&var-server=cloudgw1002 - https://alerts.wikimedia.org/?q=alertname%3DNodeDown [14:57:47] 06cloud-services-team, 10Cloud-VPS: horizon: enable IPv6 security group panels - https://phabricator.wikimedia.org/T377339 (10aborrero) 03NEW [15:01:47] RESOLVED: NodeDown: The node cloudgw1002 is unreachable. - https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/NodeDown - https://grafana.wikimedia.org/d/000000377/host-overview?orgId=1&var-server=cloudgw1002 - https://alerts.wikimedia.org/?q=alertname%3DNodeDown [15:02:14] FIRING: Kernel err priority: Server cloudgw1002 may have kernel errors - https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/Kernel_panic - https://grafana.wikimedia.org/d/b013af4c-d405-4d9f-85d4-985abb3dec0c/wmcs-kernel-panic-detector?orgId=1&var-instance=cloudgw1002 - https://alerts.wikimedia.org/?q=alertname%3DKernel+err+priority [15:04:43] 06cloud-services-team, 10Cloud-VPS: openstack: clarify IPv6 firewalling - https://phabricator.wikimedia.org/T374714#10233969 (10aborrero) 05In progress→03Resolved For now, the semantics are: * the default neutron security group in each project will allow: all egress IPv6 traffic, inbound IPv6 traffic... [15:04:46] 06cloud-services-team, 10Cloud-VPS: horizon: enable IPv6 security group panels - https://phabricator.wikimedia.org/T377339#10233998 (10aborrero) p:05Triage→03Medium [15:09:50] 06cloud-services-team, 10Cloud-VPS, 06Infrastructure-Foundations, 10netops, 06SRE: CloudVPS: IPv6 in codfw1dev - https://phabricator.wikimedia.org/T245495#10234047 (10aborrero) [15:12:18] 10cloud-services-team (FY2024/2025-Q1-Q2), 10Cloud-VPS: openstack: develop a script to migrate a VM instance from the old network setting (vlan) to the new (vxlan, IPv6) - https://phabricator.wikimedia.org/T377346 (10aborrero) 03NEW [15:12:56] 10cloud-services-team (FY2024/2025-Q1-Q2), 10Cloud-VPS: openstack: develop a script to migrate a VM instance from the old network setting (vlan) to the new (vxlan, IPv6) - https://phabricator.wikimedia.org/T377346#10234085 (10aborrero) 05Open→03In progress p:05Triage→03Medium [15:32:14] RESOLVED: Kernel err priority: Server cloudgw1002 may have kernel errors - https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/Kernel_panic - https://grafana.wikimedia.org/d/b013af4c-d405-4d9f-85d4-985abb3dec0c/wmcs-kernel-panic-detector?orgId=1&var-instance=cloudgw1002 - https://alerts.wikimedia.org/?q=alertname%3DKernel+err+priority [15:43:52] 10Quarry: [bug] Quarry queries are stopped - https://phabricator.wikimedia.org/T377010#10234228 (10Prototyperspective) Seems like much less or no issues now. In any case, please add some info when queries are stopped. [15:56:04] 06cloud-services-team, 10Cloud-VPS, 06Infrastructure-Foundations, 10netops, 06SRE: dns: integrate PTR support for 2a02:ec80:a100::/48 - https://phabricator.wikimedia.org/T376462#10234300 (10cmooney) [15:56:08] 06cloud-services-team, 10Cloud-VPS, 06Infrastructure-Foundations, 10netops, 06SRE: openstack: work out IPv6 and designate integration - https://phabricator.wikimedia.org/T374715#10234301 (10cmooney) [15:57:53] 06cloud-services-team, 10wikitech.wikimedia.org, 06Trust-and-Safety: Account recovery help needed for MediaWiki account JMando (WMF) - https://phabricator.wikimedia.org/T376819#10234308 (10JLam-WMF) Thanks, the user was able to access their developer account using the provided link. However, now they have an... [15:59:01] (03PS1) 10Arturo Borrero Gonzalez: wmcs.openstack.migrate_server_to_vxlan_and_ipv6: introduce cookbook [cloud/wmcs-cookbooks] - 10https://gerrit.wikimedia.org/r/1080755 (https://phabricator.wikimedia.org/T377346) [16:04:38] (03CR) 10CI reject: [V:04-1] wmcs.openstack.migrate_server_to_vxlan_and_ipv6: introduce cookbook [cloud/wmcs-cookbooks] - 10https://gerrit.wikimedia.org/r/1080755 (https://phabricator.wikimedia.org/T377346) (owner: 10Arturo Borrero Gonzalez) [16:16:46] 06cloud-services-team, 10wikitech.wikimedia.org, 06Trust-and-Safety: Account recovery help needed for MediaWiki account JMando (WMF) - https://phabricator.wikimedia.org/T376819#10234375 (10Aklapper) Re Phab: See https://www.mediawiki.org/wiki/Phabricator/Help/Two-factor_Authentication_Resets - ideally this w... [17:21:28] FIRING: CloudVPSDesignateLeaks: Detected 4 stray dns records - https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/Designate_record_leaks - https://grafana.wikimedia.org/d/ebJoA6VWz/wmcs-openstack-eqiad-nova-fullstack - https://alerts.wikimedia.org/?q=alertname%3DCloudVPSDesignateLeaks [18:07:20] FIRING: PuppetZeroResources: Puppet has failed generate resources on cloudweb2002-dev:9100 - https://puppetboard.wikimedia.org/nodes?status=failed - https://grafana.wikimedia.org/d/yOxVDGvWk/puppet - https://alerts.wikimedia.org/?q=alertname%3DPuppetZeroResources [19:51:10] 10wikitech.wikimedia.org: ☂ Wikitech account linking and SUL error reporting - https://phabricator.wikimedia.org/T376267#10235546 (10Ladsgroup) @CanonNi I can't find your user in wikitech. Are you sure you have a user there? [19:52:13] 10wikitech.wikimedia.org: ☂ Wikitech account linking and SUL error reporting - https://phabricator.wikimedia.org/T376267#10235547 (10Ladsgroup) @Jc3s5h I can try to force a password reset email and you let me know if it worked. Does that work for you? [19:54:20] 10VPS-project-Wikistats: Add bclwikisource to wikistats - https://phabricator.wikimedia.org/T377092#10235552 (10Dzahn) 05Open→03Resolved ` MariaDB [wikistats]> insert into wikisources (prefix, lang, loclang, method) select prefix,lang,loclang,method from wikipedias whe re prefix="bcl"; ... dzahn@wikist... [19:54:22] 10wikitech.wikimedia.org: ☂ Wikitech account linking and SUL error reporting - https://phabricator.wikimedia.org/T376267#10235555 (10Ladsgroup) @Dominic3203 I forced a reset password on the email address connected to your wikitech account. [19:55:44] 10wikitech.wikimedia.org: ☂ Wikitech account linking and SUL error reporting - https://phabricator.wikimedia.org/T376267#10235558 (10Ladsgroup) @Robertsky You have no email connected to your wikitech account. I can set it for you if you can prove the account belongs to you (edit in a SUL wiki and wikitech to pr... [19:56:16] 10VPS-project-Wikistats: Add annwiki to wikistats - https://phabricator.wikimedia.org/T377163#10235559 (10Dzahn) I see you manually created this task. (thanks!) Does it mean the bot did not do it this time? This happened sometimes in the past, but not every time. No idea what changes there. Regardless if a hum... [19:59:39] 10VPS-project-Wikistats: Add annwiki to wikistats - https://phabricator.wikimedia.org/T377163#10235574 (10Dzahn) 05Open→03Resolved ` MariaDB [wikistats]> insert into wikipedias (prefix, lang, loclang, method) values ("ann","Obolo", "Obolo", 8); ... dzahn@wikistats-bookworm:~$ /usr/lib/wikistats/update.ph... [19:59:45] 10VPS-project-Wikistats: Add ibawiki to wikistats - https://phabricator.wikimedia.org/T376576#10235577 (10Dzahn) 05Open→03Resolved ` MariaDB [wikistats]> insert into wikipedias (prefix, lang, loclang, method) values ("iba","Iban", "Jaku Iban", 8); ... dzahn@wikistats-bookworm:~$ /usr/lib/wikistats/updat... [20:04:05] 10VPS-project-Wikistats: Add tddwiki to wikistats - https://phabricator.wikimedia.org/T375428#10235585 (10Dzahn) 05Open→03Resolved ` MariaDB [wikistats]> insert into wikipedias (prefix, lang, loclang, method) values ("tdd","Tai Nüa", "", 8); ... MariaDB [wikistats]> update wikipedias set loclang="... [20:05:58] 10VPS-project-Wikistats: Add nrwiki to wikistats - https://phabricator.wikimedia.org/T375106#10235589 (10Dzahn) 05Open→03Resolved ` MariaDB [wikistats]> insert into wikipedias (prefix, lang, loclang, method) values ("nr","Southern Ndebele", "isiNdebele seSewula", 8); ... dzahn@wikistats-bookworm:~$ /usr/... [20:08:08] 10VPS-project-Wikistats: Add rskwiki to wikistats - https://phabricator.wikimedia.org/T375021#10235605 (10Dzahn) 05Open→03Resolved ` insert into wikipedias (prefix, lang, loclang, method) values ("rsk","Pannonian Rusyn", "", 8); ... MariaDB [wikistats]> update wikipedias set loclang="руl... [20:20:33] 10VPS-project-Wikistats: Add annwiki to wikistats - https://phabricator.wikimedia.org/T377163#10235665 (10Pppery) See T376332#10226991 [20:30:53] 10VPS-project-Wikistats: Add annwiki to wikistats - https://phabricator.wikimedia.org/T377163#10235728 (10Dzahn) Thanks! ACK. I would like to fix that tree structure some day but the github hosting kind of keeps me away from it. [20:32:10] 10VPS-project-Wikistats: Add annwiki to wikistats - https://phabricator.wikimedia.org/T377163#10235735 (10Pppery) Maintenance bot's source code is on GitLab now: https://gitlab.wikimedia.org/ladsgroup/Phabricator-maintenance-bot/ [20:38:15] 06cloud-services-team, 10wikitech.wikimedia.org, 06Trust-and-Safety: Account recovery help needed for MediaWiki account JMando (WMF) - https://phabricator.wikimedia.org/T376819#10235748 (10JLam-WMF) Hi all, Greg Grossmeier just informed us that he took care of this on a call with Joseph earlier today. Thanks! [20:39:48] 06cloud-services-team, 10wikitech.wikimedia.org, 06Trust-and-Safety: Account recovery help needed for MediaWiki account JMando (WMF) - https://phabricator.wikimedia.org/T376819#10235750 (10Aklapper) 05Open→03Resolved a:03greg Thanks a lot, appreciated! [20:40:31] 06cloud-services-team, 10wikitech.wikimedia.org, 06Trust-and-Safety: Account recovery help needed for MediaWiki account JMando (WMF) - https://phabricator.wikimedia.org/T376819#10235758 (10greg) https://sal.toolforge.org/log/hMRclpIBKFqumxvt5dGb :) [20:49:14] 10wikitech.wikimedia.org, 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog, 10MediaWiki-extensions-CentralNotice: Wikitech showing Wikipedia CentralNotice banners - https://phabricator.wikimedia.org/T377030#10235804 (10Ejegg) Hi @Pcoombe, I just got a settings patch deployed to add wikitech as a sepa... [20:51:03] FIRING: ToolforgeKubernetesWorkerTooManyDProcesses: Node tools-k8s-worker-nfs-27 has at least 12 procs in D state, and may be having NFS/IO issues - https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Runbooks/ToolforgeKubernetesWorkerTooManyDProcesses - https://grafana.wmcloud.org/d/3jhWxB8Vk/toolforge-general-overview - https://prometheus-alerts.wmcloud.org/?q=alertname%3DToolforgeKubernetesWorkerTooManyDProcesses [20:54:19] 10VPS-project-Wikistats: Add annwiki to wikistats - https://phabricator.wikimedia.org/T377163#10235811 (10Dzahn) ah, cool! thank you:) [21:03:19] 10Tool-video-answer-tool, 06Future-Audiences, 07Epic: [Epic] Video tool refinements - https://phabricator.wikimedia.org/T377392 (10Maryana) 03NEW [21:06:03] RESOLVED: ToolforgeKubernetesWorkerTooManyDProcesses: Node tools-k8s-worker-nfs-27 has at least 12 procs in D state, and may be having NFS/IO issues - https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Runbooks/ToolforgeKubernetesWorkerTooManyDProcesses - https://grafana.wmcloud.org/d/3jhWxB8Vk/toolforge-general-overview - https://prometheus-alerts.wmcloud.org/?q=alertname%3DToolforgeKubernetesWorkerTooManyDProcesses [21:06:31] 10Tool-video-answer-tool, 06Future-Audiences, 07Spike: Image layout adjustment for lower-res images - https://phabricator.wikimedia.org/T375690#10235881 (10Maryana) [21:06:32] 10Tool-video-answer-tool, 06Future-Audiences, 07Epic: [Epic] Video tool refinements - https://phabricator.wikimedia.org/T377392#10235880 (10Maryana) [21:07:45] 10Tool-video-answer-tool, 06Future-Audiences, 07Epic: [Epic] Video tool refinements - https://phabricator.wikimedia.org/T377392#10235882 (10Maryana) [21:07:45] 10Tool-video-answer-tool, 06Future-Audiences, 07Spike: Investigate On This Day datasets available - https://phabricator.wikimedia.org/T375733#10235883 (10Maryana) [21:08:21] 10Tool-video-answer-tool, 06Future-Audiences, 07Epic: [Epic] Video tool refinements - https://phabricator.wikimedia.org/T377392#10235886 (10Maryana) [21:08:22] 10Tool-video-answer-tool, 06Future-Audiences: Update DYK dataset to include info on which also reached GA or FA - https://phabricator.wikimedia.org/T375731#10235887 (10Maryana) [21:10:11] 10Tool-video-answer-tool, 06Future-Audiences, 07Epic: [Epic] Video tool refinements - https://phabricator.wikimedia.org/T377392#10235891 (10Maryana) [21:10:57] 10Tool-video-answer-tool, 06Future-Audiences, 07Epic: [Epic] Video tool refinements - https://phabricator.wikimedia.org/T377392#10235893 (10Maryana) [21:11:28] 10Tool-video-answer-tool, 06Future-Audiences: Display true 1920x1080 video resolution for the video tool - https://phabricator.wikimedia.org/T375296#10235895 (10Maryana) [21:21:28] FIRING: CloudVPSDesignateLeaks: Detected 4 stray dns records - https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/Designate_record_leaks - https://grafana.wikimedia.org/d/ebJoA6VWz/wmcs-openstack-eqiad-nova-fullstack - https://alerts.wikimedia.org/?q=alertname%3DCloudVPSDesignateLeaks [22:07:20] FIRING: PuppetZeroResources: Puppet has failed generate resources on cloudweb2002-dev:9100 - https://puppetboard.wikimedia.org/nodes?status=failed - https://grafana.wikimedia.org/d/yOxVDGvWk/puppet - https://alerts.wikimedia.org/?q=alertname%3DPuppetZeroResources [22:47:34] FIRING: PuppetCertificateAboutToExpire: Puppet CA certificate mwv-builder-03.mediawiki-vagrant.eqiad.wmflabs is about to expire in 8d 23h 58m 34s - https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/PuppetCertificateAboutToExpire - https://prometheus-alerts.wmcloud.org/?q=alertname%3DPuppetCertificateAboutToExpire [23:00:17] (03PS1) 10Brian Wolff: SECURITY: Escape slashes in json to prevent XSS. [labs/codesearch] - 10https://gerrit.wikimedia.org/r/1080829 (https://phabricator.wikimedia.org/T377168) [23:01:48] (03CR) 10Ladsgroup: [C:03+2] "Already deployed in production" [labs/codesearch] - 10https://gerrit.wikimedia.org/r/1080829 (https://phabricator.wikimedia.org/T377168) (owner: 10Brian Wolff) [23:02:42] (03Merged) 10jenkins-bot: SECURITY: Escape slashes in json to prevent XSS. [labs/codesearch] - 10https://gerrit.wikimedia.org/r/1080829 (https://phabricator.wikimedia.org/T377168) (owner: 10Brian Wolff) [23:14:47] 10Tool-ldap, 10Phabricator: https://ldap.toolforge.org/ integration assumes that `cn` and `uid` are equivalent - https://phabricator.wikimedia.org/T376769#10236212 (10Legoktm) Thanks, just deployed: https://gitlab.wikimedia.org/toolforge-repos/ldap/-/commit/7b5baa2b2f25f2ba2e88070bff8319fb20a062f4 So now: `... [23:39:18] (03PS1) 10Brian Wolff: Use a CSP policy to reduce risk of XSS [labs/codesearch] - 10https://gerrit.wikimedia.org/r/1080836 (https://phabricator.wikimedia.org/T377168)