[01:27:10] 10cloud-services-team (FY2024/2025-Q1-Q2), 10Cloud-VPS (Quota-requests): Subdomain for catalyst-dev project - https://phabricator.wikimedia.org/T381508#10385472 (10jeena) I set the hostname to `*` and tried to create a web proxy but I kept getting a 500 response back. Maybe I missed a step? [01:50:41] FIRING: CloudVPSDesignateLeaks: Detected 1 stray dns records - https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/Designate_record_leaks - https://grafana.wikimedia.org/d/ebJoA6VWz/wmcs-openstack-eqiad-nova-fullstack - https://alerts.wikimedia.org/?q=alertname%3DCloudVPSDesignateLeaks [02:00:41] RESOLVED: CloudVPSDesignateLeaks: Detected 1 stray dns records - https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/Designate_record_leaks - https://grafana.wikimedia.org/d/ebJoA6VWz/wmcs-openstack-eqiad-nova-fullstack - https://alerts.wikimedia.org/?q=alertname%3DCloudVPSDesignateLeaks [05:50:41] FIRING: CloudVPSDesignateLeaks: Detected 1 stray dns records - https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/Designate_record_leaks - https://grafana.wikimedia.org/d/ebJoA6VWz/wmcs-openstack-eqiad-nova-fullstack - https://alerts.wikimedia.org/?q=alertname%3DCloudVPSDesignateLeaks [06:00:41] RESOLVED: CloudVPSDesignateLeaks: Detected 1 stray dns records - https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/Designate_record_leaks - https://grafana.wikimedia.org/d/ebJoA6VWz/wmcs-openstack-eqiad-nova-fullstack - https://alerts.wikimedia.org/?q=alertname%3DCloudVPSDesignateLeaks [07:04:28] FIRING: [2x] PuppetAgentNoResources: No Puppet resources found on instance runner-1025 on project gitlab-runners - https://prometheus-alerts.wmcloud.org/?q=alertname%3DPuppetAgentNoResources [07:14:28] FIRING: [3x] PuppetAgentNoResources: No Puppet resources found on instance runner-1021 on project gitlab-runners - https://prometheus-alerts.wmcloud.org/?q=alertname%3DPuppetAgentNoResources [07:15:38] (03update) 10sstefanova: poetry: Autoupdate [repos/cloud/toolforge/envvars-cli] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/envvars-cli/-/merge_requests/71 (owner: 10group_203_bot_4866fc124f4b41659f667468a6115cf3) [07:15:39] (03approved) 10sstefanova: poetry: Autoupdate [repos/cloud/toolforge/envvars-cli] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/envvars-cli/-/merge_requests/71 (owner: 10group_203_bot_4866fc124f4b41659f667468a6115cf3) [07:15:41] (03merge) 10sstefanova: poetry: Autoupdate [repos/cloud/toolforge/envvars-cli] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/envvars-cli/-/merge_requests/71 (owner: 10group_203_bot_4866fc124f4b41659f667468a6115cf3) [07:16:08] (03update) 10sstefanova: poetry: Autoupdate [repos/cloud/toolforge/builds-cli] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/builds-cli/-/merge_requests/96 (owner: 10group_203_bot_4866fc124f4b41659f667468a6115cf3) [07:17:06] (03update) 10sstefanova: poetry: Autoupdate [repos/cloud/toolforge/jobs-emailer] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/jobs-emailer/-/merge_requests/12 (owner: 10group_203_bot_4866fc124f4b41659f667468a6115cf3) [07:17:08] (03update) 10sstefanova: poetry: Autoupdate [repos/cloud/toolforge/jobs-emailer] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/jobs-emailer/-/merge_requests/12 (owner: 10group_203_bot_4866fc124f4b41659f667468a6115cf3) [07:17:28] FIRING: PuppetAgentNoResources: No Puppet resources found on instance cloudinfra-db03 on project cloudinfra - https://prometheus-alerts.wmcloud.org/?q=alertname%3DPuppetAgentNoResources [07:18:28] FIRING: PuppetAgentNoResources: No Puppet resources found on instance metricsinfra-prometheus-2 on project metricsinfra - https://prometheus-alerts.wmcloud.org/?q=alertname%3DPuppetAgentNoResources [07:19:28] FIRING: [4x] PuppetAgentNoResources: No Puppet resources found on instance runner-1021 on project gitlab-runners - https://prometheus-alerts.wmcloud.org/?q=alertname%3DPuppetAgentNoResources [07:24:28] FIRING: [5x] PuppetAgentNoResources: No Puppet resources found on instance runner-1021 on project gitlab-runners - https://prometheus-alerts.wmcloud.org/?q=alertname%3DPuppetAgentNoResources [07:24:56] (03approved) 10sstefanova: poetry: Autoupdate [repos/cloud/toolforge/builds-cli] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/builds-cli/-/merge_requests/96 (owner: 10group_203_bot_4866fc124f4b41659f667468a6115cf3) [07:24:59] (03merge) 10sstefanova: poetry: Autoupdate [repos/cloud/toolforge/builds-cli] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/builds-cli/-/merge_requests/96 (owner: 10group_203_bot_4866fc124f4b41659f667468a6115cf3) [07:33:28] FIRING: [2x] PuppetAgentNoResources: No Puppet resources found on instance metricsinfra-prometheus-2 on project metricsinfra - https://prometheus-alerts.wmcloud.org/?q=alertname%3DPuppetAgentNoResources [07:35:47] (03approved) 10sstefanova: poetry: Autoupdate [repos/cloud/toolforge/jobs-emailer] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/jobs-emailer/-/merge_requests/12 (owner: 10group_203_bot_4866fc124f4b41659f667468a6115cf3) [07:35:51] (03merge) 10sstefanova: poetry: Autoupdate [repos/cloud/toolforge/jobs-emailer] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/jobs-emailer/-/merge_requests/12 (owner: 10group_203_bot_4866fc124f4b41659f667468a6115cf3) [07:38:02] (03open) 10group_203_bot_4866fc124f4b41659f667468a6115cf3: jobs-emailer: bump to 0.0.46-20241206073602-b68935a3 [repos/cloud/toolforge/toolforge-deploy] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/644 [07:39:28] FIRING: [6x] PuppetAgentNoResources: No Puppet resources found on instance runner-1021 on project gitlab-runners - https://prometheus-alerts.wmcloud.org/?q=alertname%3DPuppetAgentNoResources [07:40:40] !log sstefanova@cloudcumin1001 toolsbeta START - Cookbook wmcs.toolforge.component.deploy for component jobs-emailer [07:40:49] (03update) 10sstefanova: jobs-emailer: bump to 0.0.46-20241206073602-b68935a3 [repos/cloud/toolforge/toolforge-deploy] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/644 (owner: 10group_203_bot_4866fc124f4b41659f667468a6115cf3) [07:42:33] 06cloud-services-team, 10Cloud-VPS, 06Infrastructure-Foundations, 10Puppet-Core: Facter 4 upgrade removed 'mountpoints' fact, breaking cinderutils::ensure - https://phabricator.wikimedia.org/T381639 (10taavi) 03NEW [07:42:38] 06cloud-services-team, 10Cloud-VPS, 06Infrastructure-Foundations, 10Puppet-Core: Facter 4 upgrade removed 'mountpoints' fact, breaking cinderutils::ensure - https://phabricator.wikimedia.org/T381639#10385692 (10taavi) [07:43:33] !log sstefanova@cloudcumin1001 toolsbeta END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component jobs-emailer [07:43:43] !log sstefanova@cloudcumin1001 toolsbeta START - Cookbook wmcs.toolforge.component.deploy for component jobs-emailer [07:44:14] 06cloud-services-team, 10Cloud-VPS, 06Infrastructure-Foundations, 10Puppet-Core: Facter 4 upgrade removed 'mountpoints' fact, breaking cinderutils::ensure - https://phabricator.wikimedia.org/T381639#10385694 (10taavi) [07:44:28] FIRING: [7x] PuppetAgentNoResources: No Puppet resources found on instance runner-1021 on project gitlab-runners - https://prometheus-alerts.wmcloud.org/?q=alertname%3DPuppetAgentNoResources [07:45:51] 06cloud-services-team, 10Cloud-VPS, 06Infrastructure-Foundations, 10Puppet-Core: Facter 4 upgrade removed 'mountpoints' fact, breaking cinderutils::ensure - https://phabricator.wikimedia.org/T381639#10385695 (10taavi) [07:47:28] FIRING: [2x] PuppetAgentNoResources: No Puppet resources found on instance cloudinfra-db03 on project cloudinfra - https://prometheus-alerts.wmcloud.org/?q=alertname%3DPuppetAgentNoResources [07:49:00] !log sstefanova@cloudcumin1001 toolsbeta END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component jobs-emailer [07:49:28] FIRING: [9x] PuppetAgentNoResources: No Puppet resources found on instance runner-1021 on project gitlab-runners - https://prometheus-alerts.wmcloud.org/?q=alertname%3DPuppetAgentNoResources [07:49:41] !log sstefanova@cloudcumin1001 tools START - Cookbook wmcs.toolforge.component.deploy for component jobs-emailer [07:50:41] FIRING: CloudVPSDesignateLeaks: Detected 1 stray dns records - https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/Designate_record_leaks - https://grafana.wikimedia.org/d/ebJoA6VWz/wmcs-openstack-eqiad-nova-fullstack - https://alerts.wikimedia.org/?q=alertname%3DCloudVPSDesignateLeaks [07:53:28] FIRING: PuppetAgentNoResources: No Puppet resources found on instance proxy-04 on project project-proxy - https://prometheus-alerts.wmcloud.org/?q=alertname%3DPuppetAgentNoResources [07:56:52] !log sstefanova@cloudcumin1001 tools END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component jobs-emailer [07:57:14] (03approved) 10sstefanova: jobs-emailer: bump to 0.0.46-20241206073602-b68935a3 [repos/cloud/toolforge/toolforge-deploy] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/644 (owner: 10group_203_bot_4866fc124f4b41659f667468a6115cf3) [07:57:17] (03merge) 10sstefanova: jobs-emailer: bump to 0.0.46-20241206073602-b68935a3 [repos/cloud/toolforge/toolforge-deploy] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/644 (owner: 10group_203_bot_4866fc124f4b41659f667468a6115cf3) [08:00:41] RESOLVED: CloudVPSDesignateLeaks: Detected 1 stray dns records - https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/Designate_record_leaks - https://grafana.wikimedia.org/d/ebJoA6VWz/wmcs-openstack-eqiad-nova-fullstack - https://alerts.wikimedia.org/?q=alertname%3DCloudVPSDesignateLeaks [08:02:55] (03update) 10sstefanova: metrics: add prometheus instrumentation [repos/cloud/toolforge/components-api] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/components-api/-/merge_requests/46 (https://phabricator.wikimedia.org/T381249) [08:04:28] FIRING: [10x] PuppetAgentNoResources: No Puppet resources found on instance runner-1021 on project gitlab-runners - https://prometheus-alerts.wmcloud.org/?q=alertname%3DPuppetAgentNoResources [08:08:28] FIRING: [2x] PuppetAgentNoResources: No Puppet resources found on instance proxy-03 on project project-proxy - https://prometheus-alerts.wmcloud.org/?q=alertname%3DPuppetAgentNoResources [08:22:00] 14cloud-services-team (Kanban), 10Toolforge: Toolforge jobs framework: email maintainers on job failure - https://phabricator.wikimedia.org/T286135#10385723 (10JJMC89) [08:35:37] 06cloud-services-team, 10Cloud-VPS, 06Infrastructure-Foundations, 10Puppet-Core: Facter 4 upgrade removed 'mountpoints' fact, breaking cinderutils::ensure - https://phabricator.wikimedia.org/T381639#10385751 (10MoritzMuehlenhoff) I've just uploaded ruby-sys-filesystem 1.4.3-1~wmf11u1 to component/puppet7,... [08:37:10] 14cloud-services-team (Kanban), 10Toolforge: jstart - TypeError: memoryview: str object does not have the buffer interface - https://phabricator.wikimedia.org/T177614#10385753 (10JJMC89) [08:38:13] 06cloud-services-team, 10Cloud-VPS, 06Infrastructure-Foundations, 10Puppet-Core: Facter 4 upgrade removed 'mountpoints' fact, breaking cinderutils::ensure - https://phabricator.wikimedia.org/T381639#10385754 (10MoritzMuehlenhoff) facter 3 was written in C++ and the file system parsing is handled natively i... [09:14:02] 06cloud-services-team, 10Cloud-VPS, 06Infrastructure-Foundations, 10Puppet-Core: Facter 4 upgrade removed 'mountpoints' fact, breaking cinderutils::ensure - https://phabricator.wikimedia.org/T381639#10385842 (10taavi) [09:14:08] 06cloud-services-team, 10Cloud-VPS, 06Infrastructure-Foundations, 10Puppet-Core: Facter 4 upgrade removed 'mountpoints' fact, breaking cinderutils::ensure - https://phabricator.wikimedia.org/T381639#10385844 (10taavi) [09:17:53] 06cloud-services-team, 10Cloud-VPS, 06Infrastructure-Foundations, 10Puppet-Core: Facter 4 upgrade removed 'mountpoints' fact, breaking cinderutils::ensure - https://phabricator.wikimedia.org/T381639#10385862 (10taavi) Can a dependency be added to the `facter` package? That would avoid having to manually in... [09:23:28] FIRING: [2x] PuppetAgentNoResources: No Puppet resources found on instance proxy-03 on project project-proxy - https://prometheus-alerts.wmcloud.org/?q=alertname%3DPuppetAgentNoResources [09:32:28] FIRING: [2x] PuppetAgentNoResources: No Puppet resources found on instance cloudinfra-db03 on project cloudinfra - https://prometheus-alerts.wmcloud.org/?q=alertname%3DPuppetAgentNoResources [09:33:28] FIRING: [2x] PuppetAgentNoResources: No Puppet resources found on instance metricsinfra-prometheus-2 on project metricsinfra - https://prometheus-alerts.wmcloud.org/?q=alertname%3DPuppetAgentNoResources [09:37:28] RESOLVED: [2x] PuppetAgentNoResources: No Puppet resources found on instance cloudinfra-db03 on project cloudinfra - https://prometheus-alerts.wmcloud.org/?q=alertname%3DPuppetAgentNoResources [09:43:28] RESOLVED: PuppetAgentNoResources: No Puppet resources found on instance proxy-04 on project project-proxy - https://prometheus-alerts.wmcloud.org/?q=alertname%3DPuppetAgentNoResources [09:48:28] RESOLVED: [2x] PuppetAgentNoResources: No Puppet resources found on instance metricsinfra-prometheus-2 on project metricsinfra - https://prometheus-alerts.wmcloud.org/?q=alertname%3DPuppetAgentNoResources [10:39:36] 06cloud-services-team, 10Toolforge (Toolforge iteration 16), 13Patch-For-Review: [maintain-harbor] Move to become a toolforge component - https://phabricator.wikimedia.org/T358225#10385987 (10Raymond_Ndibe) 05In progress→03Resolved [11:10:41] 06cloud-services-team, 10Toolforge, 07Documentation: Update maintain-harbor documentation after move from a tool to a component - https://phabricator.wikimedia.org/T381650 (10taavi) 03NEW [11:15:52] (03update) 10sstefanova: cli: Improve deploy-token command UX and safety [repos/cloud/toolforge/components-cli] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/components-cli/-/merge_requests/6 (https://phabricator.wikimedia.org/T380706) [11:16:16] (03update) 10sstefanova: cli: Improve deploy-token command UX and safety [repos/cloud/toolforge/components-cli] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/components-cli/-/merge_requests/6 (https://phabricator.wikimedia.org/T380706) [12:13:57] 10cloud-services-team (FY2024/2025-Q1-Q2), 10Cloud-VPS (Quota-requests): Subdomain for catalyst-dev project - https://phabricator.wikimedia.org/T381508#10386255 (10fnegri) I can reproduce the issue but I'm not sure where the problem is. :/ [12:49:41] FIRING: CloudVPSDesignateLeaks: Detected 1 stray dns records - https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/Designate_record_leaks - https://grafana.wikimedia.org/d/ebJoA6VWz/wmcs-openstack-eqiad-nova-fullstack - https://alerts.wikimedia.org/?q=alertname%3DCloudVPSDesignateLeaks [13:04:41] RESOLVED: CloudVPSDesignateLeaks: Detected 1 stray dns records - https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/Designate_record_leaks - https://grafana.wikimedia.org/d/ebJoA6VWz/wmcs-openstack-eqiad-nova-fullstack - https://alerts.wikimedia.org/?q=alertname%3DCloudVPSDesignateLeaks [13:33:29] 10wikitech.wikimedia.org: ☂ Wikitech account linking and SUL error reporting - https://phabricator.wikimedia.org/T376267#10386490 (10Ladsgroup) Can you try the password reset please? [14:58:12] 06cloud-services-team, 10Cloud-VPS, 06Infrastructure-Foundations, 10Puppet-Core: Facter 4 upgrade removed 'mountpoints' fact, breaking cinderutils::ensure - https://phabricator.wikimedia.org/T381639#10386682 (10jhathaway) @taavi sorry about the breakage, I'll add a dependency to the package, in addition to... [15:39:47] 10cloud-services-team (FY2024/2025-Q1-Q2), 10Toolforge: Rescue file from Toolforge backup - https://phabricator.wikimedia.org/T381582#10386791 (10fnegri) @-jem- I have restored the file you requested from the oldest backup available (2024-11-28), overwriting the current version with the restored version. For... [15:53:34] 10cloud-services-team (FY2024/2025-Q1-Q2), 10Toolforge: Rescue file from Toolforge backup - https://phabricator.wikimedia.org/T381582#10386836 (10fnegri) 05In progress→03Resolved I documented the procedure I used to restore the file at [[ https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Cinde... [16:38:48] FIRING: PuppetZeroResources: Puppet has failed generate resources on cloudcephosd1007:9100 - https://puppetboard.wikimedia.org/nodes?status=failed - https://grafana.wikimedia.org/d/yOxVDGvWk/puppet - https://alerts.wikimedia.org/?q=alertname%3DPuppetZeroResources [16:48:48] RESOLVED: PuppetZeroResources: Puppet has failed generate resources on cloudcephosd1007:9100 - https://puppetboard.wikimedia.org/nodes?status=failed - https://grafana.wikimedia.org/d/yOxVDGvWk/puppet - https://alerts.wikimedia.org/?q=alertname%3DPuppetZeroResources [16:50:35] 06cloud-services-team, 10Cloud-VPS, 06Infrastructure-Foundations, 10Puppet-Core: Facter 4 upgrade removed 'mountpoints' fact, breaking cinderutils::ensure - https://phabricator.wikimedia.org/T381639#10387081 (10Andrew) Not directly related but likely to suffer fallout from this one way or another: T381293 [17:23:12] !log fnegri@cloudcumin1001 tools START - Cookbook wmcs.vps.remove_instance for instance tools-db-3 (T352206) [17:23:18] T352206: [toolsdb] Upgrade to MariaDB 10.6 - https://phabricator.wikimedia.org/T352206 [17:24:08] !log fnegri@cloudcumin1001 tools END (PASS) - Cookbook wmcs.vps.remove_instance (exit_code=0) for instance tools-db-3 (T352206) [17:25:19] !log fnegri@cloudcumin1001 tools START - Cookbook wmcs.vps.remove_instance for instance tools-db-1 (T352206) [17:26:12] !log fnegri@cloudcumin1001 tools END (PASS) - Cookbook wmcs.vps.remove_instance (exit_code=0) for instance tools-db-1 (T352206) [17:29:51] 06cloud-services-team, 10Toolforge: ToolsDB: simplify volume chain - https://phabricator.wikimedia.org/T335593#10387232 (10fnegri) [17:29:54] 10cloud-services-team (FY2024/2025-Q1-Q2), 10Toolforge (Toolforge iteration 16), 05Goal, 13Patch-For-Review: [toolsdb] Upgrade to MariaDB 10.6 - https://phabricator.wikimedia.org/T352206#10387233 (10fnegri) [17:32:06] 10cloud-services-team (FY2024/2025-Q1-Q2), 10Toolforge: ToolsDB: simplify volume chain - https://phabricator.wikimedia.org/T335593#10387243 (10fnegri) 05Open→03Resolved a:03fnegri After {T352206} I could delete all the following volumes: * tools-db-basevolume1 * tools-db-basesnapshot1 * tools-db-base... [18:07:12] 10Tool-yearinreview, 06Indic MediaWiki Developers UG, 06Indic-TechCom: Year in Review tool doesn't work for Wikidata and Mediawiki - https://phabricator.wikimedia.org/T381681 (10Kuldeepburjbhalaike) 03NEW [18:21:41] FIRING: CloudVPSDesignateLeaks: Detected 5 stray dns records - https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/Designate_record_leaks - https://grafana.wikimedia.org/d/ebJoA6VWz/wmcs-openstack-eqiad-nova-fullstack - https://alerts.wikimedia.org/?q=alertname%3DCloudVPSDesignateLeaks [18:42:29] 10cloud-services-team (FY2024/2025-Q1-Q2), 10Toolforge: ToolsDB: simplify volume chain - https://phabricator.wikimedia.org/T335593#10387467 (10fnegri) 05Resolved→03In progress Deleting the volumes had some complications, because of {T358774} and also the fact backy2 was trying to take a backup of one volum... [18:48:58] 06cloud-services-team, 10Data-Services, 06Data-Persistence: pt-heartbeat updates table even if read_only=1 - https://phabricator.wikimedia.org/T381690 (10fnegri) 03NEW [19:01:05] 06cloud-services-team, 10Data-Services, 06Data-Persistence: pt-heartbeat updates table even if read_only=1 - https://phabricator.wikimedia.org/T381690#10387561 (10Marostegui) Keep in mind that for now we do need it as root needs to perform schema changes on replicas which are always on RO. Also a RO system... [19:29:56] (03update) 10sstefanova: functional tests: add components-api tests [repos/cloud/toolforge/toolforge-deploy] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/631 (https://phabricator.wikimedia.org/T379092) [19:36:11] RESOLVED: CloudVPSDesignateLeaks: Detected 4 stray dns records - https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/Designate_record_leaks - https://grafana.wikimedia.org/d/ebJoA6VWz/wmcs-openstack-eqiad-nova-fullstack - https://alerts.wikimedia.org/?q=alertname%3DCloudVPSDesignateLeaks [20:12:24] 10Tool-wikiqanda, 06Future-Audiences: Tighten bot's response to "ignore all other prompts" - https://phabricator.wikimedia.org/T381700 (10Maryana) 03NEW [20:12:45] 10Tool-wikiqanda, 06Future-Audiences: Tighten bot's response to "ignore all other prompts" - https://phabricator.wikimedia.org/T381700#10387768 (10Maryana) [20:12:49] 10Tool-wikiqanda, 06Future-Audiences, 07Epic: [Epic] Discord Q&A bot Milestone 3 - https://phabricator.wikimedia.org/T378126#10387769 (10Maryana) [20:17:57] 10Tool-wikiqanda, 06Future-Audiences: Show images in bot response - https://phabricator.wikimedia.org/T381701 (10Maryana) 03NEW [20:19:41] 10Tool-wikiqanda, 06Future-Audiences: Identify errors/issues from Slack release that may apply to Discord - https://phabricator.wikimedia.org/T381702 (10Maryana) 03NEW [20:20:52] 10Tool-wikiqanda, 06Future-Audiences: Identify errors/issues from Slack release that may apply to Discord - https://phabricator.wikimedia.org/T381702#10387794 (10Maryana) [20:21:12] 10Tool-wikiqanda, 06Future-Audiences: Identify errors/issues from Slack release that may apply to Discord - https://phabricator.wikimedia.org/T381702#10387798 (10Maryana) p:05Triage→03High [20:21:34] 10Tool-wikiqanda, 06Future-Audiences: Tighten bot's response to "ignore all other prompts" - https://phabricator.wikimedia.org/T381700#10387799 (10Maryana) p:05Triage→03High [20:21:45] 10Tool-wikiqanda, 06Future-Audiences: Show images in bot response - https://phabricator.wikimedia.org/T381701#10387800 (10Maryana) p:05Triage→03Low [20:24:17] 10Tool-wikiqanda, 06Future-Audiences: Sensitive topic filtering/special-casing - https://phabricator.wikimedia.org/T378851#10387803 (10Maryana) p:05Triage→03High a:05Maryana→03None [20:32:05] 10cloud-services-team (FY2024/2025-Q1-Q2), 10Toolforge: Rescue file from Toolforge backup - https://phabricator.wikimedia.org/T381582#10387831 (10-jem-) Thanks, @fnegri and also @Andrew for the help in IRC. [20:35:21] 10Tool-wikiqanda, 06Future-Audiences: Upgrade to llama3.3 - https://phabricator.wikimedia.org/T381705 (10Maryana) 03NEW [20:35:43] 10Tool-wikiqanda, 06Future-Audiences: Upgrade to llama3.3 - https://phabricator.wikimedia.org/T381705#10387863 (10Maryana) [20:35:44] 10Tool-wikiqanda, 06Future-Audiences, 07Epic: [Epic] Discord Q&A bot Milestone 3 - https://phabricator.wikimedia.org/T378126#10387864 (10Maryana) [21:39:26] 06cloud-services-team, 10Cloud-VPS, 06Infrastructure-Foundations, 10Puppet-Core: Facter 4 upgrade removed 'mountpoints' fact, breaking cinderutils::ensure - https://phabricator.wikimedia.org/T381639#10387937 (10jhathaway) packages with depends on ruby-sys-filesystem have been published: ` bookworm: 4.3.... [22:00:52] 10Tool-wikiqanda, 06Future-Audiences: Add total bot responses to aggregate metrics logging - https://phabricator.wikimedia.org/T381402#10387968 (10etz) 05Open→03Resolved [22:00:55] 10Tool-wikiqanda, 06Future-Audiences, 07Spike: [Spike] Track original queries reacted to by bot - https://phabricator.wikimedia.org/T381403#10387982 (10etz) 05Open→03Resolved [22:53:48] 10Cloud-VPS (Project-requests), 10MediaWiki-Quickstart, 10Test-Platform (Essential Work): Request creation of "mediawiki-quickstart" VPS project - https://phabricator.wikimedia.org/T380335#10388053 (10Mhurd) [23:19:03] 10Tool-yearinreview, 06Editing-team, 06Growth-Team, 10New-Engagement-Experiments: "Year in Review" for Wikipedia Contributions - https://phabricator.wikimedia.org/T328385#10388159 (10Jdlrobson)