[00:12:41] <jinxer-wm>	 FIRING: [2x] CloudVPSDesignateLeaks: Detected 1 stray dns records - https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/Designate_record_leaks - https://grafana.wikimedia.org/d/ebJoA6VWz/wmcs-openstack-eqiad-nova-fullstack - https://alerts.wikimedia.org/?q=alertname%3DCloudVPSDesignateLeaks
[00:17:41] <jinxer-wm>	 FIRING: [3x] CloudVPSDesignateLeaks: Detected 1 stray dns records - https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/Designate_record_leaks - https://grafana.wikimedia.org/d/ebJoA6VWz/wmcs-openstack-eqiad-nova-fullstack - https://alerts.wikimedia.org/?q=alertname%3DCloudVPSDesignateLeaks
[00:22:41] <jinxer-wm>	 FIRING: [3x] CloudVPSDesignateLeaks: Detected 1 stray dns records - https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/Designate_record_leaks - https://grafana.wikimedia.org/d/ebJoA6VWz/wmcs-openstack-eqiad-nova-fullstack - https://alerts.wikimedia.org/?q=alertname%3DCloudVPSDesignateLeaks
[00:27:41] <jinxer-wm>	 RESOLVED: [3x] CloudVPSDesignateLeaks: Detected 1 stray dns records - https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/Designate_record_leaks - https://grafana.wikimedia.org/d/ebJoA6VWz/wmcs-openstack-eqiad-nova-fullstack - https://alerts.wikimedia.org/?q=alertname%3DCloudVPSDesignateLeaks
[00:49:56] <wikibugs>	 (03CR) 10Valerio Bozzolan: become: add more documentation and follow shellcheck tips (032 comments) [labs/toollabs] - 10https://gerrit.wikimedia.org/r/1026967 (owner: 10Valerio Bozzolan)
[02:42:41] <jinxer-wm>	 FIRING: CloudVPSDesignateLeaks: Detected 2 stray dns records - https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/Designate_record_leaks - https://grafana.wikimedia.org/d/ebJoA6VWz/wmcs-openstack-eqiad-nova-fullstack - https://alerts.wikimedia.org/?q=alertname%3DCloudVPSDesignateLeaks
[02:47:41] <jinxer-wm>	 FIRING: [3x] CloudVPSDesignateLeaks: Detected 1 stray dns records - https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/Designate_record_leaks - https://grafana.wikimedia.org/d/ebJoA6VWz/wmcs-openstack-eqiad-nova-fullstack - https://alerts.wikimedia.org/?q=alertname%3DCloudVPSDesignateLeaks
[02:52:41] <jinxer-wm>	 FIRING: [3x] CloudVPSDesignateLeaks: Detected 1 stray dns records - https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/Designate_record_leaks - https://grafana.wikimedia.org/d/ebJoA6VWz/wmcs-openstack-eqiad-nova-fullstack - https://alerts.wikimedia.org/?q=alertname%3DCloudVPSDesignateLeaks
[02:57:41] <jinxer-wm>	 RESOLVED: [3x] CloudVPSDesignateLeaks: Detected 1 stray dns records - https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/Designate_record_leaks - https://grafana.wikimedia.org/d/ebJoA6VWz/wmcs-openstack-eqiad-nova-fullstack - https://alerts.wikimedia.org/?q=alertname%3DCloudVPSDesignateLeaks
[03:12:08] <wikibugs>	 14Grid-Engine-to-K8s-Migration, 10Tools, 06All-and-every-Wikisource, 03Wikimedia-Hackathon-2024: Migrate phetools from Toolforge GridEngine to Toolforge Kubernetes - https://phabricator.wikimedia.org/T319965#9772020 (10Soda) >>! In T319965#9714273, @Epigeneticist wrote: > Hi, is there any chance of MATCH&S...
[06:10:23] <wikibugs>	 10Wikibugs: Report GitLab merge request events to IRC - https://phabricator.wikimedia.org/T362500#9772130 (10bd808) 05Open→03In progress p:05Triage→03Medium a:03bd808
[06:52:06] <wikibugs>	 (03PS5) 10Waldyrious: Fix files count in query results stats; rework string structure [labs/codesearch] - 10https://gerrit.wikimedia.org/r/1027135 (https://phabricator.wikimedia.org/T364266)
[07:05:53] <wikibugs>	 10Wikibugs, 13Patch-For-Review, 03Wikimedia-Hackathon-2024: wikibugs SSE client does not see events from gitlab-webhooks in real-time. - https://phabricator.wikimedia.org/T363877#9772247 (10CodeReviewBot) taavi merged https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/275  i...
[07:06:02] <logmsgbot_cloud>	 !log taavi@cloudcumin1001 tools START - Cookbook wmcs.toolforge.k8s.component.deploy for component ingress-nginx
[07:06:16] <logmsgbot_cloud>	 !log taavi@cloudcumin1001 tools END (PASS) - Cookbook wmcs.toolforge.k8s.component.deploy (exit_code=0) for component ingress-nginx
[07:44:41] <jinxer-wm>	 FIRING: CloudVPSDesignateLeaks: Detected 1 stray dns records - https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/Designate_record_leaks - https://grafana.wikimedia.org/d/ebJoA6VWz/wmcs-openstack-eqiad-nova-fullstack - https://alerts.wikimedia.org/?q=alertname%3DCloudVPSDesignateLeaks
[07:54:41] <jinxer-wm>	 RESOLVED: CloudVPSDesignateLeaks: Detected 1 stray dns records - https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/Designate_record_leaks - https://grafana.wikimedia.org/d/ebJoA6VWz/wmcs-openstack-eqiad-nova-fullstack - https://alerts.wikimedia.org/?q=alertname%3DCloudVPSDesignateLeaks
[08:04:38] <wikibugs>	 10Tool-yearinreview, 06Editing-team, 06Growth-Team, 10New-Engagement-Experiments, 06Web-Team-Backlog: "Year in Review" for Wikipedia Contributions - https://phabricator.wikimedia.org/T328385#9772366 (10Gopavasanth) @Peter Pelberg could you please provide access to the Prototype & Figma files or let us kn...
[08:12:52] <wikibugs>	 10Tool-yearinreview, 06Editing-team, 06Growth-Team, 10New-Engagement-Experiments, 06Web-Team-Backlog: "Year in Review" for Wikipedia Contributions - https://phabricator.wikimedia.org/T328385#9772395 (10mwilliams) Here are the missing SVG files for @Gopavasanth   {F50292184}  {F50292183}
[08:45:17] <wikibugs>	 10Toolforge: [envvars-cli] Add option to not show envvar values when listing - https://phabricator.wikimedia.org/T363544#9772461 (10LucasWerkmeister) CC @Slst2020 who just ran `toolforge envvars list` in {T362062} (the only variable that was truncated at 50 characters was the Django secret key) – she said she’s...
[08:50:20] <wikibugs>	 10Wikibugs, 13Patch-For-Review: Report GitLab merge request events to IRC - https://phabricator.wikimedia.org/T362500#9772467 (10CodeReviewBot) bd808 opened https://gitlab.wikimedia.org/toolforge-repos/wikibugs2/-/merge_requests/32  Report GitLab merge request events to IRC
[08:57:04] <wikibugs>	 10Tools, 10Gerrit, 03Wikimedia-Hackathon-2024: Gerrit reviewer bot should have an option to add people as CC instead of reviewers - https://phabricator.wikimedia.org/T363290#9772484 (10Tgr) See also past discussion in {T334118}.
[09:12:41] <jinxer-wm>	 FIRING: [2x] CloudVPSDesignateLeaks: Detected 2 stray dns records - https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/Designate_record_leaks - https://grafana.wikimedia.org/d/ebJoA6VWz/wmcs-openstack-eqiad-nova-fullstack - https://alerts.wikimedia.org/?q=alertname%3DCloudVPSDesignateLeaks
[09:17:41] <jinxer-wm>	 FIRING: [3x] CloudVPSDesignateLeaks: Detected 1 stray dns records - https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/Designate_record_leaks - https://grafana.wikimedia.org/d/ebJoA6VWz/wmcs-openstack-eqiad-nova-fullstack - https://alerts.wikimedia.org/?q=alertname%3DCloudVPSDesignateLeaks
[09:22:41] <jinxer-wm>	 FIRING: [3x] CloudVPSDesignateLeaks: Detected 1 stray dns records - https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/Designate_record_leaks - https://grafana.wikimedia.org/d/ebJoA6VWz/wmcs-openstack-eqiad-nova-fullstack - https://alerts.wikimedia.org/?q=alertname%3DCloudVPSDesignateLeaks
[09:27:41] <jinxer-wm>	 RESOLVED: [3x] CloudVPSDesignateLeaks: Detected 1 stray dns records - https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/Designate_record_leaks - https://grafana.wikimedia.org/d/ebJoA6VWz/wmcs-openstack-eqiad-nova-fullstack - https://alerts.wikimedia.org/?q=alertname%3DCloudVPSDesignateLeaks
[10:03:33] <wikibugs>	 10Wikibugs, 13Patch-For-Review, 03Wikimedia-Hackathon-2024: Report GitLab merge request events to IRC - https://phabricator.wikimedia.org/T362500#9772601 (10bd808)
[10:03:47] <wikibugs>	 10Wikibugs, 03Wikimedia-Hackathon-2024: wikibugs SSE client does not see events from gitlab-webhooks in real-time. - https://phabricator.wikimedia.org/T363877#9772602 (10bd808) 05In progress→03Resolved
[10:08:18] <wikibugs>	 10Tools, 06translatewiki.net, 10Language-Team (Language-2024-April-June), 03Localization Infrastructure FY2023-24, and 2 others: Make Wikidata Image Positions tool translatable on translatewiki.net - https://phabricator.wikimedia.org/T363626#9772604 (10siebrand) A PR was created successfully from twn to gi...
[10:09:38] <wikibugs>	 10Wikibugs, 13Patch-For-Review, 03Wikimedia-Hackathon-2024: Report GitLab merge request events to IRC - https://phabricator.wikimedia.org/T362500#9772605 (10CodeReviewBot) bd808 merged https://gitlab.wikimedia.org/toolforge-repos/wikibugs2/-/merge_requests/32  Report GitLab merge request events to IRC
[10:30:32] <wikibugs>	 (03PS3) 10Valerio Bozzolan: become: add more documentation, follow shellcheck tips [labs/toollabs] - 10https://gerrit.wikimedia.org/r/1026967
[10:35:33] <wikibugs>	 (03CR) 10Valerio Bozzolan: become: add more documentation, follow shellcheck tips (031 comment) [labs/toollabs] - 10https://gerrit.wikimedia.org/r/1026967 (owner: 10Valerio Bozzolan)
[10:35:51] <wikibugs>	 (03reopen) 10bd808: This is a test of the gitlab irc reporter [toolforge-repos/wikibugs2] - 10https://gitlab.wikimedia.org/toolforge-repos/wikibugs2/-/merge_requests/33
[10:38:46] <wikibugs>	 10Wikibugs, 03Wikimedia-Hackathon-2024: Report GitLab merge request events to IRC - https://phabricator.wikimedia.org/T362500#9772651 (10bd808) It's alive! `lang=irc,name=#wikimedia-cloud-feed [10:35]  < wikibugs> (reopen) bd808: This is a test of the gitlab irc reporter [toolforge-repos/wikibugs2] - https://g...
[10:41:19] <wikibugs>	 (03merge) 10lucaswerkmeister: Localisation updates from https://translatewiki.net. [toolforge-repos/wd-image-positions] - 10https://gitlab.wikimedia.org/toolforge-repos/wd-image-positions/-/merge_requests/2
[10:41:33] <wikibugs>	 10Tools, 06translatewiki.net, 10Language-Team (Language-2024-April-June), 03Localization Infrastructure FY2023-24, and 2 others: Make Wikidata Image Positions tool translatable on translatewiki.net - https://phabricator.wikimedia.org/T363626#9772655 (10CodeReviewBot) lucaswerkmeister merged https://gitlab....
[10:43:36] <wikibugs>	 (03PS4) 10Valerio Bozzolan: become: add more documentation, follow shellcheck tips [labs/toollabs] - 10https://gerrit.wikimedia.org/r/1026967
[10:51:08] <wikibugs>	 (03close) 10bd808: This is a test of the gitlab irc reporter [toolforge-repos/wikibugs2] - 10https://gitlab.wikimedia.org/toolforge-repos/wikibugs2/-/merge_requests/33
[10:55:56] <wikibugs>	 (03PS5) 10Valerio Bozzolan: become: optimizations, follow shellcheck tips [labs/toollabs] - 10https://gerrit.wikimedia.org/r/1026967
[10:56:24] <wikibugs>	 (03CR) 10Alex Paskulin: "Done in https://gerrit.wikimedia.org/r/c/jsdoc/wmf-theme/+/1027535" [labs/libraryupgrader/config] - 10https://gerrit.wikimedia.org/r/1023097 (https://phabricator.wikimedia.org/T187672) (owner: 10Majavah)
[10:59:40] <wikibugs>	 (03open) 10bd808: Demo GitLab MR status being reported on IRC [toolforge-repos/wikibugs2] - 10https://gitlab.wikimedia.org/toolforge-repos/wikibugs2/-/merge_requests/34
[11:13:07] <wikibugs>	 10VPS-project-Codesearch, 13Patch-For-Review, 03Wikimedia-Hackathon-2024: Fix number of files in code search results stats - https://phabricator.wikimedia.org/T364266#9772733 (10Krinkle)
[11:16:42] <wikibugs>	 (03PS6) 10Waldyrious: Fix files count in query results stats; rework string structure [labs/codesearch] - 10https://gerrit.wikimedia.org/r/1027135 (https://phabricator.wikimedia.org/T364266)
[11:16:54] <wikibugs>	 (03PS7) 10Krinkle: frontend: Fix files count in query results stats; rework structure [labs/codesearch] - 10https://gerrit.wikimedia.org/r/1027135 (https://phabricator.wikimedia.org/T364266) (owner: 10Waldyrious)
[11:40:29] <wikibugs>	 (03PS6) 10Valerio Bozzolan: become: optimizations, follow shellcheck tips [labs/toollabs] - 10https://gerrit.wikimedia.org/r/1026967
[11:42:15] <wikibugs>	 (03CR) 10Valerio Bozzolan: "Thanks to anon folks who helped in testing. Applied their suggestions." [labs/toollabs] - 10https://gerrit.wikimedia.org/r/1026967 (owner: 10Valerio Bozzolan)
[11:43:30] <wikibugs>	 (03open) 10varun-s22: Background change per story [toolforge-repos/yearinreview] - 10https://gitlab.wikimedia.org/toolforge-repos/yearinreview/-/merge_requests/3
[11:44:58] <wikibugs>	 (03merge) 10theprotonade: Background change per story [toolforge-repos/yearinreview] - 10https://gitlab.wikimedia.org/toolforge-repos/yearinreview/-/merge_requests/3
[11:53:16] <wikibugs>	 10Tool-yearinreview, 06Editing-team, 06Growth-Team, 10New-Engagement-Experiments, and 2 others: "Year in Review" for Wikipedia Contributions - https://phabricator.wikimedia.org/T328385#9772872 (10Gopavasanth) In the #wikimedia-hackathon-2024, @theprotonade, @Reputation22, and I (@Gopavasanth) collaborated...
[12:02:25] <wikibugs>	 (03PS8) 10Krinkle: frontend: Fix files count in query results stats; rework structure [labs/codesearch] - 10https://gerrit.wikimedia.org/r/1027135 (https://phabricator.wikimedia.org/T364266) (owner: 10Waldyrious)
[12:02:32] <wikibugs>	 (03CR) 10Krinkle: [C:03+2] frontend: Fix files count in query results stats; rework structure [labs/codesearch] - 10https://gerrit.wikimedia.org/r/1027135 (https://phabricator.wikimedia.org/T364266) (owner: 10Waldyrious)
[12:04:03] <wikibugs>	 (03Merged) 10jenkins-bot: frontend: Fix files count in query results stats; rework structure [labs/codesearch] - 10https://gerrit.wikimedia.org/r/1027135 (https://phabricator.wikimedia.org/T364266) (owner: 10Waldyrious)
[12:05:01] <wikibugs>	 10VPS-project-Codesearch, 13Patch-For-Review, 03Wikimedia-Hackathon-2024: Fix number of files in code search results stats - https://phabricator.wikimedia.org/T364266#9772899 (10Krinkle) 05Open→03Resolved
[12:35:25] <wikibugs>	 10Tool-yearinreview, 10New-Engagement-Experiments, 03Wikimedia-Hackathon-2024: Improve the year in review tool for next year - https://phabricator.wikimedia.org/T362898#9772967 (10Gopavasanth) In the Wikimedia-Hackathon-2024, @theprotonade, @Reputation22, and I (@Gopavasanth) collaborated on enhancing the Ye...
[12:45:36] <wikibugs>	 10Toolforge: [envvars-cli] Add option to not show envvar values when listing - https://phabricator.wikimedia.org/T363544#9772983 (10Slst2020) >>! In T363544#9772459, @LucasWerkmeister wrote: > CC @Slst2020 who just ran `toolforge envvars list` in {T362062} (the only variable that was truncated at 50 characters w...
[12:47:23] <wikibugs>	 06cloud-services-team, 10VPS-project-devtools, 06collaboration-services, 10Puppet (Puppet 7.0): Update devtools project puppetmaster - https://phabricator.wikimedia.org/T360470#9772991 (10Jelto) One note: the puppet sync was broken due to permission issues on the directory since end of March. Some fold...
[16:45:39] <wmcs-alerts>	 FIRING: [3x] ProbeDown: Service tools-legacy-redirector-2:443 has failed probes (http_tools_wmflabs_org_main_page_ip4) - https://wikitech.wikimedia.org/wiki/Runbook#tools-legacy-redirector-2:443 - https://grafana.wikimedia.org/d/O0nHhdhnz/network-probes-overview?var-job=probes/custom&var-module=All - https://prometheus-alerts.wmcloud.org/?q=alertname%3DProbeDown
[16:50:39] <wmcs-alerts>	 RESOLVED: [4x] ProbeDown: Service tools-legacy-redirector-2:443 has failed probes (http_tools_wmflabs_org_main_page_ip4) - https://wikitech.wikimedia.org/wiki/Runbook#tools-legacy-redirector-2:443 - https://grafana.wikimedia.org/d/O0nHhdhnz/network-probes-overview?var-job=probes/custom&var-module=All - https://prometheus-alerts.wmcloud.org/?q=alertname%3DProbeDown
[16:56:07] <wikibugs>	 14Grid-Engine-to-K8s-Migration, 10Tools, 06All-and-every-Wikisource, 03Wikimedia-Hackathon-2024: Migrate phetools from Toolforge GridEngine to Toolforge Kubernetes - https://phabricator.wikimedia.org/T319965#9773263 (10Epigeneticist) >>! In T319965#9772020, @Soda wrote: >>>! In T319965#9714273, @Epigenetic...
[16:59:06] <wmcs-alerts>	 FIRING: [2x] ProbeDown: Service tools-legacy-redirector-2:443 has failed probes (http_tools_wmflabs_org_tool_ip4) - https://wikitech.wikimedia.org/wiki/Runbook#tools-legacy-redirector-2:443 - https://grafana.wikimedia.org/d/O0nHhdhnz/network-probes-overview?var-job=probes/custom&var-module=All - https://prometheus-alerts.wmcloud.org/?q=alertname%3DProbeDown
[17:00:54] <wmcs-alerts>	 FIRING: [4x] ProbeDown: Service tools-legacy-redirector-2:443 has failed probes (http_tools_wmflabs_org_main_page_ip4) - https://wikitech.wikimedia.org/wiki/Runbook#tools-legacy-redirector-2:443 - https://grafana.wikimedia.org/d/O0nHhdhnz/network-probes-overview?var-job=probes/custom&var-module=All - https://prometheus-alerts.wmcloud.org/?q=alertname%3DProbeDown
[17:04:06] <wmcs-alerts>	 FIRING: [4x] ProbeDown: Service tools-legacy-redirector-2:443 has failed probes (http_tools_wmflabs_org_main_page_ip4) - https://wikitech.wikimedia.org/wiki/Runbook#tools-legacy-redirector-2:443 - https://grafana.wikimedia.org/d/O0nHhdhnz/network-probes-overview?var-job=probes/custom&var-module=All - https://prometheus-alerts.wmcloud.org/?q=alertname%3DProbeDown
[17:05:54] <wmcs-alerts>	 RESOLVED: [4x] ProbeDown: Service tools-legacy-redirector-2:443 has failed probes (http_tools_wmflabs_org_main_page_ip4) - https://wikitech.wikimedia.org/wiki/Runbook#tools-legacy-redirector-2:443 - https://grafana.wikimedia.org/d/O0nHhdhnz/network-probes-overview?var-job=probes/custom&var-module=All - https://prometheus-alerts.wmcloud.org/?q=alertname%3DProbeDown
[18:02:39] <wikibugs>	 14Grid-Engine-to-K8s-Migration, 10Tools, 06All-and-every-Wikisource, 03Wikimedia-Hackathon-2024: Migrate phetools from Toolforge GridEngine to Toolforge Kubernetes - https://phabricator.wikimedia.org/T319965#9773286 (10Soda) >>! In T319965#9773263, @Epigeneticist wrote: >>>! In T319965#9772020, @Soda wrote...