[05:43:25] 10Tool-translatetagger, 06Indic MediaWiki Developers UG, 06Indic-TechCom: Create Gadget to Simplify Workflow for Adding Translation Tag - https://phabricator.wikimedia.org/T393170#12061586 (10Aafi) >>! In T393170#12058133, @Super_nabla wrote: > The idea is to create a user script that modifies the standard M... [06:16:56] 10Tool-bento, 10Tool-tome: Add Bento-like file renaming convention in Tome - https://phabricator.wikimedia.org/T430390 (10psubhashish1) 03NEW [06:17:59] 10Tool-bento, 10Tool-tome: Add Bento-like file renaming convention in Tome - https://phabricator.wikimedia.org/T430390#12061629 (10psubhashish1) [06:42:36] (03open) 10arpithhhaaa: Bugs Fixed [toolforge-repos/subtitler] - 10https://gitlab.wikimedia.org/toolforge-repos/subtitler/-/merge_requests/5 [08:56:40] 10Tool-translatetagger: TranslateTagger tool fails for some pages - https://phabricator.wikimedia.org/T430392 (10_ashish_karanam_) 03NEW [09:01:35] 10Tool-techcontribs: Tool fails to fetch Gitlab contributions - https://phabricator.wikimedia.org/T430394 (10Gopavasanth) 03NEW [09:03:00] 10Tool-translatetagger, 06Indic-TechCom: Avoid issuing translate wrappers when already present - https://phabricator.wikimedia.org/T430395 (10Aafi) 03NEW [09:09:59] 10Tool-translatetagger, 06Indic-TechCom: TranslateTagger tool fails for some pages - https://phabricator.wikimedia.org/T430392#12061712 (10Aafi) [09:13:26] 10Tool-techcontribs: Tool fails to fetch Gitlab contributions - https://phabricator.wikimedia.org/T430394#12061725 (10Chlod) 05Open→03Resolved p:05Triage→03High a:03Chlod That's GitHub. Gitlab is the box immediately above it. Fixed. Forgot to mount NFS into the tool the last time it got restarted. [09:18:21] 10Tool-translatetagger, 06Indic-TechCom: TranslateTagger tool fails for some pages - https://phabricator.wikimedia.org/T430392#12061730 (10TamanpreetKaur) a:03TamanpreetKaur [09:19:49] 10Tool-techcontribs: Tool fails to fetch GitHub contributions - https://phabricator.wikimedia.org/T430394#12061731 (10Gopavasanth) [09:20:27] 10Tool-translatetagger, 06Indic MediaWiki Developers UG, 06Indic-TechCom: Consistent tvar convention - https://phabricator.wikimedia.org/T428033#12061732 (10_ashish_karanam_) pr:https://github.com/indictechcom/TranslateTagger/pull/33 [09:20:57] 10Tool-translatetagger, 06Indic MediaWiki Developers UG, 06Indic-TechCom: Consistent tvar convention - https://phabricator.wikimedia.org/T428033#12061733 (10_ashish_karanam_) 05Open→03Resolved [09:24:34] (03open) 10kavaljeetsingh: Add author override support for own-work uploads [toolforge-repos/clip2commons] - 10https://gitlab.wikimedia.org/toolforge-repos/clip2commons/-/merge_requests/6 [09:32:33] (03open) 10aadhi13: fix: improve recent video uploads panel [toolforge-repos/clip2commons] - 10https://gitlab.wikimedia.org/toolforge-repos/clip2commons/-/merge_requests/7 [09:46:16] 10Tool-translatetagger, 06Indic-TechCom, 10MediaWiki-extensions-Translate: Integrate TranslateTagger functions/workflow into Special:PagePreparation of Translate Extension - https://phabricator.wikimedia.org/T430257#12061739 (10NishthaJain7) a:03NishthaJain7 [09:59:51] 10Tool-translatetagger, 06Indic-TechCom: handling email addresses in translate tagger - https://phabricator.wikimedia.org/T430397 (10Aafi) 03NEW [10:03:23] (03update) 10anushka10patel: Complete Hindi translations [toolforge-repos/clip2commons] - 10https://gitlab.wikimedia.org/toolforge-repos/clip2commons/-/merge_requests/4 [10:11:29] (03update) 10kavaljeetsingh: Add author override support for own-work uploads [toolforge-repos/clip2commons] - 10https://gitlab.wikimedia.org/toolforge-repos/clip2commons/-/merge_requests/6 [10:13:05] (03update) 10reeti: feat: audio toggle in Edit video section (#10) [toolforge-repos/clip2commons] - 10https://gitlab.wikimedia.org/toolforge-repos/clip2commons/-/merge_requests/3 [10:17:35] (03update) 10aadhi13: fix: make batch queue items clickable with independent metadata editing [toolforge-repos/clip2commons] - 10https://gitlab.wikimedia.org/toolforge-repos/clip2commons/-/merge_requests/5 [10:18:15] (03merge) 10devjadiya: Add author override support for own-work uploads [toolforge-repos/clip2commons] - 10https://gitlab.wikimedia.org/toolforge-repos/clip2commons/-/merge_requests/6 (owner: 10kavaljeetsingh) [10:22:42] (03update) 10aadhi13: fix: make batch queue items clickable with independent metadata editing [toolforge-repos/clip2commons] - 10https://gitlab.wikimedia.org/toolforge-repos/clip2commons/-/merge_requests/5 [10:46:12] (03update) 10aadhi13: fix: improve recent video uploads panel [toolforge-repos/clip2commons] - 10https://gitlab.wikimedia.org/toolforge-repos/clip2commons/-/merge_requests/7 [11:23:42] 10Tool-wsindex, 10Wikisource Reader App (Android): Add summary statistics to analytics page - https://phabricator.wikimedia.org/T430399 (10Saiphani02) 03NEW [11:29:05] 10Tool-wsindex, 10Wikisource Reader App (Android): Add descriptions for books where Wikipedia articles are available [API] - https://phabricator.wikimedia.org/T430400 (10Saiphani02) 03NEW [11:42:12] (03update) 10arpithhhaaa: Bugs Fixed [toolforge-repos/subtitler] - 10https://gitlab.wikimedia.org/toolforge-repos/subtitler/-/merge_requests/5 [11:53:57] 10Tool-subtitler: Upload edits to source subtitle and new translated subtitles to Commons - https://phabricator.wikimedia.org/T430402 (10psubhashish1) 03NEW [12:00:43] (03open) 10kavaljeetsingh: Improve accessibility for upload form and provenance tree [toolforge-repos/clip2commons] - 10https://gitlab.wikimedia.org/toolforge-repos/clip2commons/-/merge_requests/8 [13:18:39] 10VPS-project-Codesearch, 10MediaWiki-libs-utfnormal: Add utfnormal to Codesearch - https://phabricator.wikimedia.org/T430363#12061879 (10Umherirrender) 05Open→03Resolved [13:49:26] 10Tool-bento, 10Tool-tome: Add Bento-like file renaming convention in Tome and allow uploading files with edited metadata - https://phabricator.wikimedia.org/T430390#12061920 (10psubhashish1) [13:52:32] !log tools.cluebotng Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/28291037948 (https://github.com/cluebotng/component-configs/commits/03f0e1e95886611fe4bf68c103a51f34ec7a8f41) [13:52:34] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.cluebotng/SAL [13:58:25] !log tools.cluebotng Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/28291090339 (https://github.com/cluebotng/component-configs/commits/feff80c249bc28b62ed154c74e8f8b1bfa597e3c) [13:58:28] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.cluebotng/SAL [14:05:34] FIRING: ToolforgeWebHighErrorRate: High 5xx rate on Toolforge web services #page - https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Runbooks/ToolforgeWebHighErrorRate - https://grafana.wmcloud.org/d/toolforge-k8s-haproxy/infra-k8s-haproxy?var-frontend=k8s-ingress-https&var-backend=k8s-ingress-http&var-cluster=prometheus-tools - https://prometheus-alerts.wmcloud.org/?q=alertname%3DToolforgeWebHighErrorRate [14:10:34] RESOLVED: ToolforgeWebHighErrorRate: High 5xx rate on Toolforge web services #page - https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Runbooks/ToolforgeWebHighErrorRate - https://grafana.wmcloud.org/d/toolforge-k8s-haproxy/infra-k8s-haproxy?var-frontend=k8s-ingress-https&var-backend=k8s-ingress-http&var-cluster=prometheus-tools - https://prometheus-alerts.wmcloud.org/?q=alertname%3DToolforgeWebHighErrorRate [14:29:12] (03approved) 10ladsgroup: Update UI library to use Wikimedia Codex [toolforge-repos/mvc] - 10https://gitlab.wikimedia.org/toolforge-repos/mvc/-/merge_requests/2 (owner: 10simon04) [14:45:18] !log tools.cluebotng-review Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/28292262937 (https://github.com/cluebotng/component-configs/commits/d0d81399db60e997e0f3c84c4bfcd671b88d5e51) [14:45:20] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.cluebotng-review/SAL [15:01:57] 10Toolforge, 06tools-platform-team: ToolforgeWebHighErrorRate should not page if a single tool is down - https://phabricator.wikimedia.org/T429738#12062063 (10dcaro) This triggered again today, around one hour ago, and scholia was stopped (and the alert stopped too). There's though an increased number of sess... [15:16:39] (03merge) 10ladsgroup: Update UI library to use Wikimedia Codex [toolforge-repos/mvc] - 10https://gitlab.wikimedia.org/toolforge-repos/mvc/-/merge_requests/2 (owner: 10simon04) [15:28:28] 10Toolforge, 06tools-platform-team: ToolforgeWebHighErrorRate should not page if a single tool is down - https://phabricator.wikimedia.org/T429738#12062097 (10dcaro) Another one where you can also see that the traffic on scholia moved to fourohfour, and multiplied at the same time (probably due to retries): {F... [16:02:05] 10Toolforge, 06tools-platform-team: ToolforgeWebHighErrorRate should not page if a single tool is down - https://phabricator.wikimedia.org/T429738#12062163 (10fnegri) [16:02:19] 10Toolforge, 06tools-platform-team: ToolforgeWebHighErrorRate should not page if a single tool is down - https://phabricator.wikimedia.org/T429738#12062164 (10fnegri) [16:12:17] 10Toolforge, 06tools-platform-team: ToolforgeWebHighErrorRate should not page if a single tool is down - https://phabricator.wikimedia.org/T429738#12062179 (10fnegri) > Another one where you can also see that the traffic on scholia moved to fourohfour, and multiplied at the same time (probably due to retries):... [16:13:12] 10Toolforge, 06tools-platform-team: ToolforgeWebHighErrorRate should not page if a single tool is down - https://phabricator.wikimedia.org/T429738#12062180 (10fnegri) [16:14:07] 10Toolforge, 06tools-platform-team: ToolforgeWebHighErrorRate should not page if a single tool is down - https://phabricator.wikimedia.org/T429738#12062181 (10fnegri) [16:27:59] !log tools.cluebotng-review Deployment failed: https://github.com/cluebotng/component-configs/actions/runs/28294935998 (https://github.com/cluebotng/component-configs/commits/dfafa3368a83b4ef570763c77a8e2131ae43e790) [16:28:01] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.cluebotng-review/SAL [16:36:09] !log tools.cluebotng-review Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/28294935998 (https://github.com/cluebotng/component-configs/commits/dfafa3368a83b4ef570763c77a8e2131ae43e790) [16:36:11] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.cluebotng-review/SAL [17:17:21] !log tools.cluebotng-review Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/28296058232 (https://github.com/cluebotng/component-configs/commits/e1ce8770ee82bd4202c7f54215f5b514b693352d) [17:17:23] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.cluebotng-review/SAL [17:47:44] 06cloud-services-team, 10Toolforge: Unhandled ChunkedEncodingError crash from `toolforge jobs logs -f` - https://phabricator.wikimedia.org/T417225#12062324 (10DamianZaremba) I've hit this multiple times today while tailing logs, so defiantly still happening. [18:02:36] !log tools.cluebotng-review Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/28297170540 (https://github.com/cluebotng/component-configs/commits/12a68f8f80991f77c948817dd50798649df0bfac) [18:02:38] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.cluebotng-review/SAL [19:14:10] (03merge) 10devjadiya: feat: audio toggle in Edit video section (#10) [toolforge-repos/clip2commons] - 10https://gitlab.wikimedia.org/toolforge-repos/clip2commons/-/merge_requests/3 (owner: 10reeti) [19:58:55] 10VPS-project-Codesearch, 06MediaWiki-Platform-Team (Kanban Board): Include "Mobile Apps" in "MediaWiki & services at WMF" preset for Codesearch - https://phabricator.wikimedia.org/T426627#12062401 (10Krinkle) 05Open→03Resolved a:03ArielGlenn [19:59:09] 10VPS-project-Codesearch: Codesearch stuck at Feb 12th? - https://phabricator.wikimedia.org/T421147#12062405 (10Krinkle) 05Open→03Resolved [20:23:47] 10VPS-project-Codesearch: [codesearch] alert CodesearchBackendDown is triggering - https://phabricator.wikimedia.org/T347063#12062408 (10Krinkle) 05Open→03Resolved a:03Krinkle Fixed in https://gerrit.wikimedia.org/r/c/operations/puppet/+/1079382 which reverted the addition of the unfinished/unused/plac... [20:24:04] 10VPS-project-Codesearch: [codesearch] alert CodesearchBackendDown is triggering for "design" and "discovery" instances - https://phabricator.wikimedia.org/T347063#12062411 (10Krinkle) [21:09:01] 06cloud-services-team, 10Toolforge: Unhandled ChunkedEncodingError crash from `toolforge jobs logs -f` - https://phabricator.wikimedia.org/T417225#12062455 (10DamianZaremba) >>! In T417225#12062324, @DamianZaremba wrote: > I've hit this multiple times today while tailing logs, so defiantly still happening. It... [21:28:24] 10Toolforge, 06tools-platform-team: [logs-api] failing to return logs for job - https://phabricator.wikimedia.org/T429265#12062459 (10DamianZaremba) 05Declined→03Open Re-opening as this is happening again. ` tools.cluebotng-review@tools-bastion-15:~$ date; toolforge jobs logs -f cluebotng-reviewer; date S... [22:12:02] !log tools.cluebotng-trainer Deployment failed: https://github.com/cluebotng/component-configs/actions/runs/28303337333 (https://github.com/cluebotng/component-configs/commits/23ce0f851064ca0c4fffa28a0b1510a8ee1dff1c) [22:12:04] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.cluebotng-trainer/SAL [22:12:52] !log tools.cluebot-syncer Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/28303337263 (https://github.com/cluebotng/component-configs/commits/23ce0f851064ca0c4fffa28a0b1510a8ee1dff1c) [22:12:52] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.cluebot-syncer/SAL [22:17:31] !log tools.cluebotng Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/28303337267 (https://github.com/cluebotng/component-configs/commits/23ce0f851064ca0c4fffa28a0b1510a8ee1dff1c) [22:17:34] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.cluebotng/SAL [22:18:47] !log tools.cluebotng-review Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/28303337269 (https://github.com/cluebotng/component-configs/commits/23ce0f851064ca0c4fffa28a0b1510a8ee1dff1c) [22:18:48] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.cluebotng-review/SAL [22:22:23] !log tools.cluebotng-trainer Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/28303337333 (https://github.com/cluebotng/component-configs/commits/23ce0f851064ca0c4fffa28a0b1510a8ee1dff1c) [22:22:24] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.cluebotng-trainer/SAL