[12:29:55] (03open) 10lucaswerkmeister: readme: fix link [toolforge-repos/sample-complex-app-backend] - 10https://gitlab.wikimedia.org/toolforge-repos/sample-complex-app-backend/-/merge_requests/7 [13:06:33] (03open) 10damian: run_functional_tests - abort on missing branch [repos/cloud/toolforge/toolforge-deploy] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/1036 [13:18:22] (03open) 10damian: run_functional_tests - support repository url [repos/cloud/toolforge/toolforge-deploy] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/1037 [13:19:56] (03update) 10damian: run_functional_tests - support repository url [repos/cloud/toolforge/toolforge-deploy] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/1037 [13:20:46] (03update) 10damian: components-api - Use helper for status checks [repos/cloud/toolforge/toolforge-deploy] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/1028 (https://phabricator.wikimedia.org/T408002) [13:32:52] (03update) 10damian: run_functional_tests - support repository url [repos/cloud/toolforge/toolforge-deploy] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/1037 [13:33:56] (03update) 10damian: run_functional_tests - support repository url [repos/cloud/toolforge/toolforge-deploy] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/1037 [13:38:35] (03update) 10damian: run_functional_tests - support repository url [repos/cloud/toolforge/toolforge-deploy] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/1037 [13:42:29] (03update) 10damian: run_functional_tests - abort on missing branch [repos/cloud/toolforge/toolforge-deploy] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/1036 (https://phabricator.wikimedia.org/T408766) [13:42:36] (03update) 10damian: run_functional_tests - support repository url [repos/cloud/toolforge/toolforge-deploy] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/1037 (https://phabricator.wikimedia.org/T408766) [14:04:33] (03update) 10damian: components-api - Use helper for status checks [repos/cloud/toolforge/toolforge-deploy] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/1028 (https://phabricator.wikimedia.org/T408002) [14:04:34] (03update) 10damian: components-api - Use helper for status checks [repos/cloud/toolforge/toolforge-deploy] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/1028 (https://phabricator.wikimedia.org/T408002) [14:06:44] (03update) 10damian: Change `show` command to output raw value [repos/cloud/toolforge/envvars-cli] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/envvars-cli/-/merge_requests/92 (https://phabricator.wikimedia.org/T405024) [14:15:40] 06cloud-services-team, 10Toolforge: CI too old? After a short period - https://phabricator.wikimedia.org/T408999 (10DamianZaremba) 03NEW [14:22:32] 06cloud-services-team, 10Toolforge: CI too old? After a short period - https://phabricator.wikimedia.org/T408999#11333593 (10DamianZaremba) It appears these images are stored in reggie, which is configured with a 24 hour TTL (x-ref https://gitlab.wikimedia.org/repos/releng/gitlab-cloud-runner/-/blob/main/reggi... [14:28:29] 06cloud-services-team, 10Toolforge: [toolforge_deploy_mr] Branches can only be tested for 24 hours, otherwise fail with CI too old. - https://phabricator.wikimedia.org/T408999#11333601 (10DamianZaremba) [14:30:25] PROBLEM - Wikitech-static main page has content on wikitech-static.wikimedia.org is CRITICAL: CRITICAL - Socket timeout after 10 seconds https://wikitech.wikimedia.org/wiki/Wikitech-static [14:31:19] RECOVERY - Wikitech-static main page has content on wikitech-static.wikimedia.org is OK: HTTP OK: HTTP/1.1 200 OK - 30031 bytes in 3.680 second response time https://wikitech.wikimedia.org/wiki/Wikitech-static [14:39:00] (03update) 10damian: harbor images - return digest in container image [repos/cloud/toolforge/jobs-api] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/jobs-api/-/merge_requests/232 (https://phabricator.wikimedia.org/T408574) [14:43:31] (03update) 10damian: images - support fully qualified harbor names [repos/cloud/toolforge/jobs-api] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/jobs-api/-/merge_requests/231 (https://phabricator.wikimedia.org/T408574) [14:57:39] 06cloud-services-team, 10Toolforge, 13Patch-For-Review: [jobs-api] handle qualified image names - https://phabricator.wikimedia.org/T408574#11333606 (10DamianZaremba) Function tests passing, both MRs need tagging with `NeedsReview` as usual [15:53:25] PROBLEM - Wikitech-static main page has content on wikitech-static.wikimedia.org is CRITICAL: CRITICAL - Socket timeout after 10 seconds https://wikitech.wikimedia.org/wiki/Wikitech-static [15:54:17] RECOVERY - Wikitech-static main page has content on wikitech-static.wikimedia.org is OK: HTTP OK: HTTP/1.1 200 OK - 30037 bytes in 1.904 second response time https://wikitech.wikimedia.org/wiki/Wikitech-static [16:46:25] PROBLEM - Wikitech-static main page has content on wikitech-static.wikimedia.org is CRITICAL: CRITICAL - Socket timeout after 10 seconds https://wikitech.wikimedia.org/wiki/Wikitech-static [16:49:19] RECOVERY - Wikitech-static main page has content on wikitech-static.wikimedia.org is OK: HTTP OK: HTTP/1.1 200 OK - 30031 bytes in 4.293 second response time https://wikitech.wikimedia.org/wiki/Wikitech-static [17:07:32] !log tools.cluebotng-monitoring Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/19015435727 (https://github.com/cluebotng/component-configs/commits/e834d58735fb8e7d28a81f91d23508869c73d1c5) [17:07:34] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.cluebotng-monitoring/SAL [17:22:25] PROBLEM - Wikitech-static main page has content on wikitech-static.wikimedia.org is CRITICAL: CRITICAL - Socket timeout after 10 seconds https://wikitech.wikimedia.org/wiki/Wikitech-static [17:24:17] RECOVERY - Wikitech-static main page has content on wikitech-static.wikimedia.org is OK: HTTP OK: HTTP/1.1 200 OK - 30033 bytes in 1.601 second response time https://wikitech.wikimedia.org/wiki/Wikitech-static [17:47:41] !log tools.cluebotng-monitoring Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/19015890628 (https://github.com/cluebotng/component-configs/commits/9a7a2fa73af31eda4276cabe550fb40bf7c173a5) [17:47:43] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.cluebotng-monitoring/SAL [17:49:28] !log tools.cluebotng-monitoring Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/19015905691 (https://github.com/cluebotng/component-configs/commits/3cb78b899eadbb2f6060ea355e89b4c15be3919e) [17:49:29] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.cluebotng-monitoring/SAL [17:53:25] PROBLEM - Wikitech-static main page has content on wikitech-static.wikimedia.org is CRITICAL: CRITICAL - Socket timeout after 10 seconds https://wikitech.wikimedia.org/wiki/Wikitech-static [17:54:22] !log tools.cluebotng-monitoring Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/19015945300 (https://github.com/cluebotng/component-configs/commits/b09ca1fd5dc19977fb34f5f85107e861e53587e7) [17:54:24] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.cluebotng-monitoring/SAL [17:56:19] RECOVERY - Wikitech-static main page has content on wikitech-static.wikimedia.org is OK: HTTP OK: HTTP/1.1 200 OK - 30033 bytes in 3.674 second response time https://wikitech.wikimedia.org/wiki/Wikitech-static [17:59:25] PROBLEM - Wikitech-static main page has content on wikitech-static.wikimedia.org is CRITICAL: CRITICAL - Socket timeout after 10 seconds https://wikitech.wikimedia.org/wiki/Wikitech-static [18:02:21] RECOVERY - Wikitech-static main page has content on wikitech-static.wikimedia.org is OK: HTTP OK: HTTP/1.1 200 OK - 30033 bytes in 5.085 second response time https://wikitech.wikimedia.org/wiki/Wikitech-static [18:12:59] (03open) 10dcaro: loki: split into two components [repos/cloud/toolforge/toolforge-deploy] (loki-tracing) - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/1038 [18:13:31] !log tools.cluebotng-monitoring Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/19016164140 (https://github.com/cluebotng/component-configs/commits/042c1033922105af1510ad83356d090383abb809) [18:13:34] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.cluebotng-monitoring/SAL [18:14:47] 06cloud-services-team, 10Toolforge: [jobs-api] failed to create job from components - https://phabricator.wikimedia.org/T409007 (10DamianZaremba) 03NEW [18:25:05] !log tools.cluebotng-monitoring Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/19016297587 (https://github.com/cluebotng/component-configs/commits/7620c10586a5803b6d797aac0fcee5303142d049) [18:25:07] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.cluebotng-monitoring/SAL [18:25:32] 06cloud-services-team, 10Huggle: huggle-nfs volume filling up - https://phabricator.wikimedia.org/T402806#11333795 (10Addshore) I have pinged petrb elsewhere. If I dont get a reply, I'll offload what I can only assume are some DB backups from the NFS store to put them somewhere else (until I can confirm they a... [18:32:07] 06cloud-services-team, 10Toolforge: Toolforge fourohfour tool (404 error) shows URL twice - https://phabricator.wikimedia.org/T409008 (10LucasWerkmeister) 03NEW [18:36:47] 06cloud-services-team, 10Toolforge: Toolforge fourohfour tool (404 error) shows URL twice - https://phabricator.wikimedia.org/T409008#11333817 (10LucasWerkmeister) Looking at this code in `index()`: `lang=python # ingress-nginx connection error pages if "X-Original-URI" in flask.request.headers:... [18:39:14] 06cloud-services-team, 10Toolforge: [functional tests] leave a mess behind - https://phabricator.wikimedia.org/T409009 (10DamianZaremba) 03NEW [18:55:17] (03update) 10damian: components-api - Use helper for status checks [repos/cloud/toolforge/toolforge-deploy] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/1028 (https://phabricator.wikimedia.org/T408002) [19:26:39] (03open) 10aradhya: T407558/add work form with autocomplete [toolforge-repos/paulina] - 10https://gitlab.wikimedia.org/toolforge-repos/paulina/-/merge_requests/162 [19:27:01] (03update) 10aradhya: T407558/add work form with autocomplete [toolforge-repos/paulina] - 10https://gitlab.wikimedia.org/toolforge-repos/paulina/-/merge_requests/162 [19:30:11] (03update) 10aradhya: T407558/add work form with autocomplete [toolforge-repos/paulina] - 10https://gitlab.wikimedia.org/toolforge-repos/paulina/-/merge_requests/162 [21:56:25] PROBLEM - Wikitech-static main page has content on wikitech-static.wikimedia.org is CRITICAL: CRITICAL - Socket timeout after 10 seconds https://wikitech.wikimedia.org/wiki/Wikitech-static [21:57:17] RECOVERY - Wikitech-static main page has content on wikitech-static.wikimedia.org is OK: HTTP OK: HTTP/1.1 200 OK - 30041 bytes in 1.725 second response time https://wikitech.wikimedia.org/wiki/Wikitech-static [23:38:02] 10VPS-project-Wikistats: Add English Gyaanipedia to Wikistats - https://phabricator.wikimedia.org/T409014#11334097 (10Pppery)