[00:03:22] (03PS3) 10Jdlrobson: Remove false positives of slightly different (correctly) sized images in Parsoid [integration/visualdiff] - 10https://gerrit.wikimedia.org/r/1214173 [00:03:40] (03CR) 10CI reject: [V:04-1] Remove false positives of slightly different (correctly) sized images in Parsoid [integration/visualdiff] - 10https://gerrit.wikimedia.org/r/1214173 (owner: 10Jdlrobson) [00:22:59] (03PS4) 10Jdlrobson: Remove false positives of slightly different (correctly) sized images in Parsoid [integration/visualdiff] - 10https://gerrit.wikimedia.org/r/1214173 [00:23:03] (03PS5) 10Jdlrobson: Remove false positives of slightly different (correctly) sized images in Parsoid [integration/visualdiff] - 10https://gerrit.wikimedia.org/r/1214173 (https://phabricator.wikimedia.org/T412169) [00:37:16] (03PS6) 10Jdlrobson: Update mobile handling for more reliable screenshots [integration/visualdiff] - 10https://gerrit.wikimedia.org/r/1214172 [09:55:36] 10Gerrit, 06collaboration-services, 13Patch-For-Review: gerrit behind CDN - https://phabricator.wikimedia.org/T411895#11446433 (10Jelto) @elukey notified me about `ConfdResourceFailed` alerts for the `gerrit-ssh` service catalog entry. All tcp-proxies are currently set to `pooled: inactive` and confd does no... [10:18:26] 10Gerrit, 06collaboration-services, 13Patch-For-Review: gerrit behind CDN - https://phabricator.wikimedia.org/T411895#11446491 (10Jelto) I set all tcp-proxies to `set/pooled=no`: ` sudo confctl select 'cluster=tcp-proxy,service=gerrit' set/pooled=no ` And the confd alert resolved. [10:57:39] 10MediaWiki-Releasing, 05MW-1.45-release: Release MW 1.45.0-rc.1 (if needed) - https://phabricator.wikimedia.org/T408479#11446605 (10ABreault-WMF) 05Open→03Declined [10:58:39] 10MediaWiki-Releasing, 07Documentation, 05MW-1.45-notes, 05MW-1.45-release: Finish up RELEASE-NOTES for 1.45.0 - https://phabricator.wikimedia.org/T408480#11446612 (10ABreault-WMF) 05Open→03Resolved a:03Atieno [11:00:03] maintenance-disconnect-full-disks build 762007 integration-agent-docker-1056 (/: 36%, /srv: 100%, /var/lib/docker: 32%): OFFLINE due to disk space [11:05:03] maintenance-disconnect-full-disks build 762008 integration-agent-docker-1056 (/: 36%, /srv: 30%, /var/lib/docker: 31%): RECOVERY disk space OK [11:08:21] (03PS1) 10Dreamy Jazz: Zuul: [mediawiki/extensions/CheckUser] Add EventBus dependency [integration/config] - 10https://gerrit.wikimedia.org/r/1217142 (https://phabricator.wikimedia.org/T409260) [11:11:29] (03merge) 10taavi: runner: Handle core's weird Jest config file location [repos/ci-tools/libup] - 10https://gitlab.wikimedia.org/repos/ci-tools/libup/-/merge_requests/96 [11:11:32] (03update) 10taavi: runner: Add context object to hold information about current run [repos/ci-tools/libup] - 10https://gitlab.wikimedia.org/repos/ci-tools/libup/-/merge_requests/97 [11:14:45] (03PS2) 10Dreamy Jazz: Zuul: [mediawiki/extensions/CheckUser] Add EventBus dependency [integration/config] - 10https://gerrit.wikimedia.org/r/1217142 (https://phabricator.wikimedia.org/T409260) [11:15:24] (03CR) 10Subramanya Sastry: [C:03+2] Update mobile handling for more reliable screenshots [integration/visualdiff] - 10https://gerrit.wikimedia.org/r/1214172 (owner: 10Jdlrobson) [11:15:57] (03Merged) 10jenkins-bot: Update mobile handling for more reliable screenshots [integration/visualdiff] - 10https://gerrit.wikimedia.org/r/1214172 (owner: 10Jdlrobson) [11:51:33] (03CR) 10Kosta Harlan: [C:03+1] Zuul: [mediawiki/extensions/CheckUser] Add EventBus dependency [integration/config] - 10https://gerrit.wikimedia.org/r/1217142 (https://phabricator.wikimedia.org/T409260) (owner: 10Dreamy Jazz) [11:52:08] (03CR) 10Hashar: [C:03+2] "Note the list of dependencies for the non-phan jobs remains the same. That is because EventBus and EventLogging are dependencies of some o" [integration/config] - 10https://gerrit.wikimedia.org/r/1217142 (https://phabricator.wikimedia.org/T409260) (owner: 10Dreamy Jazz) [11:54:13] (03Merged) 10jenkins-bot: Zuul: [mediawiki/extensions/CheckUser] Add EventBus dependency [integration/config] - 10https://gerrit.wikimedia.org/r/1217142 (https://phabricator.wikimedia.org/T409260) (owner: 10Dreamy Jazz) [11:54:53] (03CR) 10Hashar: [C:03+2] "Deployed and I have triggered a `recheck` on If6678d5ca9c595b4e3c5c084de03ed6bf098583d" [integration/config] - 10https://gerrit.wikimedia.org/r/1217142 (https://phabricator.wikimedia.org/T409260) (owner: 10Dreamy Jazz) [12:22:27] 10GitLab (Account Approval), 06Release-Engineering-Team: Requesting GitLab account activation for It's moon - https://phabricator.wikimedia.org/T412205 (10itsmoon) 03NEW [12:55:48] (03CR) 10Hashar: [C:03+2] "I18390b904e0c4531d08702073d3b0774af6bd9d0 has been merged and backported to release branches." [integration/config] - 10https://gerrit.wikimedia.org/r/1216760 (https://phabricator.wikimedia.org/T404939) (owner: 10Hashar) [12:57:29] (03Merged) 10jenkins-bot: Revert "Zuul: [WP25EasterEggs] add CommunityConfigurationExample" [integration/config] - 10https://gerrit.wikimedia.org/r/1216760 (https://phabricator.wikimedia.org/T404939) (owner: 10Hashar) [12:58:34] 06Release-Engineering-Team (Doing 😎), 06Growth-Team, 10MediaWiki-extensions-CommunityConfiguration, 07Essential-Work, 13Patch-For-Review: CommunityConfiguration unconditionally requires CommunityConfigurationExample - https://phabricator.wikimedia.org/T404939#11447177 (10hashar) 05Open→03Resolved [13:02:41] (03CR) 10Dreamy Jazz: "Thanks!" [integration/config] - 10https://gerrit.wikimedia.org/r/1217142 (https://phabricator.wikimedia.org/T409260) (owner: 10Dreamy Jazz) [13:28:23] (03update) 10audreypenven: Adds support for shellbox score with httpd service [repos/releng/cli] - 10https://gitlab.wikimedia.org/repos/releng/cli/-/merge_requests/640 [13:53:18] (03update) 10audreypenven: Adds support for shellbox score with httpd service [repos/releng/cli] - 10https://gitlab.wikimedia.org/repos/releng/cli/-/merge_requests/640 [14:27:31] 10MediaWiki-Releasing, 10ExtensionDistributor, 05MW-1.45-release, 13Patch-For-Review: Mark REL1_45 in ExtensionDistributor as a stable release - https://phabricator.wikimedia.org/T408482#11447478 (10ABreault-WMF) 05Open→03Resolved [14:28:44] I read https://www.mediawiki.org/wiki/Continuous_integration/Jenkins#Comment_commands again, and tried "check perf". 25 minutes and no bot response. What I'm doing wrong? [14:32:16] IKhitron: on which change? [14:32:37] https://gerrit.wikimedia.org/r/c/mediawiki/extensions/GlobalWatchlist/+/1211732 [14:34:05] hm, that looks to me like it should work (now that you’re on the CI allowlist) [14:34:57] Well, "check codehealth" did work. [14:35:07] I’m not sure which repos have a perf pipeline… maybe that’s limited [14:36:03] hm, https://gerrit.wikimedia.org/g/integration/config/+/89f412c1cb/zuul/layout.yaml#2944 looks like that might only exist in mediawiki/core.git and nowhere else [14:36:04] not sure though [14:48:40] I see... [14:49:09] 10Continuous-Integration-Config, 06Growth-Team, 10GrowthExperiments, 07ci-test-error (WMF-deployed Build Failure): phpbench job for GrowthExperiments fails due to missing dependency - https://phabricator.wikimedia.org/T329280#11447610 (10Michael) By chance, I discovered that phpbench is not only executed i... [15:02:27] 10Continuous-Integration-Config, 06Growth-Team, 10GrowthExperiments, 07ci-test-error (WMF-deployed Build Failure): phpbench job for GrowthExperiments fails due to missing dependency - https://phabricator.wikimedia.org/T329280#11447655 (10kostajh) Yeah, I don't think this ever took off as a useful developer... [15:37:48] !log ssh integration-castor05.integration.eqiad1.wikimedia.cloud sudo -u jenkins-deploy rm -rf /srv/castor/castor-mw-ext-and-skins/master/mediawiki-node20 # fix failure seen in mediawiki-node20 38178, 38180 [15:37:49] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [15:38:23] I’m not sure what to make of the error at https://integration.wikimedia.org/ci/job/quibble-vendor-mysql-php82/21567/console – git said 'fatal: Could not write new index file.'? [15:38:52] ah, ok, further down it’s 'No space left on device'. that sounds more familiar / mundane [15:40:35] 10Gerrit, 06collaboration-services, 13Patch-For-Review: gerrit behind CDN - https://phabricator.wikimedia.org/T411895#11447837 (10Dzahn) Thank you, Jelto. I don't think it causes problems but also I don't think it was expected that this would happen and it would cause a problem to NOT do it. Being "inactive"... [15:44:19] 10Gerrit, 06collaboration-services, 13Patch-For-Review: gerrit behind CDN - https://phabricator.wikimedia.org/T411895#11447842 (10Dzahn) What was the alert actually like? Did it alert in -operations? Wondering why would we be getting it now and not already a week ago. After all all this should have been... [16:01:11] 10Gerrit, 06collaboration-services, 13Patch-For-Review: gerrit behind CDN - https://phabricator.wikimedia.org/T411895#11447888 (10elukey) I found the ConfdResourceFailed alert in alerts.wikimedia.org, and it was from 6 days ago. On the server the problem was: ` Dec 10 08:33:48 config-master1001 confd-lint-w... [16:15:01] (03PS1) 10Jforrester: Zuul: [mediawiki/extensions/GrowthExperiments] Drop phpbench job, dupe [integration/config] - 10https://gerrit.wikimedia.org/r/1217231 (https://phabricator.wikimedia.org/T329280) [16:15:03] (03PS1) 10Jforrester: Zuul: Drop mediawiki-phpbench-patch template, now unused [integration/config] - 10https://gerrit.wikimedia.org/r/1217232 (https://phabricator.wikimedia.org/T329280) [16:15:05] (03PS1) 10Jforrester: jjb: Drop mediawiki-phpbench-patch, now unused [integration/config] - 10https://gerrit.wikimedia.org/r/1217233 (https://phabricator.wikimedia.org/T329280) [16:18:41] (03CR) 10Jforrester: [C:03+2] Zuul: [mediawiki/extensions/GrowthExperiments] Drop phpbench job, dupe [integration/config] - 10https://gerrit.wikimedia.org/r/1217231 (https://phabricator.wikimedia.org/T329280) (owner: 10Jforrester) [16:19:02] 10Continuous-Integration-Config, 06Growth-Team, 10GrowthExperiments, 07ci-test-error (WMF-deployed Build Failure), 13Patch-For-Review: phpbench job for GrowthExperiments fails due to missing dependency - https://phabricator.wikimedia.org/T329280#11447929 (10Jdforrester-WMF) >>! In T329280#11447655, @kost... [16:19:39] (03CR) 10Jforrester: [C:03+2] jjb: Drop mediawiki-phpbench-patch, now unused [integration/config] - 10https://gerrit.wikimedia.org/r/1217233 (https://phabricator.wikimedia.org/T329280) (owner: 10Jforrester) [16:19:41] (03CR) 10Jforrester: [C:03+2] Zuul: Drop mediawiki-phpbench-patch template, now unused [integration/config] - 10https://gerrit.wikimedia.org/r/1217232 (https://phabricator.wikimedia.org/T329280) (owner: 10Jforrester) [16:20:08] (03Merged) 10jenkins-bot: Zuul: [mediawiki/extensions/GrowthExperiments] Drop phpbench job, dupe [integration/config] - 10https://gerrit.wikimedia.org/r/1217231 (https://phabricator.wikimedia.org/T329280) (owner: 10Jforrester) [16:21:21] (03Merged) 10jenkins-bot: Zuul: Drop mediawiki-phpbench-patch template, now unused [integration/config] - 10https://gerrit.wikimedia.org/r/1217232 (https://phabricator.wikimedia.org/T329280) (owner: 10Jforrester) [16:21:22] (03Merged) 10jenkins-bot: jjb: Drop mediawiki-phpbench-patch, now unused [integration/config] - 10https://gerrit.wikimedia.org/r/1217233 (https://phabricator.wikimedia.org/T329280) (owner: 10Jforrester) [16:21:58] !log Zuul: [mediawiki/extensions/GrowthExperiments] Drop phpbench job, dupe, for T329280 [16:22:01] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [16:22:01] T329280: phpbench job for GrowthExperiments fails due to missing dependency - https://phabricator.wikimedia.org/T329280 [17:55:44] 10Gerrit, 06collaboration-services, 13Patch-For-Review: gerrit behind CDN - https://phabricator.wikimedia.org/T411895#11448437 (10Dzahn) Oh, i see. Thanks! Well, if it's 6 days old then I am not as surprised anymore but the actual issue is either the alerting or that a new pool should be allowed to be empty.... [18:50:15] (03PS1) 10Kimberly Sarabia: Decomissioning Article Summaries [integration/config] - 10https://gerrit.wikimedia.org/r/1217260 (https://phabricator.wikimedia.org/T411558) [18:51:09] (03CR) 10Pppery: "This also needs to be added to the "archived repositories" section at the bottom of the file." [integration/config] - 10https://gerrit.wikimedia.org/r/1217260 (https://phabricator.wikimedia.org/T411558) (owner: 10Kimberly Sarabia) [21:11:15] 10Phabricator: Request for acl*Batch-Editors for KReid_WMF - https://phabricator.wikimedia.org/T412273 (10KReid-WMF) 03NEW [21:49:47] !log Unblock 41.74.176.0/20 (T411945) [21:49:49] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [21:57:11] 10Beta-Cluster-Infrastructure: No Puppet resources found on instance deployment-deploy04 on project deployment-prep - https://phabricator.wikimedia.org/T411674#11449390 (10bd808) 05Open→03Invalid Transient