[00:14:31] (03PS1) 10Tim Starling: Add mediawiki/extensions/EventSimulator [integration/config] - 10https://gerrit.wikimedia.org/r/834404 [08:07:08] (03CR) 10Hashar: [C: 03+2] Add mediawiki/extensions/EventSimulator [integration/config] - 10https://gerrit.wikimedia.org/r/834404 (owner: 10Tim Starling) [08:09:01] (03Merged) 10jenkins-bot: Add mediawiki/extensions/EventSimulator [integration/config] - 10https://gerrit.wikimedia.org/r/834404 (owner: 10Tim Starling) [08:26:30] (03CR) 10Jaime Nuche: [C: 03+2] Perform k8s deployments in parallel [tools/scap] - 10https://gerrit.wikimedia.org/r/832338 (https://phabricator.wikimedia.org/T318181) (owner: 10Ahmon Dancy) [08:30:28] (03Merged) 10jenkins-bot: Perform k8s deployments in parallel [tools/scap] - 10https://gerrit.wikimedia.org/r/832338 (https://phabricator.wikimedia.org/T318181) (owner: 10Ahmon Dancy) [08:52:51] 10Phabricator, 10Release-Engineering-Team (Bonus Level 🕹ī¸), 10DBA, 10serviceops, and 2 others: sort out mysql privileges for phab1004/phab2002 - https://phabricator.wikimedia.org/T315713 (10Marostegui) Daniel, while working on the grants, we've noticed something strange with db1117 (m3-slave), so we are go... [09:10:56] 10Phabricator, 10Release-Engineering-Team (Bonus Level 🕹ī¸), 10DBA, 10serviceops, and 2 others: sort out mysql privileges for phab1004/phab2002 - https://phabricator.wikimedia.org/T315713 (10Marostegui) @Dzahn also, to confirm, phab1004 needs to have exactly the same grants as phab1001, right? I see it does... [10:43:48] 10Beta-Cluster-Infrastructure, 10Patch-For-Review: deployment-ms-fe03 puppet failure - https://phabricator.wikimedia.org/T316845 (10MatthewVernon) [sorry for the delay - it's been the SRE Summit this week, which has eaten all of my time] OK, the problem is you need to tell the swift ring management machinery... [13:15:41] (03PS5) 10Jforrester: Zuul: Run php 7.4 phan for extensions and skins [integration/config] - 10https://gerrit.wikimedia.org/r/833053 (owner: 10Zabe) [13:15:46] (03CR) 10Jforrester: [C: 03+2] Zuul: Run php 7.4 phan for extensions and skins [integration/config] - 10https://gerrit.wikimedia.org/r/833053 (owner: 10Zabe) [13:17:39] (03Merged) 10jenkins-bot: Zuul: Run php 7.4 phan for extensions and skins [integration/config] - 10https://gerrit.wikimedia.org/r/833053 (owner: 10Zabe) [13:25:24] dcausse: I forgot about the ApiFeatureUsage patch from yesterday, I guess I can cherry pick deploy it to prod ? ) [13:25:45] that looks fairly isolated, but maybe it is safer to wait on monday [13:26:30] !log Zuul: Run php 7.4 phan for extensions and skins [13:26:32] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [13:27:27] James_F: nice one! :) [13:27:41] hashar: Zabe spotted it, credit to him. :-) [13:27:56] hashar: yes sure! [13:29:15] https://gerrit.wikimedia.org/r/c/mediawiki/extensions/ApiFeatureUsage/+/834531 :D [13:29:43] hashar: lemme know if you want me to test [13:30:09] I am scaping it with `scap backport` [13:30:51] so I guess ~ 15 minutes before it get merged then we can test on mwdebug [13:31:05] it is probably all about browsing to `Special:ApiFeatureUsage` [13:31:38] yes, seems easy to trigger the problem [13:31:50] oh [13:31:51] seeing results might actually require knowing a bot UA [13:31:52] it has merged already [13:32:01] CI is very empty right now. [13:32:07] yes without tests CI is fast :P [13:32:09] And APIFeatureUsage has almost no tests. [13:32:29] aha [13:32:34] anyway that fixed it [13:32:44] I have tested https://en.wikipedia.org/wiki/Special:ApiFeatureUsage?wpagent=pywikibot&wpstartdate=2021-11-24&wpenddate=2022-09-22 [13:33:11] yes looks like it's working [13:33:17] thanks for the backport! [13:33:17] <3 [13:34:24] going live [14:36:25] (03PS1) 10Jforrester: jjb: Provide api-testing-*-php74-docker [integration/config] - 10https://gerrit.wikimedia.org/r/834563 [14:36:29] (03PS1) 10Jforrester: jjb: Provide integration-composer-check-php74-docker [integration/config] - 10https://gerrit.wikimedia.org/r/834564 [14:36:31] (03PS1) 10Jforrester: jjb: Migrate integration-quibble-fullrun* from php72 to php74 [integration/config] - 10https://gerrit.wikimedia.org/r/834565 [14:36:40] (03PS1) 10Jforrester: dockerfiles: [composer-security-check] Migrate from php72 to php74 [integration/config] - 10https://gerrit.wikimedia.org/r/834566 [14:36:42] (03PS1) 10Jforrester: dockerfiles: [mediawiki-phan] Migrate from php72 to php74 [integration/config] - 10https://gerrit.wikimedia.org/r/834567 [14:36:44] (03PS1) 10Jforrester: dockerfiles: [mediawiki-phan-testrun] Migrate from php72 to php74 [integration/config] - 10https://gerrit.wikimedia.org/r/834568 [14:36:46] (03PS1) 10Jforrester: dockerfiles: [phpmetrics] Migrate from php72 to php74 [integration/config] - 10https://gerrit.wikimedia.org/r/834569 [14:36:55] (03PS3) 10Jforrester: [DNM] Zuul: [mediawiki/vendor] Drop PHP72 jobs, use only PHP74 ones [integration/config] - 10https://gerrit.wikimedia.org/r/833024 [14:36:56] (03PS5) 10Jforrester: [DNM] Zuul: [mediawiki/core] Drop PHP 7.2 and PHP 7.3 testing for master and wmf [integration/config] - 10https://gerrit.wikimedia.org/r/827496 (https://phabricator.wikimedia.org/T261872) [14:36:58] (03PS2) 10Jforrester: [DNM] Zuul: Drop PHP72 jobs everywhere, and PHP73 everywhere except old branches [integration/config] - 10https://gerrit.wikimedia.org/r/833051 [14:37:01] (03PS1) 10Jforrester: Zuul: Fold extension-quibble-composer-php73-or-later into extension-quibble-composer [integration/config] - 10https://gerrit.wikimedia.org/r/834570 [14:37:13] (03PS1) 10Jforrester: Zuul: [labs/tools/coverme] Migrate tests from php73+ to php74+ [integration/config] - 10https://gerrit.wikimedia.org/r/834571 [14:37:15] (03PS1) 10Jforrester: Zuul: [labs/tools/guc] Migrate tests from php73+ to php74+ [integration/config] - 10https://gerrit.wikimedia.org/r/834572 [14:37:17] (03PS1) 10Jforrester: Zuul: [wikimedia-cz/web-*] Migrate tests from php73+ to php74+ [integration/config] - 10https://gerrit.wikimedia.org/r/834573 [14:37:19] (03PS1) 10Jforrester: Zuul: [integration/docroot] Migrate tests from php73+ to php74+ [integration/config] - 10https://gerrit.wikimedia.org/r/834574 [14:37:21] (03PS1) 10Jforrester: jjb: [mw-tools-codesniffer-mwcore-testrun] Switch helps to PHP 7.4 [integration/config] - 10https://gerrit.wikimedia.org/r/834575 [14:37:23] (03PS1) 10Jforrester: jjb: Drop unused jobs for PHP 7.2 and 7.3 [integration/config] - 10https://gerrit.wikimedia.org/r/834576 [14:37:25] (03PS1) 10Jforrester: jjb: Migrate mediawiki-selenium-integration-docker from php72 to php74 [integration/config] - 10https://gerrit.wikimedia.org/r/834577 [14:37:27] (03PS1) 10Jforrester: jjb: Migrate legacy-quibble-rubyselenium-docker from php72 to php74 [integration/config] - 10https://gerrit.wikimedia.org/r/834578 [14:37:29] (03PS1) 10Jforrester: jjb: Migrate mediawiki-phpbench-patch-docker from php72 to php74 [integration/config] - 10https://gerrit.wikimedia.org/r/834579 [14:37:31] (03PS1) 10Jforrester: jjb: Provide quibble-daily-* for php74 as well as php72 [integration/config] - 10https://gerrit.wikimedia.org/r/834580 [14:37:33] (03PS1) 10Jforrester: jjb: Drop quibble-daily-* for for php72 [integration/config] - 10https://gerrit.wikimedia.org/r/834581 [14:37:35] (03PS1) 10Jforrester: jjb: Drop quibble php72 jobs [integration/config] - 10https://gerrit.wikimedia.org/r/834582 [14:37:37] (03PS1) 10Jforrester: dockerfiles: Drop php72 images, now unused [integration/config] - 10https://gerrit.wikimedia.org/r/834583 [14:37:57] Oh dear, 24 patches deep? Whoops, that might kill Zuul. :-( [14:39:39] oh my [14:39:40] (Queue (Jenkins jobs + Zuul functions) alert) firing: Queue (Jenkins jobs + Zuul functions) alert - https://alerts.wikimedia.org/?q=alertname%3DQueue+%28Jenkins+jobs+%2B+Zuul+functions%29+alert [14:39:53] * Lucas_WMDE still excited for PHP 7.4 though [14:39:58] (03CR) 10CI reject: [V: 04-1] [DNM] Zuul: [mediawiki/core] Drop PHP 7.2 and PHP 7.3 testing for master and wmf [integration/config] - 10https://gerrit.wikimedia.org/r/827496 (https://phabricator.wikimedia.org/T261872) (owner: 10Jforrester) [14:40:17] (03CR) 10CI reject: [V: 04-1] [DNM] Zuul: Drop PHP72 jobs everywhere, and PHP73 everywhere except old branches [integration/config] - 10https://gerrit.wikimedia.org/r/833051 (owner: 10Jforrester) [14:40:40] (03CR) 10CI reject: [V: 04-1] Zuul: Fold extension-quibble-composer-php73-or-later into extension-quibble-composer [integration/config] - 10https://gerrit.wikimedia.org/r/834570 (owner: 10Jforrester) [14:41:20] (03CR) 10CI reject: [V: 04-1] Zuul: [labs/tools/coverme] Migrate tests from php73+ to php74+ [integration/config] - 10https://gerrit.wikimedia.org/r/834571 (owner: 10Jforrester) [14:41:46] (03CR) 10CI reject: [V: 04-1] Zuul: [labs/tools/guc] Migrate tests from php73+ to php74+ [integration/config] - 10https://gerrit.wikimedia.org/r/834572 (owner: 10Jforrester) [14:42:29] (03CR) 10CI reject: [V: 04-1] Zuul: [wikimedia-cz/web-*] Migrate tests from php73+ to php74+ [integration/config] - 10https://gerrit.wikimedia.org/r/834573 (owner: 10Jforrester) [14:43:09] (03CR) 10CI reject: [V: 04-1] Zuul: [integration/docroot] Migrate tests from php73+ to php74+ [integration/config] - 10https://gerrit.wikimedia.org/r/834574 (owner: 10Jforrester) [14:43:55] (03CR) 10CI reject: [V: 04-1] jjb: [mw-tools-codesniffer-mwcore-testrun] Switch helps to PHP 7.4 [integration/config] - 10https://gerrit.wikimedia.org/r/834575 (owner: 10Jforrester) [14:44:44] (03CR) 10CI reject: [V: 04-1] jjb: Drop unused jobs for PHP 7.2 and 7.3 [integration/config] - 10https://gerrit.wikimedia.org/r/834576 (owner: 10Jforrester) [14:45:31] (03CR) 10CI reject: [V: 04-1] jjb: Migrate mediawiki-selenium-integration-docker from php72 to php74 [integration/config] - 10https://gerrit.wikimedia.org/r/834577 (owner: 10Jforrester) [14:46:33] (03CR) 10CI reject: [V: 04-1] jjb: Migrate legacy-quibble-rubyselenium-docker from php72 to php74 [integration/config] - 10https://gerrit.wikimedia.org/r/834578 (owner: 10Jforrester) [14:47:40] (03CR) 10CI reject: [V: 04-1] jjb: Migrate mediawiki-phpbench-patch-docker from php72 to php74 [integration/config] - 10https://gerrit.wikimedia.org/r/834579 (owner: 10Jforrester) [14:48:46] (03CR) 10CI reject: [V: 04-1] jjb: Provide quibble-daily-* for php74 as well as php72 [integration/config] - 10https://gerrit.wikimedia.org/r/834580 (owner: 10Jforrester) [14:50:11] (03CR) 10CI reject: [V: 04-1] jjb: Drop quibble-daily-* for for php72 [integration/config] - 10https://gerrit.wikimedia.org/r/834581 (owner: 10Jforrester) [14:50:49] PROBLEM - Work requests waiting in Zuul Gearman server on contint2001 is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [400.0] https://www.mediawiki.org/wiki/Continuous_integration/Zuul https://grafana.wikimedia.org/d/000000322/zuul-gearman?orgId=1&viewPanel=10 [14:51:29] (03CR) 10CI reject: [V: 04-1] jjb: Drop quibble php72 jobs [integration/config] - 10https://gerrit.wikimedia.org/r/834582 (owner: 10Jforrester) [14:52:51] (03CR) 10CI reject: [V: 04-1] dockerfiles: Drop php72 images, now unused [integration/config] - 10https://gerrit.wikimedia.org/r/834583 (owner: 10Jforrester) [15:39:40] (Queue (Jenkins jobs + Zuul functions) alert) firing: (2) Queue (Jenkins jobs + Zuul functions) alert - https://alerts.wikimedia.org/?q=alertname%3DQueue+%28Jenkins+jobs+%2B+Zuul+functions%29+alert [15:41:07] RECOVERY - Work requests waiting in Zuul Gearman server on contint2001 is OK: OK: Less than 100.00% above the threshold [200.0] https://www.mediawiki.org/wiki/Continuous_integration/Zuul https://grafana.wikimedia.org/d/000000322/zuul-gearman?orgId=1&viewPanel=10 [15:47:17] (03CR) 10Jforrester: [C: 03+2] "Deployed." [integration/config] - 10https://gerrit.wikimedia.org/r/834563 (owner: 10Jforrester) [15:47:32] (03CR) 10Jforrester: [C: 03+2] "Deployed." [integration/config] - 10https://gerrit.wikimedia.org/r/834564 (owner: 10Jforrester) [15:47:58] (03CR) 10Jforrester: [C: 03+2] "Deployed." [integration/config] - 10https://gerrit.wikimedia.org/r/834565 (owner: 10Jforrester) [15:49:43] (03Merged) 10jenkins-bot: jjb: Provide api-testing-*-php74-docker [integration/config] - 10https://gerrit.wikimedia.org/r/834563 (owner: 10Jforrester) [15:49:45] (03Merged) 10jenkins-bot: jjb: Provide integration-composer-check-php74-docker [integration/config] - 10https://gerrit.wikimedia.org/r/834564 (owner: 10Jforrester) [15:49:54] (03Merged) 10jenkins-bot: jjb: Migrate integration-quibble-fullrun* from php72 to php74 [integration/config] - 10https://gerrit.wikimedia.org/r/834565 (owner: 10Jforrester) [15:51:00] (03CR) 10Jforrester: [C: 03+2] dockerfiles: [composer-security-check] Migrate from php72 to php74 [integration/config] - 10https://gerrit.wikimedia.org/r/834566 (owner: 10Jforrester) [15:51:02] (03CR) 10Jforrester: [C: 03+2] dockerfiles: [mediawiki-phan] Migrate from php72 to php74 [integration/config] - 10https://gerrit.wikimedia.org/r/834567 (owner: 10Jforrester) [15:51:06] (03CR) 10Jforrester: [C: 03+2] dockerfiles: [mediawiki-phan-testrun] Migrate from php72 to php74 [integration/config] - 10https://gerrit.wikimedia.org/r/834568 (owner: 10Jforrester) [15:51:08] (03CR) 10Jforrester: [C: 03+2] dockerfiles: [phpmetrics] Migrate from php72 to php74 [integration/config] - 10https://gerrit.wikimedia.org/r/834569 (owner: 10Jforrester) [15:52:59] (03Merged) 10jenkins-bot: dockerfiles: [composer-security-check] Migrate from php72 to php74 [integration/config] - 10https://gerrit.wikimedia.org/r/834566 (owner: 10Jforrester) [15:53:04] (03Merged) 10jenkins-bot: dockerfiles: [mediawiki-phan] Migrate from php72 to php74 [integration/config] - 10https://gerrit.wikimedia.org/r/834567 (owner: 10Jforrester) [15:53:10] (03Merged) 10jenkins-bot: dockerfiles: [mediawiki-phan-testrun] Migrate from php72 to php74 [integration/config] - 10https://gerrit.wikimedia.org/r/834568 (owner: 10Jforrester) [15:53:14] (03Merged) 10jenkins-bot: dockerfiles: [phpmetrics] Migrate from php72 to php74 [integration/config] - 10https://gerrit.wikimedia.org/r/834569 (owner: 10Jforrester) [15:55:11] !log Docker: Building and publishing php74 versions of composer-security-check, mediawiki-phan, mediawiki-phan-testrun, and phpmetrics [15:55:13] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [15:57:06] (03PS1) 10Jforrester: jjb: [php-composer-security-docker] Switch to php74 image [integration/config] - 10https://gerrit.wikimedia.org/r/834591 [15:57:08] (03PS1) 10Jforrester: jjb: Upgrade phpmetrics jobs to ones using the php74 image [integration/config] - 10https://gerrit.wikimedia.org/r/834592 [15:57:46] (03CR) 10Jforrester: [C: 03+2] "Deployed." [integration/config] - 10https://gerrit.wikimedia.org/r/834591 (owner: 10Jforrester) [15:57:52] (03CR) 10Jforrester: [C: 03+2] "Deployed." [integration/config] - 10https://gerrit.wikimedia.org/r/834592 (owner: 10Jforrester) [15:59:40] (Queue (Jenkins jobs + Zuul functions) alert) resolved: Queue (Jenkins jobs + Zuul functions) alert - https://alerts.wikimedia.org/?q=alertname%3DQueue+%28Jenkins+jobs+%2B+Zuul+functions%29+alert [15:59:48] (03Merged) 10jenkins-bot: jjb: [php-composer-security-docker] Switch to php74 image [integration/config] - 10https://gerrit.wikimedia.org/r/834591 (owner: 10Jforrester) [15:59:55] (03Merged) 10jenkins-bot: jjb: Upgrade phpmetrics jobs to ones using the php74 image [integration/config] - 10https://gerrit.wikimedia.org/r/834592 (owner: 10Jforrester) [16:01:10] (03PS1) 10Jforrester: dockerfiles: Tweak mediawiki-phan and mediawiki-phan-testrun fixes to build [integration/config] - 10https://gerrit.wikimedia.org/r/834593 [16:01:17] (03CR) 10Jforrester: [C: 03+2] dockerfiles: Tweak mediawiki-phan and mediawiki-phan-testrun fixes to build [integration/config] - 10https://gerrit.wikimedia.org/r/834593 (owner: 10Jforrester) [16:03:14] (03Merged) 10jenkins-bot: dockerfiles: Tweak mediawiki-phan and mediawiki-phan-testrun fixes to build [integration/config] - 10https://gerrit.wikimedia.org/r/834593 (owner: 10Jforrester) [16:06:54] (03PS1) 10Jforrester: jjb: [mw-tools-phan-mwcore-testrun] Switch to php74 image [integration/config] - 10https://gerrit.wikimedia.org/r/834595 [16:07:12] (03CR) 10Jforrester: [C: 03+2] "Deployed." [integration/config] - 10https://gerrit.wikimedia.org/r/834595 (owner: 10Jforrester) [16:09:06] (03Merged) 10jenkins-bot: jjb: [mw-tools-phan-mwcore-testrun] Switch to php74 image [integration/config] - 10https://gerrit.wikimedia.org/r/834595 (owner: 10Jforrester) [16:11:47] (03PS2) 10Jforrester: jjb: Migrate mediawiki-selenium-integration-docker from php72 to php74 [integration/config] - 10https://gerrit.wikimedia.org/r/834577 [16:11:49] (03PS2) 10Jforrester: jjb: Migrate legacy-quibble-rubyselenium-docker from php72 to php74 [integration/config] - 10https://gerrit.wikimedia.org/r/834578 [16:11:51] (03PS2) 10Jforrester: jjb: Migrate mediawiki-phpbench-patch-docker from php72 to php74 [integration/config] - 10https://gerrit.wikimedia.org/r/834579 [16:11:53] (03PS2) 10Jforrester: jjb: Provide quibble-daily-* for php74 as well as php72 [integration/config] - 10https://gerrit.wikimedia.org/r/834580 [16:11:55] (03PS2) 10Jforrester: Zuul: [labs/tools/coverme] Migrate tests from php73+ to php74+ [integration/config] - 10https://gerrit.wikimedia.org/r/834571 [16:11:57] (03PS2) 10Jforrester: Zuul: [labs/tools/guc] Migrate tests from php73+ to php74+ [integration/config] - 10https://gerrit.wikimedia.org/r/834572 [16:11:59] (03PS2) 10Jforrester: Zuul: [wikimedia-cz/web-*] Migrate tests from php73+ to php74+ [integration/config] - 10https://gerrit.wikimedia.org/r/834573 [16:12:01] (03PS4) 10Jforrester: [DNM] Zuul: [mediawiki/vendor] Drop PHP72 jobs, use only PHP74 ones [integration/config] - 10https://gerrit.wikimedia.org/r/833024 [16:12:03] (03PS6) 10Jforrester: [DNM] Zuul: [mediawiki/core] Drop PHP 7.2 and PHP 7.3 testing for master and wmf [integration/config] - 10https://gerrit.wikimedia.org/r/827496 (https://phabricator.wikimedia.org/T261872) [16:12:05] (03PS3) 10Jforrester: [DNM] Zuul: Drop PHP72 jobs everywhere, and PHP73 everywhere except old branches [integration/config] - 10https://gerrit.wikimedia.org/r/833051 [16:12:07] (03PS2) 10Jforrester: Zuul: Fold extension-quibble-composer-php73-or-later into extension-quibble-composer [integration/config] - 10https://gerrit.wikimedia.org/r/834570 [16:12:09] (03PS2) 10Jforrester: Zuul: [integration/docroot] Migrate tests from php73+ to php74+ [integration/config] - 10https://gerrit.wikimedia.org/r/834574 [16:12:11] (03PS2) 10Jforrester: jjb: [mw-tools-codesniffer-mwcore-testrun] Switch helps to PHP 7.4 [integration/config] - 10https://gerrit.wikimedia.org/r/834575 [16:12:13] (03PS2) 10Jforrester: jjb: Drop unused jobs for PHP 7.2 and 7.3 [integration/config] - 10https://gerrit.wikimedia.org/r/834576 [16:12:15] (03PS2) 10Jforrester: jjb: Drop quibble-daily-* for for php72 [integration/config] - 10https://gerrit.wikimedia.org/r/834581 [16:12:17] (03PS2) 10Jforrester: jjb: Drop quibble php72 jobs [integration/config] - 10https://gerrit.wikimedia.org/r/834582 [16:12:19] (03PS2) 10Jforrester: dockerfiles: Drop php72 images, now unused [integration/config] - 10https://gerrit.wikimedia.org/r/834583 [16:13:19] (03CR) 10Jforrester: [C: 03+2] "Deployed." [integration/config] - 10https://gerrit.wikimedia.org/r/834577 (owner: 10Jforrester) [16:14:26] (03CR) 10Jforrester: [C: 03+2] "Deployed." [integration/config] - 10https://gerrit.wikimedia.org/r/834578 (owner: 10Jforrester) [16:14:38] (03CR) 10Jforrester: [C: 03+2] "Deployed." [integration/config] - 10https://gerrit.wikimedia.org/r/834579 (owner: 10Jforrester) [16:14:45] (03CR) 10CI reject: [V: 04-1] Zuul: [labs/tools/coverme] Migrate tests from php73+ to php74+ [integration/config] - 10https://gerrit.wikimedia.org/r/834571 (owner: 10Jforrester) [16:14:49] (03CR) 10CI reject: [V: 04-1] Zuul: [labs/tools/guc] Migrate tests from php73+ to php74+ [integration/config] - 10https://gerrit.wikimedia.org/r/834572 (owner: 10Jforrester) [16:14:59] (03CR) 10CI reject: [V: 04-1] Zuul: [wikimedia-cz/web-*] Migrate tests from php73+ to php74+ [integration/config] - 10https://gerrit.wikimedia.org/r/834573 (owner: 10Jforrester) [16:15:03] (03CR) 10Jforrester: [C: 03+2] "Deployed." [integration/config] - 10https://gerrit.wikimedia.org/r/834580 (owner: 10Jforrester) [16:15:10] (03CR) 10CI reject: [V: 04-1] [DNM] Zuul: [mediawiki/vendor] Drop PHP72 jobs, use only PHP74 ones [integration/config] - 10https://gerrit.wikimedia.org/r/833024 (owner: 10Jforrester) [16:15:33] (03CR) 10CI reject: [V: 04-1] [DNM] Zuul: [mediawiki/core] Drop PHP 7.2 and PHP 7.3 testing for master and wmf [integration/config] - 10https://gerrit.wikimedia.org/r/827496 (https://phabricator.wikimedia.org/T261872) (owner: 10Jforrester) [16:15:41] (Queue (Jenkins jobs + Zuul functions) alert) firing: Queue (Jenkins jobs + Zuul functions) alert - https://alerts.wikimedia.org/?q=alertname%3DQueue+%28Jenkins+jobs+%2B+Zuul+functions%29+alert [16:15:56] (03CR) 10CI reject: [V: 04-1] [DNM] Zuul: Drop PHP72 jobs everywhere, and PHP73 everywhere except old branches [integration/config] - 10https://gerrit.wikimedia.org/r/833051 (owner: 10Jforrester) [16:16:20] (03CR) 10CI reject: [V: 04-1] Zuul: Fold extension-quibble-composer-php73-or-later into extension-quibble-composer [integration/config] - 10https://gerrit.wikimedia.org/r/834570 (owner: 10Jforrester) [16:16:50] (03PS1) 10Jforrester: Zuul: Provide composer-test-php74-or-later template [integration/config] - 10https://gerrit.wikimedia.org/r/834597 [16:16:56] (03CR) 10CI reject: [V: 04-1] Zuul: [integration/docroot] Migrate tests from php73+ to php74+ [integration/config] - 10https://gerrit.wikimedia.org/r/834574 (owner: 10Jforrester) [16:17:06] (03CR) 10Jforrester: [C: 03+2] Zuul: Provide composer-test-php74-or-later template [integration/config] - 10https://gerrit.wikimedia.org/r/834597 (owner: 10Jforrester) [16:17:29] (03CR) 10CI reject: [V: 04-1] jjb: [mw-tools-codesniffer-mwcore-testrun] Switch helps to PHP 7.4 [integration/config] - 10https://gerrit.wikimedia.org/r/834575 (owner: 10Jforrester) [16:18:07] (03CR) 10CI reject: [V: 04-1] jjb: Drop unused jobs for PHP 7.2 and 7.3 [integration/config] - 10https://gerrit.wikimedia.org/r/834576 (owner: 10Jforrester) [16:18:49] (03CR) 10CI reject: [V: 04-1] jjb: Drop quibble-daily-* for for php72 [integration/config] - 10https://gerrit.wikimedia.org/r/834581 (owner: 10Jforrester) [16:19:39] (03CR) 10CI reject: [V: 04-1] jjb: Drop quibble php72 jobs [integration/config] - 10https://gerrit.wikimedia.org/r/834582 (owner: 10Jforrester) [16:20:34] (03CR) 10CI reject: [V: 04-1] dockerfiles: Drop php72 images, now unused [integration/config] - 10https://gerrit.wikimedia.org/r/834583 (owner: 10Jforrester) [16:20:37] (03Merged) 10jenkins-bot: jjb: Migrate mediawiki-selenium-integration-docker from php72 to php74 [integration/config] - 10https://gerrit.wikimedia.org/r/834577 (owner: 10Jforrester) [16:21:10] (03Merged) 10jenkins-bot: jjb: Migrate legacy-quibble-rubyselenium-docker from php72 to php74 [integration/config] - 10https://gerrit.wikimedia.org/r/834578 (owner: 10Jforrester) [16:21:12] (03Merged) 10jenkins-bot: jjb: Migrate mediawiki-phpbench-patch-docker from php72 to php74 [integration/config] - 10https://gerrit.wikimedia.org/r/834579 (owner: 10Jforrester) [16:21:14] (03Merged) 10jenkins-bot: jjb: Provide quibble-daily-* for php74 as well as php72 [integration/config] - 10https://gerrit.wikimedia.org/r/834580 (owner: 10Jforrester) [16:21:16] (03Merged) 10jenkins-bot: Zuul: Provide composer-test-php74-or-later template [integration/config] - 10https://gerrit.wikimedia.org/r/834597 (owner: 10Jforrester) [16:26:31] PROBLEM - Work requests waiting in Zuul Gearman server on contint2001 is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [400.0] https://www.mediawiki.org/wiki/Continuous_integration/Zuul https://grafana.wikimedia.org/d/000000322/zuul-gearman?orgId=1&viewPanel=10 [16:34:33] 10GitLab (CI & Job Runners), 10Release-Engineering-Team (Priority Backlog đŸ“Ĩ), 10Patch-For-Review: Buildkitd cannot publish image due to `certificate signed by unknown authority` - https://phabricator.wikimedia.org/T318019 (10dduvall) 05Open→03Resolved [16:39:15] 10Phabricator, 10Release-Engineering-Team (Bonus Level 🕹ī¸), 10DBA, 10serviceops, and 2 others: sort out mysql privileges for phab1004/phab2002 - https://phabricator.wikimedia.org/T315713 (10Aklapper) Assuming it's related, if not please ignore this comment: After ssh'ing onto phab1001, I cannot connect to... [16:50:25] RECOVERY - Work requests waiting in Zuul Gearman server on contint2001 is OK: OK: Less than 100.00% above the threshold [200.0] https://www.mediawiki.org/wiki/Continuous_integration/Zuul https://grafana.wikimedia.org/d/000000322/zuul-gearman?orgId=1&viewPanel=10 [16:50:41] (Queue (Jenkins jobs + Zuul functions) alert) firing: (2) Queue (Jenkins jobs + Zuul functions) alert - https://alerts.wikimedia.org/?q=alertname%3DQueue+%28Jenkins+jobs+%2B+Zuul+functions%29+alert [17:10:41] (Queue (Jenkins jobs + Zuul functions) alert) resolved: Queue (Jenkins jobs + Zuul functions) alert - https://alerts.wikimedia.org/?q=alertname%3DQueue+%28Jenkins+jobs+%2B+Zuul+functions%29+alert [17:24:00] 10GitLab (CI & Job Runners), 10Release-Engineering-Team (Priority Backlog đŸ“Ĩ), 10Patch-For-Review, 10User-brennen: Deploy buildkitd to trusted GitLab runners - https://phabricator.wikimedia.org/T308271 (10dduvall) [17:24:52] 10GitLab (CI & Job Runners), 10Release-Engineering-Team (Priority Backlog đŸ“Ĩ), 10Patch-For-Review, 10User-brennen: Authenticate trusted runners for registry access against GitLab using temporary JSON Web Token - https://phabricator.wikimedia.org/T308501 (10dduvall) 05Stalled→03In progress Now that https... [17:29:24] (03Abandoned) 10Dduvall: WIP: scap blame-trace for investigating MW stack traces [tools/scap] - 10https://gerrit.wikimedia.org/r/773870 (owner: 10Dduvall) [17:34:29] James_F: I have opened Gerrit and my homepage is full of yellowish changesI have to review :D [17:51:30] hashar: I'll deploy a bunch of them, don't worry. :-) [17:52:55] (03CR) 10Dduvall: [C: 03+2] Support checks running before a stage [tools/scap] - 10https://gerrit.wikimedia.org/r/831152 (owner: 10Hashar) [17:54:31] (03CR) 10Dduvall: [C: 03+2] Remove legacy sync.flag check [tools/scap] - 10https://gerrit.wikimedia.org/r/833464 (owner: 10Ahmon Dancy) [17:57:17] (03PS3) 10Jforrester: Zuul: [labs/tools/coverme] Migrate tests from php73+ to php74+ [integration/config] - 10https://gerrit.wikimedia.org/r/834571 [17:57:19] (03PS3) 10Jforrester: Zuul: [labs/tools/guc] Migrate tests from php73+ to php74+ [integration/config] - 10https://gerrit.wikimedia.org/r/834572 [17:57:21] (03PS3) 10Jforrester: Zuul: [wikimedia-cz/web-*] Migrate tests from php73+ to php74+ [integration/config] - 10https://gerrit.wikimedia.org/r/834573 [17:57:23] (03PS5) 10Jforrester: [DNM] Zuul: [mediawiki/vendor] Drop PHP72 jobs, use only PHP74 ones [integration/config] - 10https://gerrit.wikimedia.org/r/833024 [17:57:34] (03Merged) 10jenkins-bot: Remove legacy sync.flag check [tools/scap] - 10https://gerrit.wikimedia.org/r/833464 (owner: 10Ahmon Dancy) [17:59:38] (03CR) 10Jforrester: [C: 03+2] Zuul: [labs/tools/coverme] Migrate tests from php73+ to php74+ [integration/config] - 10https://gerrit.wikimedia.org/r/834571 (owner: 10Jforrester) [18:02:02] (03Merged) 10jenkins-bot: Zuul: [labs/tools/coverme] Migrate tests from php73+ to php74+ [integration/config] - 10https://gerrit.wikimedia.org/r/834571 (owner: 10Jforrester) [18:04:15] !log Zuul: [labs/tools/coverme] Migrate tests from php73+ to php74+ [18:04:16] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [18:04:35] (03CR) 10Jforrester: [C: 03+2] Zuul: [labs/tools/guc] Migrate tests from php73+ to php74+ [integration/config] - 10https://gerrit.wikimedia.org/r/834572 (owner: 10Jforrester) [18:06:40] (03Merged) 10jenkins-bot: Zuul: [labs/tools/guc] Migrate tests from php73+ to php74+ [integration/config] - 10https://gerrit.wikimedia.org/r/834572 (owner: 10Jforrester) [18:06:54] !log Zuul: [labs/tools/guc] Migrate tests from php73+ to php74+ [18:06:55] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [18:07:02] (03CR) 10Jforrester: [C: 03+2] Zuul: [wikimedia-cz/web-*] Migrate tests from php73+ to php74+ [integration/config] - 10https://gerrit.wikimedia.org/r/834573 (owner: 10Jforrester) [18:08:59] (03Merged) 10jenkins-bot: Zuul: [wikimedia-cz/web-*] Migrate tests from php73+ to php74+ [integration/config] - 10https://gerrit.wikimedia.org/r/834573 (owner: 10Jforrester) [18:09:04] !log Zuul: [wikimedia-cz/web-*] Migrate tests from php73+ to php74+ [18:09:05] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [18:13:22] (03PS3) 10Jforrester: jjb: [mw-tools-codesniffer-mwcore-testrun] Switch helpers to PHP 7.4 [integration/config] - 10https://gerrit.wikimedia.org/r/834575 [18:13:24] (03PS6) 10Jforrester: [DNM] Zuul: [mediawiki/vendor] Drop PHP72 jobs, use only PHP74 ones [integration/config] - 10https://gerrit.wikimedia.org/r/833024 [18:13:26] (03PS7) 10Jforrester: [DNM] Zuul: [mediawiki/core] Drop PHP 7.2 and PHP 7.3 testing for master and wmf [integration/config] - 10https://gerrit.wikimedia.org/r/827496 (https://phabricator.wikimedia.org/T261872) [18:13:28] (03PS4) 10Jforrester: [DNM] Zuul: Drop PHP72 jobs everywhere, and PHP73 everywhere except old branches [integration/config] - 10https://gerrit.wikimedia.org/r/833051 [18:13:30] (03PS3) 10Jforrester: Zuul: Fold extension-quibble-composer-php73-or-later into extension-quibble-composer [integration/config] - 10https://gerrit.wikimedia.org/r/834570 [18:13:32] (03PS3) 10Jforrester: Zuul: [integration/docroot] Migrate tests from php73+ to php74+ [integration/config] - 10https://gerrit.wikimedia.org/r/834574 [18:13:34] (03PS3) 10Jforrester: jjb: Drop unused jobs for PHP 7.2 and 7.3 [integration/config] - 10https://gerrit.wikimedia.org/r/834576 [18:13:36] (03PS3) 10Jforrester: jjb: Drop quibble-daily-* for for php72 [integration/config] - 10https://gerrit.wikimedia.org/r/834581 [18:13:38] (03PS3) 10Jforrester: jjb: Drop quibble php72 jobs [integration/config] - 10https://gerrit.wikimedia.org/r/834582 [18:13:40] (03PS3) 10Jforrester: dockerfiles: Drop php72 images, now unused [integration/config] - 10https://gerrit.wikimedia.org/r/834583 [18:13:42] (03CR) 10Jforrester: [C: 03+2] "Deployed." [integration/config] - 10https://gerrit.wikimedia.org/r/834575 (owner: 10Jforrester) [18:15:37] (03CR) 10CI reject: [V: 04-1] [DNM] Zuul: Drop PHP72 jobs everywhere, and PHP73 everywhere except old branches [integration/config] - 10https://gerrit.wikimedia.org/r/833051 (owner: 10Jforrester) [18:15:42] (03CR) 10CI reject: [V: 04-1] [DNM] Zuul: [mediawiki/core] Drop PHP 7.2 and PHP 7.3 testing for master and wmf [integration/config] - 10https://gerrit.wikimedia.org/r/827496 (https://phabricator.wikimedia.org/T261872) (owner: 10Jforrester) [18:15:49] (03CR) 10CI reject: [V: 04-1] Zuul: Fold extension-quibble-composer-php73-or-later into extension-quibble-composer [integration/config] - 10https://gerrit.wikimedia.org/r/834570 (owner: 10Jforrester) [18:16:01] (03CR) 10CI reject: [V: 04-1] Zuul: [integration/docroot] Migrate tests from php73+ to php74+ [integration/config] - 10https://gerrit.wikimedia.org/r/834574 (owner: 10Jforrester) [18:16:14] (03CR) 10jenkins-bot: jjb: Drop unused jobs for PHP 7.2 and 7.3 [integration/config] - 10https://gerrit.wikimedia.org/r/834576 (owner: 10Jforrester) [18:16:27] (03CR) 10jenkins-bot: jjb: Drop quibble-daily-* for for php72 [integration/config] - 10https://gerrit.wikimedia.org/r/834581 (owner: 10Jforrester) [18:16:51] (03CR) 10jenkins-bot: jjb: Drop quibble php72 jobs [integration/config] - 10https://gerrit.wikimedia.org/r/834582 (owner: 10Jforrester) [18:17:15] (03CR) 10jenkins-bot: dockerfiles: Drop php72 images, now unused [integration/config] - 10https://gerrit.wikimedia.org/r/834583 (owner: 10Jforrester) [18:17:53] (03Merged) 10jenkins-bot: jjb: [mw-tools-codesniffer-mwcore-testrun] Switch helpers to PHP 7.4 [integration/config] - 10https://gerrit.wikimedia.org/r/834575 (owner: 10Jforrester) [19:46:13] 10MediaWiki-Releasing, 10Documentation, 10MW-1.39-release: Write release announcement for 1.39.0-rc.0 - https://phabricator.wikimedia.org/T313924 (10Reedy) [19:46:26] 10MediaWiki-Releasing, 10MW-1.39-notes, 10MW-1.39-release: Release MW 1.39.0 - https://phabricator.wikimedia.org/T313916 (10Reedy) [19:46:30] 10MediaWiki-Releasing, 10MW-1.39-notes, 10MW-1.39-release: Release 1.39.0-rc.0 - https://phabricator.wikimedia.org/T313923 (10Reedy) 05Open→03In progress [19:50:24] 10GitLab (CI & Job Runners), 10Release-Engineering-Team (Priority Backlog đŸ“Ĩ), 10Patch-For-Review, 10User-brennen: Authenticate trusted runners for registry access against GitLab using temporary JSON Web Token - https://phabricator.wikimedia.org/T308501 (10dduvall) I should add that I thought one possibilit... [20:12:15] 10Continuous-Integration-Config, 10Release-Engineering-Team (Priority Backlog đŸ“Ĩ), 10Release Pipeline, 10Patch-For-Review, 10User-dduvall: Fully deprecate service-pipeline-test and service-pipeline-test-and-publish jobs - https://phabricator.wikimedia.org/T307507 (10dduvall) [20:13:00] 10Continuous-Integration-Config, 10Release-Engineering-Team (Priority Backlog đŸ“Ĩ), 10Release Pipeline, 10Patch-For-Review, 10User-dduvall: Fully deprecate service-pipeline-test and service-pipeline-test-and-publish jobs - https://phabricator.wikimedia.org/T307507 (10dduvall) 05Stalled→03Resolved [20:18:02] (03CR) 10Dduvall: [C: 03+2] Make DeployLocal._valid_chk() static + test coverage [tools/scap] - 10https://gerrit.wikimedia.org/r/834012 (owner: 10Hashar) [20:20:53] (03Merged) 10jenkins-bot: Make DeployLocal._valid_chk() static + test coverage [tools/scap] - 10https://gerrit.wikimedia.org/r/834012 (owner: 10Hashar) [20:23:17] (03Merged) 10jenkins-bot: Support checks running before a stage [tools/scap] - 10https://gerrit.wikimedia.org/r/831152 (owner: 10Hashar) [20:56:14] 10MediaWiki-Releasing, 10MW-1.39-notes, 10MW-1.39-release: Release 1.39.0-rc.0 - https://phabricator.wikimedia.org/T313923 (10Reedy) [20:56:18] 10MediaWiki-Releasing, 10Documentation, 10MW-1.39-release: Write release announcement for 1.39.0-rc.0 - https://phabricator.wikimedia.org/T313924 (10Reedy) 05In progress→03Resolved [20:58:10] 10MediaWiki-Releasing, 10MW-1.39-notes, 10MW-1.39-release: Release 1.39.0-rc.0 - https://phabricator.wikimedia.org/T313923 (10Reedy) 05In progress→03Resolved [20:58:14] 10MediaWiki-Releasing, 10MW-1.39-notes, 10MW-1.39-release: Release MW 1.39.0 - https://phabricator.wikimedia.org/T313916 (10Reedy) [21:17:18] 10MediaWiki-Releasing, 10MW-1.40-release, 10MobileFrontend (Tracking): Bundle MobileFrontend extension with MediaWiki - https://phabricator.wikimedia.org/T191734 (10Jdlrobson) Not happening 1.39 so retagging. FWIW I'm not sure I'd recommend bundling MobileFrontend for third parties these days. I think the s... [21:21:01] 10Phabricator, 10Release-Engineering-Team (Bonus Level 🕹ī¸), 10DBA, 10serviceops, and 2 others: sort out mysql privileges for phab1004/phab2002 - https://phabricator.wikimedia.org/T315713 (10Marostegui) It is related yeah, we are rebuilding it [21:21:33] 10MediaWiki-Releasing, 10Reference Previews, 10MW-1.39-release: Bundle Popups extension with MediaWiki - https://phabricator.wikimedia.org/T231797 (10Jdlrobson) Also, Popups with TextExtracts creates a lot of unnecessary/and badly served third party support work, because it is not fit for purpose (which is w... [21:21:40] 10MediaWiki-Releasing, 10Reference Previews, 10MW-1.39-release: Bundle Popups extension with MediaWiki - https://phabricator.wikimedia.org/T231797 (10Jdlrobson) [21:22:22] 10MediaWiki-Releasing, 10Reference Previews, 10MW-1.40-release: Bundle Popups extension with MediaWiki - https://phabricator.wikimedia.org/T231797 (10Jdlrobson) [22:03:27] (03PS1) 10Ahmon Dancy: Tie up some TimeoutLock loose ends [tools/scap] - 10https://gerrit.wikimedia.org/r/834615 [22:04:05] (03PS2) 10Ahmon Dancy: Tie up some TimeoutLock loose ends [tools/scap] - 10https://gerrit.wikimedia.org/r/834615 (https://phabricator.wikimedia.org/T315531) [22:07:32] (03PS3) 10Ahmon Dancy: Tie up some TimeoutLock loose ends [tools/scap] - 10https://gerrit.wikimedia.org/r/834615 (https://phabricator.wikimedia.org/T315531)