[01:42:24] 10Continuous-Integration-Infrastructure, 10Release-Engineering-Team (CI & Testing services), 10Release-Engineering-Team-TODO (201909), 10cloud-services-team: Check bandwidth limitation on integration-castor03.integration.eqiad.wmflabs / cloudvirt1002 - https://phabricator.wikimedia.org/T232644 (10Andrew) I... [01:48:31] 10MediaWiki-Releasing, 10MediaWiki-Installer, 10MW-1.34-release: Bundle PageImages with MediaWiki - https://phabricator.wikimedia.org/T229128 (10CCicalese_WMF) [01:48:56] 10MediaWiki-Releasing, 10MediaWiki-Installer, 10MW-1.34-release: Bundle TextExtracts with MediaWiki - https://phabricator.wikimedia.org/T229127 (10CCicalese_WMF) [02:14:03] Project mediawiki-core-doxygen-docker build #9942: 04FAILURE in 10 min: https://integration.wikimedia.org/ci/job/mediawiki-core-doxygen-docker/9942/ [03:10:25] Yippee, build fixed! [03:10:25] Project mediawiki-core-doxygen-docker build #9943: 09FIXED in 6 min 21 sec: https://integration.wikimedia.org/ci/job/mediawiki-core-doxygen-docker/9943/ [03:12:55] 10Release-Engineering-Team, 10Wikimedia-Site-requests: "empty" InitialiseSettings.php breaks a ton of links and references to that file - https://phabricator.wikimedia.org/T233069 (10Dcljr) >>! In T233069#5498701, @Ladsgroup wrote: > In general, you should not use this files directly, use api.php sitematrix, s... [07:36:20] !log Raised integration-castor03 egress trafic shaping from 50mbps to 100mbps # T232644 [07:36:22] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [07:36:23] T232644: Check bandwidth limitation on integration-castor03.integration.eqiad.wmflabs / cloudvirt1002 - https://phabricator.wikimedia.org/T232644 [07:40:14] 10Continuous-Integration-Infrastructure, 10Release-Engineering-Team (CI & Testing services), 10Release-Engineering-Team-TODO (201909), 10cloud-services-team: Check bandwidth limitation on integration-castor03.integration.eqiad.wmflabs / cloudvirt1002 - https://phabricator.wikimedia.org/T232644 (10hashar) >... [07:43:20] !log Raised integration-castor03 egress trafic shaping from 50mbps to 100mbps # T213223 [07:43:22] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [07:51:15] 10Continuous-Integration-Config, 10Quibble, 10ci-test-error: Selenium tests for Wikibase are being ran twice - https://phabricator.wikimedia.org/T231862 (10hashar) Released and deployed on September 17th with #Quibble 0.0.35. [07:53:42] 10Continuous-Integration-Config, 10Release-Engineering-Team (Unit & Int & System Tooling), 10Release-Engineering-Team-TODO, 10MediaWiki-Core-Testing, and 5 others: Reduce runtime of MW shared gate Jenkins jobs to 5 min - https://phabricator.wikimedia.org/T225730 (10hashar) >>! In T225730#5400979, @gerritbo... [08:23:50] (03CR) 10Awight: Deduplicate projects (031 comment) [integration/quibble] - 10https://gerrit.wikimedia.org/r/534134 (https://phabricator.wikimedia.org/T231862) (owner: 10Awight) [08:32:35] 10Continuous-Integration-Config, 10Quibble, 10ci-test-error: Selenium tests for Wikibase are being ran twice - https://phabricator.wikimedia.org/T231862 (10hashar) Looking at wmf-quibble-core-vendor-mysql-php72-docker build timing ( https://integration.wikimedia.org/ci/job/wmf-quibble-core-vendor-mysql-php72... [08:40:05] 10Continuous-Integration-Config, 10Quibble, 10ci-test-error: Selenium tests for Wikibase are being ran twice - https://phabricator.wikimedia.org/T231862 (10awight) /p\ Imagine how much more we could improve by running the browser tests in parallel, even at per-repo granularity. [08:42:04] 10Beta-Cluster-Infrastructure, 10Release-Engineering-Team-TODO (201909), 10Wikimedia-Logstash, 10observability: logstash-beta.wmflabs.org does not receive any mediawiki events - https://phabricator.wikimedia.org/T233134 (10hashar) I had not checked which instances was used for `logstash-beta.wmflabs.org`.... [08:48:03] PROBLEM - Host deployment-alex-test is DOWN: CRITICAL - Host Unreachable (172.16.6.31) [08:49:38] 10Continuous-Integration-Infrastructure, 10Release-Engineering-Team (CI & Testing services), 10Release-Engineering-Team-TODO (201909), 10Zuul, 10Operations: Upload zuul_2.5.1-wmf10 to apt.wikimedia.org - https://phabricator.wikimedia.org/T233025 (10hashar) [08:49:40] 10Continuous-Integration-Infrastructure, 10Gerrit, 10Release-Engineering-Team-TODO (201909), 10Zuul: Zuul cancels all changes when a change is manually merged - https://phabricator.wikimedia.org/T203846 (10hashar) [09:22:33] 10Continuous-Integration-Infrastructure, 10Release-Engineering-Team (CI & Testing services), 10Release-Engineering-Team-TODO, 10Zuul: Write / update tutorial for Zuul Debian packaging - https://phabricator.wikimedia.org/T140912 (10hashar) 05Open→03Resolved a:03Paladox That has been done by @Paladox o... [09:25:06] 10Continuous-Integration-Infrastructure, 10Release-Engineering-Team (CI & Testing services), 10Release-Engineering-Team-TODO (201909), 10Zuul, 10Operations: Upload zuul_2.5.1-wmf10 to apt.wikimedia.org - https://phabricator.wikimedia.org/T233025 (10hashar) [09:33:06] 10Continuous-Integration-Infrastructure, 10Release-Engineering-Team (CI & Testing services), 10Release-Engineering-Team-TODO (201909), 10Zuul, 10Operations: Upload zuul_2.5.1-wmf10 to apt.wikimedia.org - https://phabricator.wikimedia.org/T233025 (10hashar) Hi @herron, others have pointed me to you for th... [09:38:27] 10Continuous-Integration-Infrastructure, 10Release-Engineering-Team (CI & Testing services), 10Release-Engineering-Team-TODO, 10Operations, and 2 others: Export zuul metrics to Prometheus - https://phabricator.wikimedia.org/T233089 (10hashar) [10:30:00] 10Continuous-Integration-Config, 10Accessibility, 10Upstream: Red-green in PHPUnit code coverage are hard to read - https://phabricator.wikimedia.org/T232915 (10Legoktm) I didn't find the upstream response of allowing for custom CSS super satisfying, but I guess it's what we got. If someone writes a styleshe... [11:22:03] 10Gerrit, 10Accessibility, 10Patch-For-Review: Gerrit red-green diff make the code hard to read (impossible for color-blind users) - https://phabricator.wikimedia.org/T232893 (10kostajh) Hmm, the blue in the elegent theme (after) screenshot looks like user-selected text to me, but if this improves accessibil... [11:34:00] 10Continuous-Integration-Config, 10Release-Engineering-Team (Unit & Int & System Tooling), 10Release-Engineering-Team-TODO, 10MediaWiki-Core-Testing, and 5 others: Reduce runtime of MW shared gate Jenkins jobs to 5 min - https://phabricator.wikimedia.org/T225730 (10Ladsgroup) >>! In T225730#5502199, @hasha... [12:17:24] 10Release-Engineering-Team-TODO (201909), 10AbuseFilter, 10Patch-For-Review, 10User-zeljkofilipin: The first Selenium test for AbuseFilter - https://phabricator.wikimedia.org/T214478 (10Daimona) [12:17:50] 10Release-Engineering-Team-TODO (201909), 10AbuseFilter, 10Patch-For-Review, 10User-zeljkofilipin: The first Selenium test for AbuseFilter - https://phabricator.wikimedia.org/T214478 (10Daimona) 05Open→03Resolved Thanks Željko! [12:17:52] 10Release-Engineering-Team (Kanban), 10User-zeljkofilipin: 5 of the 15 prioritized repositories have at least 1 end-to-end test - https://phabricator.wikimedia.org/T206621 (10Daimona) [12:17:57] 10Release-Engineering-Team-TODO (201909), 10AbuseFilter, 10User-zeljkofilipin: The first Selenium test for AbuseFilter - https://phabricator.wikimedia.org/T214478 (10Daimona) [12:20:40] 10Release-Engineering-Team (CI & Testing services), 10Release-Engineering-Team-TODO (201909), 10Browser-Tests, 10User-zeljkofilipin: selenium-daily-beta-REPOSITORY Jenkins jobs broken since 2019-09-08 - https://phabricator.wikimedia.org/T232357 (10zeljkofilipin) 05Open→03Stalled Blocked on {T232796}. [12:21:02] 10Release-Engineering-Team (CI & Testing services), 10Release-Engineering-Team-TODO (201909), 10Browser-Tests, 10User-zeljkofilipin: selenium-daily-beta-REPOSITORY Jenkins jobs broken since 2019-09-08 - https://phabricator.wikimedia.org/T232357 (10zeljkofilipin) a:05zeljkofilipin→03None [12:32:30] 10MediaWiki-Releasing, 10AbuseFilter, 10MW-1.35-release, 10Patch-For-Review, 10User-Daimona: Bundle AbuseFilter extension with MediaWiki - https://phabricator.wikimedia.org/T191740 (10Daimona) [12:34:46] 10Release-Engineering-Team (CI & Testing services), 10Release-Engineering-Team-TODO (201909), 10User-zeljkofilipin: Update existing Selenium documentation - https://phabricator.wikimedia.org/T232598 (10zeljkofilipin) [12:36:06] 10Release-Engineering-Team (CI & Testing services), 10Release-Engineering-Team-TODO (201909), 10User-zeljkofilipin: Update existing Selenium documentation - https://phabricator.wikimedia.org/T232598 (10zeljkofilipin) [12:36:33] 10Release-Engineering-Team (CI & Testing services), 10Release-Engineering-Team-TODO (201909), 10User-zeljkofilipin: Update existing Selenium documentation - https://phabricator.wikimedia.org/T232598 (10zeljkofilipin) [12:47:05] 10Release-Engineering-Team (CI & Testing services), 10Release-Engineering-Team-TODO (201909), 10User-zeljkofilipin: Update existing Selenium documentation - https://phabricator.wikimedia.org/T232598 (10zeljkofilipin) [12:51:05] 10Release-Engineering-Team (CI & Testing services), 10Release-Engineering-Team-TODO (201909), 10User-zeljkofilipin: Update existing Selenium documentation - https://phabricator.wikimedia.org/T232598 (10zeljkofilipin) [12:54:36] 10Release-Engineering-Team (CI & Testing services), 10Release-Engineering-Team-TODO (201909), 10User-zeljkofilipin: Update existing Selenium documentation - https://phabricator.wikimedia.org/T232598 (10zeljkofilipin) [12:56:20] 10Release-Engineering-Team (CI & Testing services), 10Release-Engineering-Team-TODO (201909), 10User-zeljkofilipin: Update existing Selenium documentation - https://phabricator.wikimedia.org/T232598 (10zeljkofilipin) [12:57:26] 10Release-Engineering-Team (CI & Testing services), 10Release-Engineering-Team-TODO (201909), 10User-zeljkofilipin: Update existing Selenium documentation - https://phabricator.wikimedia.org/T232598 (10zeljkofilipin) [13:10:00] there is some visible html in https://integration.wikimedia.org/zuul/ in the notice [13:28:14] James_F: I restarted Jenkins and thus the issue about plugins dependencies is gone :] [13:28:23] I am off again *wave* [13:30:08] hmm [13:30:12] err wrong channel [14:28:43] 10Phabricator, 10Release-Engineering-Team (Development services), 10Release-Engineering-Team-TODO (201909), 10Documentation, 10User-MModell: Make PHD run on the backup phabricator server (phab2001, currently) - https://phabricator.wikimedia.org/T232883 (10thcipriani) p:05Triage→03Normal Patches are m... [14:29:28] 10Release-Engineering-Team (CI & Testing services), 10Release-Engineering-Team-TODO (201909), 10User-zeljkofilipin: Update existing Selenium documentation - https://phabricator.wikimedia.org/T232598 (10zeljkofilipin) [14:45:46] 10Release-Engineering-Team (CI & Testing services), 10Release-Engineering-Team-TODO (201909), 10User-zeljkofilipin: Update existing Selenium documentation - https://phabricator.wikimedia.org/T232598 (10zeljkofilipin) [14:53:35] PROBLEM - App Server Main HTTP Response on deployment-mediawiki-09 is CRITICAL: (Service Check Timed Out) [14:57:08] 10Release-Engineering-Team (Pipeline), 10Release-Engineering-Team-TODO, 10Product-Infrastructure-Team-Backlog, 10Maps (Kartotherian), 10Patch-For-Review: CI service-pipeline-test-and-publish job assumes blubber config has a single production image - https://phabricator.wikimedia.org/T231928 (10thcipriani... [14:58:32] RECOVERY - App Server Main HTTP Response on deployment-mediawiki-09 is OK: HTTP OK: HTTP/1.1 200 OK - 48066 bytes in 6.171 second response time [15:17:41] so, i had a question .. if i enable a new class ( mediawiki::profile::php ) for a deployment-prep vm, does the hieradata values come from the puppet repo or do i need to enter those values in the horizon UI? [15:18:00] i ask because i am running in trouble entering boolean and ints .. puppet seems to think they are all strings if i enter it in the horizon ui. [15:22:22] 10Release-Engineering-Team (Unit & Int & System Tooling), 10Release-Engineering-Team-TODO, 10MinervaNeue, 10Readers-Web-Backlog, 10User-zeljkofilipin: Need RelEng help: selenium-daily-beta-Minerva and MobileFrontend has failed for 6 days - https://phabricator.wikimedia.org/T232708 (10zeljkofilipin) [15:23:28] 10Release-Engineering-Team (Unit & Int & System Tooling), 10Release-Engineering-Team-TODO (201909), 10MinervaNeue, 10Readers-Web-Backlog, 10User-zeljkofilipin: Need RelEng help: selenium-daily-beta-Minerva and MobileFrontend has failed for 6 days - https://phabricator.wikimedia.org/T232708 (10zeljkofilipi... [15:23:52] 10Release-Engineering-Team-TODO (201909), 10MobileFrontend, 10Readers-Web-Backlog, 10User-zeljkofilipin: MF Selenium tests failing with "Promise timeout" - https://phabricator.wikimedia.org/T233193 (10zeljkofilipin) [15:24:41] 10Release-Engineering-Team (Unit & Int & System Tooling), 10Release-Engineering-Team-TODO (201909), 10MinervaNeue, 10Readers-Web-Backlog, 10User-zeljkofilipin: Need RelEng help: selenium-daily-beta-Minerva and MobileFrontend has failed for 6 days - https://phabricator.wikimedia.org/T232708 (10zeljkofilipi... [15:24:48] 10Release-Engineering-Team-TODO (201909), 10MobileFrontend, 10Readers-Web-Backlog, 10User-zeljkofilipin: MF Selenium tests failing with "Promise timeout" - https://phabricator.wikimedia.org/T233193 (10zeljkofilipin) a:03zeljkofilipin [15:25:24] 10Release-Engineering-Team (Unit & Int & System Tooling), 10Release-Engineering-Team-TODO (201909), 10MinervaNeue, 10Readers-Web-Backlog, 10User-zeljkofilipin: Need RelEng help: selenium-daily-beta-Minerva and MobileFrontend has failed for 6 days - https://phabricator.wikimedia.org/T232708 (10zeljkofilipi... [15:25:26] 10Release-Engineering-Team (CI & Testing services), 10Release-Engineering-Team-TODO (201909), 10Browser-Tests, 10User-zeljkofilipin: selenium-daily-beta-REPOSITORY Jenkins jobs broken since 2019-09-08 - https://phabricator.wikimedia.org/T232357 (10zeljkofilipin) [15:25:33] 10Release-Engineering-Team-TODO (201909), 10MobileFrontend, 10Readers-Web-Backlog, 10User-zeljkofilipin: MF Selenium tests failing with "Promise timeout" - https://phabricator.wikimedia.org/T233193 (10zeljkofilipin) [15:25:36] 10Release-Engineering-Team (CI & Testing services), 10Release-Engineering-Team-TODO (201909), 10Browser-Tests, 10User-zeljkofilipin: selenium-daily-beta-REPOSITORY Jenkins jobs broken since 2019-09-08 - https://phabricator.wikimedia.org/T232357 (10zeljkofilipin) [16:00:14] 10Phabricator, 10Release-Engineering-Team (Development services), 10Release-Engineering-Team-TODO, 10Documentation, 10User-MModell: Document subtypes / task types in Phabricator - https://phabricator.wikimedia.org/T224417 (10mmodell) https://www.mediawiki.org/wiki/Phabricator/Project_management#Task_Type... [16:01:51] 10Continuous-Integration-Infrastructure, 10Core Platform Team, 10MediaWiki-Installer, 10MW-1.32-release, and 3 others: MediaWiki web installer do not show extension when their dependency is missing - https://phabricator.wikimedia.org/T220514 (10CCicalese_WMF) [16:37:11] (03PS1) 10Jforrester: jjb: Define pipeline jobs for kartotherian and tilerator [integration/config] - 10https://gerrit.wikimedia.org/r/537689 (https://phabricator.wikimedia.org/T231928) [16:37:13] (03PS1) 10Jforrester: layout: Use trigger-kartotherian-pipeline-kartotherian and trigger-kartotherian-pipeline-tilerator [integration/config] - 10https://gerrit.wikimedia.org/r/537690 (https://phabricator.wikimedia.org/T231928) [16:38:05] (03CR) 10jerkins-bot: [V: 04-1] jjb: Define pipeline jobs for kartotherian and tilerator [integration/config] - 10https://gerrit.wikimedia.org/r/537689 (https://phabricator.wikimedia.org/T231928) (owner: 10Jforrester) [16:38:38] (03CR) 10jerkins-bot: [V: 04-1] layout: Use trigger-kartotherian-pipeline-kartotherian and trigger-kartotherian-pipeline-tilerator [integration/config] - 10https://gerrit.wikimedia.org/r/537690 (https://phabricator.wikimedia.org/T231928) (owner: 10Jforrester) [17:00:06] Zuul supports checkers now! - https://review.opendev.org/680778 [17:07:50] Interesting. [17:08:07] It's probably a bit late for us to include that in our future-CI evaluation, sadly. [17:08:38] (03PS2) 10Jforrester: jjb: Define pipeline jobs for kartotherian and tilerator [integration/config] - 10https://gerrit.wikimedia.org/r/537689 (https://phabricator.wikimedia.org/T231928) [17:08:40] (03PS2) 10Jforrester: layout: Use trigger-kartotherian-pipeline-kartotherian and trigger-kartotherian-pipeline-tilerator [integration/config] - 10https://gerrit.wikimedia.org/r/537690 (https://phabricator.wikimedia.org/T231928) [17:14:01] James_F oh, has the new ci been decided? [17:14:37] (03CR) 10Jforrester: [C: 03+2] jjb: Define pipeline jobs for kartotherian and tilerator [integration/config] - 10https://gerrit.wikimedia.org/r/537689 (https://phabricator.wikimedia.org/T231928) (owner: 10Jforrester) [17:14:42] Krinkle also the colours you choice for GWT diff view are the colours used in PolyGerrit's rebase thing view. (it has red/gree and yellow/blue) [17:14:53] paladox: No. [17:14:58] ok [17:16:54] (03Merged) 10jenkins-bot: jjb: Define pipeline jobs for kartotherian and tilerator [integration/config] - 10https://gerrit.wikimedia.org/r/537689 (https://phabricator.wikimedia.org/T231928) (owner: 10Jforrester) [17:16:55] Krinkle which may confused users as the yellow/blue is used differently. It's used to indicate those sections as safe (under a rebase view) [17:16:56] https://www.gerritcodereview.com/2.15.html#mark-changes-due-to-rebase [17:17:14] (03CR) 10Jforrester: [C: 03+2] layout: Use trigger-kartotherian-pipeline-kartotherian and trigger-kartotherian-pipeline-tilerator [integration/config] - 10https://gerrit.wikimedia.org/r/537690 (https://phabricator.wikimedia.org/T231928) (owner: 10Jforrester) [17:18:44] (03Merged) 10jenkins-bot: layout: Use trigger-kartotherian-pipeline-kartotherian and trigger-kartotherian-pipeline-tilerator [integration/config] - 10https://gerrit.wikimedia.org/r/537690 (https://phabricator.wikimedia.org/T231928) (owner: 10Jforrester) [17:19:41] !log Zuul: T231928 Migrate kartotherian to custom pipeline jobs [17:19:44] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [17:19:44] T231928: CI service-pipeline-test-and-publish job assumes blubber config has a single production image - https://phabricator.wikimedia.org/T231928 [17:21:25] paladox: nobody has to use it, it does not become the default [17:22:03] paladox: red/green is unacceptable for colorblind users. The patch provides two alternatives, opt-in for those who wish to use it. A lighter version of red/green and yellow/blue. [17:38:33] 10Beta-Cluster-Infrastructure, 10Release-Engineering-Team-TODO (201909), 10MediaWiki-extensions-CentralAuth, 10User-zeljkofilipin: [betalabs] Cannot create a new user account - https://phabricator.wikimedia.org/T232796 (10mmodell) a:03mmodell [17:40:42] 10MediaWiki-Releasing, 10MediaWiki-Installer, 10MW-1.34-release: Bundle PageImages with MediaWiki - https://phabricator.wikimedia.org/T229128 (10Anomie) > Supports MySQL, SQLite, and Postgres (if there are schema changes) I don't see any schema changes in this extension. Also it seems to work for me locally... [17:40:47] 10MediaWiki-Releasing, 10MediaWiki-Installer, 10MW-1.34-release: Bundle TextExtracts with MediaWiki - https://phabricator.wikimedia.org/T229127 (10Anomie) > Supports MySQL, SQLite, and Postgres (sqlite doesn't support regex, so that option is hidden) I don't see any schema changes in this extension. Also i... [17:41:22] if I push a tag to a pipeline enabled repository, that shows up in the Docker registry "at some point" [17:41:29] what dictates when? [17:41:42] is it on a schedule interval? [17:41:56] 10MediaWiki-Releasing, 10MediaWiki-Installer, 10MW-1.34-release: Bundle TextExtracts with MediaWiki - https://phabricator.wikimedia.org/T229127 (10CCicalese_WMF) Great! Thank you, @Anomie. This should be ok to bundle. [17:42:05] 10MediaWiki-Releasing, 10MediaWiki-Installer, 10MW-1.34-release: Bundle TextExtracts with MediaWiki - https://phabricator.wikimedia.org/T229127 (10CCicalese_WMF) [17:42:54] 10MediaWiki-Releasing, 10MediaWiki-Installer, 10MW-1.34-release: Bundle PageImages with MediaWiki - https://phabricator.wikimedia.org/T229128 (10CCicalese_WMF) Great! Thank you, @Anomie. This should be ok to bundle. [17:43:04] 10MediaWiki-Releasing, 10MediaWiki-Installer, 10MW-1.34-release: Bundle PageImages with MediaWiki - https://phabricator.wikimedia.org/T229128 (10CCicalese_WMF) [17:46:52] (03PS1) 10Jforrester: make-release: Include PageImages and TextExtracts in 1.34+ [tools/release] - 10https://gerrit.wikimedia.org/r/537708 (https://phabricator.wikimedia.org/T229127) [17:47:21] (03CR) 10Jforrester: [C: 03+2] make-release: Include PageImages and TextExtracts in 1.34+ [tools/release] - 10https://gerrit.wikimedia.org/r/537708 (https://phabricator.wikimedia.org/T229127) (owner: 10Jforrester) [17:48:36] (03Merged) 10jenkins-bot: make-release: Include PageImages and TextExtracts in 1.34+ [tools/release] - 10https://gerrit.wikimedia.org/r/537708 (https://phabricator.wikimedia.org/T229127) (owner: 10Jforrester) [17:48:55] 10MediaWiki-Releasing, 10MediaWiki-Installer, 10Epic, 10MW-1.34-release: Expand the set of bundled extensions and skins in MediaWiki 1.34 - https://phabricator.wikimedia.org/T209220 (10Jdforrester-WMF) [17:48:57] 10MediaWiki-Releasing, 10MediaWiki-Installer, 10MW-1.34-release, 10Patch-For-Review: Bundle PageImages with MediaWiki - https://phabricator.wikimedia.org/T229128 (10Jdforrester-WMF) 05Open→03Resolved a:03Jdforrester-WMF [17:49:02] 10MediaWiki-Releasing, 10MediaWiki-Installer, 10Epic, 10MW-1.34-release: Expand the set of bundled extensions and skins in MediaWiki 1.34 - https://phabricator.wikimedia.org/T209220 (10Jdforrester-WMF) [17:49:05] 10MediaWiki-Releasing, 10MediaWiki-Installer, 10MW-1.34-release, 10Patch-For-Review: Bundle TextExtracts with MediaWiki - https://phabricator.wikimedia.org/T229127 (10Jdforrester-WMF) 05Open→03Resolved a:03Jdforrester-WMF [17:54:32] 10MediaWiki-Releasing, 10MediaWiki-Installer, 10Epic, 10MW-1.34-release: Expand the set of bundled extensions and skins in MediaWiki 1.34 - https://phabricator.wikimedia.org/T209220 (10Jdforrester-WMF) 05Open→03Resolved [17:54:42] 10MediaWiki-Releasing, 10Epic: Expand the set of bundled skins - https://phabricator.wikimedia.org/T194266 (10Jdforrester-WMF) [17:54:46] 10MediaWiki-Releasing, 10MediaWiki-Installer, 10Epic: Expand the set of bundled extensions and skins to achieve a default MediaWiki experience that's comparable to Wikimedia sites - https://phabricator.wikimedia.org/T178349 (10Jdforrester-WMF) [18:01:45] 10Beta-Cluster-Infrastructure, 10Release-Engineering-Team-TODO (201909), 10Release Pipeline: Experiment with hosted kubernetes solutions for Beta - https://phabricator.wikimedia.org/T222820 (10jeena) a:05jeena→03None [18:10:37] or maybe it never happens at all? [18:21:00] 10MediaWiki-Releasing, 10Reference Previews: Bundle Reference Tooltips extension with MediaWiki tarballs - https://phabricator.wikimedia.org/T231797 (10CCicalese_WMF) There is no Reference Tooltips extension. The functionality is provided by a gadget (see https://www.mediawiki.org/wiki/Reference_Tooltips). How... [18:21:41] 10MediaWiki-Releasing, 10Reference Previews: Bundle Popups extension with MediaWiki - https://phabricator.wikimedia.org/T231797 (10CCicalese_WMF) [18:21:50] 10MediaWiki-Releasing, 10Reference Previews: Bundle Popups extension with MediaWiki - https://phabricator.wikimedia.org/T231797 (10CCicalese_WMF) [18:21:53] 10MediaWiki-Releasing, 10MediaWiki-Installer, 10Epic, 10MW-1.35-release: Expand the set of bundled extensions and skins in MediaWiki 1.35 - https://phabricator.wikimedia.org/T232854 (10CCicalese_WMF) [18:21:55] 10MediaWiki-Releasing, 10MediaWiki-Installer, 10Epic: Expand the set of bundled extensions and skins to achieve a default MediaWiki experience that's comparable to Wikimedia sites - https://phabricator.wikimedia.org/T178349 (10CCicalese_WMF) [18:22:29] 10MediaWiki-Releasing, 10Reference Previews, 10MW-1.35-release: Bundle Popups extension with MediaWiki - https://phabricator.wikimedia.org/T231797 (10CCicalese_WMF) p:05Triage→03Normal [18:28:25] 10MediaWiki-Releasing, 10Reference Previews, 10MW-1.35-release: Bundle Popups extension with MediaWiki - https://phabricator.wikimedia.org/T231797 (10CCicalese_WMF) [18:29:48] 10MediaWiki-Releasing, 10Reference Previews, 10MW-1.35-release: Bundle Popups extension with MediaWiki - https://phabricator.wikimedia.org/T231797 (10CCicalese_WMF) [18:31:23] 10MediaWiki-Releasing, 10MediaWiki-Installer, 10Epic, 10MW-1.35-release: Expand the set of bundled extensions and skins in MediaWiki 1.35 - https://phabricator.wikimedia.org/T232854 (10CCicalese_WMF) [18:32:09] Hmm. How long should we let https://integration.wikimedia.org/ci/job/kartotherian-pipeline-kartotherian/1/console and https://integration.wikimedia.org/ci/job/kartotherian-pipeline-tilerator/1/console keep spinning their wheels? It's been over an hour… [18:44:50] (Ping marxarelli thcipriani for the above, I guess?) [18:45:45] eek [18:45:54] "expected to call java.lang.RuntimeException. but wound up catching org.wikimedia.integration.ExecutionGraph.toString; see: https://jenkins.io/redirect/pipeline-cps-method-mismatches/" doesn't look good [18:46:08] No, but the failure to exit is curious. [18:46:28] might be an issue in integration/pipelinelib [18:47:01] curious and disconcerting [18:47:20] Yeah. [18:47:45] !log T231928 terminating endlessly-running attempts to build kartotherian and tilerator [18:47:47] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [18:47:48] T231928: CI service-pipeline-test-and-publish job assumes blubber config has a single production image - https://phabricator.wikimedia.org/T231928 [18:48:14] Aha, on aborting it gives an NPE. [18:48:52] i hate groovy-cps [18:50:30] (03PS1) 10Jforrester: layout: Drop extension-seccheck-non-voting and skin-seccheck-non-voting, unused [integration/config] - 10https://gerrit.wikimedia.org/r/537722 [18:50:32] (03PS1) 10Jforrester: jjb: Drop mwskin-php72-phan-docker-non-voting, mwext-php72-phan-seccheck-docker-non-voting, mwskin-php72-phan-seccheck-docker-non-voting, unused [integration/config] - 10https://gerrit.wikimedia.org/r/537723 [18:51:36] (03CR) 10Jforrester: [C: 03+2] layout: Drop extension-seccheck-non-voting and skin-seccheck-non-voting, unused [integration/config] - 10https://gerrit.wikimedia.org/r/537722 (owner: 10Jforrester) [18:53:09] (03Merged) 10jenkins-bot: layout: Drop extension-seccheck-non-voting and skin-seccheck-non-voting, unused [integration/config] - 10https://gerrit.wikimedia.org/r/537722 (owner: 10Jforrester) [18:54:20] !log Zuul: Drop extension-seccheck-non-voting and skin-seccheck-non-voting, unused [18:54:22] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [18:54:35] 10Continuous-Integration-Infrastructure, 10Release-Engineering-Team (CI & Testing services), 10Release-Engineering-Team-TODO (201909), 10Zuul, 10Operations: Upload zuul_2.5.1-wmf10 to apt.wikimedia.org - https://phabricator.wikimedia.org/T233025 (10herron) Hey @hashar, zuul_2.5.1-wmf10 has been uploaded... [18:55:27] (03CR) 10Jforrester: [C: 03+2] jjb: Drop mwskin-php72-phan-docker-non-voting, mwext-php72-phan-seccheck-docker-non-voting, mwskin-php72-phan-seccheck-docker-non-voting, un [integration/config] - 10https://gerrit.wikimedia.org/r/537723 (owner: 10Jforrester) [18:57:41] (03Merged) 10jenkins-bot: jjb: Drop mwskin-php72-phan-docker-non-voting, mwext-php72-phan-seccheck-docker-non-voting, mwskin-php72-phan-seccheck-docker-non-voting, unused [integration/config] - 10https://gerrit.wikimedia.org/r/537723 (owner: 10Jforrester) [19:06:24] 10Beta-Cluster-Infrastructure, 10Release-Engineering-Team-TODO (201909), 10Release Pipeline: Experiment with hosted kubernetes solutions for Beta - https://phabricator.wikimedia.org/T222820 (10Bstorm) If this project ends up integrating with WMCS-managed stuff at all (Beta cluster -- does that mean deploymen... [19:06:39] 10Continuous-Integration-Infrastructure, 10Release-Engineering-Team (CI & Testing services), 10Release-Engineering-Team-TODO, 10Operations, and 2 others: Export zuul metrics to Prometheus - https://phabricator.wikimedia.org/T233089 (10herron) p:05Triage→03Normal [19:08:15] 10Continuous-Integration-Infrastructure, 10Release-Engineering-Team (CI & Testing services), 10Release-Engineering-Team-TODO (201909), 10Zuul, 10Operations: Upload zuul_2.5.1-wmf10 to apt.wikimedia.org - https://phabricator.wikimedia.org/T233025 (10herron) 05Open→03Resolved a:03herron [19:08:17] 10Continuous-Integration-Infrastructure, 10Gerrit, 10Release-Engineering-Team-TODO (201909), 10Zuul: Zuul cancels all changes when a change is manually merged - https://phabricator.wikimedia.org/T203846 (10herron) [19:08:57] hashar: You seen T233143? Not sure what's going on there. [19:08:58] T233143: Quibble jobs error (non-fatal) "ERROR:zuul.Repo:Unable to initialize repo for npm-test.git" - https://phabricator.wikimedia.org/T233143 [19:09:26] 10Phabricator, 10Release-Engineering-Team (Development services), 10Operations, 10hardware-requests, 10serviceops: The phabricator server, WMF7426, was given to us temporarily, we would like to make it permanent - https://phabricator.wikimedia.org/T232887 (10herron) p:05Triage→03Normal [19:20:48] James_F: not missed it :\ [19:20:56] nope, I have missed it [19:22:34] !log Keeping https://integration.wikimedia.org/ci/job/mediawiki-quibble-vendor-mysql-php72-docker/5393/ forever for T233143 [19:22:37] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [19:22:38] T233143: Quibble jobs error (non-fatal) "ERROR:zuul.Repo:Unable to initialize repo for npm-test.git" - https://phabricator.wikimedia.org/T233143 [19:23:06] Thanks. [19:26:09] I'm going to rephrase my Q: should I expect to get a tagged image in the docker registry if I push a tag to my repository? [19:26:41] (this does not seem to be working anymore) [19:32:02] 10Continuous-Integration-Config, 10Release-Engineering-Team, 10Quibble: Quibble jobs error (non-fatal) "ERROR:zuul.Repo:Unable to initialize repo for npm-test.git" - https://phabricator.wikimedia.org/T233143 (10hashar) The build was for https://gerrit.wikimedia.org/r/#/c/mediawiki/core/+/537445/2 and there i... [19:32:04] James_F: found it [19:32:09] I dont get the root cause but in short: [19:32:15] quibble --skip composer-test npm-test [19:32:42] the values passed to skip must be comma separated [19:32:51] not sure how the job is still working really [19:36:23] 10Continuous-Integration-Config, 10Release-Engineering-Team, 10Quibble: Quibble jobs error (non-fatal) "ERROR:zuul.Repo:Unable to initialize repo for npm-test.git" - https://phabricator.wikimedia.org/T233143 (10Krinkle) I guess that answers my concern from T225248#5485061. Glad to hear we're fine with skippi... [19:40:45] 10Continuous-Integration-Config, 10Release-Engineering-Team, 10Quibble: Quibble jobs error (non-fatal) "ERROR:zuul.Repo:Unable to initialize repo for npm-test.git" - https://phabricator.wikimedia.org/T233143 (10hashar) ` 00:00:31.608 ERROR:zuul.Repo:Unable to initialize repo for https://gerrit.wikimedia.org/... [19:40:48] James_F: yeah hmm so those jobs need some heavy rethink :] [19:40:54] --skip npm-test is ignored [19:41:14] so we run npm test with each of hhvm / php7.2 etc even though we should not [19:41:16] ;] [19:41:32] and Quibble should probably fails as soon as a repository can not be cloned [19:41:36] so two bugs in one good [19:46:04] (03PS1) 10Jforrester: jjb: [quibble] Fix syntax for --skip command [integration/config] - 10https://gerrit.wikimedia.org/r/537743 (https://phabricator.wikimedia.org/T233143) [19:47:12] hashar: ^^ Tah-dah for the --skip fix. [19:47:21] But as you say, it should actually error. [19:49:56] 10Continuous-Integration-Config, 10Release-Engineering-Team, 10Quibble, 10Patch-For-Review: Quibble jobs error (non-fatal) "ERROR:zuul.Repo:Unable to initialize repo for npm-test.git" - https://phabricator.wikimedia.org/T233143 (10hashar) @legoktm did the optimizations for mediawiki/core. I guess we can re... [19:50:13] James_F: and I have brain dumped more things [19:50:22] Yeah. [19:50:55] (03CR) 10Jforrester: "Affected jobs:" [integration/config] - 10https://gerrit.wikimedia.org/r/537743 (https://phabricator.wikimedia.org/T233143) (owner: 10Jforrester) [19:51:05] 62 jobs affected! [19:51:07] Ouch. [19:51:26] oh [19:51:27] (03CR) 10Hashar: [C: 03+1] "And mediawiki repositories should all have a npm test job running (that was the aim of the optimization: save time to not run npm test in " [integration/config] - 10https://gerrit.wikimedia.org/r/537743 (https://phabricator.wikimedia.org/T233143) (owner: 10Jforrester) [19:51:47] hmm [19:51:49] bah [19:52:09] no [19:52:10] yes [19:52:12] James_F: it is fine [19:52:15] well should be fine [19:52:23] Hopefully. [19:52:26] because all the repos/branches already have a node10-test-docker or such job [19:52:33] Yes. [19:52:40] so the repositories always already run "npm test" for the repo that triggered the patch [19:52:44] and it is fine to skip it entirely [19:53:00] the reason quibble default to running it is for local development purpose [19:53:10] Also e have ?100 quibble jobs; this is not all of them. [19:53:18] so that when you invoke quibble on your machine, it runs the linter first (composertest/npm test) and fails early [19:53:23] but on CI that is done in different jobs [19:54:01] Yeah. [19:54:16] there are some jobs for fresnel? [19:56:19] (03CR) 10Hashar: [C: 03+1] "+integration-quibble-tox-publish" [integration/config] - 10https://gerrit.wikimedia.org/r/537743 (https://phabricator.wikimedia.org/T233143) (owner: 10Jforrester) [19:56:35] hashar: jjb quibble jobs not affected are: [19:56:36] James_F: I pasted a list that are not affected [19:56:41] https://www.irccloud.com/pastebin/qqhf1jxz/ [19:56:50] Snap. [19:57:10] oh [19:57:15] you probably have missed one occurence? [19:57:21] Maybe [19:57:23] Done by hand. [19:57:34] man [19:57:42] don't you have an AI to code for you yet?! :] [19:57:53] Isn't that you? ;-) [19:58:05] touché [19:58:09] jjb/mediawiki.yaml: quibble_args: '--skip selenium npm-test' [19:58:12] that one is fun [19:58:23] that is for the noselenium jobs [19:58:27] For noselenium jobs, yeah. [19:58:34] which is broken as well [19:58:40] (I am grepping master, not your patch) [19:58:43] it is fetching still bah [19:58:43] Mostly will speed up BlueSpice. [19:58:45] * hashar blames gerrit [19:59:03] * hashar blames self [20:02:18] I cant download the patch from gerrit for some reason [20:02:42] Huh. [20:02:58] takes age :] [20:05:26] hmm [20:05:34] I smell the deadlock is occuring [20:06:16] deadlock? [20:09:00] 10Release-Engineering-Team: Docker registry not updating when a tag is pushed to Gerrit - https://phabricator.wikimedia.org/T233259 (10Eevans) [20:11:40] (03CR) 10Hashar: [C: 03+1] "Some quibble jobs are not changed because they do not --skip composer-test, just npm-test. Those jobs are for extensions." [integration/config] - 10https://gerrit.wikimedia.org/r/537743 (https://phabricator.wikimedia.org/T233143) (owner: 10Jforrester) [20:11:49] paladox: false alarm :] [20:11:57] ah gerrit [20:11:58] James_F: so yeah that patch sounds fine :] [20:12:07] on those good words, I am stopping here and will head to bed! [20:12:16] See you. [20:12:23] thank you James_F ! [20:51:57] 10Release-Engineering-Team, 10MediaWiki-Release-Tools: makedeploynotes.py omits some changes for no apparent reason - https://phabricator.wikimedia.org/T231956 (10Krinkle) [20:57:50] PROBLEM - Host deployment-mediawiki-jhuneidi is DOWN: CRITICAL - Host Unreachable (172.16.4.177) [20:58:35] 10Beta-Cluster-Infrastructure, 10Release-Engineering-Team-TODO, 10Release Pipeline: Experiment with hosted kubernetes solutions for Beta - https://phabricator.wikimedia.org/T222820 (10thcipriani) 05Open→03Stalled >>! In T222820#5504304, @Bstorm wrote: > If this project ends up integrating with WMCS-manag... [20:58:38] 10Beta-Cluster-Infrastructure, 10Editing-team, 10Release Pipeline, 10serviceops, and 2 others: Migrate Beta cluster services to use Kubernetes - https://phabricator.wikimedia.org/T220235 (10thcipriani) [21:13:26] 10Beta-Cluster-Infrastructure: Request access to deployment-prep and beta-cluster logstash - https://phabricator.wikimedia.org/T231684 (10Urbanecm) >>! In T231684#5457017, @D3r1ck01 wrote: >>>! In T231684#5456991, @Aklapper wrote: >>> help in reporting, fixing and cleaning up errors >> Could you be a bit more sp... [21:23:33] 10Beta-Cluster-Infrastructure, 10Wikimedia-production-error: Fatal error: Invalid operand type was used: cannot perform this operation with arrays in /srv/mediawiki/php-master/languages/Language.php on line 514 - https://phabricator.wikimedia.org/T233155 (10Urbanecm) >>! In T233155#5501102, @MarcoAurelio wrote... [21:24:17] 10Beta-Cluster-Infrastructure, 10MediaWiki-extensions-WikimediaIncubator: Create a Wikimedia Incubator test wiki on the Beta Cluster - https://phabricator.wikimedia.org/T210492 (10Urbanecm) >>! In T210492#4781610, @Ebe123 wrote: > https://incubator.wmflabs.org/wiki/Main_Page ? That's different project, it wou... [21:28:42] 10Beta-Cluster-Infrastructure: Request access to deployment-prep and beta-cluster logstash - https://phabricator.wikimedia.org/T231684 (10Krenair) >>! In T231684#5504698, @Urbanecm wrote: >>>! In T231684#5457017, @D3r1ck01 wrote: >>>>! In T231684#5456991, @Aklapper wrote: >>>> help in reporting, fixing and clean... [21:46:35] 10Beta-Cluster-Infrastructure: Request access to deployment-prep and beta-cluster logstash - https://phabricator.wikimedia.org/T231684 (10Krinkle) The reason beta-cluster Logstash no longer uses regular LDAP I believe has to do with privacy and sensitive nature of the data there. It is currently limited to Beta... [21:50:26] 10Beta-Cluster-Infrastructure: Request access to deployment-prep and beta-cluster logstash - https://phabricator.wikimedia.org/T231684 (10Krenair) >>! In T231684#5504758, @Krinkle wrote: > The reason beta-cluster Logstash no longer uses regular LDAP I believe has to do with privacy and sensitive nature of the da... [21:55:47] 10Continuous-Integration-Infrastructure, 10Release-Engineering-Team, 10Composer, 10Wikimedia-production-error (Shared Build Failure): Jenkins jobs failing with Composer TransportException: 404 Not Found (September 2019) - https://phabricator.wikimedia.org/T233264 (10Krinkle) [21:55:49] 10Beta-Cluster-Infrastructure, 10Release-Engineering-Team-TODO, 10Release Pipeline: Experiment with hosted kubernetes solutions for Beta - https://phabricator.wikimedia.org/T222820 (10Krenair) I would like to say that if we are considering external clouds to integrate into deployment-prep we should ensure we... [21:55:58] 10Continuous-Integration-Infrastructure, 10Release-Engineering-Team, 10Composer, 10Wikimedia-production-error (Shared Build Failure): Jenkins jobs failing with Composer TransportException: 404 Not Found (September 2019) - https://phabricator.wikimedia.org/T233264 (10Krinkle) [21:56:18] (03CR) 10Jforrester: [C: 03+2] "Deployed, no issues seen." [integration/config] - 10https://gerrit.wikimedia.org/r/537743 (https://phabricator.wikimedia.org/T233143) (owner: 10Jforrester) [21:56:35] 10Continuous-Integration-Infrastructure, 10Release-Engineering-Team, 10Composer, 10Wikimedia-production-error (Shared Build Failure): Jenkins jobs failing with Composer TransportException: 404 Not Found (September 2019) - https://phabricator.wikimedia.org/T233264 (10Krinkle) Upstream reports: * 10Continuous-Integration-Infrastructure, 10Release-Engineering-Team, 10Composer, 10Wikimedia-production-error (Shared Build Failure): Jenkins jobs failing with Composer TransportException: 404 Not Found (September 2019) - https://phabricator.wikimedia.org/T233264 (10Krinkle) [21:58:26] (03Merged) 10jenkins-bot: jjb: [quibble] Fix syntax for --skip command [integration/config] - 10https://gerrit.wikimedia.org/r/537743 (https://phabricator.wikimedia.org/T233143) (owner: 10Jforrester) [22:07:30] 10Continuous-Integration-Config, 10Release-Engineering-Team (Unit & Int & System Tooling), 10Release-Engineering-Team-TODO, 10MediaWiki-Core-Testing, and 5 others: Reduce runtime of MW shared gate Jenkins jobs to 5 min - https://phabricator.wikimedia.org/T225730 (10Krinkle) >>! In T233143#5504801, @gerritb... [22:08:00] 10Continuous-Integration-Config, 10Release-Engineering-Team (Unit & Int & System Tooling), 10Release-Engineering-Team-TODO, 10MediaWiki-Core-Testing, and 5 others: Reduce runtime of MW shared gate Jenkins jobs to 5 min - https://phabricator.wikimedia.org/T225730 (10Krinkle) [22:15:05] 10Beta-Cluster-Infrastructure, 10Wikimedia-production-error: Fatal error: Invalid operand type was used: cannot perform this operation with arrays in /srv/mediawiki/php-master/languages/Language.php on line 514 - https://phabricator.wikimedia.org/T233155 (10jeena) I've deleted my instance so it shouldn't be cl... [22:56:35] thcipriani fyi https://groups.google.com/forum/#!topic/repo-discuss/nEkvNVCZzNM [23:56:24] 10Continuous-Integration-Config, 10Release-Engineering-Team, 10Quibble: Quibble jobs error (non-fatal) "ERROR:zuul.Repo:Unable to initialize repo for npm-test.git" - https://phabricator.wikimedia.org/T233143 (10Jdforrester-WMF) The mis-configuration that caused this error is fixed, but hashar pointed out tha... [23:56:31] PROBLEM - Host integration-agent-docker-1001 is DOWN: CRITICAL - Host Unreachable (172.16.3.36)