[00:05:14] maintenance-disconnect-full-disks build 62625 integration-slave-docker-1040: OFFLINE due to disk space [00:05:15] maintenance-disconnect-full-disks build 62625 integration-slave-docker-1048: OFFLINE due to disk space [00:07:59] 10Release-Engineering-Team (Kanban), 10Patch-For-Review, 10Release, 10Train Deployments: 1.33.0-wmf.25 deployment blockers - https://phabricator.wikimedia.org/T206679 (10Jdforrester-WMF) [00:10:56] PROBLEM - Free space - all mounts on integration-slave-docker-1043 is CRITICAL: CRITICAL: integration.integration-slave-docker-1043.diskspace._srv.byte_percentfree (<10.00%) [00:11:51] 10MediaWiki-Releasing, 10Release-Engineering-Team (Kanban), 10MW-1.33-notes, 10MW-1.33-release, 10User-greg: Announce 1.33 "pencils down" and likely timeline to wikitech-l etc. - https://phabricator.wikimedia.org/T220655 (10Jdforrester-WMF) a:03greg [00:13:06] 10MediaWiki-Releasing, 10Release-Engineering-Team, 10MW-1.33-notes, 10MW-1.33-release: Release MW 1.33 - https://phabricator.wikimedia.org/T220652 (10greg) [00:13:09] 10MediaWiki-Releasing, 10Release-Engineering-Team (Kanban), 10MW-1.33-notes, 10MW-1.33-release, 10User-greg: Announce 1.33 "pencils down" and likely timeline to wikitech-l etc. - https://phabricator.wikimedia.org/T220655 (10greg) 05Open→03Resolved https://lists.wikimedia.org/pipermail/wikitech-l/2019... [00:20:57] RECOVERY - Free space - all mounts on integration-slave-docker-1043 is OK: OK: All targets OK [00:26:42] greg-g: wooo 1.33! When are we officially becoming 1.34? [00:32:16] maintenance-disconnect-full-disks build 62630 integration-slave-docker-1040: OFFLINE due to disk space [00:32:16] maintenance-disconnect-full-disks build 62630 integration-slave-docker-1048: OFFLINE due to disk space [00:32:16] MaxSem: It's landing now. [00:32:16] MaxSem: Oh, no, it just landed: https://gerrit.wikimedia.org/r/c/mediawiki/core/+/502544 [00:32:17] 10Continuous-Integration-Config, 10MediaWiki-Core-Testing, 10MediaWiki-extensions-MultimediaViewer, 10MobileFrontend, and 10 others: Audit tests/selenium/LocalSettings.php file aiming at possibly deprecating the feature - https://phabricator.wikimedia.org/T199939 (10Jdlrobson) Ran into this problem again... [00:32:17] 10Continuous-Integration-Config, 10MediaWiki-Core-Testing, 10MediaWiki-extensions-MultimediaViewer, 10MobileFrontend, and 10 others: Audit tests/selenium/LocalSettings.php file aiming at possibly deprecating the feature - https://phabricator.wikimedia.org/T199939 (10Jdlrobson) [00:32:32] \m/ [00:33:52] * MaxSem unpacks his deletionhammer... [00:34:00] * James_F grins. [00:34:10] MaxSem: Easy, we don't want to make backports too hard in the next week or so. [00:34:41] Only unused crap for now [00:35:04] Sure. :-) [00:43:29] 10MediaWiki-Releasing, 10Release-Engineering-Team, 10MW-1.33-notes, 10MW-1.33-release: Release MW 1.33 - https://phabricator.wikimedia.org/T220652 (10Jdforrester-WMF) [00:43:34] 10MediaWiki-Releasing, 10Release-Engineering-Team, 10MW-1.33-notes, 10MW-1.33-release: Branch REL1_33 for MediaWiki and deployed extensions - https://phabricator.wikimedia.org/T220653 (10Jdforrester-WMF) 05Open→03Stalled This is now done manually for tarball extensions and skins, but needs doing proper... [00:46:23] 10Release-Engineering-Team (Kanban), 10Patch-For-Review, 10Release, 10Train Deployments: 1.33.0-wmf.25 deployment blockers - https://phabricator.wikimedia.org/T206679 (10Jdforrester-WMF) [00:53:28] MaxSem: https://gerrit.wikimedia.org/r/q/is:open+file:RELEASE-NOTES-1.33+project:mediawiki%252Fcore may also be fun to fiddle with, if you're bored. :-) [00:55:12] maintenance-disconnect-full-disks build 62635 integration-slave-docker-1040: OFFLINE due to disk space [00:55:13] maintenance-disconnect-full-disks build 62635 integration-slave-docker-1048: OFFLINE due to disk space [01:20:12] maintenance-disconnect-full-disks build 62640 integration-slave-docker-1040: OFFLINE due to disk space [01:20:13] maintenance-disconnect-full-disks build 62640 integration-slave-docker-1048: OFFLINE due to disk space [01:45:11] maintenance-disconnect-full-disks build 62645 integration-slave-docker-1040: OFFLINE due to disk space [01:45:11] maintenance-disconnect-full-disks build 62645 integration-slave-docker-1048: OFFLINE due to disk space [02:10:12] maintenance-disconnect-full-disks build 62650 integration-slave-docker-1040: OFFLINE due to disk space [02:10:12] maintenance-disconnect-full-disks build 62650 integration-slave-docker-1048: OFFLINE due to disk space [02:35:13] maintenance-disconnect-full-disks build 62655 integration-slave-docker-1040: OFFLINE due to disk space [02:35:13] maintenance-disconnect-full-disks build 62655 integration-slave-docker-1048: OFFLINE due to disk space [03:00:11] maintenance-disconnect-full-disks build 62660 integration-slave-docker-1040: OFFLINE due to disk space [03:00:12] maintenance-disconnect-full-disks build 62660 integration-slave-docker-1048: OFFLINE due to disk space [03:25:11] maintenance-disconnect-full-disks build 62665 integration-slave-docker-1040: OFFLINE due to disk space [03:25:12] maintenance-disconnect-full-disks build 62665 integration-slave-docker-1048: OFFLINE due to disk space [03:50:11] maintenance-disconnect-full-disks build 62670 integration-slave-docker-1040: OFFLINE due to disk space [03:50:12] maintenance-disconnect-full-disks build 62670 integration-slave-docker-1048: OFFLINE due to disk space [04:15:11] maintenance-disconnect-full-disks build 62675 integration-slave-docker-1040: OFFLINE due to disk space [04:15:11] maintenance-disconnect-full-disks build 62675 integration-slave-docker-1048: OFFLINE due to disk space [04:16:06] 10Continuous-Integration-Infrastructure, 10MediaWiki-Installer, 10MW-1.32-release, 10Patch-For-Review: MediaWiki web installer do not show extension when their dependency is missing - https://phabricator.wikimedia.org/T220514 (10tstarling) I'm thinking about how to fix this. In the meantime, for CI, if you... [04:40:12] maintenance-disconnect-full-disks build 62680 integration-slave-docker-1040: OFFLINE due to disk space [04:40:12] maintenance-disconnect-full-disks build 62680 integration-slave-docker-1048: OFFLINE due to disk space [05:05:11] maintenance-disconnect-full-disks build 62685 integration-slave-docker-1040: OFFLINE due to disk space [05:05:11] maintenance-disconnect-full-disks build 62685 integration-slave-docker-1048: OFFLINE due to disk space [05:30:11] maintenance-disconnect-full-disks build 62690 integration-slave-docker-1040: OFFLINE due to disk space [05:30:12] maintenance-disconnect-full-disks build 62690 integration-slave-docker-1048: OFFLINE due to disk space [05:55:12] maintenance-disconnect-full-disks build 62695 integration-slave-docker-1040: OFFLINE due to disk space [05:55:12] maintenance-disconnect-full-disks build 62695 integration-slave-docker-1048: OFFLINE due to disk space [06:20:12] maintenance-disconnect-full-disks build 62700 integration-slave-docker-1040: OFFLINE due to disk space [06:20:13] maintenance-disconnect-full-disks build 62700 integration-slave-docker-1048: OFFLINE due to disk space [06:45:11] maintenance-disconnect-full-disks build 62705 integration-slave-docker-1040: OFFLINE due to disk space [06:45:12] maintenance-disconnect-full-disks build 62705 integration-slave-docker-1048: OFFLINE due to disk space [06:54:56] (03CR) 10QChris: [C: 03+1] Add tox setup for labs/tools/Isa [integration/config] - 10https://gerrit.wikimedia.org/r/502618 (owner: 10QChris) [07:00:59] (03CR) 10Eugene233: "Looks good! However just thought of something." (031 comment) [integration/config] - 10https://gerrit.wikimedia.org/r/502618 (owner: 10QChris) [07:10:11] maintenance-disconnect-full-disks build 62710 integration-slave-docker-1040: OFFLINE due to disk space [07:10:12] maintenance-disconnect-full-disks build 62710 integration-slave-docker-1048: OFFLINE due to disk space [07:35:11] maintenance-disconnect-full-disks build 62715 integration-slave-docker-1040: OFFLINE due to disk space [07:35:12] maintenance-disconnect-full-disks build 62715 integration-slave-docker-1048: OFFLINE due to disk space [08:00:12] maintenance-disconnect-full-disks build 62720 integration-slave-docker-1040: OFFLINE due to disk space [08:00:12] maintenance-disconnect-full-disks build 62720 integration-slave-docker-1048: OFFLINE due to disk space [08:22:31] (03PS6) 10Gehel: sonar: run sonar analysis as a pre-merge step [integration/config] - 10https://gerrit.wikimedia.org/r/487786 (https://phabricator.wikimedia.org/T215135) [08:23:33] (03CR) 10jerkins-bot: [V: 04-1] sonar: run sonar analysis as a pre-merge step [integration/config] - 10https://gerrit.wikimedia.org/r/487786 (https://phabricator.wikimedia.org/T215135) (owner: 10Gehel) [08:25:12] maintenance-disconnect-full-disks build 62725 integration-slave-docker-1040: OFFLINE due to disk space [08:25:13] maintenance-disconnect-full-disks build 62725 integration-slave-docker-1048: OFFLINE due to disk space [08:34:21] PROBLEM - Free space - all mounts on integration-slave-docker-1052 is CRITICAL: CRITICAL: integration.integration-slave-docker-1052.diskspace._srv.byte_percentfree (<11.11%) [08:35:45] ^^^ those are lies [08:37:05] they are very persistent lies :-D [08:39:20] RECOVERY - Free space - all mounts on integration-slave-docker-1052 is OK: OK: All targets OK [08:40:04] (03CR) 10Phuedx: [C: 03+1] Run Minerva browser tests against the mobile domain [integration/config] - 10https://gerrit.wikimedia.org/r/502884 (https://phabricator.wikimedia.org/T190710) (owner: 10Jdlrobson) [08:50:12] maintenance-disconnect-full-disks build 62730 integration-slave-docker-1040: OFFLINE due to disk space [08:50:13] maintenance-disconnect-full-disks build 62730 integration-slave-docker-1048: OFFLINE due to disk space [09:15:12] maintenance-disconnect-full-disks build 62735 integration-slave-docker-1040: OFFLINE due to disk space [09:15:12] maintenance-disconnect-full-disks build 62735 integration-slave-docker-1048: OFFLINE due to disk space [09:26:59] 10Continuous-Integration-Infrastructure, 10Release-Engineering-Team (Kanban): Audit jenkins-bot@wikimedia.org usage and migrate to a better system - https://phabricator.wikimedia.org/T220663 (10Peachey88) [09:27:01] 10Continuous-Integration-Infrastructure, 10Release-Engineering-Team (Kanban): Audit jenkins-bot@wikimedia.org usage and migrate to a better system - https://phabricator.wikimedia.org/T220664 (10Peachey88) [09:42:28] (03CR) 10Hashar: [C: 03+2] Selenium daily tests for beta using Docker/wdio (032 comments) [integration/config] - 10https://gerrit.wikimedia.org/r/443931 (https://phabricator.wikimedia.org/T188742) (owner: 10Hashar) [10:24:35] 10Release-Engineering-Team (Kanban), 10Multimedia, 10SDC Engineering, 10Multimedia-Current-Work, and 2 others: Jenkins job to run core tests against commons.wikimedia.beta.wmflabs.org - https://phabricator.wikimedia.org/T220621 (10zeljkofilipin) Current job names are in the format `selenium-daily-beta-(rep... [10:33:11] 10Release-Engineering-Team (Kanban), 10Multimedia, 10SDC Engineering, 10Multimedia-Current-Work, and 2 others: Jenkins job to run core tests against commons.wikimedia.beta.wmflabs.org - https://phabricator.wikimedia.org/T220621 (10zeljkofilipin) [10:35:17] 10Release-Engineering-Team (Kanban), 10Multimedia, 10SDC Engineering, 10Multimedia-Current-Work, and 2 others: Jenkins job to run core tests against commons.wikimedia.beta.wmflabs.org - https://phabricator.wikimedia.org/T220621 (10zeljkofilipin) [10:51:37] Yippee, build fixed! [10:51:38] Project beta-scap-eqiad build #244845: 09FIXED in 9 min 36 sec: https://integration.wikimedia.org/ci/job/beta-scap-eqiad/244845/ [11:22:17] PROBLEM - Disk space on contint1001 is CRITICAL: DISK CRITICAL - free space: / 2490 MB (5% inode=63%) [11:37:03] RECOVERY - Disk space on contint1001 is OK: DISK OK [11:53:03] 10Release-Engineering-Team (Kanban), 10Patch-For-Review, 10Readers-Web-Backlog (Readers-Web-Kanbanana-Board-2018-19-Q4), 10User-Jdlrobson, 10User-zeljkofilipin: Enable a MobileFrontend daily Selenium build - https://phabricator.wikimedia.org/T220659 (10zeljkofilipin) a:03zeljkofilipin [11:53:24] (03CR) 10QChris: [C: 03+1] Add tox setup for labs/tools/Isa (031 comment) [integration/config] - 10https://gerrit.wikimedia.org/r/502618 (owner: 10QChris) [11:56:06] 10Continuous-Integration-Config, 10Release-Engineering-Team (Kanban), 10Patch-For-Review, 10Readers-Web-Backlog (Readers-Web-Kanbanana-Board-2018-19-Q4), 10User-zeljkofilipin: Minerva browser tests must be configured to run on the mobile domain - https://phabricator.wikimedia.org/T220658 (10zeljkofilipin... [11:57:50] 10Continuous-Integration-Config, 10MediaWiki-Core-Testing, 10MediaWiki-extensions-MultimediaViewer, 10MobileFrontend, and 10 others: Audit tests/selenium/LocalSettings.php file aiming at possibly deprecating the feature - https://phabricator.wikimedia.org/T199939 (10zeljkofilipin) p:05Triage→03Normal [12:03:56] 10Continuous-Integration-Infrastructure, 10Zuul: ERROR zuul.source.Gerrit: Exception looking for ref refs/heads/master: HTTP Error 401: Unauthorized - https://phabricator.wikimedia.org/T220692 (10hashar) [12:04:56] PROBLEM - Free space - all mounts on integration-slave-docker-1034 is CRITICAL: CRITICAL: integration.integration-slave-docker-1034.diskspace._srv.byte_percentfree (<10.00%) [12:08:12] 10Project-Admins: Create a tag for new Community Tech project 'Night Mode - https://phabricator.wikimedia.org/T220571 (10Aklapper) 05Open→03Resolved a:03Aklapper Requested public project #Night-Mode has been created and H260 has been adjusted. I set the description to > A night time reading mode for the w... [12:14:57] RECOVERY - Free space - all mounts on integration-slave-docker-1034 is OK: OK: All targets OK [12:19:05] 10Continuous-Integration-Infrastructure, 10Gerrit, 10Release-Engineering-Team (Kanban), 10Zuul, 10Patch-For-Review: Zuul cancels all changes when a change is manually merged - https://phabricator.wikimedia.org/T203846 (10hashar) The patch has some issues though: `counterexample 2019-04-11 00:55:50,226 DE... [12:27:39] 10Continuous-Integration-Infrastructure, 10Gerrit, 10Release-Engineering-Team (Kanban), 10Zuul, 10Patch-For-Review: Zuul cancels all changes when a change is manually merged - https://phabricator.wikimedia.org/T203846 (10hashar) My code logic was wrong. The intent is to ignore error when trying to submit... [12:30:35] (03PS1) 10Hashar: Fix flaw in wmf-ignore-submit-error-on-merged-change [integration/zuul] (debian/jessie-wikimedia) - 10https://gerrit.wikimedia.org/r/502984 (https://phabricator.wikimedia.org/T203846) [12:36:32] (03CR) 10Eugene233: Add tox setup for labs/tools/Isa (031 comment) [integration/config] - 10https://gerrit.wikimedia.org/r/502618 (owner: 10QChris) [12:53:20] (03CR) 10Hashar: [C: 03+2] Fix flaw in wmf-ignore-submit-error-on-merged-change [integration/zuul] (debian/jessie-wikimedia) - 10https://gerrit.wikimedia.org/r/502984 (https://phabricator.wikimedia.org/T203846) (owner: 10Hashar) [12:56:21] (03Merged) 10jenkins-bot: Fix flaw in wmf-ignore-submit-error-on-merged-change [integration/zuul] (debian/jessie-wikimedia) - 10https://gerrit.wikimedia.org/r/502984 (https://phabricator.wikimedia.org/T203846) (owner: 10Hashar) [13:13:19] 10Release-Engineering-Team (Kanban): Tech Talks Proposal 2019: new CI system candidate demonstration - https://phabricator.wikimedia.org/T220695 (10LarsWirzenius) [13:14:50] 10Release-Engineering-Team (Kanban): Tech Talks Proposal 2019: new CI system candidate demonstration - https://phabricator.wikimedia.org/T220695 (10LarsWirzenius) [13:31:48] (03CR) 10Hashar: [C: 03+2] "Lets do the tox job first :]" (031 comment) [integration/config] - 10https://gerrit.wikimedia.org/r/502618 (owner: 10QChris) [13:33:28] (03CR) 10Lars Wirzenius: "I'd like the commit message explain the context of the change. I know I've been part of discussing these before, but I admit I still don't" (031 comment) [integration/pipelinelib] - 10https://gerrit.wikimedia.org/r/502917 (https://phabricator.wikimedia.org/T210267) (owner: 10Dduvall) [13:33:54] (03Merged) 10jenkins-bot: Add tox setup for labs/tools/Isa [integration/config] - 10https://gerrit.wikimedia.org/r/502618 (owner: 10QChris) [13:38:33] (03CR) 10Hashar: [C: 04-1] Run Minerva browser tests against the mobile domain (031 comment) [integration/config] - 10https://gerrit.wikimedia.org/r/502884 (https://phabricator.wikimedia.org/T190710) (owner: 10Jdlrobson) [13:39:22] (03PS13) 10Kosta Harlan: Establish codehealth pipeline [integration/config] - 10https://gerrit.wikimedia.org/r/502606 (https://phabricator.wikimedia.org/T218598) [13:39:36] (03CR) 10Hashar: [C: 03+2] MediaWiki: REL1_33 now exists [integration/config] - 10https://gerrit.wikimedia.org/r/502922 (owner: 10Jforrester) [13:41:46] (03Merged) 10jenkins-bot: MediaWiki: REL1_33 now exists [integration/config] - 10https://gerrit.wikimedia.org/r/502922 (owner: 10Jforrester) [13:51:53] (03PS1) 10Hashar: quibble-integration: drop EOL branch REL1_30 [integration/config] - 10https://gerrit.wikimedia.org/r/502994 [13:51:55] (03PS1) 10Hashar: quibble-integration: only run php55 for REL1_27 [integration/config] - 10https://gerrit.wikimedia.org/r/502995 [13:52:25] (03CR) 10Hashar: "Already deployed https://integration.wikimedia.org/ci/job/quibble-integration/ :)" [integration/config] - 10https://gerrit.wikimedia.org/r/502994 (owner: 10Hashar) [13:52:56] (03CR) 10Hashar: "So that if we trigger a build, the php55 check boxes are already unchecked." [integration/config] - 10https://gerrit.wikimedia.org/r/502995 (owner: 10Hashar) [13:58:54] 10Release-Engineering-Team (Kanban): Tech Talks Proposal 2019: new CI system candidate demonstration - https://phabricator.wikimedia.org/T220695 (10LarsWirzenius) a:05LarsWirzenius→03None [14:15:54] 10Release-Engineering-Team (Kanban), 10Patch-For-Review, 10Quibble (marble): Quibble should clone repositories in parallel - https://phabricator.wikimedia.org/T211701 (10hashar) Seems it is working fine, will make it the default in a future Quibble version. [14:19:06] (03PS1) 10Hashar: Default to use 4 git workers [integration/quibble] - 10https://gerrit.wikimedia.org/r/503003 (https://phabricator.wikimedia.org/T211701) [14:26:35] (03PS7) 10Ejegg: DonationInterface tests run on PHP7 and MediaWiki 1.31 [integration/config] - 10https://gerrit.wikimedia.org/r/499334 [14:31:04] (03CR) 10Reedy: DonationInterface tests run on PHP7 and MediaWiki 1.31 (031 comment) [integration/config] - 10https://gerrit.wikimedia.org/r/499334 (owner: 10Ejegg) [14:32:51] (03CR) 10Reedy: [C: 03+2] DonationInterface tests run on PHP7 and MediaWiki 1.31 [integration/config] - 10https://gerrit.wikimedia.org/r/499334 (owner: 10Ejegg) [14:35:12] (03CR) 10jerkins-bot: [V: 04-1] DonationInterface tests run on PHP7 and MediaWiki 1.31 [integration/config] - 10https://gerrit.wikimedia.org/r/499334 (owner: 10Ejegg) [14:37:59] hashar: How am I supposed to see what's wrong in that 5 meg of text? :P [14:42:43] hah, oh fun [14:43:06] (03CR) 10Reedy: [C: 03+2] "recheck" [integration/config] - 10https://gerrit.wikimedia.org/r/499334 (owner: 10Ejegg) [14:45:17] (03CR) 10jerkins-bot: [V: 04-1] DonationInterface tests run on PHP7 and MediaWiki 1.31 [integration/config] - 10https://gerrit.wikimedia.org/r/499334 (owner: 10Ejegg) [14:48:03] hmph [14:48:06] looking [14:50:10] ok, Job quibble-donationinterface-REL1_31-php70-docker not defined [14:50:20] so, let's see [14:51:27] I have a job-template with name quibble-donationinterface-{branch}-php70-docker [14:52:14] So how do we get REL1_31 slotted into that '{branch}' placeholder? [14:53:15] Hmm, so in project donationinterface-fundraising-branches-php70, I have branch: REL1_31 and jobs: quibble-donationinterface-{branch}-php70-docker [14:54:15] 10Release-Engineering-Team (Kanban), 10MediaWiki-extensions-MultimediaViewer, 10Multimedia, 10Patch-For-Review, 10User-zeljkofilipin: Misconfigured -- Unsupported OS/browser/version/device combo - https://phabricator.wikimedia.org/T214389 (10zeljkofilipin) a:03zeljkofilipin [14:54:25] Can you find where the REL1_27/php56 version of that was? [14:55:32] (03CR) 10Jforrester: [C: 03+1] quibble-integration: drop EOL branch REL1_30 [integration/config] - 10https://gerrit.wikimedia.org/r/502994 (owner: 10Hashar) [14:55:38] wm-fundraising.yaml previously had project: donationinterface-fundraising-branches-php56 with branch: REL1_27 and jobs: quibble-donationinterface-{branch}-zend56-docker [14:55:41] (03CR) 10Jforrester: [C: 03+1] quibble-integration: only run php55 for REL1_27 [integration/config] - 10https://gerrit.wikimedia.org/r/502995 (owner: 10Hashar) [14:55:52] then job-template quibble-donationinterface-{branch}-zend56-docker [14:56:55] 10Release-Engineering-Team (Kanban), 10MediaWiki-extensions-MultimediaViewer, 10Multimedia, 10Patch-For-Review, 10User-zeljkofilipin: Misconfigured -- Unsupported OS/browser/version/device combo - https://phabricator.wikimedia.org/T214389 (10zeljkofilipin) p:05Triage→03Low [14:56:58] and that seemed to work fine [14:57:08] I can't see where else it would have been defined [14:59:43] Reedy: I'm sort of just cargo-culting it here... So when the magic happens, it starts by looping over the projects, which take the branches and job names defined within, then somehow looks for matching job-templates? [15:01:43] I believe it does something like that, yeah [15:10:02] ejegg: [15:10:02] zuul/layout.yaml: # Skip MediaWiki tests related to PHP 7.2 support on fundraising/, and MW < 1.32. [15:10:10] That sounds suspicious [15:10:20] There's a few like that [15:10:49] oh? [15:10:55] But we want to run under 7.0 [15:11:00] So that might still be OK [15:11:11] looking again [15:11:24] # Fallback settings for all Quibble jobs [15:11:24] - name: ^.*quibble-.*-docker$ [15:11:24] skip-if: [15:11:24] # Disable on fundraising branches [15:11:24] - project: '^mediawiki/core$' [15:11:26] branch: ^(fundraising/REL1_(27|31))$ [15:11:32] aha, yeah, there's one for php70 too [15:11:37] - name: ^.*quibble.*php70.*$ [15:11:37] will get rid of that [15:11:39] skip-if: [15:11:41] # Disable on fundraising branches [15:11:43] - project: '^mediawiki/core$' [15:11:45] branch: ^(fundraising/REL1_(27|31))$ [15:11:52] Probably worth cleaning up a load of those skips too (in another patch) [15:11:59] but... layout-yaml only defines when jobs are triggered, right? [15:12:07] not the job definitions themselves? [15:13:09] Not sure [15:13:13] I think that file has some impact [15:18:57] 10Continuous-Integration-Infrastructure, 10Release-Engineering-Team (Kanban): Audit jenkins-bot@wikimedia.org usage and migrate to a better system - https://phabricator.wikimedia.org/T220664 (10Dzahn) @bcampbell Could you create jenkins-bot@wikimedia.org as a Google group and add Hashar? (and a second placehol... [15:26:15] (03PS8) 10Ejegg: DonationInterface tests run on PHP7 and MediaWiki 1.31 [integration/config] - 10https://gerrit.wikimedia.org/r/499334 [15:26:26] OK, let's see if that does anything [15:28:27] (03CR) 10jerkins-bot: [V: 04-1] DonationInterface tests run on PHP7 and MediaWiki 1.31 [integration/config] - 10https://gerrit.wikimedia.org/r/499334 (owner: 10Ejegg) [15:29:24] shoot [15:31:12] (03PS9) 10Ejegg: DonationInterface tests run on PHP7 and MediaWiki 1.31 [integration/config] - 10https://gerrit.wikimedia.org/r/499334 [15:33:16] 10Phabricator: Hostname settings on phab1001.eqiad.wmnet - https://phabricator.wikimedia.org/T220711 (10Incnis_Mrsi) [15:37:04] ejegg: Shall we try again? :) [15:38:41] sure! [15:39:23] (03CR) 10Reedy: [C: 03+2] DonationInterface tests run on PHP7 and MediaWiki 1.31 [integration/config] - 10https://gerrit.wikimedia.org/r/499334 (owner: 10Ejegg) [15:40:50] (03Abandoned) 10Jdlrobson: Run Minerva browser tests against the mobile domain [integration/config] - 10https://gerrit.wikimedia.org/r/502884 (https://phabricator.wikimedia.org/T190710) (owner: 10Jdlrobson) [15:41:40] 10Beta-Cluster-Infrastructure, 10Continuous-Integration-Infrastructure, 10DBA, 10MediaWiki-Database, and 2 others: Enable MariaDB/MySQL's Strict Mode - https://phabricator.wikimedia.org/T108255 (10Umherirrender) [15:42:12] (03CR) 10jerkins-bot: [V: 04-1] DonationInterface tests run on PHP7 and MediaWiki 1.31 [integration/config] - 10https://gerrit.wikimedia.org/r/499334 (owner: 10Ejegg) [15:42:16] lol [15:42:39] Why does it only fail on gate? [15:42:41] same fail? [15:42:55] not sure yet [15:43:02] at my parents where the internet is slooow [15:44:19] 16:40:28 INFO:zuul.DependenFAILURE: Job quibble-donationinterface-REL1_31-php70-docker not defined [15:45:02] So yeah... [15:45:36] the feck [15:45:37] https://integration.wikimedia.org/ci/job/integration-config-zuul-layout-diff-docker/841/console [15:45:44] the passing one... the log is over 100,000 kB [15:45:47] *KB [15:45:53] yeah, same failure: Job quibble-donationinterface-REL1_31-php70-docker not defined [15:45:57] jeepers [15:46:47] so.. who's the true wizard on these matters? [15:47:18] hashar who isn't here [15:47:31] shoot [15:48:34] Can it be avoided that the PHP7 test servers add a PHP7 tag to every edit done there? [15:48:55] 10Phabricator: Hostname settings on phab1001.eqiad.wmnet - https://phabricator.wikimedia.org/T220711 (10Aklapper) 05Open→03Stalled Hi @Incnis_Mrsi. This task does not explain why these questions are asked. If there is some issue with something, read and follow https://www.mediawiki.org/wiki/How_to_report_a_b... [15:49:28] I have a browser test expecting specific tags and the PHP7 test servers mess with that ^^' [15:49:54] Nope, it's done purposely for tracking purposes [15:50:12] Is your browser test looking for a specific string, rather than just a tag in a list/array? [15:51:00] Yeah I could probably build may way around that somehow. Just wanted to ask first, before I do that. [15:51:01] 10Release-Engineering-Team, 10MediaWiki-Core-Testing, 10Readers-Web-Backlog (Tracking), 10User-Jdlrobson: Provide generic wrapper inside wdio-mediawiki for API requests - https://phabricator.wikimedia.org/T220712 (10Jdlrobson) [15:51:20] Krinkle: Bored? Any idea why zuul-layout-diff is failing on gate but not normal checks... [15:54:32] Krinkle: specifically, why Job quibble-donationinterface-REL1_31-php70-docker is not defined after this change: https://gerrit.wikimedia.org/r/499334 [15:54:55] Or legoktm if he's also about and bored :P [15:55:43] I guess it's diff vs validate... but still [16:06:41] (03PS3) 10Dduvall: pipeline: Builder and stage implementation [integration/pipelinelib] - 10https://gerrit.wikimedia.org/r/502918 (https://phabricator.wikimedia.org/T210267) [16:06:44] (03PS3) 10Dduvall: pipeline: Provide a rickety but useful system test [integration/pipelinelib] - 10https://gerrit.wikimedia.org/r/502919 [16:07:23] (03CR) 10PipelineBot: "pipeline-dashboard: service-pipeline-test" [integration/pipelinelib] - 10https://gerrit.wikimedia.org/r/502918 (https://phabricator.wikimedia.org/T210267) (owner: 10Dduvall) [16:07:39] (03CR) 10PipelineBot: "pipeline-dashboard: service-pipeline-test" [integration/pipelinelib] - 10https://gerrit.wikimedia.org/r/502919 (owner: 10Dduvall) [16:09:52] 10Beta-Cluster-Infrastructure, 10SDC General, 10Wikidata, 10Services (next): No jobs running on beta cluster - https://phabricator.wikimedia.org/T215339 (10kostajh) This is important to #growth-team as well as we use the job queue in various places of #mediawiki-extensions-growthexperiments and can't QA so... [16:12:05] !log deployment-chromium0[1-2] Update Proton on to 8988283 (T213362, T216191, T212322) [16:18:07] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [16:18:07] T216191: Replace Istanbul with nyc - https://phabricator.wikimedia.org/T216191 [16:18:08] T213362: Limit what URLs Proton can access - https://phabricator.wikimedia.org/T213362 [16:18:08] T212322: Verify Proton can handle Queue timeouts properly - https://phabricator.wikimedia.org/T212322 [16:20:21] 10Beta-Cluster-Infrastructure, 10SDC General, 10Wikidata, 10Services (next): No jobs running on beta cluster - https://phabricator.wikimedia.org/T215339 (10Krenair) It seems to me that someone should be able to make profile::mediawiki::jobrunner_tls permit customisation of the hostname instead of hardcodin... [16:20:30] 10Continuous-Integration-Config: Run experimental sqlite also for gated extension - https://phabricator.wikimedia.org/T220715 (10Umherirrender) [16:25:45] !log deleting deployment-db04, unused and shut down since 28th March. T219087 [16:31:14] !log deleting deployment-db04, unused and shut down since 28th March. T219087 [16:31:34] stashbot, next [16:31:45] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [16:31:45] T219087: Get rid of deployment-db0[34] - https://phabricator.wikimedia.org/T219087 [16:32:15] See https://wikitech.wikimedia.org/wiki/Tool:Stashbot for help. [16:33:55] 10Beta-Cluster-Infrastructure, 10Patch-For-Review: Get rid of deployment-db0[34] - https://phabricator.wikimedia.org/T219087 (10Krenair) 05Open→03Resolved [16:34:17] 10Beta-Cluster-Infrastructure: Migrate away from Debian Jessie to Debian Stretch - https://phabricator.wikimedia.org/T218729 (10Krenair) [16:48:44] 10Phabricator, 10Mail: Hostname settings on phab1001.eqiad.wmnet - https://phabricator.wikimedia.org/T220711 (10Aklapper) 05Stalled→03Open @Incnis_Mrsi: If this is about Phabricator mail notification headers like ` Received: from localhost ([::1]:47496 helo=localhost.localdomain) by phab1001.eqiad.... [16:48:46] 10Release-Engineering-Team (Kanban), 10Developer-Advocacy: Tech Talks Proposal 2019: new CI system candidate demonstration - https://phabricator.wikimedia.org/T220695 (10Aklapper) [16:48:49] 10Phabricator, 10Mail: Hostname settings on phab1001.eqiad.wmnet - https://phabricator.wikimedia.org/T220711 (10Dzahn) > And what is the argument to domain in /etc/resolv.conf? Unlikely there is such line at all. ` [phab1001:~] $ cat /etc/resolv.conf #########################################################... [16:52:43] 10Phabricator, 10Mail: Hostname settings on phab1001.eqiad.wmnet - https://phabricator.wikimedia.org/T220711 (10herron) 05Open→03Resolved a:03herron Localhost is seen in the mail headers because the Phabricator application relays mail to a local Exim MTA via SMTP. The local MTA provides message queueing... [16:57:18] 10MediaWiki-Codesniffer, 10MediaWiki-General-or-Unknown: Standardize return type hint spacing - https://phabricator.wikimedia.org/T220719 (10Tgr) [17:01:23] 10Release-Engineering-Team, 10MediaWiki-Core-Testing, 10Readers-Web-Backlog (Tracking), 10User-Jdlrobson, 10User-zeljkofilipin: Provide generic wrapper inside wdio-mediawiki for API requests - https://phabricator.wikimedia.org/T220712 (10zeljkofilipin) [17:04:28] 10Release-Engineering-Team (Kanban), 10MediaWiki-Core-Testing, 10MW-1.34-notes (1.34.0-wmf.1; 2019-04-16), 10Patch-For-Review, and 2 others: selenium-daily-beta-MediaWiki fails due to QuickSurveys inserting HTML in the content - https://phabricator.wikimedia.org/T217544 (10zeljkofilipin) 05Open→03Resolv... [17:32:25] 10Phabricator, 10Mail: Hostname settings on phab1001.eqiad.wmnet - https://phabricator.wikimedia.org/T220711 (10Incnis_Mrsi) … because the Phabricator application relays mail //having no Message-ID header of its own// to a local Exim MTA. Unlikely Exim would replace an existing ID with crap. IMHO not a good pr... [17:32:26] is there some special way to add new development composer dependencies to mw extensions? The dependency was added to composer.json in require-dev but https://integration.wikimedia.org/ci/job/wmf-quibble-vendor-mysql-hhvm-docker/21745/console says it's not available. I see composer is ran twice, the first time through for some static analysis checks seems to load the dev dependency, but the [17:32:26] second time for mw test cases the dev dep isn't reported as installed [17:32:27] the composer.*.json.txt stored in CI artifacts seems to confirm the new dep isn't loaded [17:32:27] (03CR) 10Hashar: "Don't we need to keep the REL1_27 job until the migration has completed?" (031 comment) [integration/config] - 10https://gerrit.wikimedia.org/r/499334 (owner: 10Ejegg) [17:32:28] ebernhardson: I don't think we've got any examples of actually doing this so far... [17:32:29] (03PS10) 10Ejegg: DonationInterface tests run on PHP7 and MediaWiki 1.31 [integration/config] - 10https://gerrit.wikimedia.org/r/499334 [17:32:29] Reedy: hmm, so basically add it to require-dev in vendor.git? [17:32:29] (03CR) 10Ejegg: "Thanks for looking at this Hashar. We've finally upgraded payments-wiki to PHP7.0 and Mediawiki 1.31, so it should be OK to merge this. I " [integration/config] - 10https://gerrit.wikimedia.org/r/499334 (owner: 10Ejegg) [17:32:30] (03CR) 10Reedy: [C: 03+2] "So I/we need to deploy the job using JJB (after cherry picking this locally), and then resubmit this?" [integration/config] - 10https://gerrit.wikimedia.org/r/499334 (owner: 10Ejegg) [17:33:27] (03CR) 10Jforrester: "> Patch Set 9:" [integration/config] - 10https://gerrit.wikimedia.org/r/499334 (owner: 10Ejegg) [17:48:15] !log deployed 'quibble-donationinterface-REL1_31-php70-docker' to jenkins [17:48:27] ejegg|food: Going for food also, but the gate job should work now... [17:49:21] * ebernhardson notes reedy doesn't want to approve of what is obviously a hack :P [17:49:53] ebernhardson: I honestly don't know if it'll work :P [17:49:58] Try it and see? :P [17:49:58] Reedy: it does, I already tested it [17:50:15] orly? [17:50:22] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [17:50:36] just under require-dev in composer.json of mediawiki-vendor? Committing no files? [17:50:40] basically all quibble does is open composer.json from meidawiki.git and vendor.git, and create a composer require line out of the require-dev in both [17:50:43] Reedy: yes [17:50:43] It's not that bad... [17:51:06] ok, i made a ticket that says find a better way, and will do this for now [17:51:23] yeah, if it unblocks you... [17:51:26] It might be fine longer time [17:51:54] term [17:51:55] not time [17:57:30] ebernhardson: I can merge it for you when I'm done with food [17:58:57] 10Continuous-Integration-Config, 10Release-Engineering-Team (Kanban), 10MW-1.34-notes (1.34.0-wmf.1; 2019-04-16), 10Patch-For-Review, and 2 others: Minerva browser tests must be configured to run on the mobile domain - https://phabricator.wikimedia.org/T220658 (10Jdlrobson) 05Open→03Resolved Fixed and... [17:59:52] (03PS6) 10Jforrester: Drop jsduck jobs no longer used after I211c507f957675b [integration/config] - 10https://gerrit.wikimedia.org/r/496894 [18:00:02] 10Gerrit, 10Release-Engineering-Team (Kanban), 10Scap, 10Patch-For-Review, 10User-zeljkofilipin: `scap clean` failure - https://phabricator.wikimedia.org/T218783 (10mmodell) p:05Unbreak!→03Normal [18:00:54] Reedy: If you're in a generous merging mood, there's https://gerrit.wikimedia.org/r/c/integration/config/+/480463 :-) [18:01:14] 10Gerrit, 10Release-Engineering-Team (Kanban), 10Scap, 10Patch-For-Review, 10User-zeljkofilipin: `scap clean` failure - https://phabricator.wikimedia.org/T218783 (10mmodell) Ok I ran scap clean for `wmf.18`**-**`wmf.20` and it seems like it got things all cleaned up. [18:01:20] 10MediaWiki-Codesniffer, 10MediaWiki-General-or-Unknown: Standardize return type hint spacing - https://phabricator.wikimedia.org/T220719 (10Mainframe98) I quote from https://www.mediawiki.org/wiki/Manual:Coding_conventions/CSS: > We love whitespace. And from https://www.mediawiki.org/wiki/Manual:Coding_conve... [18:02:03] (03CR) 10jerkins-bot: [V: 04-1] Drop jsduck jobs no longer used after I211c507f957675b [integration/config] - 10https://gerrit.wikimedia.org/r/496894 (owner: 10Jforrester) [18:06:58] James_F: Yeah, I'll do that after I do the FR one [18:14:20] (03CR) 10Reedy: [C: 03+2] DonationInterface tests run on PHP7 and MediaWiki 1.31 [integration/config] - 10https://gerrit.wikimedia.org/r/499334 (owner: 10Ejegg) [18:16:29] (03Merged) 10jenkins-bot: DonationInterface tests run on PHP7 and MediaWiki 1.31 [integration/config] - 10https://gerrit.wikimedia.org/r/499334 (owner: 10Ejegg) [18:16:43] Reedy: <3 [18:16:51] yay jerkins [18:17:22] !log reloading zuul to deploy https://gerrit.wikimedia.org/r/499334 [18:17:42] (03PS7) 10Reedy: Add WikibaseMediaInfo to gated extensions [integration/config] - 10https://gerrit.wikimedia.org/r/480463 (https://phabricator.wikimedia.org/T204153) (owner: 10Jforrester) [18:18:11] (03CR) 10Reedy: [C: 03+2] Add WikibaseMediaInfo to gated extensions [integration/config] - 10https://gerrit.wikimedia.org/r/480463 (https://phabricator.wikimedia.org/T204153) (owner: 10Jforrester) [18:19:47] (03Merged) 10jenkins-bot: Add WikibaseMediaInfo to gated extensions [integration/config] - 10https://gerrit.wikimedia.org/r/480463 (https://phabricator.wikimedia.org/T204153) (owner: 10Jforrester) [18:20:59] !log reloading zuul to deploy https://gerrit.wikimedia.org/r/480463 [18:21:29] (03PS3) 10Reedy: Skip php70 tests on new SecurityCheckPlugin development branch [integration/config] - 10https://gerrit.wikimedia.org/r/502590 (https://phabricator.wikimedia.org/T220540) (owner: 10SBassett) [18:21:34] (03CR) 10Reedy: [C: 03+2] Skip php70 tests on new SecurityCheckPlugin development branch [integration/config] - 10https://gerrit.wikimedia.org/r/502590 (https://phabricator.wikimedia.org/T220540) (owner: 10SBassett) [18:23:05] 10Release-Engineering-Team, 10Security-Team, 10phan-taint-check-plugin, 10Patch-For-Review: Skip php70 tests on new SecurityCheckPlugin development branch - https://phabricator.wikimedia.org/T220540 (10sbassett) [18:23:06] (03Merged) 10jenkins-bot: Skip php70 tests on new SecurityCheckPlugin development branch [integration/config] - 10https://gerrit.wikimedia.org/r/502590 (https://phabricator.wikimedia.org/T220540) (owner: 10SBassett) [18:23:18] (03PS4) 10Reedy: Re-enable CI tests for ArticleFeedbackv5 extension [integration/config] - 10https://gerrit.wikimedia.org/r/497792 (https://phabricator.wikimedia.org/T218759) (owner: 10D3r1ck01) [18:23:22] (03CR) 10Reedy: [C: 03+2] Re-enable CI tests for ArticleFeedbackv5 extension [integration/config] - 10https://gerrit.wikimedia.org/r/497792 (https://phabricator.wikimedia.org/T218759) (owner: 10D3r1ck01) [18:23:51] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [18:25:00] (03Merged) 10jenkins-bot: Re-enable CI tests for ArticleFeedbackv5 extension [integration/config] - 10https://gerrit.wikimedia.org/r/497792 (https://phabricator.wikimedia.org/T218759) (owner: 10D3r1ck01) [18:25:10] 10Phabricator, 10Release-Engineering-Team (Kanban): task-series broken because of error: invalid type "custom.release.date" - https://phabricator.wikimedia.org/T219192 (10mmodell) 05Open→03Resolved [18:25:29] (03PS2) 10Reedy: GrowthExperiments: Add dependency on EventLogging for phan [integration/config] - 10https://gerrit.wikimedia.org/r/500471 (owner: 10Kosta Harlan) [18:25:32] (03CR) 10Reedy: [C: 03+2] GrowthExperiments: Add dependency on EventLogging for phan [integration/config] - 10https://gerrit.wikimedia.org/r/500471 (owner: 10Kosta Harlan) [18:27:01] (03Merged) 10jenkins-bot: GrowthExperiments: Add dependency on EventLogging for phan [integration/config] - 10https://gerrit.wikimedia.org/r/500471 (owner: 10Kosta Harlan) [18:27:08] (03PS2) 10Reedy: Remove BetaFeatures req from AdvancedSearch [integration/config] - 10https://gerrit.wikimedia.org/r/499257 (owner: 10WMDE-Fisch) [18:27:12] (03CR) 10Reedy: [C: 03+2] Remove BetaFeatures req from AdvancedSearch [integration/config] - 10https://gerrit.wikimedia.org/r/499257 (owner: 10WMDE-Fisch) [18:27:24] 10Continuous-Integration-Config, 10Release-Engineering-Team, 10Epic: Have dependencies of gated extensions in the gate - https://phabricator.wikimedia.org/T204252 (10Jdforrester-WMF) [18:30:35] (03PS2) 10Jforrester: gate: Add Scribunto [integration/config] - 10https://gerrit.wikimedia.org/r/497574 (https://phabricator.wikimedia.org/T125050) [18:30:35] (03Merged) 10jenkins-bot: Remove BetaFeatures req from AdvancedSearch [integration/config] - 10https://gerrit.wikimedia.org/r/499257 (owner: 10WMDE-Fisch) [18:30:35] (03CR) 10Jforrester: [C: 04-1] "Per Timo's concerns that we would slow down the gate too much right now." [integration/config] - 10https://gerrit.wikimedia.org/r/497574 (https://phabricator.wikimedia.org/T125050) (owner: 10Jforrester) [18:30:36] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [18:30:36] !log reloading zuul to deploy https://gerrit.wikimedia.org/r/502590 https://gerrit.wikimedia.org/r/497792 https://gerrit.wikimedia.org/r/500471 https://gerrit.wikimedia.org/r/499257 [18:30:57] (03PS3) 10Jforrester: Drop `extension-quibble` for repos covered by `extension-gate` [integration/config] - 10https://gerrit.wikimedia.org/r/497575 [18:44:20] 10Continuous-Integration-Config, 10Release-Engineering-Team (Kanban), 10MW-1.34-notes (1.34.0-wmf.1; 2019-04-16), 10Patch-For-Review, and 2 others: Minerva browser tests must be configured to run on the mobile domain - https://phabricator.wikimedia.org/T220658 (10zeljkofilipin) a:05zeljkofilipin→03Jdlro... [18:45:15] 10Release-Engineering-Team (Kanban), 10Release, 10Train Deployments: 1.34.0-wmf.1 deployment blockers - https://phabricator.wikimedia.org/T220726 (10mmodell) a:03mmodell [18:46:03] 10Release-Engineering-Team (Kanban), 10Release, 10Train Deployments: 1.34.0-wmf.3 deployment blockers - https://phabricator.wikimedia.org/T220728 (10mmodell) a:03thcipriani [18:46:24] 10Release-Engineering-Team (Kanban), 10Release, 10Train Deployments: 1.34.0-wmf.4 deployment blockers - https://phabricator.wikimedia.org/T220729 (10mmodell) a:03thcipriani [18:46:38] 10Release-Engineering-Team (Kanban), 10Release, 10Train Deployments: 1.34.0-wmf.5 deployment blockers - https://phabricator.wikimedia.org/T220730 (10mmodell) a:03hashar [18:46:56] 10Release-Engineering-Team (Kanban), 10Release, 10Train Deployments: 1.34.0-wmf.6 deployment blockers - https://phabricator.wikimedia.org/T220731 (10mmodell) a:03hashar [18:47:15] 10Release-Engineering-Team (Kanban), 10Release, 10Train Deployments: 1.34.0-wmf.7 deployment blockers - https://phabricator.wikimedia.org/T220732 (10mmodell) a:03zeljkofilipin [18:47:31] 10Release-Engineering-Team (Kanban), 10Release, 10Train Deployments: 1.34.0-wmf.8 deployment blockers - https://phabricator.wikimedia.org/T220733 (10mmodell) a:03zeljkofilipin [18:48:33] 10Release-Engineering-Team (Kanban), 10Release, 10Train Deployments: 1.34.0-wmf.10 deployment blockers - https://phabricator.wikimedia.org/T220735 (10mmodell) a:03dduvall [18:48:49] 10Release-Engineering-Team (Kanban), 10Release, 10Train Deployments: 1.34.0-wmf.9 deployment blockers - https://phabricator.wikimedia.org/T220734 (10mmodell) a:03dduvall [18:52:52] 10Release-Engineering-Team (Backlog), 10Readers-Web-Backlog, 10Browser-Tests: Have a discussion around Minerva selenium browser test architecture - https://phabricator.wikimedia.org/T220755 (10Jdlrobson) [18:53:10] PROBLEM - Host deployment-db04 is DOWN: CRITICAL - Host Unreachable (172.16.5.5) [18:57:09] 10Continuous-Integration-Infrastructure, 10Shinken, 10Patch-For-Review: Shinken keeps alerting about long gone instances - https://phabricator.wikimedia.org/T218146 (10Krenair) It's still broken, I just received a host down alert for an instance I deleted two hours ago. [18:57:12] trying to follow [18:57:13] https://wikitech.wikimedia.org/wiki/Gerrit#Github [18:57:25] I ran, ` ssh -p 29418 gerrit.wikimedia.org replication start wikipeg --wait` [18:57:42] and got, "startReplication for plugin replication not permitted" [18:57:46] can someone help? [18:58:00] I'd be surprised if that could be run by non-administrators. [18:58:52] If an example has been written for operations it may not necessarily be applicable to people with limited rights. [18:59:10] I was hoping soemone with the proper permissions lived here [19:00:33] thcipriani, twentyafterfour ? [19:01:01] what is the issue? [19:01:10] arlolra: This is the brand-new repo, right? It'll get synced into GitHub via the regular (daily?) cron script, I think. [19:01:14] we usually do not need to run that replication command [19:01:23] and yes that requires some special rights [19:01:42] James_F: yes, I just created it [19:01:51] ok, daily is faine [19:01:52] fine [19:01:54] thanks [19:02:04] (03CR) 10Umherirrender: "The requested package monolog/monolog ~1.18.2 exists as monolog/monolog[1.22.1] but these are rejected by your constraint." [integration/config] - 10https://gerrit.wikimedia.org/r/499334 (owner: 10Ejegg) [19:02:19] for replication: we need to create the repo on github, then gerrit replication will take over from there (or we can run it manually the first time) [19:04:01] 10Release-Engineering-Team (Kanban), 10Release, 10Train Deployments: 1.34.0-wmf.7 deployment blockers - https://phabricator.wikimedia.org/T220732 (10zeljkofilipin) a:05zeljkofilipin→03None Unassigning from myself, since this is in a couple of months. I'll assign it back to me in time. [19:04:10] 10Release-Engineering-Team (Kanban), 10Release, 10Train Deployments: 1.34.0-wmf.8 deployment blockers - https://phabricator.wikimedia.org/T220733 (10zeljkofilipin) a:05zeljkofilipin→03None Unassigning from myself, since this is in a couple of months. I'll assign it back to me in time. [19:04:18] 10Release-Engineering-Team (Kanban), 10Release, 10Train Deployments, 10User-zeljkofilipin: 1.34.0-wmf.7 deployment blockers - https://phabricator.wikimedia.org/T220732 (10zeljkofilipin) [19:04:32] 10Release-Engineering-Team (Kanban), 10Release, 10Train Deployments, 10User-zeljkofilipin: 1.34.0-wmf.8 deployment blockers - https://phabricator.wikimedia.org/T220733 (10zeljkofilipin) [19:05:12] thcipriani: Ah, interesting, it happens so smoothly I assumed it was automated. :-) [19:05:38] 10Release-Engineering-Team (Backlog), 10Readers-Web-Backlog, 10Browser-Tests, 10User-zeljkofilipin: Have a discussion around Minerva selenium browser test architecture - https://phabricator.wikimedia.org/T220755 (10zeljkofilipin) [19:06:23] James_F: I did as well for the longest time :) [19:06:30] * James_F grins. [19:06:55] 10Continuous-Integration-Infrastructure (shipyard), 10Release-Engineering-Team (Kanban), 10releng-201718-q3, 10Epic, and 2 others: [EPIC] Migrate Mediawiki jobs from Nodepool to Docker - https://phabricator.wikimedia.org/T183512 (10hashar) [19:06:57] 10Continuous-Integration-Infrastructure (Slipway), 10Release-Engineering-Team (Kanban), 10MediaWiki-extensions-DonationInterface, 10Patch-For-Review: Migrate DonationInterface CI job to Docker - https://phabricator.wikimedia.org/T203084 (10hashar) 05Open→03Resolved a:03hashar REL1_27 and the outdated... [19:10:25] arlolra: FYI up-to-date now: https://github.com/wikimedia/wikipeg [19:10:25] 10Release-Engineering-Team (Kanban), 10Release, 10Train Deployments: 1.34.0-wmf.1 deployment blockers - https://phabricator.wikimedia.org/T220726 (10mmodell) p:05Triage→03Normal [19:10:25] :) [19:10:26] REL1_27 goes EOL in June, REL1_30 went EOL in December 2018, and REL_32 will go EOL this December, right? [19:11:03] arlolra: ah that was for github. So yeah we need to manually create the repo first then eventually gerrit catch up whenever some activity occurs on the repo :) [19:11:18] arlolra: note that Github already emailed us about uglify-js being outdated/vulnerable [19:11:29] 10Release-Engineering-Team (Kanban), 10Release, 10Train Deployments: 1.34.0-wmf.10 deployment blockers - https://phabricator.wikimedia.org/T220735 (10mmodell) p:05Triage→03Normal [19:11:31] 10Release-Engineering-Team (Kanban), 10Release, 10Train Deployments, 10User-zeljkofilipin: 1.34.0-wmf.8 deployment blockers - https://phabricator.wikimedia.org/T220733 (10mmodell) p:05Triage→03Normal [19:11:33] 10Release-Engineering-Team (Kanban), 10Release, 10Train Deployments: 1.34.0-wmf.9 deployment blockers - https://phabricator.wikimedia.org/T220734 (10mmodell) p:05Triage→03Normal [19:11:35] 10Release-Engineering-Team (Kanban), 10Release, 10Train Deployments, 10User-zeljkofilipin: 1.34.0-wmf.7 deployment blockers - https://phabricator.wikimedia.org/T220732 (10mmodell) p:05Triage→03Normal [19:11:37] 10Release-Engineering-Team (Kanban), 10Release, 10Train Deployments: 1.34.0-wmf.6 deployment blockers - https://phabricator.wikimedia.org/T220731 (10mmodell) p:05Triage→03Normal [19:11:39] 10Release-Engineering-Team (Kanban), 10Release, 10Train Deployments: 1.34.0-wmf.5 deployment blockers - https://phabricator.wikimedia.org/T220730 (10mmodell) p:05Triage→03Normal [19:11:39] James_F: in my browser history I type: mediawiki lifecycle [19:11:41] 10Release-Engineering-Team (Kanban), 10Release, 10Train Deployments: 1.34.0-wmf.4 deployment blockers - https://phabricator.wikimedia.org/T220729 (10mmodell) p:05Triage→03Normal [19:11:43] 10Release-Engineering-Team (Kanban), 10Release, 10Train Deployments: 1.34.0-wmf.3 deployment blockers - https://phabricator.wikimedia.org/T220728 (10mmodell) p:05Triage→03Normal [19:11:44] which yields me the helpful page https://www.mediawiki.org/wiki/Version_lifecycle [19:12:10] hashar: Yes, but what it says on the wiki and what people think it says differ over time. [19:12:12] and I can't wait for 1.27 to be removed [19:12:18] will let us drop php5.5 from CI! [19:12:21] Yeah. [19:12:31] I really want us to drop HHVM from CI too. [19:12:32] the pity is [19:12:47] CI gotta maintain bunch of obsolete software way after they are EOL :/ [19:12:56] HHVM yes as well [19:13:05] Or we could just stop checking those things. [19:13:07] and we should probably drop 7.1 [19:13:13] Yes. Maybe right now. [19:13:32] (And 7.0 ASAP.) [19:13:45] well I am still confused about the state of php on the prod cluster though [19:13:58] several people kept repeating me which the current state but I keep forgetting :] [19:14:02] arlolra: https://github.com/wikimedia/wikipeg/network/alert/package.json/uglify-js/open [19:14:06] or maybe that is because I am busy with too many things [19:14:32] 10Release-Engineering-Team (Backlog), 10Readers-Web-Backlog, 10Browser-Tests, 10User-zeljkofilipin: Have a discussion around Minerva selenium browser test architecture - https://phabricator.wikimedia.org/T220755 (10zeljkofilipin) If we want to meet soon, it has to be in the next few days. I'll be traveling... [19:14:42] hashar: Current state: 99.99% of traffic goes to HHVM, and all the job runners, but 7.2 is installed and usable via a cookie and a split test. There's a blocker (changing Unicode support), but once that's resolved it'll titrate up quickly. [19:15:07] hashar: I'd be unsurprised if we managed to kill off HHVM from traffic by the end of the quarter. ServiceOpsen are awesome, after all. [19:15:07] so we do not use 7.0 on prod? [19:15:27] No, I think we've dropped 7.0 from all of prod now, but there might be some odd areas left. [19:15:48] good [19:15:59] will have to revisit the jobs that are triggered, though t.imo did some cleanup recently [19:16:13] Right now we "could" drop PHP 7.0 and 7.1 support from MediaWiki without adverse effect on Wikimedia (but third parties would be impacted, so it's subject to discussion). [19:18:21] 10Release-Engineering-Team (Watching / External), 10Operations, 10Release Pipeline, 10Core Platform Team Kanban (Done with CPT), 10Services (done): Track and install additional npm packages for all service container images - https://phabricator.wikimedia.org/T205911 (10mobrovac) [19:19:48] 10Release-Engineering-Team, 10Security-Team, 10phan-taint-check-plugin: Skip php70 tests on new SecurityCheckPlugin development branch - https://phabricator.wikimedia.org/T220540 (10sbassett) 05Open→03Resolved [19:22:03] James_F: yes, I will fix [19:22:11] 10Release-Engineering-Team (Kanban), 10Patch-For-Review, 10Release, 10Train Deployments: 1.33.0-wmf.25 deployment blockers - https://phabricator.wikimedia.org/T206679 (10mmodell) [19:26:20] arlolra: Thanks! [19:28:28] Reedy: thanks! I'll see what's up with that version constraint [19:40:48] Reedy: ok, going to increase the monolog requirement in DonationInterface to match mw 1.31. But for some dev dependencies, it looks like DonationInterface is actually ahead of mediawiki [19:40:48] shouldn't be any harm in bumping those up in mediawiki, I hope? [19:40:48] Wikimedia prod/beta might not be affected by dropping of support for PHP 7.0/7.1 [19:40:48] But at least on my laptop I've got 7.0 [19:40:48] I imagine other Wikimedia developers are likely to have it too [19:40:49] hmm, latest DonationInterface failure is this: InvalidArgumentException from line 374 of /workspace/src/includes/libs/rdbms/database/Database.php: No database user provided [19:40:49] and... it seems to be due to a failure with the ContributionTracking extension [19:40:49] that extn basically just manages a single table [19:40:49] I guess something changed between the old tests and the new as to how the db credentials are provided? [19:40:49] https://integration.wikimedia.org/ci/job/quibble-donationinterface-REL1_31-php70-docker/4/console [19:40:50] James_F it would be a bummer not to have mediawiki run on debian stable! [19:40:51] (03PS2) 10Hashar: Default to use 4 git workers [integration/quibble] - 10https://gerrit.wikimedia.org/r/503003 (https://phabricator.wikimedia.org/T211701) [19:40:52] (03CR) 10Hashar: [C: 03+2] "So 8 works fine on CI, but 4 seems like a more reasonable value. At least in my experience with my DSL connection." [integration/quibble] - 10https://gerrit.wikimedia.org/r/503003 (https://phabricator.wikimedia.org/T211701) (owner: 10Hashar) [19:40:52] (03Merged) 10jenkins-bot: Default to use 4 git workers [integration/quibble] - 10https://gerrit.wikimedia.org/r/503003 (https://phabricator.wikimedia.org/T211701) (owner: 10Hashar) [19:40:56] 10Release-Engineering-Team (Kanban), 10Patch-For-Review, 10Quibble (marble): Quibble should clone repositories in parallel - https://phabricator.wikimedia.org/T211701 (10hashar) 05Open→03Resolved I think that is good enough for now. We can add more `--git-parallel` later on. [19:41:18] (03CR) 10jenkins-bot: Default to use 4 git workers [integration/quibble] - 10https://gerrit.wikimedia.org/r/503003 (https://phabricator.wikimedia.org/T211701) (owner: 10Hashar) [19:44:56] ejegg: That's Debian's problem, bluntly. [19:45:18] ejegg: If they want to endlessly support crapware, that's on them. [20:01:27] releng folks, anyone know off the top of their head why a quibble test setup [20:01:36] would fail with missing DB credentials? [20:01:43] https://integration.wikimedia.org/ci/job/quibble-donationinterface-REL1_31-php70-docker/4/console [20:02:42] James_F: WikibaseMediaInfo is failing on all commits. May need to disable from the gate or fix asap. [20:03:12] (03PS7) 10Hashar: Better arg handling [integration/quibble] - 10https://gerrit.wikimedia.org/r/496125 (https://phabricator.wikimedia.org/T218357) [20:04:08] (03CR) 10Hashar: "for this change I keep --commands to accept multiple args for back compatibility with CI. Though theoretically on CI I can bump the image " [integration/quibble] - 10https://gerrit.wikimedia.org/r/496125 (https://phabricator.wikimedia.org/T218357) (owner: 10Hashar) [20:05:22] Krinkle: What's the failure? [20:05:28] Krinkle: Eurgh, yes. [20:05:38] Reedy: Selenium being selenium. [20:06:51] Tests cause so many problems [20:11:55] James_F: Immediate issue is that the test isn't waiting for the element to appear, so in isolation last week it loaded quick enough. Now with the whole gate thrown at it, it takes longer to appear. [20:16:37] Yeah, should I just put in a sleep for now? [20:17:27] Everything about testing media-related code is a disaster. It all based on config, and CI doesn't test that well. [20:18:59] James_F: there is a wait for visible command,, dont use pause() [20:19:16] it also has a timeout [20:19:54] I should probably patch core to disable all tests that use pause() because they are going to be flaky. Ugh. [20:20:02] sooner or later. [20:24:59] FFS. [20:25:07] Atom auto-corrected my lowercase 'f'. [20:28:31] Oh, no, the lowercase 'f' is for the config but not the code? WDIO lives to confuse. [20:42:29] James_F: I assume C.ormac works UTC~1 hours? I can land it once it passes. [20:42:55] Krinkle: Yeah, though it's Eric who's done most work of late. [20:44:49] oh okay, feel free to CC him first then. don't want to intervene :) [20:44:51] Also, what bit of Phab do I have to hit with a hammer to stop WBMI gerrit patches spamming tasks like at the top of T220758? [20:44:52] T220758: Flaky wdio test "Special:Version has WikibaseMediaInfo listed" - https://phabricator.wikimedia.org/T220758 [20:45:03] Krinkle: UBN -> Merge first, tell people later. [20:45:12] k [20:45:43] James_F: Yeah, for some repositories Phab is mirroring every unmerged draft of every patch through some kind of internal Gerrit link. It's weird. and only for some repos. [20:46:28] It's something to do with mirroring of refs/whatever, but it's beyond my Phabmin foo. [20:46:57] I imagine t.wentyafterfour or t.hcipriani would know. [20:47:08] James_F fixed [20:47:22] Switching off "Publish/Notify" fixed it. [20:47:27] In https://phabricator.wikimedia.org/diffusion/EWBI/manage/actions/ [20:47:58] Ah! I was looking at https://phabricator.wikimedia.org/diffusion/EWBI/manage/uris/ [20:48:03] Thanks, paladox. [20:48:26] Thanks, Krinkle. [20:48:39] paladox: does that disabling mirroring entirely or just for internal gerrit branches? [20:49:34] oh, I guess that just means it won't auto-mention with maniphest. [20:50:18] Nope [20:50:24] it just prevents what James_F was describing :) [20:50:38] Krinkle yeh, prevents auto mentions. [20:51:31] interesting, I see that's how most repos as set up as well. And indeed, they all mirror everything. That's not configurable (I'm seeing gerrit patch sets of mine for all repos at https://phabricator.wikimedia.org/people/commits/114/ ) [20:51:47] I was hoping there'd be a way to turn that off, but fine I guess. [20:52:11] well that links to all commits you made but it should not notify you (ie annoy you :)) [20:52:26] yeah, indeed it does not [20:53:47] 10Continuous-Integration-Infrastructure, 10RelEng-Archive-FY201718-Q1, 10Patch-For-Review: CI job fails with: /usr/lib/x86_64-linux-gnu/hhvm/extensions/20150212/tidy.so: cannot open shared object file: No such file or directory - https://phabricator.wikimedia.org/T169004 (10hashar) [20:53:49] 10Continuous-Integration-Infrastructure, 10Release-Engineering-Team (Backlog), 10Tidy: Figure out the package conflict between libtidy-dev from sury and hhvm-tidy - https://phabricator.wikimedia.org/T169008 (10hashar) 05Open→03Declined I think this one is too old, I don't remember having that issue with... [20:54:28] (03CR) 10Hashar: [C: 03+2] Emit a warning for EXT_DEPENDENCIES and SKIN_DEPENDENCIES [integration/quibble] - 10https://gerrit.wikimedia.org/r/501566 (https://phabricator.wikimedia.org/T220199) (owner: 10Hashar) [20:54:34] (03CR) 10jerkins-bot: [V: 04-1] Emit a warning for EXT_DEPENDENCIES and SKIN_DEPENDENCIES [integration/quibble] - 10https://gerrit.wikimedia.org/r/501566 (https://phabricator.wikimedia.org/T220199) (owner: 10Hashar) [20:55:36] (03CR) 10Krinkle: "The diff isn't obviously safe. It does remove a bunch of potential job triggers for various gerrit repos on zuul pipelines 'test' and 'gat" [integration/config] - 10https://gerrit.wikimedia.org/r/497575 (owner: 10Jforrester) [20:55:46] (03PS3) 10Hashar: Emit a warning for EXT_DEPENDENCIES and SKIN_DEPENDENCIES [integration/quibble] - 10https://gerrit.wikimedia.org/r/501566 (https://phabricator.wikimedia.org/T220199) [20:58:28] 10Continuous-Integration-Infrastructure, 10Shinken, 10Patch-For-Review: Shinken keeps alerting about long gone instances - https://phabricator.wikimedia.org/T218146 (10Andrew) I was working on shinken just now, and it was broken/down for a couple of days due to adding a new project without a contact group.... [20:59:23] (03CR) 10Hashar: [C: 03+2] "recheck" [integration/quibble] - 10https://gerrit.wikimedia.org/r/501566 (https://phabricator.wikimedia.org/T220199) (owner: 10Hashar) [21:00:02] (03Merged) 10jenkins-bot: Emit a warning for EXT_DEPENDENCIES and SKIN_DEPENDENCIES [integration/quibble] - 10https://gerrit.wikimedia.org/r/501566 (https://phabricator.wikimedia.org/T220199) (owner: 10Hashar) [21:00:46] (03CR) 10jenkins-bot: Emit a warning for EXT_DEPENDENCIES and SKIN_DEPENDENCIES [integration/quibble] - 10https://gerrit.wikimedia.org/r/501566 (https://phabricator.wikimedia.org/T220199) (owner: 10Hashar) [21:12:22] PROBLEM - Free space - all mounts on integration-slave-docker-1034 is CRITICAL: CRITICAL: integration.integration-slave-docker-1034.diskspace._srv.byte_percentfree (<11.11%) [21:22:23] RECOVERY - Free space - all mounts on integration-slave-docker-1034 is OK: OK: All targets OK [21:55:49] 10Release-Engineering-Team, 10Developer Productivity, 10Epic: Improve Developer Tooling - https://phabricator.wikimedia.org/T212449 (10jeena) [21:55:55] 10Release-Engineering-Team (Kanban), 10Developer Productivity, 10Patch-For-Review, 10User-zeljkofilipin: Add MacOS installation Documentation and Install Script for local-charts repo - https://phabricator.wikimedia.org/T219437 (10jeena) 05Open→03Resolved Merged the dependency install script and per dis... [21:56:59] 10Release-Engineering-Team (Backlog), 10Developer Productivity: Add Windows installation Documentation and Install Script for local-charts repo - https://phabricator.wikimedia.org/T219438 (10jeena) [22:02:23] (03PS1) 10Hashar: Context manager to time stuff [integration/quibble] - 10https://gerrit.wikimedia.org/r/503125 [22:02:24] (03PS1) 10Jforrester: makedeploynotes.py: Use authors, not committers [tools/release] - 10https://gerrit.wikimedia.org/r/503126 [22:02:24] (03CR) 10jerkins-bot: [V: 04-1] makedeploynotes.py: Use authors, not committers [tools/release] - 10https://gerrit.wikimedia.org/r/503126 (owner: 10Jforrester) [22:02:24] (03PS2) 10Jforrester: makedeploynotes.py: Use authors, not committers [tools/release] - 10https://gerrit.wikimedia.org/r/503126 [22:02:24] (03CR) 10Hashar: "Mukunda, I think we talked about measuring the time it takes for each of Quibble stages. So here is a very basic context manager." [integration/quibble] - 10https://gerrit.wikimedia.org/r/503125 (owner: 10Hashar) [22:07:34] 10Release-Engineering-Team, 10Developer Productivity: Improve documentation for running local-charts and building docker images using the temporary Dockerfiles - https://phabricator.wikimedia.org/T220771 (10jeena) p:05Triage→03Normal [22:15:16] (03CR) 10Ejegg: "Thanks Umherirrender, I think this change should fix the version conflict: I624725cf48fe0721c67d53069a2722845fd676c1" [integration/config] - 10https://gerrit.wikimedia.org/r/499334 (owner: 10Ejegg) [22:17:41] 10Release-Engineering-Team, 10Developer Productivity: Improve documentation for running local-charts and building docker images using the temporary Dockerfiles - https://phabricator.wikimedia.org/T220771 (10jeena) I am hesitant to create a separate section in the README for services used by Mediawiki core and... [22:23:45] (03CR) 10Hashar: "extension-gate has jobs such as:" [integration/config] - 10https://gerrit.wikimedia.org/r/497575 (owner: 10Jforrester) [22:58:38] 10Continuous-Integration-Infrastructure, 10Release-Engineering-Team (Kanban): Audit jenkins-bot@wikimedia.org usage and migrate to a better system - https://phabricator.wikimedia.org/T220664 (10bcampbell) @Dzahn I created jenkins-bot@ as a Google Group and added @hashar as the sole owner and member (don't need... [23:01:57] 10Continuous-Integration-Infrastructure, 10Release-Engineering-Team (Kanban): Audit jenkins-bot@wikimedia.org usage and migrate to a better system - https://phabricator.wikimedia.org/T220664 (10Dzahn) oh cool, that was quick. thank you very much @bcampell @hashar i'll delete the current alias but wait until t... [23:02:28] 10Continuous-Integration-Infrastructure, 10Release-Engineering-Team (Kanban): Audit jenkins-bot@wikimedia.org usage and migrate to a better system - https://phabricator.wikimedia.org/T220664 (10Dzahn) p:05Triage→03Normal [23:07:22] 10Continuous-Integration-Config, 10Release-Engineering-Team, 10Wikimedia-Site-requests, 10serviceops: Consider creating a puppet-compiler equivalent for mediawiki-config.git - https://phabricator.wikimedia.org/T220775 (10Jdforrester-WMF)