[00:30:43] !log configuring integration-slave-docker-1034 jenkins node to use 6 executors [00:30:48] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [00:33:17] (03CR) 10Legoktm: "+1 to validating the changelog, especially for people who are creating them by hand instead of using dch." [integration/config] - 10https://gerrit.wikimedia.org/r/460883 (owner: 10Hashar) [00:33:30] 10Continuous-Integration-Infrastructure, 10Release-Engineering-Team (Kanban), 10Release Pipeline: Evaluate different strategy for Docker CI instances - https://phabricator.wikimedia.org/T202160 (10dduvall) I've reconfigured one of the `bigram` instances (`integration-slave-docker-1034`) to use 6 executors. G... [02:51:36] 10Beta-Cluster-Infrastructure, 10Parsoid, 10VisualEditor, 10Services (watching): Can't load VE on Beta cluster - https://phabricator.wikimedia.org/T204624 (10Ryasmeen) Thanks @Pchelolo for looking into this! [06:46:04] 10Continuous-Integration-Config, 10Gerrit, 10Cleanup, 10GitHub-Mirrors, and 7 others: Archive mediawiki/extensions/Collection and others - https://phabricator.wikimedia.org/T183891 (10Mholloway) 05declined>03Open The Reading Infrastructure team discussed this in a weekly meeting yesterday (after consul... [06:46:53] 10Continuous-Integration-Config, 10Gerrit, 10Cleanup, 10GitHub-Mirrors, and 7 others: Archive mediawiki/extensions/Collection/OfflineContentGenerator and all OCG-related repos - https://phabricator.wikimedia.org/T183891 (10Mholloway) [06:47:55] 10Continuous-Integration-Config, 10Gerrit, 10Cleanup, 10GitHub-Mirrors, and 7 others: Archive mediawiki/extensions/Collection/OfflineContentGenerator and all OCG-related repos - https://phabricator.wikimedia.org/T183891 (10Mholloway) [06:48:12] 10Continuous-Integration-Config, 10Gerrit, 10Cleanup, 10GitHub-Mirrors, and 7 others: Archive mediawiki/extensions/Collection/OfflineContentGenerator and all OCG-related repos - https://phabricator.wikimedia.org/T183891 (10Mholloway) [07:27:36] 10Continuous-Integration-Config, 10Gerrit, 10Cleanup, 10GitHub-Mirrors, and 7 others: Archive mediawiki/extensions/Collection/OfflineContentGenerator and all OCG-related repos - https://phabricator.wikimedia.org/T183891 (10hashar) [07:29:27] 10Continuous-Integration-Config, 10Gerrit, 10Cleanup, 10GitHub-Mirrors, and 7 others: Archive mediawiki/extensions/Collection/OfflineContentGenerator and all OCG-related repos - https://phabricator.wikimedia.org/T183891 (10hashar) [07:31:45] !log cleaning disk on deployment-sca01 [07:31:49] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [07:34:50] !log deployment-sca01: rm -fR /srv/ores /srv/deployment/cxserver.jenkins # untouched since 2016 [07:34:54] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [07:42:15] (03CR) 10Hashar: [C: 032] "I have 2+ed it on A Saturday and most definitely forgot to reload. Sorry :\" [integration/config] - 10https://gerrit.wikimedia.org/r/460578 (https://phabricator.wikimedia.org/T204372) (owner: 10MarcoAurelio) [07:43:00] (03CR) 10Zfilipin: [C: 032] Fix URL to selenium credential store [integration/config] - 10https://gerrit.wikimedia.org/r/460935 (https://phabricator.wikimedia.org/T204571) (owner: 10Reedy) [07:45:13] (03Merged) 10jenkins-bot: Fix URL to selenium credential store [integration/config] - 10https://gerrit.wikimedia.org/r/460935 (https://phabricator.wikimedia.org/T204571) (owner: 10Reedy) [07:46:29] (03PS2) 10Hashar: mwselenium job to Quibble 0.0.25 and drop Firefox [integration/config] - 10https://gerrit.wikimedia.org/r/460514 (https://phabricator.wikimedia.org/T204214) [07:48:01] !log Updating jenkins jobs to use Quibble 0.0.25 [07:48:05] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [07:48:17] oh my god [07:48:22] AttributeError: 'QuibbleCmd' object has no attribute 'db_dir' [07:48:23] ;D [07:52:05] (03PS1) 10Hashar: QuibbleCmd lacked db_dir attribute [integration/quibble] - 10https://gerrit.wikimedia.org/r/461043 [07:53:36] (03CR) 10jenkins-bot: QuibbleCmd lacked db_dir attribute [integration/quibble] - 10https://gerrit.wikimedia.org/r/461043 (owner: 10Hashar) [07:56:50] (03PS3) 10Hashar: mwselenium job to Quibble 0.0.26 and drop Firefox [integration/config] - 10https://gerrit.wikimedia.org/r/460514 (https://phabricator.wikimedia.org/T204214) [07:56:52] (03PS1) 10Hashar: quibble: 0.0.26 [integration/config] - 10https://gerrit.wikimedia.org/r/461082 [07:57:01] (03CR) 10Hashar: [C: 032] quibble: 0.0.26 [integration/config] - 10https://gerrit.wikimedia.org/r/461082 (owner: 10Hashar) [07:58:47] (03Merged) 10jenkins-bot: quibble: 0.0.26 [integration/config] - 10https://gerrit.wikimedia.org/r/461082 (owner: 10Hashar) [08:07:57] 10Continuous-Integration-Config, 10Patch-For-Review: https://integration.wikimedia.org/ci/credential-store/domain/selenium/ is 404 - https://phabricator.wikimedia.org/T204571 (10hashar) 05Open>03Resolved a:03Reedy [08:32:58] (03PS1) 10Hashar: docker: use python-debian to test changelog files [integration/config] - 10https://gerrit.wikimedia.org/r/461090 [08:33:25] (03CR) 10Hashar: Basic tests for dockerfiles (031 comment) [integration/config] - 10https://gerrit.wikimedia.org/r/460883 (owner: 10Hashar) [08:40:14] (03PS2) 10Hashar: docker: use python-debian to test changelog files [integration/config] - 10https://gerrit.wikimedia.org/r/461090 [08:41:07] (03CR) 10Hashar: "PS2:" [integration/config] - 10https://gerrit.wikimedia.org/r/461090 (owner: 10Hashar) [08:50:07] 10Phabricator, 10Project-Admins: WMEE to pilot using Estonian in chapter project management - https://phabricator.wikimedia.org/T203409 (10Aklapper) >>! In T203409#4587837, @reosarevok wrote: > Any chance I could also get subproject creation rights? It seems @tramm can't just give them to me himself :) (I'm al... [09:37:40] PROBLEM - Puppet errors on deployment-aqs01 is CRITICAL: CRITICAL: 20.00% of data above the critical threshold [0.0] [09:40:28] 10Release-Engineering-Team (Kanban), 10Release, 10Train Deployments: 1.32.0-wmf.22 deployment blockers - https://phabricator.wikimedia.org/T191068 (10Ciencia_Al_Poder) [09:40:59] (03PS1) 10Hashar: docker: test dependencies exist [integration/config] - 10https://gerrit.wikimedia.org/r/461095 [09:41:31] (03CR) 10Hashar: "> Also would be nice to validate control files, especially the "Depends" field." [integration/config] - 10https://gerrit.wikimedia.org/r/460883 (owner: 10Hashar) [09:46:19] !log updating mwselenium-quibble-docker to Quibble 0.0.26 [09:46:22] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [09:46:32] (03CR) 10Hashar: [C: 032] mwselenium job to Quibble 0.0.26 and drop Firefox [integration/config] - 10https://gerrit.wikimedia.org/r/460514 (https://phabricator.wikimedia.org/T204214) (owner: 10Hashar) [09:48:26] (03Merged) 10jenkins-bot: mwselenium job to Quibble 0.0.26 and drop Firefox [integration/config] - 10https://gerrit.wikimedia.org/r/460514 (https://phabricator.wikimedia.org/T204214) (owner: 10Hashar) [10:04:37] (03PS1) 10Hashar: Bump Jenkins jobs to Quibble 0.0.26 images [integration/config] - 10https://gerrit.wikimedia.org/r/461099 [10:04:49] !log Updating Quibble Jenkins jobs to 0.0.26 [10:04:53] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [10:05:12] (03CR) 10Hashar: [C: 032] Bump Jenkins jobs to Quibble 0.0.26 images [integration/config] - 10https://gerrit.wikimedia.org/r/461099 (owner: 10Hashar) [10:07:08] (03Merged) 10jenkins-bot: Bump Jenkins jobs to Quibble 0.0.26 images [integration/config] - 10https://gerrit.wikimedia.org/r/461099 (owner: 10Hashar) [10:17:41] RECOVERY - Puppet errors on deployment-aqs01 is OK: OK: Less than 1.00% above the threshold [0.0] [10:27:34] (03PS1) 10Hashar: Quibble default log dir to /workspace/log [integration/config] - 10https://gerrit.wikimedia.org/r/461103 [10:28:16] (03CR) 10Hashar: [C: 032] Quibble default log dir to /workspace/log [integration/config] - 10https://gerrit.wikimedia.org/r/461103 (owner: 10Hashar) [10:29:17] 10Beta-Cluster-Infrastructure, 10Parsoid, 10VisualEditor, 10Services (watching): Parsoid is misbehaving in Beta cluster - https://phabricator.wikimedia.org/T204624 (10Krenair) [10:30:12] (03Merged) 10jenkins-bot: Quibble default log dir to /workspace/log [integration/config] - 10https://gerrit.wikimedia.org/r/461103 (owner: 10Hashar) [10:48:04] 10Project-Admins: New Extension: ChangeUserPasswords - https://phabricator.wikimedia.org/T202275 (10Mz83ude) Thank you for pointing out the mistake. It seems the commit was successful but the push was not. I do not have rights to push. {F26007938} )See error screenshot). [11:19:37] 10Continuous-Integration-Infrastructure (shipyard), 10Release-Engineering-Team, 10Quibble, 10Patch-For-Review, 10Regression: Quibble MariaDB should use a tmpfs as a datadir - https://phabricator.wikimedia.org/T203181 (10hashar) CI now runs out of Quibble 0.0.26 which has `--db-dir` [11:20:57] (03Abandoned) 10Hashar: Have all docker jobs use tmpfs for /tmp [integration/config] - 10https://gerrit.wikimedia.org/r/457070 (https://phabricator.wikimedia.org/T203181) (owner: 10Legoktm) [11:32:38] 10Project-Admins: New Extension: ChangeUserPasswords - https://phabricator.wikimedia.org/T202275 (10Aklapper) https://gerrit.wikimedia.org/r/#/admin/groups/1509,members states that you are a repository members. The default setup is that you can propose changes in Gerrit so they have to [[ https://www.mediawiki.o... [11:35:21] 10Release-Engineering-Team (Watching / External), 10Operations, 10SRE-Access-Requests: Add contint-roots to releases{1,2}001 - https://phabricator.wikimedia.org/T201470 (10mark) Although we didn't manage to discuss this in our SRE meeting yesterday I discussed it with relevant people afterwards. There are n... [11:35:33] 10Release-Engineering-Team (Watching / External), 10Operations, 10SRE-Access-Requests: Add contint-roots to releases{1,2}001 - https://phabricator.wikimedia.org/T201470 (10mark) a:05mark>03RobH [11:53:28] (03PS1) 10Hashar: Use a 256MB tmpfs for Quibble database directory [integration/config] - 10https://gerrit.wikimedia.org/r/461108 (https://phabricator.wikimedia.org/T203181) [11:56:34] (03CR) 10Hashar: "Replaced by https://gerrit.wikimedia.org/r/#/c/integration/config/+/461108/" [integration/config] - 10https://gerrit.wikimedia.org/r/457070 (https://phabricator.wikimedia.org/T203181) (owner: 10Legoktm) [11:58:19] 10Continuous-Integration-Config, 10MediaWiki-Release-Tools, 10MediaWiki-extensions-CentralNotice, 10MediaWiki-extensions-Validator, and 2 others: [Task] make core wmf branches only use submodule branches that run with it in CI - https://phabricator.wikimedia.org/T113731 (10Addshore) @hashar any idea what t... [11:59:39] (03CR) 10Hashar: [C: 032] "Updated all 90 jobs." [integration/config] - 10https://gerrit.wikimedia.org/r/461108 (https://phabricator.wikimedia.org/T203181) (owner: 10Hashar) [12:00:13] 10Continuous-Integration-Infrastructure (shipyard), 10Release-Engineering-Team, 10Quibble, 10Patch-For-Review, 10Regression: Quibble MariaDB should use a tmpfs as a datadir - https://phabricator.wikimedia.org/T203181 (10hashar) 05Open>03Resolved a:03hashar Should be good now, using a 256MB tmpfs. [12:02:09] (03Merged) 10jenkins-bot: Use a 256MB tmpfs for Quibble database directory [integration/config] - 10https://gerrit.wikimedia.org/r/461108 (https://phabricator.wikimedia.org/T203181) (owner: 10Hashar) [12:26:15] 10Gerrit, 10Phabricator, 10Release-Engineering-Team (Someday): Stop using Differential for code review - https://phabricator.wikimedia.org/T191182 (10Aklapper) [12:31:13] 10Continuous-Integration-Infrastructure, 10Wikidata, 10Wikidata Query UI, 10Jenkins, 10Patch-For-Review: wikidata/query/gui CI job lacks PhantomJS / proper browsers - https://phabricator.wikimedia.org/T183831 (10Addshore) @hashar @Jonas is this all resolved? [12:44:54] 10Release-Engineering-Team (Kanban), 10MediaWiki-Core-Tests, 10Browser-Tests: Browser Test Failures with Password Blacklist patches - https://phabricator.wikimedia.org/T204569 (10zeljkofilipin) [12:45:10] 10Release-Engineering-Team (Kanban), 10MediaWiki-Core-Tests, 10Browser-Tests, 10User-zeljkofilipin: Browser Test Failures with Password Blacklist patches - https://phabricator.wikimedia.org/T204569 (10zeljkofilipin) [12:47:38] 10Project-Admins: New Extension: ChangeUserPasswords - https://phabricator.wikimedia.org/T202275 (10Mz83ude) Thank you. The code is now pushed. [12:54:42] 10Release-Engineering-Team (Kanban), 10MediaWiki-Core-Tests, 10Browser-Tests, 10User-zeljkofilipin: Browser Test Failures with Password Blacklist patches - https://phabricator.wikimedia.org/T204569 (10zeljkofilipin) >>! In T204569#4590313, @Reedy wrote: > It looks like we need to change the passwords of `s... [12:54:52] 10Release-Engineering-Team (Kanban), 10MediaWiki-Core-Tests, 10Browser-Tests, 10User-zeljkofilipin: Browser Test Failures with Password Blacklist patches - https://phabricator.wikimedia.org/T204569 (10zeljkofilipin) p:05Triage>03Low [12:55:10] 10Project-Admins: New Extension: ChangeUserPasswords - https://phabricator.wikimedia.org/T202275 (10MGChecker) > I wonder if that should be documented on https://www.mediawiki.org/wiki/Gerrit/Troubleshooting - edits welcome. I think it shouldn't, as it is really bad practice. The only one who should push commit... [12:56:17] 10Release-Engineering-Team (Kanban), 10MediaWiki-Core-Tests, 10Browser-Tests, 10User-zeljkofilipin: Browser Test Failures with Password Blacklist patches - https://phabricator.wikimedia.org/T204569 (10zeljkofilipin) I'm looking where the password for Quibble jobs is stored. Maybe @hashar would know. [13:01:30] 10Release-Engineering-Team (Kanban), 10MediaWiki-Core-Tests, 10Browser-Tests, 10User-zeljkofilipin: Browser Test Failures with Password Blacklist patches - https://phabricator.wikimedia.org/T204569 (10zeljkofilipin) I think this is the last time we had a similar problem: {T188520}. [13:20:46] 10Release-Engineering-Team (Kanban), 10Release, 10Train Deployments: 1.32.0-wmf.22 deployment blockers - https://phabricator.wikimedia.org/T191068 (10hashar) Checked {T204669} with DBA / Brad Jorsch, that is an ongoing experimentation on group0 done via a config change: https://gerrit.wikimedia.org/r/c/opera... [13:29:17] (03CR) 10Hashar: make-wmf-branch: Add fixcopyright.wm.o extensions and skin (031 comment) [tools/release] - 10https://gerrit.wikimedia.org/r/456779 (https://phabricator.wikimedia.org/T203296) (owner: 10Legoktm) [13:29:37] (03PS1) 10Hashar: make-wmf-branch: fix typo in EUCopyrightCampaign [tools/release] - 10https://gerrit.wikimedia.org/r/461127 (https://phabricator.wikimedia.org/T203296) [13:29:46] (03CR) 10Hashar: [C: 032] make-wmf-branch: fix typo in EUCopyrightCampaign [tools/release] - 10https://gerrit.wikimedia.org/r/461127 (https://phabricator.wikimedia.org/T203296) (owner: 10Hashar) [13:30:26] (03Merged) 10jenkins-bot: make-wmf-branch: fix typo in EUCopyrightCampaign [tools/release] - 10https://gerrit.wikimedia.org/r/461127 (https://phabricator.wikimedia.org/T203296) (owner: 10Hashar) [13:47:45] (03PS1) 10Hashar: make-wmf-branch: basic test for config.json [tools/release] - 10https://gerrit.wikimedia.org/r/461130 [13:50:11] 10Deployments, 10Release-Engineering-Team (Kanban): make-wmf-branch: no permission on lib/ve VisualEditor submodule - https://phabricator.wikimedia.org/T204710 (10hashar) [14:05:52] 10Deployments, 10Release-Engineering-Team (Kanban): make-wmf-branch: no permission on lib/ve VisualEditor submodule - https://phabricator.wikimedia.org/T204710 (10hashar) All remotes use https but for lib/ve I have ssh as a push url: ``` hashar@deploy1001:/tmp/make-wmf-branch/VisualEditor/lib/ve$ git remote -v... [14:07:22] 10Deployments, 10Release-Engineering-Team (Kanban), 10Patch-For-Review: make-wmf-branch: no permission on lib/ve VisualEditor submodule - https://phabricator.wikimedia.org/T204710 (10hashar) a:03hashar [14:24:14] 10Release-Engineering-Team (Kanban), 10MediaWiki-Core-Tests, 10Browser-Tests, 10User-zeljkofilipin: Browser Test Failures with Password Blacklist patches - https://phabricator.wikimedia.org/T204569 (10zeljkofilipin) The last time password was updated in [[ https://gerrit.wikimedia.org/r/c/integration/jenki... [14:24:54] 10Deployments, 10Release-Engineering-Team (Kanban), 10Patch-For-Review: make-wmf-branch: no permission on lib/ve VisualEditor submodule - https://phabricator.wikimedia.org/T204710 (10hashar) 05Open>03Resolved [14:27:34] 10Phabricator, 10Wikidata: Wikidata board on phabricator returns UNRECOVERABLE FATAL ERROR - https://phabricator.wikimedia.org/T204721 (10Addshore) [14:27:46] we broke phab [14:27:48] ^^ :D [14:28:24] 10Phabricator, 10Wikidata: Wikidata board on phabricator returns UNRECOVERABLE FATAL ERROR - https://phabricator.wikimedia.org/T204721 (10Addshore) [14:29:00] 10Phabricator, 10Wikidata: Wikidata board on phabricator returns UNRECOVERABLE FATAL ERROR when viewing all tasks (including closed ones) - https://phabricator.wikimedia.org/T204721 (10Lucas_Werkmeister_WMDE) [14:29:53] 10Release-Engineering-Team (Kanban), 10MediaWiki-Core-Tests, 10Browser-Tests, 10Patch-For-Review, 10User-zeljkofilipin: Browser Test Failures with Password Blacklist patches - https://phabricator.wikimedia.org/T204569 (10zeljkofilipin) This is currently in [[ https://phabricator.wikimedia.org/diffusion/C... [14:31:19] 10Release-Engineering-Team (Kanban), 10MediaWiki-Core-Tests, 10Browser-Tests, 10Patch-For-Review, 10User-zeljkofilipin: Browser Test Failures with Password Blacklist patches - https://phabricator.wikimedia.org/T204569 (10zeljkofilipin) a:05zeljkofilipin>03Reedy Assigning to @Reedy since he already cr... [14:32:20] 10Release-Engineering-Team (Kanban), 10MediaWiki-Core-Tests, 10Browser-Tests, 10Patch-For-Review, 10User-zeljkofilipin: Browser Test Failures with Password Blacklist patches - https://phabricator.wikimedia.org/T204569 (10Reedy) My patch isn't going to fix it, just testing whether the blacklist is blackli... [14:36:30] 10Phabricator, 10Wikidata: Wikidata board on phabricator returns UNRECOVERABLE FATAL ERROR when viewing all tasks (including closed ones) - https://phabricator.wikimedia.org/T204721 (10Aklapper) Same for querying a list of all #Wikidata tasks at https://phabricator.wikimedia.org/maniphest/query/QbWgRtSw4dQk/#R... [14:43:26] PROBLEM - SSH on integration-slave-docker-1021 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [14:48:14] RECOVERY - SSH on integration-slave-docker-1021 is OK: SSH OK - OpenSSH_6.7p1 Debian-5+deb8u7 (protocol 2.0) [14:48:47] 10Project-Admins, 10User-Urbanecm: Create Map of monuments project - https://phabricator.wikimedia.org/T204725 (10Urbanecm) [15:12:01] 10Continuous-Integration-Config, 10MinervaNeue, 10Readers-Web-Backlog, 10phan-taint-check-plugin: Minerva taint error: Calling method \BaseTemplate::set() in \SkinMinerva::prepareHeaderAndFooter that outputs using tainted argument - https://phabricator.wikimedia.org/T204094 (10matmarex) It is happening inc... [15:18:55] twentyafterfour thcipriani fyi there was a fix merged into the lfs plugin for gerrit in the 2.15 branch. [15:19:13] https://gerrit-review.googlesource.com/c/plugins/lfs/+/195984 [15:22:59] 10Beta-Cluster-Infrastructure, 10Parsoid, 10VisualEditor, 10Services (watching): Parsoid is misbehaving in Beta cluster - https://phabricator.wikimedia.org/T204624 (10cscott) The last Parsoid deploy to beta was Wed or Thursday of last week. Assuming this problem started recently it's probably not a code o... [15:31:03] (03CR) 10Jforrester: [C: 032] make-wmf-branch: basic test for config.json [tools/release] - 10https://gerrit.wikimedia.org/r/461130 (owner: 10Hashar) [15:31:41] (03Merged) 10jenkins-bot: make-wmf-branch: basic test for config.json [tools/release] - 10https://gerrit.wikimedia.org/r/461130 (owner: 10Hashar) [15:32:32] 10Beta-Cluster-Infrastructure, 10Parsoid, 10VisualEditor, 10Services (watching): Parsoid is misbehaving in Beta cluster - https://phabricator.wikimedia.org/T204624 (10Arlolra) Probably the same thing that caused T198421 cropping up again [15:40:11] 10Beta-Cluster-Infrastructure, 10Maps (Kartographer): [beta cluster] Uncaught TypeError: Cannot read property 'lat' of null - when 'Edit layer' option is used. - https://phabricator.wikimedia.org/T194440 (10Mholloway) [15:48:04] hashar: huh, nice catch. it was pure luck that there was no train last week so we didn't notice earlier... [15:48:27] 10Continuous-Integration-Config, 10MinervaNeue, 10Readers-Web-Backlog, 10phan-taint-check-plugin: Minerva taint error: Calling method \BaseTemplate::set() in \SkinMinerva::prepareHeaderAndFooter that outputs using tainted argument - https://phabricator.wikimedia.org/T204094 (10matmarex) It seems that the b... [15:55:21] hi, does anyone know where the "collabpad" tab is coming form on the beta cluster? https://meta.wikimedia.beta.wmflabs.org/wiki/Special:SpecialPages [15:55:35] 10Release-Engineering-Team (Watching / External), 10Operations, 10SRE-Access-Requests, 10Patch-For-Review: Add contint-roots to releases{1,2}001 - https://phabricator.wikimedia.org/T201470 (10RobH) 05stalled>03Resolved a:05RobH>03None Ok, with @mark's approval I've gone ahead and merged a patchset... [15:55:38] It's also rogue here: https://meta.wikimedia.beta.wmflabs.org/wiki/Special:CentralNotice [16:00:22] 10Release-Engineering-Team (Kanban), 10Release, 10Train Deployments: 1.32.0-wmf.22 deployment blockers - https://phabricator.wikimedia.org/T191068 (10hashar) Release notes pasted at https://www.mediawiki.org/wiki/MediaWiki_1.32/wmf.22/Changelog I will deploy to group0 later today, after 19:00UTC. [16:24:23] PROBLEM - SSH on integration-slave-docker-1021 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [16:29:14] RECOVERY - SSH on integration-slave-docker-1021 is OK: SSH OK - OpenSSH_6.7p1 Debian-5+deb8u7 (protocol 2.0) [17:26:24] 10Project-Admins: New Extension: ChangeUserPasswords - https://phabricator.wikimedia.org/T202275 (10Reedy) Hello @Mz83ude it looks like you've done this wrong... You have pushed a copy of mediawiki core, bundled extensions and your own extension as can be seen at https://github.com/wikimedia/mediawiki-extension... [17:27:36] 10Project-Admins: New Extension: ChangeUserPasswords - https://phabricator.wikimedia.org/T202275 (10Krinkle) >>! In T202275#4593502, @Mz83ude wrote: > Thank you. The code is now pushed. I seems the entire MediaWiki website including a copy of MediaWiki core and extension was pushed. I assume this was unintenti... [17:38:37] 10Beta-Cluster-Infrastructure: Generate beta captchas - https://phabricator.wikimedia.org/T204611 (10MarcoAurelio) Okay so I have a random list of 3251 words. Shall I upload a patch with them? [17:38:58] 10Release-Engineering-Team (Kanban), 10MediaWiki-Core-Tests, 10Browser-Tests, 10Patch-For-Review, 10User-zeljkofilipin: Browser Test Failures with Password Blacklist patches - https://phabricator.wikimedia.org/T204569 (10Reedy) So... `Error: Unrecognised hook ["after each" hook for "should be deletable"]... [17:42:08] 10Beta-Cluster-Infrastructure, 10Parsoid, 10VisualEditor, 10Services (watching): Parsoid is misbehaving in Beta cluster - https://phabricator.wikimedia.org/T204624 (10Arlolra) > The last Parsoid deploy to beta was Wed or Thursday of last week. According to the logs, it was on Wednesday. > After restartin... [17:46:28] 10Continuous-Integration-Config, 10Gerrit, 10Cleanup, 10GitHub-Mirrors, and 7 others: Archive mediawiki/extensions/Collection/OfflineContentGenerator and all OCG-related repos - https://phabricator.wikimedia.org/T183891 (10MarcoAurelio) [17:59:40] 10Phabricator, 10Release-Engineering-Team (Kanban), 10Security-Team, 10User-MModell: Should security tasks be a custom type in maniphest? - https://phabricator.wikimedia.org/T204160 (10mmodell) The SECURITY ISSUE task type can be created by using [[ /maniphest/task/edit/form/48/ | Form 48 ]] [18:01:28] PROBLEM - SSH on integration-slave-docker-1021 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:06:15] RECOVERY - SSH on integration-slave-docker-1021 is OK: SSH OK - OpenSSH_6.7p1 Debian-5+deb8u7 (protocol 2.0) [18:13:07] (03PS1) 10Thcipriani: Wrap maintenance with timeout [integration/config] - 10https://gerrit.wikimedia.org/r/461174 (https://phabricator.wikimedia.org/T204077) [18:16:41] 10Phabricator, 10Wikidata: Wikidata board on phabricator returns UNRECOVERABLE FATAL ERROR when viewing all tasks (including closed ones) - https://phabricator.wikimedia.org/T204721 (10mmodell) I don't think there is any way to solve this. There are just too many tasks to render within a reasonable time limit. [18:18:10] 10Phabricator, 10Wikidata: Wikidata board on phabricator returns UNRECOVERABLE FATAL ERROR when viewing all tasks (including closed ones) - https://phabricator.wikimedia.org/T204721 (10Paladox) I belive we should increase the php timeout to 30secs. (that should at least fix it) but will break in the future again. [18:19:17] 10Phabricator, 10Wikidata: Wikidata board on phabricator returns UNRECOVERABLE FATAL ERROR when viewing all tasks (including closed ones) - https://phabricator.wikimedia.org/T204721 (10Aklapper) Also see Chad's comment from 2017-02-06 on https://gerrit.wikimedia.org/r/#/c/335714/ again... [18:47:16] 10Release-Engineering-Team (Kanban), 10MediaWiki-Core-Tests, 10Browser-Tests, 10Patch-For-Review, 10User-zeljkofilipin: Browser Test Failures with Password Blacklist patches - https://phabricator.wikimedia.org/T204569 (10Reedy) Ok... So https://gerrit.wikimedia.org/r/#/c/mediawiki/libs/PasswordBlacklist... [18:47:36] 10Release-Engineering-Team (Kanban), 10MediaWiki-Core-Tests, 10Browser-Tests, 10Patch-For-Review, 10User-zeljkofilipin: Browser Test Failures with Password Blacklist patches - https://phabricator.wikimedia.org/T204569 (10Reedy) a:05Reedy>03None [19:07:58] 10Release-Engineering-Team (Kanban), 10MediaWiki-Core-Tests, 10Browser-Tests, 10Patch-For-Review, 10User-zeljkofilipin: Browser Test Failures with Password Blacklist patches - https://phabricator.wikimedia.org/T204569 (10Reedy) I just found this in CirrusSearch. Certainly looks supicious - https://gerrit... [19:17:38] 10Release-Engineering-Team (Kanban), 10MediaWiki-Core-Tests, 10Browser-Tests, 10Patch-For-Review, 10User-zeljkofilipin: Browser Test Failures with Password Blacklist patches - https://phabricator.wikimedia.org/T204569 (10hashar) ``` wmf-quibble-core-vendor-mysql-hhvm-docker FAILURE in 13m 07s mediawiki-q... [19:26:45] (03PS1) 10Reedy: Use stronger password in quibble related browser tests [integration/quibble] - 10https://gerrit.wikimedia.org/r/461195 [19:27:19] 10Release-Engineering-Team (Kanban), 10Release, 10Train Deployments: /srv/mediawiki/php-1.32.0-wmf.22/includes/deferred/LinksUpdate.php:140 PHP Notice: Undefined index: 1 - https://phabricator.wikimedia.org/T204756 (10hashar) [19:27:47] (03PS2) 10Reedy: Use stronger password in quibble related browser tests [integration/quibble] - 10https://gerrit.wikimedia.org/r/461195 (https://phabricator.wikimedia.org/T204569) [19:29:30] 10Release-Engineering-Team (Kanban), 10MediaWiki-Core-Tests, 10Browser-Tests, 10Patch-For-Review, 10User-zeljkofilipin: Browser Test Failures with Password Blacklist patches - https://phabricator.wikimedia.org/T204569 (10Reedy) Thanks @hashar! Patch above to update the passwords there... :) [19:30:11] 10Release-Engineering-Team (Kanban), 10Release, 10Train Deployments: /srv/mediawiki/php-1.32.0-wmf.22/includes/deferred/LinksUpdate.php:140 PHP Notice: Undefined index: 1 - https://phabricator.wikimedia.org/T204756 (10hashar) Comes from API queries, one of them had as referrer https://www.mediawiki.org/w/ind... [19:34:18] 10Release-Engineering-Team (Kanban), 10MediaWiki-extensions-OAuth, 10Release, 10Train Deployments: [OAuth] PHP Fatal Error: Call to undefined method MediaWiki\Extensions\OAuth\MWOAuthDAOAccessControl::getForHtml() - https://phabricator.wikimedia.org/T204757 (10hashar) [19:40:26] 10Release-Engineering-Team (Kanban), 10MediaWiki-extensions-OAuth, 10Patch-For-Review, 10Release, 10Train Deployments: [OAuth] PHP Fatal Error: Call to undefined method MediaWiki\Extensions\OAuth\MWOAuthDAOAccessControl::getForHtml() - https://phabricator.wikimedia.org/T204757 (10hashar) Comes from https... [19:44:23] 10Beta-Cluster-Infrastructure, 10Parsoid, 10VisualEditor, 10Services (done), 10User-Ryasmeen: Parsoid is misbehaving in Beta cluster - https://phabricator.wikimedia.org/T204624 (10Pchelolo) 05Open>03Resolved a:03Pchelolo VE works properly in Beta now. After decreasing change-prop concurrency level... [19:46:35] 10Release-Engineering-Team (Kanban), 10MediaWiki-extensions-OAuth, 10Patch-For-Review, 10Train Deployments, 10Wikimedia-production-error: [OAuth] PHP Fatal Error: Call to undefined method MediaWiki\Extensions\OAuth\MWOAuthDAOAccessControl::getForHtml() - https://phabricator.wikimedia.org/T204757 (10Krinkl... [19:47:08] 10Release-Engineering-Team (Kanban), 10MediaWiki-extensions-OAuth, 10Patch-For-Review, 10Train Deployments, 10Wikimedia-production-error: [OAuth] PHP Fatal Error: Call to undefined method MediaWiki\Extensions\OAuth\MWOAuthDAOAccessControl::getForHtml() - https://phabricator.wikimedia.org/T204757 (10Krinkl... [19:47:56] 10Release-Engineering-Team (Kanban), 10Release, 10Train Deployments: /srv/mediawiki/php-1.32.0-wmf.22/includes/deferred/LinksUpdate.php:140 PHP Notice: Undefined index: 1 - https://phabricator.wikimedia.org/T204756 (10Krinkle) [19:47:58] 10Release-Engineering-Team (Kanban), 10Release, 10Train Deployments: 1.32.0-wmf.22 deployment blockers - https://phabricator.wikimedia.org/T191068 (10Krinkle) [19:48:02] 10Release-Engineering-Team (Kanban), 10MediaWiki-extensions-OAuth, 10Patch-For-Review, 10Train Deployments, 10Wikimedia-production-error: [OAuth] PHP Fatal Error: Call to undefined method MediaWiki\Extensions\OAuth\MWOAuthDAOAccessControl::getForHtml() - https://phabricator.wikimedia.org/T204757 (10Krinkl... [19:50:53] 10Release-Engineering-Team (Kanban), 10Release, 10Train Deployments: 1.32.0-wmf.22 deployment blockers - https://phabricator.wikimedia.org/T191068 (10Krinkle) [19:52:09] 10Release-Engineering-Team (Kanban), 10Train Deployments, 10Wikimedia-production-error: /srv/mediawiki/php-1.32.0-wmf.22/includes/deferred/LinksUpdate.php:140 PHP Notice: Undefined index: 1 - https://phabricator.wikimedia.org/T204756 (10Krinkle) [19:58:52] Project beta-scap-eqiad build #222352: 15ABORTED in 5 min 3 sec: https://integration.wikimedia.org/ci/job/beta-scap-eqiad/222352/ [20:01:34] 00:00:08.393 19:39:20 Started cache_git_info [20:01:34] 00:12:20.924 19:51:33 Finished cache_git_info (duration: 12m 12s) [20:01:35] :( [20:02:41] 10Beta-Cluster-Infrastructure: On deployment-prep scap cache_git_info takes 12 minutes (that is too slow) - https://phabricator.wikimedia.org/T204762 (10hashar) [20:02:53] 10Beta-Cluster-Infrastructure, 10Release-Engineering-Team (Kanban), 10Scap: On deployment-prep scap cache_git_info takes 12 minutes (that is too slow) - https://phabricator.wikimedia.org/T204762 (10hashar) [20:05:27] 10Release-Engineering-Team (Kanban), 10MediaWiki-extensions-OAuth, 10MW-1.32-release-notes (WMF-deploy-2018-09-18 (1.32.0-wmf.22)), 10Patch-For-Review, and 2 others: [OAuth] PHP Fatal Error: Call to undefined method MediaWiki\Extensions\OAuth\MWOAuthDAOAccessContro... - https://phabricator.wikimedia.org/T204757 [20:06:00] 10Release-Engineering-Team (Kanban), 10Release, 10Train Deployments: 1.32.0-wmf.22 deployment blockers - https://phabricator.wikimedia.org/T191068 (10hashar) [20:06:05] 10Release-Engineering-Team (Kanban), 10MediaWiki-extensions-OAuth, 10MW-1.32-release-notes (WMF-deploy-2018-09-18 (1.32.0-wmf.22)), 10Patch-For-Review, and 2 others: [OAuth] PHP Fatal Error: Call to undefined method MediaWiki\Extensions\OAuth\MWOAuthDAOAccessContro... - https://phabricator.wikimedia.org/T204757 [20:08:51] [pid 20176] close(7486) = -1 EBADF (Bad file descriptor) [20:08:52] [pid 20176] close(7487) = -1 EBADF (Bad file descriptor) [20:08:52] [etc [20:08:54] that sounds bad :) [20:17:02] oh my god [20:17:08] I have see scap/sh.py [20:17:44] 10Release-Engineering-Team (Kanban), 10Release, 10Train Deployments: 1.32.0-wmf.22 deployment blockers - https://phabricator.wikimedia.org/T191068 (10Catrope) [20:19:04] 10Release-Engineering-Team (Kanban), 10Release, 10Train Deployments: 1.32.0-wmf.22 deployment blockers - https://phabricator.wikimedia.org/T191068 (10hashar) Pushed to group0 around 19:00 UTC [20:23:34] 10Beta-Cluster-Infrastructure, 10Release-Engineering-Team (Kanban), 10Scap: On deployment-prep scap cache_git_info takes 12 minutes (that is too slow) - https://phabricator.wikimedia.org/T204762 (10thcipriani) Takes a while on beta because of all the extensions (plus disks are slower than in production where... [20:40:28] hashar: how to add an extension to https://doc.wikimedia.org/cover-extensions/ ? [20:41:14] 10Release-Engineering-Team (Kanban), 10Release, 10Train Deployments: 1.32.0-wmf.22 deployment blockers - https://phabricator.wikimedia.org/T191068 (10hashar) There are a few issues related to the newish actor table: The current blockers related to actor: * {T204669} * {T204764} * {T204767} The feature is t... [20:41:23] 10Release-Engineering-Team (Kanban), 10Release, 10Train Deployments: 1.32.0-wmf.22 deployment blockers - https://phabricator.wikimedia.org/T191068 (10hashar) [20:58:00] 10Continuous-Integration-Config, 10MinervaNeue, 10Readers-Web-Backlog, 10phan-taint-check-plugin: Minerva taint error: Calling method \BaseTemplate::set() in \SkinMinerva::prepareHeaderAndFooter that outputs using tainted argument - https://phabricator.wikimedia.org/T204094 (10Legoktm) I'm unable to reprod... [20:59:29] Hauskatze: add the extension-coverage zuul template in layout.yaml [21:00:26] legoktm: ack, but ain't coverage tests already run for all extensions? [21:01:43] Hauskatze: no, I only added it to extensions that seemed to have PHPUnit tests [21:02:20] aha, ok [21:02:45] wanted to see if WikimediaMessages was covered enough but couldn't find it there ;) [21:12:42] 10Gerrit, 10Patch-For-Review: Place holder task for Gerrit 2.16 upgrade - https://phabricator.wikimedia.org/T200739 (10Paladox) There's a gerrit user event (and a hackathon before) in november 2018 where luca suggested we release 2.16. He said that 2.16 should be branched now so it's polished and made stable.... [21:15:05] 10Phabricator, 10Cleanup: Form 33 amendment request - https://phabricator.wikimedia.org/T204487 (10MarcoAurelio) [21:36:30] (03CR) 10Thcipriani: [C: 032] "Deployed." [integration/config] - 10https://gerrit.wikimedia.org/r/461174 (https://phabricator.wikimedia.org/T204077) (owner: 10Thcipriani) [21:38:56] (03Merged) 10jenkins-bot: Wrap maintenance with timeout [integration/config] - 10https://gerrit.wikimedia.org/r/461174 (https://phabricator.wikimedia.org/T204077) (owner: 10Thcipriani) [22:47:58] 10Release-Engineering-Team (Kanban), 10MediaWiki-Core-Tests, 10Browser-Tests, 10Patch-For-Review, and 2 others: Browser Test Failures with Password Blacklist patches - https://phabricator.wikimedia.org/T204569 (10Reedy) [22:53:17] I'm impressed that Phan figured out that an object I thought was an Article was really a WikiPage, despite very limited information https://integration.wikimedia.org/ci/job/mwext-php70-phan-docker/13515/console [22:53:51] It must have figured this out from the only method that writes to $this->articles having a WikiPage parameter type hint, because there's no doc comment for $this->articles itself [23:08:17] static analysis can be awesome [23:33:25] 10Project-Admins, 10User-Urbanecm: Create Map of monuments project - https://phabricator.wikimedia.org/T204725 (10MGChecker) 05Open>03Resolved a:03MGChecker Requested public project #Map-of-monuments has been created: https://phabricator.wikimedia.org/project/view/3607/ Please encourage interested peopl... [23:47:19] 10Continuous-Integration-Config, 10MinervaNeue, 10phan-taint-check-plugin, 10Readers-Web-Backlog (Readers-Web-Kanbanana-Board-2018-19-Q1): Minerva taint error: Calling method \BaseTemplate::set() in \SkinMinerva::prepareHeaderAndFooter that outputs using tainted ar... - https://phabricator.wikimedia.org/T204094