[07:31:31] (03PS1) 10Umherirrender: Revert "Drop Echo dependency for PageTriage, causes tests to fail" [integration/config] - 10https://gerrit.wikimedia.org/r/452617 (https://phabricator.wikimedia.org/T201812) [07:31:56] Krenair: elastic09 was a test node for stretch migration, I deleted it. And I have a log of doing "puppet node clean" on it. [07:32:10] * gehel wonders why it is still here [07:33:52] (03PS1) 10Umherirrender: Add seccheck for ArticlePlaceholder [integration/config] - 10https://gerrit.wikimedia.org/r/452618 [07:34:51] (03PS1) 10Umherirrender: Add seccheck for SubPageList3 [integration/config] - 10https://gerrit.wikimedia.org/r/452619 [08:26:57] (03PS1) 10Ema: operations-puppet: install Busted for lua unit testing [integration/config] - 10https://gerrit.wikimedia.org/r/452634 (https://phabricator.wikimedia.org/T199720) [11:17:44] (03CR) 10Pablo Grass (WMDE): [C: 031] Add a link to the main documentation [integration/quibble] - 10https://gerrit.wikimedia.org/r/451599 (owner: 10Jakob) [11:21:13] (03CR) 10Pablo Grass (WMDE): Update Quibble Docker README log directory (031 comment) [integration/quibble] - 10https://gerrit.wikimedia.org/r/451294 (owner: 10Tarrow) [13:07:06] I'm getting a weird error in Gerrit. The title is "Code Review - Error" and the message is "Plugin "zuul" failed to load". [13:08:30] ah seems to be T195176 [13:08:31] T195176: Gerrit plugin "zuul" failed to load - https://phabricator.wikimedia.org/T195176 [13:09:12] 10Gerrit, 10Release-Engineering-Team: Gerrit plugin "zuul" failed to load - https://phabricator.wikimedia.org/T195176 (10Niedzielski) This seems to be occurring for me. For example: https://gerrit.wikimedia.org/r/#/c/mediawiki/extensions/MobileFrontend/+/452413/. [13:32:17] 10Phabricator, 10Release-Engineering-Team (Kanban): Unable to log in to Phabricator via MediaWiki on mobile (CSP error) - https://phabricator.wikimedia.org/T201460 (10Krinkle) 05Resolved>03Open [13:47:46] Hey, I can't seem to create a new web proxy on horizon. I just get shown the "Working" spinner for about a minute, then an error message: "Danger: There was an error submitting the form. Please try again." [13:49:07] edsanders i think you want #wikimedia-cloud [13:49:09] for horizion [13:49:25] though try clearing cache / cookies, there was some maint yesturday on horizion [13:53:52] edsanders: i didn't see any of my proxies and had to reset my "active project" in horizon. when i did and went to the proxies tab, I got "Something went wrong! [13:53:53] An unexpected error has occurred. Try refreshing the page. If that doesn't help, contact your local administrator." [13:54:20] so maybe not just you? [13:55:02] I can see the existing proxies [14:33:40] !log deployment-maps04 tilerator/deploy@31e8585 Update node mapnik to 3.7.2 [14:33:44] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [14:33:45] !log deployment-maps04 kartotherian/deploy@fed001c Update node mapnik to 3.7.2 [14:33:49] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [15:22:40] 10Beta-Cluster-Infrastructure, 10Collaboration-Team-Triage, 10Maps, 10Collaboration-Feature-Rollouts (Collaboration-Maps): [betalabs] Uncaught TypeError: Cannot read property 'lat' of null - when 'Edit layer' option is used. - https://phabricator.wikimedia.org/T194440 (10Mholloway) p:05Triage>03Normal [15:23:06] 10Beta-Cluster-Infrastructure, 10Maps (Kartographer): [betalabs] Uncaught TypeError: Cannot read property 'lat' of null - when 'Edit layer' option is used. - https://phabricator.wikimedia.org/T194440 (10Mholloway) [15:27:20] (03PS2) 10Ema: operations-puppet: install Busted for lua unit testing [integration/config] - 10https://gerrit.wikimedia.org/r/452634 (https://phabricator.wikimedia.org/T199720) [15:29:39] 10Release-Engineering-Team, 10User-zeljkofilipin: Wikimedia Portals Update and European Mid-day SWAT windows at the same time - https://phabricator.wikimedia.org/T201932 (10zeljkofilipin) [15:30:00] 10Release-Engineering-Team, 10User-zeljkofilipin: Wikimedia Portals Update and European Mid-day SWAT windows at the same time - https://phabricator.wikimedia.org/T201932 (10zeljkofilipin) p:05Triage>03Normal [15:31:45] (03CR) 10Giuseppe Lavagetto: [C: 031] operations-puppet: install Busted for lua unit testing [integration/config] - 10https://gerrit.wikimedia.org/r/452634 (https://phabricator.wikimedia.org/T199720) (owner: 10Ema) [15:33:34] 10Release-Engineering-Team, 10User-zeljkofilipin: Wikimedia Portals Update and European Mid-day SWAT windows at the same time on Mondays - https://phabricator.wikimedia.org/T201932 (10zeljkofilipin) [15:33:56] (03CR) 10Ema: [C: 031] operations-puppet: install Busted for lua unit testing [integration/config] - 10https://gerrit.wikimedia.org/r/452634 (https://phabricator.wikimedia.org/T199720) (owner: 10Ema) [15:37:50] 10Gerrit, 10Upstream: No keyboard shortcut for adding reviewers in PolyGerrit - https://phabricator.wikimedia.org/T199463 (10Paladox) I am not sure what the key is on windows / linux maybe ctrl + A but on the mac it's FN + A that opens the dialog where you write replies but also the one that adds reviewers. [15:39:00] 10Release-Engineering-Team, 10User-zeljkofilipin: Wikimedia Portals Update and European Mid-day SWAT windows at the same time on Mondays - https://phabricator.wikimedia.org/T201932 (10zeljkofilipin) [15:40:11] 10Release-Engineering-Team (Kanban), 10User-zeljkofilipin: Wikimedia Portals Update and European Mid-day SWAT windows at the same time on Mondays - https://phabricator.wikimedia.org/T201932 (10zeljkofilipin) a:03zeljkofilipin [15:42:02] (03PS1) 10Ema: Edit Project Config [integration/config] (refs/meta/config) - 10https://gerrit.wikimedia.org/r/452688 [15:56:42] 10Release-Engineering-Team (Kanban), 10User-zeljkofilipin: Wikimedia Portals Update and European Mid-day SWAT windows at the same time on Mondays - https://phabricator.wikimedia.org/T201932 (10zeljkofilipin) [15:57:14] (03CR) 10Reedy: [C: 032] operations-puppet: install Busted for lua unit testing [integration/config] - 10https://gerrit.wikimedia.org/r/452634 (https://phabricator.wikimedia.org/T199720) (owner: 10Ema) [15:58:41] (03Merged) 10jenkins-bot: operations-puppet: install Busted for lua unit testing [integration/config] - 10https://gerrit.wikimedia.org/r/452634 (https://phabricator.wikimedia.org/T199720) (owner: 10Ema) [16:00:39] !log Updating docker-pkg files on contint1001 for https://gerrit.wikimedia.org/r/#/c/integration/config/+/452634/ [16:00:42] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [16:04:19] (03PS1) 10Ema: Use new operations-puppet image with Lua support [integration/config] - 10https://gerrit.wikimedia.org/r/452692 (https://phabricator.wikimedia.org/T199720) [16:13:44] thcipriani: About? [16:13:44] [contint1001.wikimedia.org] out: ERROR: image docker-registry.discovery.wmnet/releng/operations-puppet failed to build, see logs for details [16:13:49] Do you know which logs this is talking about? [16:14:40] hrm, IIRC it creates a log in the directory where docker-pkg is running [16:14:50] I think it is deleted at the end of the fab task [16:15:45] looks like the log is in /tmp [16:16:04] thanks [16:21:52] 10Release-Engineering-Team (Kanban), 10MediaWiki-Core-Tests, 10Quibble, 10Patch-For-Review, 10User-zeljkofilipin: Quibble does not install ffmpeg - https://phabricator.wikimedia.org/T193157 (10zeljkofilipin) [16:26:12] (03PS1) 10Zfilipin: ffmpeg is needed for recording videos of Selenium tests [integration/config] - 10https://gerrit.wikimedia.org/r/452703 (https://phabricator.wikimedia.org/T193157) [16:27:15] (03CR) 10Zfilipin: "> Patch Set 2:" [integration/quibble] - 10https://gerrit.wikimedia.org/r/451645 (https://phabricator.wikimedia.org/T193157) (owner: 10Zfilipin) [16:27:28] (03CR) 10Zfilipin: "> Patch Set 2:" [integration/quibble] - 10https://gerrit.wikimedia.org/r/451645 (https://phabricator.wikimedia.org/T193157) (owner: 10Zfilipin) [16:27:52] (03Abandoned) 10Zfilipin: Install ffmpeg needed for recording videos of Selenium tests [integration/quibble] - 10https://gerrit.wikimedia.org/r/451645 (https://phabricator.wikimedia.org/T193157) (owner: 10Zfilipin) [16:29:23] 10Release-Engineering-Team (Kanban), 10MediaWiki-Core-Tests, 10Quibble, 10Patch-For-Review, 10User-zeljkofilipin: Quibble does not install ffmpeg - https://phabricator.wikimedia.org/T193157 (10zeljkofilipin) [16:58:03] !log deployment-maps04 tilerator/deploy@f4c4359 Update node mapnik to 3.7.2 - Fixing submodule deploy [16:58:06] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [16:58:08] !log deployment-maps04 kartotherian/deploy@a0f7111 Update node mapnik to 3.7.2 - Fixing submodule deploy [16:58:12] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [17:06:55] (03PS1) 10Ema: operations-puppet: install unzip, required by luarocks [integration/config] - 10https://gerrit.wikimedia.org/r/452714 (https://phabricator.wikimedia.org/T199720) [17:07:55] (03CR) 10Reedy: [C: 032] "Take two" [integration/config] - 10https://gerrit.wikimedia.org/r/452714 (https://phabricator.wikimedia.org/T199720) (owner: 10Ema) [17:09:25] (03Merged) 10jenkins-bot: operations-puppet: install unzip, required by luarocks [integration/config] - 10https://gerrit.wikimedia.org/r/452714 (https://phabricator.wikimedia.org/T199720) (owner: 10Ema) [17:09:51] (03PS2) 10Ema: Use new operations-puppet image with Lua support [integration/config] - 10https://gerrit.wikimedia.org/r/452692 (https://phabricator.wikimedia.org/T199720) [17:10:00] !log Updating docker-pkg files on contint1001 for https://gerrit.wikimedia.org/r/452714 [17:10:03] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [17:13:22] (03PS2) 10EBernhardson: Don't run search-mjolnir-tox-docker concurrently [integration/config] - 10https://gerrit.wikimedia.org/r/451999 (https://phabricator.wikimedia.org/T201479) [17:13:39] 10Continuous-Integration-Config, 10Patch-For-Review: Submitting multiple mjolnir patches receive -1 with OSError: [Errno 12] Cannot allocate memory - https://phabricator.wikimedia.org/T201479 (10EBernhardson) I've updated the patch to reference the m4executor [17:16:04] Is there anyone left who knows how to do gerrit account management? thcipriani for example? [17:16:22] I ask re: T171417 [17:16:23] T171417: Request rename of "Alangi derick" to "Alangi Derick" on wikitech/LDAP/Gerrit - https://phabricator.wikimedia.org/T171417 [17:16:51] seems upstream favour going straing to 3.0 and skipping 2.16 https://groups.google.com/forum/#!topic/repo-discuss/Ra7ZCBNYYmQ [17:18:17] andrewbogott i think that may be blocked on https://phabricator.wikimedia.org/T199749 [17:22:15] (03CR) 10Reedy: [C: 032] Use new operations-puppet image with Lua support [integration/config] - 10https://gerrit.wikimedia.org/r/452692 (https://phabricator.wikimedia.org/T199720) (owner: 10Ema) [17:23:04] andrewbogott: we are the ones who remain to do gerrit account management. I haven't looked at that rename at all, I'll check it out. I don't think it is blocked on the gerrit plugin twentyafterfour and I are working on. [17:23:35] thcipriani: excellent, thank you [17:23:44] I can do the ldap cleanup after the fact, which I think is all that remains on that task [17:24:11] (03Merged) 10jenkins-bot: Use new operations-puppet image with Lua support [integration/config] - 10https://gerrit.wikimedia.org/r/452692 (https://phabricator.wikimedia.org/T199720) (owner: 10Ema) [17:40:11] 10Phabricator: Account for Petar Petković (WMF Language team SE) needs to be enabled - https://phabricator.wikimedia.org/T201949 (10Arrbee) [17:42:20] docker_deploy seems to be hanging on mediawiki-phpcs-dryrun [17:56:58] 10Phabricator: Account for Petar Petković (WMF Language team SE) needs to be enabled - https://phabricator.wikimedia.org/T201949 (10MarcoAurelio) @mmodell Was this your antivandalism algorithm? [17:58:13] twentyafterfour: you around? [18:19:38] 10Phabricator: Account for Petar Petković (WMF Language team SE) needs to be enabled - https://phabricator.wikimedia.org/T201949 (10Arrbee) >>! In T201949#4502433, @MarcoAurelio wrote: > @mmodell Was this your antivandalism algorithm? That does fit with the timeline though. [18:21:27] 10Phabricator: Account for Petar Petković (WMF Language team SE) needs to be enabled - https://phabricator.wikimedia.org/T201949 (10mmodell) Indeed. I enabled the account. [18:26:28] 10Phabricator: Account for Petar Petković (WMF Language team SE) needs to be enabled - https://phabricator.wikimedia.org/T201949 (10MarcoAurelio) How does one see/check/know the users that were filtered by the tool? Thanks. [18:27:55] (03PS1) 10Reedy: Revert "Use new operations-puppet image with Lua support" [integration/config] - 10https://gerrit.wikimedia.org/r/452731 [18:29:26] 10Phabricator: Account for Petar Petković (WMF Language team SE) needs to be enabled - https://phabricator.wikimedia.org/T201949 (10Petar.petkovic) Thank you for enabling me, @mmodell. Now that I have my account back, I can see this notification: {F24942618} [18:29:31] 10Phabricator: Account for Petar Petković (WMF Language team SE) needs to be enabled - https://phabricator.wikimedia.org/T201949 (10Arrbee) Thanks @mmodell [18:29:45] (03CR) 10Reedy: [C: 032] Revert "Use new operations-puppet image with Lua support" [integration/config] - 10https://gerrit.wikimedia.org/r/452731 (owner: 10Reedy) [18:29:55] 10Phabricator: Account for Petar Petković (WMF Language team SE) needs to be enabled - https://phabricator.wikimedia.org/T201949 (10Petar.petkovic) 05Open>03Resolved a:03mmodell [18:32:07] (03Merged) 10jenkins-bot: Revert "Use new operations-puppet image with Lua support" [integration/config] - 10https://gerrit.wikimedia.org/r/452731 (owner: 10Reedy) [18:42:47] (03PS1) 10Umherirrender: Run extension-quibble-noselenium for EmailAuthorization [integration/config] - 10https://gerrit.wikimedia.org/r/452732 [18:47:49] (03CR) 10Jdlrobson: [C: 031] [MobileFrontend] [MinervaNeue] [Popups] Update: promote JSDocs to postmerge [integration/config] - 10https://gerrit.wikimedia.org/r/450635 (https://phabricator.wikimedia.org/T188261) (owner: 10Niedzielski) [18:52:59] legoktm https://gerrit-review.googlesource.com/c/plugins/rename-project/+/192750 [18:53:20] 2.15 support [18:54:27] 10Gerrit, 10Release-Engineering-Team: Install rename-project plugin - https://phabricator.wikimedia.org/T201953 (10Paladox) [18:58:16] finally!!! [18:58:53] paladox: and when will the new UI support patch creation and editting? [18:59:06] Hauskatze 2.16 / 3.0 [18:59:19] so when we upgrade next we will gain more of the missing features! [18:59:29] average time it'll take for us to get there? [18:59:49] Hauskatze as it hasen't been branched yet, so we could not upgrade yet :) [19:00:02] it was too sweet to be true :'( [19:00:04] though we would wait until a point release ie 2.16.1 [19:01:16] Hauskatze https://gerrit-review.googlesource.com/c/gerrit/+/192751 [19:05:16] Hauskatze you can already create changes through the new ui [19:05:18] in 2.15 [19:05:22] as i added that hehehe [19:05:33] but you will have to switch to gwtui to edit using the inline editor [19:07:09] to create a change you go to browse -> repoistory (which is the default) -> repo -> commands [19:09:53] 10Gerrit, 10Release-Engineering-Team: Install rename-project plugin - https://phabricator.wikimedia.org/T201953 (10Paladox) 05Open>03stalled Stalled until notedb is supported in the plugin. [19:13:48] Project mediawiki-core-doxygen-docker build #1270: 04FAILURE in 9 min 41 sec: https://integration.wikimedia.org/ci/job/mediawiki-core-doxygen-docker/1270/ [19:25:59] I'm looking at the CI dashboards in Grafana to try and see what the bottleneck currently is. [19:26:18] It used to be Nodepool, but it seems like that isn't the case given lots of ready supply at https://grafana.wikimedia.org/dashboard/db/nodepool [19:26:46] But then again it also says there is a 2 hour wait for Nodepool/ci-jessie-wikimedia at https://grafana.wikimedia.org/dashboard/db/zuul?orgId=1 [19:27:17] Ah, that was yesterday , my bad [19:29:20] hey all, I'm trying to work out why this job hasn't been auto-merged after passing CI and being +2'd, https://gerrit.wikimedia.org/r/#/c/mediawiki/core/+/452742/ [19:29:31] looks like zuul ran for part of it [19:30:09] but I can' see the build succeeded entry [19:30:37] s/can'/can't [19:31:02] jgleeson: It's in a nice queue backlog https://integration.wikimedia.org/zuul/ [19:31:30] ahhh I see [19:31:43] thanks Reedy [19:31:55] It's known it's backed up. Not really known why just yet [20:09:48] jgleeson: The CI test pass there was from "Main test" (for patch submission), when it gets merged there'll be another test pass from "Gate and submit test". [20:12:45] cool, thanks [20:23:45] !log deactivated and cleaned node for deployment-elastic09 which vanished mysteriously [20:23:49] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [20:26:19] hello [20:26:22] 10Phabricator: Phabricator account with existing email address - https://phabricator.wikimedia.org/T201960 (10MarcoAurelio) [20:26:47] probably zuul throwing away all the results again because of the dependent queue [20:26:55] I see that a patch just got V-1'd [20:31:30] 10Phabricator: Account for Petar Petković (WMF Language team SE) needs to be enabled - https://phabricator.wikimedia.org/T201949 (10mmodell) Thanks everyone, it looks like my filter is still too aggressive. I have added @Petar.petkovic to the #trusted-contributors project and adjusted the vandalism filter to be... [20:32:08] Hauskatze: I'm around [20:32:46] oh I see it was about the antivandalism already dealt with, sorry for the supurfluous ping [20:33:01] twentyafterfour: no probs, but now that you're here, I have a problem with arcanist [20:33:20] it happens that when I arc diff a patch, and then another, the previous one is also added [20:33:30] arc diff --create better? [20:33:50] or git checkout branch -> work ? [20:34:05] arc diff HEAD^ [20:34:54] example of what happened: https://phabricator.wikimedia.org/D1093 [20:35:00] I wanted to do each of them in one diff [20:35:15] not too bad but surprised me heh [20:38:13] so you want to do one differential revision or two? [20:54:06] 10Gerrit, 10Release-Engineering-Team (Kanban): Gerrit has created duplicate accounts for some users - https://phabricator.wikimedia.org/T197083 (10thcipriani) Quick update. I pushed up a new patchset for review for the plugin we're working on to resolve the problem in the notedb database: https://gerrit-review... [20:57:11] 10Release-Engineering-Team (Kanban), 10MediaWiki-Core-Tests, 10MW-1.32-release-notes (WMF-deploy-2018-08-21 (1.32.0-wmf.18)), 10Patch-For-Review, 10User-zeljkofilipin: Run tests daily targeting beta cluster for all repositories with Selenium tests - https://phabricator.wikimedia.org/T188742 (10Jdforrester... [21:19:24] Yippee, build fixed! [21:19:24] Project mediawiki-core-doxygen-docker build #1271: 09FIXED in 15 min: https://integration.wikimedia.org/ci/job/mediawiki-core-doxygen-docker/1271/ [21:22:55] 10Gerrit, 10Release-Engineering-Team (Kanban): Gerrit has created duplicate accounts for some users - https://phabricator.wikimedia.org/T197083 (10kaldari) I'm totally fine with losing all history at this point :) [23:16:13] Does anyone know how the prioritization of the gate-and-submit-swat queue works? It seems broken [23:16:32] I +2ed a number of wmf branch commits for SWAT 13 minutes ago and none of their jobs have even started yet [23:17:02] Meanwhile, mediawiki-config patches that I +2ed went into the gate-and-submit queue (but independent of the mediawiki/core patch chain in there) and were processed quickly [23:20:55] RoanKattouw: The job runners for mw-config are trivial and not resource constrained, unlike "real" code repos. [23:21:11] RoanKattouw: Priority means you get the first available runner. [23:21:34] Sure, but zero runners have been assigned to my jobs in the past ~15 mins [23:21:58] The number of active runners seems to have declined if anything over that time period [23:22:23] That said the active runners are all on jobs older than mine, so maybe my turn will come after those [23:25:10] RoanKattouw: any open CI node should prioritize gate-and-submit-swat over anything else [23:25:12] theoretically [23:25:47] But "open" is the key. [23:26:02] https://integration.wikimedia.org/ci/computer/ shows no open m4 docker slots [23:27:08] Did we lose a lot of capacity recently, did the CI infrastructure start using more jobs or for longer, or are we all just feeling the pinch of ever-growing use of CI? [23:28:17] Aha, it's started [23:29:00] 10Continuous-Integration-Infrastructure, 10Release-Engineering-Team: Add some more m4executor docker slaves for Jenkins - https://phabricator.wikimedia.org/T201972 (10Legoktm) p:05Triage>03High [23:29:46] James_F: the last two I think. Also I added the sqlite/postgres jobs [23:29:55] Also our test coverage is going up! [23:30:05] quibble also got rid of a lot of parallelism [23:30:33] Yeah. [23:30:58] Is there a task to allocate more resources? If not I'll make one. [23:42:17] James_F: I just filed https://phabricator.wikimedia.org/T201972 [23:43:05] ❤️ [23:45:54] Hmm it processed some of my changes but two others are stuck behind regular MW core changes now :( [23:46:05] Maybe because it was a chain of five, and the last two were grey at first [23:48:30] Yeah… [23:52:03] 10Continuous-Integration-Infrastructure, 10Release-Engineering-Team: Add some more m4executor docker slaves for Jenkins - https://phabricator.wikimedia.org/T201972 (10Jdforrester-WMF) > maybe we can give up some of the nodepool capacity in favor of more docker instances Or even "most of"? Time to start punish... [23:55:31] thcipriani|afk: what in zuul gives the gate-and-submit-swat queue a higher priority than gate-and-submit? I'm not seeing anything