[00:00:24] It's possibly better to just remove that config completely.... Leave a useful commit summary and tell people to rewrite it [00:03:13] heh [00:03:30] I'm being serious [00:03:30] Reedy do you know how i can choose a db server in update.php ? [00:03:37] Reedy yes i know [00:04:01] what do you mean choose a db server? [00:04:53] Reedy it's using the mw server (we use https://github.com/miraheze/mw-config/blob/master/Database.php#L131) but it dosen't seem to be detecting that in the script [00:12:52] 10Phabricator: Add support for task types - https://phabricator.wikimedia.org/T93499#4195922 (10MBinder_WMF) That would be super cool, I've definitely heard at least one use case for that. :) [00:31:49] (03CR) 10BearND: [C: 031] Run mobileapps-periodic-test hourly regardless of repo changes [integration/config] - 10https://gerrit.wikimedia.org/r/432310 (https://phabricator.wikimedia.org/T177896) (owner: 10Mholloway) [01:23:09] 10Release-Engineering-Team (Kanban), 10Release, 10Train Deployments: 1.32.0-wmf.3 deployment blockers - https://phabricator.wikimedia.org/T191049#4196045 (10mmodell) [01:25:59] 10Release-Engineering-Team, 10MediaWiki-Parser, 10MediaWiki-Platform-Team, 10Operations, and 2 others: Servers using tidy-html5 are rendering pages differently, especially with - https://phabricator.wikimedia.org/T193414#4196048 (10zhuyifei1999) >>! In T193414#4195487, @ssastry wrote: > See https://c... [01:35:44] 10Release-Engineering-Team (Kanban), 10Release, 10Train Deployments: 1.32.0-wmf.3 deployment blockers - https://phabricator.wikimedia.org/T191049#4196059 (10mmodell) [03:57:37] Yippee, build fixed! [03:57:38] Project mediawiki-core-code-coverage build #3499: 09FIXED in 57 min: https://integration.wikimedia.org/ci/job/mediawiki-core-code-coverage/3499/ [09:26:42] (03CR) 10MarcoAurelio: [C: 031] Whitelist Rxy on zuul [integration/config] - 10https://gerrit.wikimedia.org/r/432051 (owner: 10MarcoAurelio) [09:50:57] (03PS3) 10MarcoAurelio: Add AbuseFilter dependency on TorBlock [integration/config] - 10https://gerrit.wikimedia.org/r/431806 [10:25:26] 10Beta-Cluster-Infrastructure: GlobalRename stuck again at Beta - https://phabricator.wikimedia.org/T194376#4196710 (10MarcoAurelio) [10:32:19] 10Beta-Cluster-Infrastructure: GlobalRename stuck again at Beta - https://phabricator.wikimedia.org/T194376#4196737 (10MarcoAurelio) cpjobqueue: KafkaConsumer is not connected I see lots of those at Logstash: ``` cpjobqueue: KafkaConsumer is not connected at Function.createLibrdkafkaError [as create] (/srv... [10:32:47] mobrovac: is it possible to reconnect Kafka consumer for Beta Cluster? JobQue broken again. [10:35:46] 10Beta-Cluster-Infrastructure: GlobalRename stuck again at Beta - https://phabricator.wikimedia.org/T194376#4196739 (10MarcoAurelio) Lots == 4,302,490 in the last 24 hours. [10:48:13] 10Beta-Cluster-Infrastructure: GlobalRename stuck again at Beta - https://phabricator.wikimedia.org/T194376#4196762 (10MarcoAurelio) The `deployment-kafka-jumbo{1,2}` machines are failing on puppet as well: ```name=deployment-kafka-jumbo-1 The last Puppet run was at Wed May 9 16:40:22 UTC 2018 (1083 minutes ag... [10:56:58] 10Beta-Cluster-Infrastructure: GlobalRename stuck again at Beta - https://phabricator.wikimedia.org/T194376#4196783 (10MarcoAurelio) @Ottomata Hi. I see at https://github.com/wikimedia/puppet/commits/production that you did some commits yesterday with 'kafka' as title. May any of those be the reason? Thanks :) [11:19:32] 10Beta-Cluster-Infrastructure: Remove deployment-mediawiki06 app server? - https://phabricator.wikimedia.org/T194151#4196871 (10EddieGP) [11:19:34] 10Beta-Cluster-Infrastructure, 10Security-Team: Delete deployment-mediawiki06 - https://phabricator.wikimedia.org/T192996#4196874 (10EddieGP) [11:21:24] 10Beta-Cluster-Infrastructure, 10Scap: Enable `scap log` on deployment-* servers - https://phabricator.wikimedia.org/T192032#4196886 (10EddieGP) p:05Triage>03Lowest [12:02:07] parsoidsvc-doc-docker-publish and beta-mediawiki-config-update-eqiad have been queued for 20h and 11h [12:23:09] https://gerrit-review.googlesource.com/c/gerrit/+/177590 [12:35:14] 10Beta-Cluster-Infrastructure: GlobalRename stuck again at Beta - https://phabricator.wikimedia.org/T194376#4197031 (10mobrovac) >>! In T194376#4196737, @MarcoAurelio wrote: > cpjobqueue: KafkaConsumer is not connected > > I see lots of those at Logstash: > > ``` > cpjobqueue: KafkaConsumer is not connected >... [12:38:22] mobrovac: hi, so the kafka thing at beta is resolved? I also see puppet errors [12:40:09] Hauskatze: kafak-jumbo is not related to the jobqueue, only kafka-main-* hosts [12:40:34] mobrovac: so I shouldn't worry about those? Is the queue working right then now? [12:40:52] sorry for too much asking but puppet is hard to understand for me [12:41:18] Hauskatze: correct, the jobqueue uses the eventbus system, which is kafka-main hosts and change prop [12:43:54] yep, global rename is working again [12:44:06] I'll have to manually unblock that stuck rename though [12:44:20] unless there's any command to let the jobqueue do it [12:44:47] nope, you'll have to manually do it, sorry [12:45:40] ok [12:48:36] started to unblock and got stuck again at en.wikiquote@beta [12:48:37] :| [12:49:41] !log maurelio@deployment-tin:~$ mwscript extensions/CentralAuth/maintenance/fixStuckGlobalRename.php --wiki=deploymentwiki --logwiki=deploymentwiki 'Hosiryuhosi' 'Rxy' [12:49:41] | T194376 [12:49:43] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [12:49:43] T194376: GlobalRename stuck again at Beta - https://phabricator.wikimedia.org/T194376 [12:52:50] mobrovac: I still see those errors on logstash-beta: KafkaConsumer not connected [12:54:00] indeed Hauskatze, kafka is misbehaving :/ [12:54:18] Hauskatze: we'll have to wait for ottomata,he should be online in an hour or so [12:54:48] mobrovac: no probs. I mentioned him in the task. He may be able, perhaps, to check the puppet errors for the kafka-jumbo machines? [12:55:13] yes, he would, but as I said kafka-jumbo is not related to this problem [13:03:13] Hi, I'm trying to `scap deploy` in labs (I'm used to doing it in prod) and I have a permission issue. Anyone can help me troubleshoot it? [13:05:41] I have access there but never used scap [13:05:57] btw code is deployed there each 10 minutes right? [13:08:57] I'm deploying kartotherian (maps), not mediawiki. Roan has created a test server in labs where he deploys with scap regularly. [13:09:24] I don't know if he had to do any tricks for it to work for him but he's asleep for several more hours. [13:11:44] I'm in the middle of a SWAT, maybe I can have a look after that [13:19:27] !log maurelio@deployment-tin:~$ mwscript extensions/CentralAuth/maintenance/fixStuckGlobalRename.php --wiki=deploymentwiki --logwiki=deploymentwiki 'Hosiryuhosi' 'Rxy' | T194376 [13:19:32] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [13:19:32] T194376: GlobalRename stuck again at Beta - https://phabricator.wikimedia.org/T194376 [13:22:09] 10Beta-Cluster-Infrastructure: GlobalRename stuck again at Beta - https://phabricator.wikimedia.org/T194376#4197145 (10MarcoAurelio) I've fixed the global rename stuck after the jobqueue restart, and while it finished, none of the accounts ended attached so I'll have to run an attachment script I think. Notwiths... [13:30:12] 10Beta-Cluster-Infrastructure: GlobalRename stuck again at Beta - https://phabricator.wikimedia.org/T194376#4197150 (10Ottomata) Ah, the jumbo nodes failing is because I changed a prod puppet class, but did not uninclude it from deployment-prep horizon. Should be unrelated Will fix. The commits yesterday were... [13:38:30] tgr: says "file doesn't exist" [13:38:48] maurelio@deployment-tin:~$ mwscript extensions/CentralAuth/maintenance/attachAccount.php --wiki=deploymentwiki --userlist=home/maurelio/to-fix.txt --dry-run [13:38:48] ERROR - File not found: home/maurelio/to-fix.txt [13:39:19] I tried with "to-fix.txt', ~/home/maurelio/to-fix.txt [13:39:30] maurelio/to-fix.txt [13:39:33] etc [13:41:57] Hauskatze: it should be /home/maurelio/to-fix.txt or ~/to-fix.txt probably [13:42:14] * Hauskatze retries [13:43:57] file not found with both options [13:46:00] let me try [13:47:29] Hauskatze: mwscript runs as www-data user [13:47:38] so it can't see the file [13:48:09] tgr where should I put it then? [13:48:26] or rather, chmod 755 the file? [13:48:31] yeah [13:48:37] the last one? ok [13:49:08] -rw-rw-r-- 1 maurelio wikidev 4 May 10 13:32 to-fix.txt <-- already has this [13:49:20] your user directory, then? [13:49:38] can just use a pipe of some sort, probably [13:49:41] maybe I can put the file temporary in the root [14:02:37] tgr: fixed -- I didn't even remembered that *I* created https://wikitech.wikimedia.org/wiki/Reattach_a_global_account [14:18:23] 10Release-Engineering-Team (Kanban), 10MediaWiki-General-or-Unknown, 10MW-1.32-release-notes (WMF-deploy-2018-05-15 (1.32.0-wmf.4)), 10Patch-For-Review, and 2 others: `npm audit` for mediawiki/core found 24 vulnerabilities - https://phabricator.wikimedia.org/T194280#4197290 (10zeljkofilipin) a:03zeljkofil... [14:19:48] 10Release-Engineering-Team (Kanban), 10MediaWiki-General-or-Unknown, 10MW-1.32-release-notes (WMF-deploy-2018-05-15 (1.32.0-wmf.4)), 10Patch-For-Review, and 2 others: `npm audit` for mediawiki/core found 24 vulnerabilities - https://phabricator.wikimedia.org/T194280#4197295 (10zeljkofilipin) [14:29:04] 10Release-Engineering-Team (Kanban), 10MediaWiki-General-or-Unknown, 10MW-1.32-release-notes (WMF-deploy-2018-05-15 (1.32.0-wmf.4)), 10Patch-For-Review, and 2 others: `npm audit` for mediawiki/core found 24 vulnerabilities - https://phabricator.wikimedia.org/T194280#4197324 (10zeljkofilipin) `24 vulnerabil... [14:30:30] 10Release-Engineering-Team (Kanban), 10MediaWiki-General-or-Unknown, 10MW-1.32-release-notes (WMF-deploy-2018-05-15 (1.32.0-wmf.4)), 10Patch-For-Review, and 2 others: `npm audit` for mediawiki/core found 24 vulnerabilities - https://phabricator.wikimedia.org/T194280#4197326 (10zeljkofilipin) ``` $ npm audi... [14:37:38] 10Release-Engineering-Team (Kanban), 10MediaWiki-General-or-Unknown, 10MW-1.32-release-notes (WMF-deploy-2018-05-15 (1.32.0-wmf.4)), 10Patch-For-Review, and 2 others: `npm audit` for mediawiki/core found 24 vulnerabilities - https://phabricator.wikimedia.org/T194280#4194305 (10Krinkle) Note that the `[dev]... [14:46:52] 10Release-Engineering-Team (Kanban), 10MediaWiki-General-or-Unknown, 10MW-1.32-release-notes (WMF-deploy-2018-05-15 (1.32.0-wmf.4)), 10Patch-For-Review, and 2 others: `npm audit` for mediawiki/core found 24 vulnerabilities - https://phabricator.wikimedia.org/T194280#4197376 (10zeljkofilipin) p:05Normal>... [14:47:28] 10Scap (Scap3-MediaWiki-MVP), 10scap2, 10Wikimedia-Incident: Implement MediaWiki pre-promote checks - https://phabricator.wikimedia.org/T121597#4197379 (10Krinkle) @thcipriani Does this mean that writing a patch replacing `/w/index.php` in operations/mediawiki-config with `die(1);` can be synced with `scap s... [14:48:09] 10Release-Engineering-Team (Kanban), 10MediaWiki-General-or-Unknown, 10MW-1.32-release-notes (WMF-deploy-2018-05-15 (1.32.0-wmf.4)), 10Patch-For-Review, and 2 others: `npm audit` for mediawiki/core found 24 vulnerabilities - https://phabricator.wikimedia.org/T194280#4197381 (10zeljkofilipin) [15:01:25] 10Release-Engineering-Team (Kanban), 10MediaWiki-General-or-Unknown, 10MW-1.32-release-notes (WMF-deploy-2018-05-15 (1.32.0-wmf.4)), 10Patch-For-Review, and 2 others: `npm audit` for mediawiki/core found 24 vulnerabilities - https://phabricator.wikimedia.org/T194280#4197413 (10zeljkofilipin) Next step coul... [15:03:00] 10Deployments, 10Scap, 10WorkType-NewFunctionality: Create canary deploy process for MediaWiki - https://phabricator.wikimedia.org/T136883#4197417 (10thcipriani) [15:03:03] 10Scap (Scap3-MediaWiki-MVP), 10scap2, 10Wikimedia-Incident: Implement MediaWiki pre-promote checks - https://phabricator.wikimedia.org/T121597#4197414 (10thcipriani) 05Resolved>03Open a:05thcipriani>03None >>! In T121597#4197379, @Krinkle wrote: > In other words, does it run the spec against localho... [15:04:59] 10Phabricator, 10Release-Engineering-Team (Kanban): Make sure elasticsearch 6 is supported in phabricator - https://phabricator.wikimedia.org/T181393#4197431 (10EBernhardson) 6 months is approaching :) Still don't have a date, but am doing some preliminary work resolving current problems that would block the u... [15:08:25] 10Release-Engineering-Team (Kanban), 10MediaWiki-General-or-Unknown, 10MW-1.32-release-notes (WMF-deploy-2018-05-15 (1.32.0-wmf.4)), 10Patch-For-Review, and 2 others: `npm audit` for mediawiki/core found 24 vulnerabilities - https://phabricator.wikimedia.org/T194280#4197442 (10zeljkofilipin) Well, updating... [15:09:40] 10Release-Engineering-Team (Kanban), 10MediaWiki-General-or-Unknown, 10MW-1.32-release-notes (WMF-deploy-2018-05-15 (1.32.0-wmf.4)), 10Patch-For-Review, and 2 others: `npm audit` for mediawiki/core found 24 vulnerabilities - https://phabricator.wikimedia.org/T194280#4197450 (10zeljkofilipin) ``` $ npm aud... [15:10:36] 10Release-Engineering-Team (Kanban), 10MediaWiki-General-or-Unknown, 10MW-1.32-release-notes (WMF-deploy-2018-05-15 (1.32.0-wmf.4)), 10Patch-For-Review, and 2 others: `npm audit` for mediawiki/core found 24 vulnerabilities - https://phabricator.wikimedia.org/T194280#4197452 (10zeljkofilipin) a:05zeljkofil... [15:17:43] 10Release-Engineering-Team, 10MediaWiki-Database, 10Performance-Team, 10Wikimedia-log-errors: Wikimedia\Rdbms\ChronologyProtector::initPositions: expected but failed to find position index. - https://phabricator.wikimedia.org/T194403#4197474 (10jcrespo) [15:32:44] 10Release-Engineering-Team (Kanban), 10Wikimedia-Hackathon-2018, 10JavaScript, 10User-zeljkofilipin: Pair on writing Selenium tests in JavaScript/Node.js - https://phabricator.wikimedia.org/T190687#4197533 (10zeljkofilipin) [15:34:35] 10Release-Engineering-Team (Kanban), 10MW-1.30-release-notes, 10MediaWiki-Core-Tests, 10JavaScript, and 5 others: Run Selenium Cucumber tests in CI - https://phabricator.wikimedia.org/T179190#4197538 (10zeljkofilipin) >>! In T179190#4173431, @Krinkle wrote: > Let me know if you're interested in trying to g... [15:36:45] there are two projects called Wikimedia-Hackathon-2018 (one archived now) [15:37:04] and Phabricator gets very confused about which is which: https://phabricator.wikimedia.org/project/profile/3319/ [15:37:38] ...I should probably file a bug instead of ranting on IRC shouldn't I [15:39:40] 10Phabricator: Phabricator confuses which identically-named project a task belongs to - https://phabricator.wikimedia.org/T194407#4197570 (10Tgr) [16:50:30] 10Beta-Cluster-Infrastructure, 10MediaWiki-General-or-Unknown, 10MediaWiki-extensions-WikimediaEvents, 10MW-1.31-release-notes (WMF-deploy-2018-01-02 (1.31.0-wmf.15)), and 3 others: [{exception_id}] {exception_url} ErrorException from line 177 of includes/H... - https://phabricator.wikimedia.org/T183503#4197898 [16:54:13] 10Scap (Scap3-MediaWiki-MVP), 10scap2, 10Wikimedia-Incident: Implement MediaWiki pre-promote checks - https://phabricator.wikimedia.org/T121597#4197925 (10Krinkle) Thanks for re-opening. I'm a fan of Scap's logstash checks and catching any size regression that affects real requests, including cases we might... [17:36:19] legoktm hi, would using the callback work around the problem? [17:36:22] when using ajax [17:36:57] yes i know it needs to be moved to the api, but that fix will take alot longer (requires someone who knows how to do that) :) [18:08:44] 10Continuous-Integration-Config, 10MediaWiki-General-or-Unknown, 10Multi-Content-Revisions, 10Test-Coverage, 10User-Addshore: mediawiki tests fail in mediawiki code coverage test - https://phabricator.wikimedia.org/T183777#4198192 (10Krinkle) [18:09:31] 10Continuous-Integration-Config, 10MediaWiki-General-or-Unknown, 10Multi-Content-Revisions, 10Test-Coverage, 10User-Addshore: Some PHPUnit tests consistently fail when collecting coverage report - https://phabricator.wikimedia.org/T183777#3863386 (10Krinkle) [18:09:36] yep that works [18:09:37] using callback just tested [18:24:14] 10Project-Admins: ESEAP Conference 2018 - https://phabricator.wikimedia.org/T162229#4198231 (10Aklapper) According to https://meta.wikimedia.org/wiki/ESEAP_Conference_2018 the conference took place last weekend. According to https://phabricator.wikimedia.org/maniphest/query/5ryMTrIeZCe0/#R the Phab tag #eseap-20... [18:46:11] 10Gerrit: Gerrit offers CR options when commenting on merged patches - https://phabricator.wikimedia.org/T194422#4198289 (10MaxSem) [18:49:21] 10Gerrit: Gerrit offers CR options when commenting on merged patches - https://phabricator.wikimedia.org/T194422#4198289 (10Paladox) This is a new feature in gerrit 2.14+. This is expected. [18:53:46] twentyafterfour hi, wondering if you could merge https://gerrit.wikimedia.org/r/#/c/432413/ please? [18:53:51] I've tested it this time and works [18:54:07] (before it did not without that change) [18:54:55] ok [18:55:07] thanks :) [18:55:36] twentyafterfour could you also merge https://gerrit.wikimedia.org/r/#/c/432417/ please? (backport of the change to REL1_31) [18:57:18] paladox: why backporting to 1.31? [18:57:57] twentyafterfour because since mw 1.31+ it throws an error if you use the same config in config: {} in other extensions. [18:58:07] so this is a work around by using the callback. [18:58:34] does anyone have a clue how to clear the zuul queue? We keep accumulating stalled jobs in the postmerge pipeline [18:58:53] paladox: ok [18:59:32] 10Project-Admins: Create Technical Writing Project - https://phabricator.wikimedia.org/T192093#4198340 (10Aklapper) Meouw. How do we proceed? Decline this task for the time being (feel free to via the {nav name=Add Action... > Change Status} dropdown)? Or something else wanted / preferred here? Please tell me... [18:59:33] thanks :) [18:59:34] the coverage pipeline is still backed up as well :-/ [19:01:07] twentyafterfour i think you need to restart something though forgot the name of it [19:01:48] 10Gerrit, 10Developer-Relations, 10Documentation: Gerrit's test instance gerrit.git.wmflabs.org is not quite visible in the docs; no clear instructions how to use it - https://phabricator.wikimedia.org/T193788#4198345 (10Aklapper) [19:02:51] for all the beta postmerge jobs the instructions are on https://www.mediawiki.org/wiki/Continuous_integration/Jenkins#Hung_beta_code/db_update [19:03:21] twentyafterfour https://www.mediawiki.org/wiki/Continuous_integration/Jenkins#Hung_beta_code/db_update [19:03:41] thcipriani heh you found it before me :) [19:03:59] I'm a quick draw on the wiki links :) [19:04:11] heh [19:06:48] 10Phabricator: Phabricator confuses which identically-named project a task belongs to - https://phabricator.wikimedia.org/T194407#4198355 (10Aklapper) @Tgr: I don't see that: One is Wikimedia, one is Wikimania here (if one has not been renamed in the meantime?). Which specific task (example ID) do you see showin... [19:10:05] !log reset jenkins slave on deployment-tin [19:10:06] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [19:12:36] i guess it must have been because it was low on storage [19:13:00] and i've seen in the jenkins-infra channel them having problems with it automatically detecting that space has been cleaned [19:33:40] twentyafterfour: it's OK if the coverage queue looks logged, the jobs are low priority and intentionally run sequentially instead of in parallel [19:34:02] clogged* [19:36:29] !log kicked postmerge queue in jenkins [19:36:31] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [19:42:32] dang, core patches seemto be failing on a CirrusSearch error [19:42:45] Anyone know what's up with that? [19:42:46] PHP Fatal error: Class 'SearchIndexField' not found in /home/jenkins/workspace/mediawiki-extensions-php55-jessie/src/extensions/CirrusSearch/CirrusSearch.php on line 1363 [19:42:57] https://integration.wikimedia.org/ci/job/mediawiki-extensions-php55-jessie/6807/console [19:43:13] for this totally unrelated change: https://gerrit.wikimedia.org/r/432420 [19:53:01] 10Release-Engineering-Team (Kanban), 10Release, 10Train Deployments: 1.32.0-wmf.3 deployment blockers - https://phabricator.wikimedia.org/T191049#4198432 (10mmodell) [19:56:33] 10Release-Engineering-Team (Kanban), 10Release, 10Train Deployments: 1.32.0-wmf.3 deployment blockers - https://phabricator.wikimedia.org/T191049#4198450 (10mmodell) [19:58:08] huh, maybe something totally transient, looks like tests are passing now [20:01:31] (03PS1) 10Umherirrender: Run tests for HoverGallery with correct camelcase [integration/config] - 10https://gerrit.wikimedia.org/r/432426 [20:02:43] 10Release-Engineering-Team (Kanban), 10Release, 10Train Deployments: 1.32.0-wmf.3 deployment blockers - https://phabricator.wikimedia.org/T191049#4198462 (10mmodell) 05Open>03Resolved [20:02:47] i recommend php7.2 for mediawiki, since upgrading performance has been really good. [20:05:08] (03CR) 10Legoktm: [C: 04-1] "The jjb diff says that there are no functional changes in this patch?" [integration/config] - 10https://gerrit.wikimedia.org/r/432310 (https://phabricator.wikimedia.org/T177896) (owner: 10Mholloway) [20:06:15] twentyafterfour: um, how did you deploy https://gerrit.wikimedia.org/r/#/c/415886/ ?? [20:06:21] AFAICT it doesn't do anything [20:07:04] (03CR) 10Legoktm: [C: 04-1] "Now that I looked a bit more closely, I don't see how this patch adds a job, since it only adds a job template, and no job itself? The dif" [integration/config] - 10https://gerrit.wikimedia.org/r/415886 (https://phabricator.wikimedia.org/T177896) (owner: 10Mholloway) [20:09:19] (03CR) 10Legoktm: "We need to fix this so you don't have to make such a big diff next time :(" [integration/config] - 10https://gerrit.wikimedia.org/r/431554 (owner: 10KartikMistry) [20:09:49] legoktm: from the context I thought there was some other patch incoming which would use the job template but I haven't seen such a patch. I just merged that one because it was called out in scrum of scrums [20:10:20] (03PS3) 10Legoktm: Whitelist Rxy on zuul [integration/config] - 10https://gerrit.wikimedia.org/r/432051 (owner: 10MarcoAurelio) [20:10:22] (03PS4) 10Legoktm: Add AbuseFilter dependency on TorBlock [integration/config] - 10https://gerrit.wikimedia.org/r/431806 (owner: 10MarcoAurelio) [20:10:24] (03PS2) 10Legoktm: Add tests for Extension:VEForAll [integration/config] - 10https://gerrit.wikimedia.org/r/431853 (owner: 10Cicalese) [20:10:36] (03PS2) 10Legoktm: Archive extension CategorySlideShow [integration/config] - 10https://gerrit.wikimedia.org/r/431610 (https://phabricator.wikimedia.org/T186969) (owner: 10MarcoAurelio) [20:10:38] (03PS2) 10Legoktm: Add apertium-streamparser package [integration/config] - 10https://gerrit.wikimedia.org/r/431554 (owner: 10KartikMistry) [20:10:40] (03PS2) 10Legoktm: Run tests for HoverGallery with correct camelcase [integration/config] - 10https://gerrit.wikimedia.org/r/432426 (owner: 10Umherirrender) [20:10:42] (03CR) 10Legoktm: [C: 032] Whitelist Rxy on zuul [integration/config] - 10https://gerrit.wikimedia.org/r/432051 (owner: 10MarcoAurelio) [20:10:44] (03CR) 10Legoktm: [C: 032] Add AbuseFilter dependency on TorBlock [integration/config] - 10https://gerrit.wikimedia.org/r/431806 (owner: 10MarcoAurelio) [20:10:48] (03CR) 10Legoktm: [C: 032] Add tests for Extension:VEForAll [integration/config] - 10https://gerrit.wikimedia.org/r/431853 (owner: 10Cicalese) [20:10:51] (03CR) 10Legoktm: [C: 032] Archive extension CategorySlideShow [integration/config] - 10https://gerrit.wikimedia.org/r/431610 (https://phabricator.wikimedia.org/T186969) (owner: 10MarcoAurelio) [20:10:57] (03CR) 10Legoktm: [C: 032] Add apertium-streamparser package [integration/config] - 10https://gerrit.wikimedia.org/r/431554 (owner: 10KartikMistry) [20:11:02] (03CR) 10Legoktm: [C: 032] Run tests for HoverGallery with correct camelcase [integration/config] - 10https://gerrit.wikimedia.org/r/432426 (owner: 10Umherirrender) [20:11:09] twentyafterfour: :| [20:12:10] (03Merged) 10jenkins-bot: Whitelist Rxy on zuul [integration/config] - 10https://gerrit.wikimedia.org/r/432051 (owner: 10MarcoAurelio) [20:12:13] (03Merged) 10jenkins-bot: Add AbuseFilter dependency on TorBlock [integration/config] - 10https://gerrit.wikimedia.org/r/431806 (owner: 10MarcoAurelio) [20:12:14] Hey folks. I'm trying to get lfs working on ORES labs install. What's the right approach re. puppet? [20:12:23] Is there a class/module/role I can look for? [20:12:23] (03Merged) 10jenkins-bot: Add tests for Extension:VEForAll [integration/config] - 10https://gerrit.wikimedia.org/r/431853 (owner: 10Cicalese) [20:12:48] (03Merged) 10jenkins-bot: Archive extension CategorySlideShow [integration/config] - 10https://gerrit.wikimedia.org/r/431610 (https://phabricator.wikimedia.org/T186969) (owner: 10MarcoAurelio) [20:12:50] (03Merged) 10jenkins-bot: Add apertium-streamparser package [integration/config] - 10https://gerrit.wikimedia.org/r/431554 (owner: 10KartikMistry) [20:13:17] It looks like tossing a "require_package('git-lfs')" in our base is the right way to do this. [20:13:30] legoktm: :-/ [20:13:42] halfak: ... [20:14:00] yeah that's probably correct [20:14:31] (03Merged) 10jenkins-bot: Run tests for HoverGallery with correct camelcase [integration/config] - 10https://gerrit.wikimedia.org/r/432426 (owner: 10Umherirrender) [20:14:35] Cool. I'll get it added [20:15:12] !log deployed https://gerrit.wikimedia.org/r/432051 https://gerrit.wikimedia.org/r/431806 https://gerrit.wikimedia.org/r/431853 https://gerrit.wikimedia.org/r/431610 https://gerrit.wikimedia.org/r/431554 https://gerrit.wikimedia.org/r/432426 [20:15:14] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [20:16:54] (03CR) 10Legoktm: [C: 032] "Note that the extension is currently failing tests: https://integration.wikimedia.org/ci/job/quibble-vendor-mysql-hhvm-docker/1792/console" [integration/config] - 10https://gerrit.wikimedia.org/r/431853 (owner: 10Cicalese) [20:41:53] (03PS1) 10Legoktm: Run phan and seccheck for 3D [integration/config] - 10https://gerrit.wikimedia.org/r/432526 [20:45:00] (03CR) 10Legoktm: [C: 032] Run phan and seccheck for 3D [integration/config] - 10https://gerrit.wikimedia.org/r/432526 (owner: 10Legoktm) [20:46:26] (03Merged) 10jenkins-bot: Run phan and seccheck for 3D [integration/config] - 10https://gerrit.wikimedia.org/r/432526 (owner: 10Legoktm) [20:47:00] !log deployed https://gerrit.wikimedia.org/r/432526 [20:47:02] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [21:45:08] so beta-scap-eqiad is running git pack-objects on every repo on every sync? [21:46:07] it seems to be taking a significant chunk of every scap's time [21:46:26] 10Project-Admins: Create Technical Writing Project - https://phabricator.wikimedia.org/T192093#4198817 (10bd808) 05Open>03declined Let's try just using the #documentation workboard for now per T192093#4138006. [21:58:01] !log Touched everything in beta cluster's wmf-config to fix some files not being synced [21:58:03] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [22:02:49] !log Add Console Section patterns to Jenkins Config for "setup-docker" [22:02:51] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [22:02:54] !log Add Console Section patterns to Jenkins Config for "JS Documentation" [22:02:55] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [22:03:00] !log Update Console Section patterns to Jenkins Config for "QUnit" [22:03:02] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [22:03:21] ! Update Console Sections in Jenkins Config to collapse setup-* sections by default [22:07:54] !log Update Console Section patterns to Jenkins Config for "setup-composer" (didn't match anymore) [22:07:56] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [22:15:57] MaxSem: do you mean the cache_git_info step? [22:21:44] 10Release-Engineering-Team, 10MediaWiki-Database, 10Performance-Team, 10Wikimedia-log-errors: Wikimedia\Rdbms\ChronologyProtector::initPositions: expected but failed to find position index. - https://phabricator.wikimedia.org/T194403#4198885 (10aaron) The logging level went from INFO to WARNING. I suppose... [22:42:35] thcipriani: not sure, I've just seen a bunch of these processes eating all CPU resources and taking forever, but at a closer look I don't see then in further syncs so probably not a problem [22:43:21] thcipriani: there's a blocked postmerge test on zuul for parsoid for 37 hours+ already [22:43:57] 31 hours, sorry; still too much time [22:44:08] can someone review https://gerrit.wikimedia.org/r/#/c/432165/ please? [22:44:36] TabbyCat: I'm aware. It's not blocking anything and other post-merge tasks have run for that repo since. It just got stuck in limbo and I'm scared to kick zuul because there's a big warning on the wiki :) [22:45:00] tl;dr: it's harmless, and will go away post zuul-restart afaiu [22:45:08] thcipriani: if you're already aware then it's ok for me [22:45:35] MaxSem: I'll take a look [22:45:41] thanks! [22:46:05] missing "i" in Adding on commit message but lgtm otherwise ;-) [22:51:45] (03PS3) 10MaxSem: Add GlobalPreferences to extension-gate [integration/config] - 10https://gerrit.wikimedia.org/r/432165 (https://phabricator.wikimedia.org/T194229) [22:54:11] (03CR) 10Thcipriani: [C: 032] Add GlobalPreferences to extension-gate [integration/config] - 10https://gerrit.wikimedia.org/r/432165 (https://phabricator.wikimedia.org/T194229) (owner: 10MaxSem) [22:54:31] will deploy post-merge [22:54:46] muchas gracias [22:54:57] no charge :) [22:55:35] (03Merged) 10jenkins-bot: Add GlobalPreferences to extension-gate [integration/config] - 10https://gerrit.wikimedia.org/r/432165 (https://phabricator.wikimedia.org/T194229) (owner: 10MaxSem) [22:59:26] !log reloading zuul to deploy https://gerrit.wikimedia.org/r/#/c/432165/ [22:59:28] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [22:59:53] MaxSem: should be deployed [23:00:01] woo [23:04:57] we could probably restart zuul at midnight when no one is doing anything to avoid dropping events [23:05:07] Also, there is some way to kill jobs via gearman I think. [23:09:40] it does seem like there should be a way to kill jobs in gearman :) [23:10:35] I'll try to remember to hop on late tonight and boot it if no one is around