[00:03:34] lol [00:03:39] I apologize for $wgAPIMaxResultSize [00:17:40] (03PS1) 10Paladox: [EducationProgram] Add composer-test and move jshint to check: [integration/config] - 10https://gerrit.wikimedia.org/r/276065 [00:23:55] (03PS1) 10Paladox: [EmailCapture] Add npm test [integration/config] - 10https://gerrit.wikimedia.org/r/276067 [00:44:55] 5Gerrit-Migration, 3releng-201516-q4: Get early adopters using Differential - https://phabricator.wikimedia.org/T129301#2101658 (10greg) [00:46:04] (03PS1) 10Paladox: [EtherEditor] Add npm test [integration/config] - 10https://gerrit.wikimedia.org/r/276074 [00:49:22] (03PS1) 10Paladox: [ExpandTemplates] Archive extension [integration/config] - 10https://gerrit.wikimedia.org/r/276076 [00:55:28] 5Gerrit-Migration, 3releng-201516-q4: Get early adopters using Differential - https://phabricator.wikimedia.org/T129301#2101708 (10greg) [00:57:59] 5Gerrit-Migration, 6Release-Engineering-Team, 3releng-201516-q4: Get early adopters using Differential - https://phabricator.wikimedia.org/T129301#2101713 (10greg) [01:00:10] 6Release-Engineering-Team, 3releng-201516-q4: [keyresult] Release MW 1.27 - https://phabricator.wikimedia.org/T129303#2101715 (10greg) [01:02:50] 5Gerrit-Migration, 6Release-Engineering-Team, 3releng-201516-q4: Get early adopters using Differential - https://phabricator.wikimedia.org/T129301#2101729 (10Paladox) Can you accept your own reviews just wondering since doing that is useful sometimes. [01:04:36] 5Gerrit-Migration, 6Release-Engineering-Team, 3releng-201516-q4: Get early adopters using Differential - https://phabricator.wikimedia.org/T129301#2101730 (10greg) @Paladox: Let's not clutter this task with general Differential questions, please. And yes, you can. :) [01:04:55] 5Gerrit-Migration, 6Release-Engineering-Team, 3releng-201516-q4: [keyresult] Get early adopters using Differential - https://phabricator.wikimedia.org/T129301#2101731 (10greg) [01:05:34] 5Gerrit-Migration, 10Differential: Find way to use Differential with plain git (i.e.: without requiring arc) - https://phabricator.wikimedia.org/T127#1791 (10Paladox) Can the priority be changed since we're moving to phabricator differential soon. [01:17:04] 5Gerrit-Migration, 10Differential: Find way to use Differential with plain git (i.e.: without requiring arc) - https://phabricator.wikimedia.org/T127#2101741 (10greg) A couple things: 1) The session at the Developer Summit (WikiDev16) included discussing this issue and the general consensus was that this isn'... [02:55:26] 10MediaWiki-Codesniffer: Fix the SpaceyParenthesisSniff can't fix wffoo(__$a, $b_) and wffoo(__$a__); - https://phabricator.wikimedia.org/T129231#2101910 (10Lethexie) [03:07:24] 10MediaWiki-Codesniffer: Fix the SpaceyParenthesisSniff can't fix wffoo(__$a, $b_) and wffoo(__$a__); - https://phabricator.wikimedia.org/T129231#2101917 (10Lethexie) @Aklapper Sorry,I input two space acturally. I don't know the reason why it just display single space :P Oh,thanks for you reminder of Gerrit ,I... [03:13:34] Project browsertests-MultimediaViewer-en.wikipedia.beta.wmflabs.org-linux-firefox-sauce build #903: 04FAILURE in 23 min: https://integration.wikimedia.org/ci/job/browsertests-MultimediaViewer-en.wikipedia.beta.wmflabs.org-linux-firefox-sauce/903/ [03:14:43] Project browsertests-MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-firefox-sauce build #1003: 04FAILURE in 32 min: https://integration.wikimedia.org/ci/job/browsertests-MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-firefox-sauce/1003/ [03:31:44] RECOVERY - Puppet failure on deployment-tmh01 is OK: OK: Less than 1.00% above the threshold [0.0] [04:07:05] 10Beta-Cluster-Infrastructure, 10VisualEditor, 10VisualEditor-MediaWiki: Beta Cluster threw a 'internal_api_error_DBConnectionError' at me - https://phabricator.wikimedia.org/T129192#2101951 (10AlexMonk-WMF) I don't think there's anything for VE to do here. Can you still reproduce the issue with beta? [04:11:10] 10MediaWiki-Codesniffer: Fix the bug of SpaceyParenthesisSniff - https://phabricator.wikimedia.org/T129231#2101952 (10Lethexie) [04:39:12] (03PS2) 10Lethexie: Changes to SpaceyParenthesisSniff [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/275796 (https://phabricator.wikimedia.org/T129231) [04:46:46] RECOVERY - Puppet failure on deployment-mediawiki01 is OK: OK: Less than 1.00% above the threshold [0.0] [04:55:28] (03PS1) 10Tim Starling: Add a script to rebase changes from prior phpcs standards [tools/code-utils] - 10https://gerrit.wikimedia.org/r/276095 [05:08:00] 10MediaWiki-Codesniffer: Add sniff to keep single space between closing parenthesis and opening brace of some statement - https://phabricator.wikimedia.org/T129313#2102043 (10Lethexie) [05:10:13] 10MediaWiki-Codesniffer: Add sniff to keep single space between closing parenthesis and opening brace of some statement - https://phabricator.wikimedia.org/T129313#2102055 (10Lethexie) [05:11:22] RECOVERY - Puppet failure on mira is OK: OK: Less than 1.00% above the threshold [0.0] [05:11:22] RECOVERY - Puppet failure on deployment-jobrunner01 is OK: OK: Less than 1.00% above the threshold [0.0] [05:12:13] 10MediaWiki-Codesniffer: Add sniff to keep single space between closing parenthesis and opening brace of some statement - https://phabricator.wikimedia.org/T129313#2102056 (10polybuildr) [05:12:16] 10MediaWiki-Codesniffer: Codesniffer allows missing space before opening brace - https://phabricator.wikimedia.org/T126976#2102057 (10polybuildr) [05:14:07] (03PS2) 10Lethexie: Add the SpaceBeforeControlStructureBraceSniff [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/275747 [07:33:04] (03PS3) 10Lethexie: Add the SpaceBeforeControlStructureBraceSniff [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/275747 (https://phabricator.wikimedia.org/T89682) [07:39:36] (03PS4) 10Lethexie: Add the SpaceBeforeControlStructureBraceSniff [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/275747 (https://phabricator.wikimedia.org/T89682) [07:41:03] (03PS3) 10Lethexie: Changes to SpaceyParenthesisSniff [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/275796 (https://phabricator.wikimedia.org/T89682) [07:43:15] 10MediaWiki-Codesniffer, 10Possible-Tech-Projects, 13Patch-For-Review: Improving static analysis tools for MediaWiki - https://phabricator.wikimedia.org/T89682#2102122 (10Lethexie) @Aklapper : Thanks :) [07:53:40] 10MediaWiki-Codesniffer: SpaceyParenthesis bug - https://phabricator.wikimedia.org/T116519#2102127 (10Lethexie) [07:53:42] 10MediaWiki-Codesniffer: Fix the bug of SpaceyParenthesisSniff - https://phabricator.wikimedia.org/T129231#2102128 (10Lethexie) [08:23:14] Project beta-mediawiki-config-update-eqiad build #4446: 04FAILURE in 1.6 sec: https://integration.wikimedia.org/ci/job/beta-mediawiki-config-update-eqiad/4446/ [08:39:43] (03PS1) 10Lethexie: Changes in SpaceAfterControlStructureSniff.php [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/276110 (https://phabricator.wikimedia.org/T89682) [09:01:33] (03PS1) 10Paladox: [FlaggedRevs] Add jshint to check: [integration/config] - 10https://gerrit.wikimedia.org/r/276114 [09:05:00] 10Browser-Tests-Infrastructure, 10MediaWiki-extensions-MultimediaViewer, 5WMF-deploy-2016-03-01_(1.27.0-wmf.15), 5WMF-deploy-2016-03-08_(1.27.0-wmf.16): browsertests-MultimediaViewer-mediawiki.org-linux-firefox-sauce fails with "757: unexpected token" - https://phabricator.wikimedia.org/T128079#2102222 (10z... [09:05:14] 5Continuous-Integration-Scaling: Diskimage fail on xvfb/systemd - https://phabricator.wikimedia.org/T129320#2102224 (10hashar) [09:05:29] 10Browser-Tests-Infrastructure, 13Patch-For-Review: Simplify creating of Jenkins jobs for running browser tests daily - https://phabricator.wikimedia.org/T128190#2066598 (10zeljkofilipin) [09:05:31] 10Browser-Tests-Infrastructure, 10MediaWiki-extensions-MultimediaViewer, 5WMF-deploy-2016-03-01_(1.27.0-wmf.15), 5WMF-deploy-2016-03-08_(1.27.0-wmf.16): browsertests-MultimediaViewer-mediawiki.org-linux-firefox-sauce fails with "757: unexpected token" - https://phabricator.wikimedia.org/T128079#2102236 (10z... [09:06:32] 5Continuous-Integration-Scaling: Diskimage fail on xvfb/systemd - https://phabricator.wikimedia.org/T129320#2102238 (10hashar) [09:07:56] Yippee, build fixed! [09:07:57] Project browsertests-RelatedArticles-en.m.wikipedia.beta.wmflabs.org-linux-chrome-sauce build #69: 09FIXED in 54 sec: https://integration.wikimedia.org/ci/job/browsertests-RelatedArticles-en.m.wikipedia.beta.wmflabs.org-linux-chrome-sauce/69/ [09:17:12] hashar: Looks like we found why it wasent starting (https://phabricator.wikimedia.org/T129320) or it could be something else. [09:19:53] (03PS1) 10Paladox: [FundraiserLandingPage] Add npm test [integration/config] - 10https://gerrit.wikimedia.org/r/276117 [09:22:17] 5Continuous-Integration-Scaling: Diskimage fail on xvfb/systemd - https://phabricator.wikimedia.org/T129320#2102268 (10hashar) The call chain is: * `xvfb` class * `base::service_unit` * pick_initscript( $::initsystem ) initsystem is a fact provided by `modules/base/lib/facter/initsystem.rb` which detects it by... [09:24:35] (03Abandoned) 10Hashar: Add global-set-env-npm script [integration/jenkins] - 10https://gerrit.wikimedia.org/r/275932 (owner: 10Paladox) [09:28:39] (03PS1) 10Paladox: [FundraisingTranslateWorkflow] Move jsonlint to check: and remove jshint [integration/config] - 10https://gerrit.wikimedia.org/r/276119 [09:47:18] Project browsertests-Flow-en.wikipedia.beta.wmflabs.org-linux-chrome-monobook-sauce build #741: 04FAILURE in 26 min: https://integration.wikimedia.org/ci/job/browsertests-Flow-en.wikipedia.beta.wmflabs.org-linux-chrome-monobook-sauce/741/ [10:15:28] 5Continuous-Integration-Scaling: Diskimage fail on xvfb/systemd - https://phabricator.wikimedia.org/T129320#2102378 (10hashar) I have made the build script to `export FACTER_initsystem='systemd'` and that got me past the error: ``` Notice: /Stage[main]/Xvfb/Base::Service_unit[xvfb]/File[/lib/systemd/system/xvfb.... [10:18:03] hashar: Npm failing at https://integration.wikimedia.org/ci/job/mediawiki-extensions-qunit/34252/console [10:18:12] with [10:18:12] 10:17:18 npm ERR! Linux 3.13.0-77-generic [10:18:12] 10:17:18 npm ERR! argv "node" "/usr/local/bin/npm" "install" [10:18:12] 10:17:18 npm ERR! node v0.10.25 [10:18:12] 10:17:18 npm ERR! npm v2.14.12 [10:18:13] 10:17:18 npm ERR! code MODULE_NOT_FOUND [10:18:15] 10:17:18 [10:18:17] 10:17:18 npm ERR! Cannot find module '/usr/local/lib/node_modules/npm/lib/unbuild.js' [10:18:19] 10:17:18 npm ERR! [10:18:21] 10:17:18 npm ERR! If you need help, you may report this error at: [10:18:25] 10:17:18 npm ERR! [10:18:27] 10:17:18 npm ERR! Linux 3.13.0-77-generic [10:18:29] 10:17:18 npm ERR! argv "node" "/usr/local/bin/npm" "install" [10:18:31] 10:17:18 npm ERR! node v0.10.25 [10:18:33] 10:17:18 npm ERR! npm v2.14.12 [10:18:35] 10:17:18 npm ERR! code MODULE_NOT_FOUND [10:18:37] 10:17:18 [10:18:39] 10:17:18 npm ERR! Cannot find module '/usr/local/lib/node_modules/npm/lib/unbuild.js' [10:20:19] paladox: fill it as a task and mention the gerrit change that triggered the build [10:20:24] paladox: busy this morning sorry [10:20:45] hashar: Ok. i will try one more time to see if it was a one time error before filling a task. [10:21:12] no clue what code MODULE_NOT_FOUND means [10:22:34] hashar: Oh ok. [10:25:28] 10Browser-Tests-Infrastructure, 10MobileFrontend: Net::ReadTimeout in MobileFrontend browser tests - https://phabricator.wikimedia.org/T129328#2102415 (10zeljkofilipin) [10:25:46] Works now so no need to fill a task. [10:26:10] (03PS1) 10Hashar: dib: override initsystem fact [integration/config] - 10https://gerrit.wikimedia.org/r/276128 (https://phabricator.wikimedia.org/T129320) [10:26:26] 10Browser-Tests-Infrastructure, 10Reading-Web, 13Patch-For-Review, 5WMF-deploy-2016-03-01_(1.27.0-wmf.15): Fix MobileFrontend scenarios that fail at en.wikipedia.beta.wmflabs.org or do not run them daily - https://phabricator.wikimedia.org/T94156#2102433 (10zeljkofilipin) [10:28:58] 5Continuous-Integration-Scaling, 13Patch-For-Review: Diskimage fail on xvfb/systemd - https://phabricator.wikimedia.org/T129320#2102437 (10hashar) [10:29:00] 10Continuous-Integration-Infrastructure, 5Continuous-Integration-Scaling, 10OOjs, 13Patch-For-Review, 7WorkType-NewFunctionality: Provide the Chrome binary on the nodepool servers so OOjs, VE core can use it in testing - https://phabricator.wikimedia.org/T128090#2102436 (10hashar) [10:29:19] 10Continuous-Integration-Infrastructure, 5Continuous-Integration-Scaling, 10OOjs, 13Patch-For-Review, 7WorkType-NewFunctionality: Provide the Chrome binary on the nodepool servers so OOjs, VE core can use it in testing - https://phabricator.wikimedia.org/T128090#2063621 (10hashar) Image build could not p... [10:29:43] !log Nodepool: created new image and refreshing snapshot in attempt to get Xvfb running T129320 T128090 [10:29:45] T129320: Diskimage fail on xvfb/systemd - https://phabricator.wikimedia.org/T129320 [10:29:45] T128090: Provide the Chrome binary on the nodepool servers so OOjs, VE core can use it in testing - https://phabricator.wikimedia.org/T128090 [10:29:46] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL, Master [10:30:42] jzerebecki: I think https://gerrit.wikimedia.org/r/#/c/275435/ is the only thing left to do to resolve https://phabricator.wikimedia.org/T128065 [10:31:45] (03CR) 10Paladox: [C: 031] dib: override initsystem fact [integration/config] - 10https://gerrit.wikimedia.org/r/276128 (https://phabricator.wikimedia.org/T129320) (owner: 10Hashar) [10:35:46] Yippee, build fixed! [10:35:46] Project browsertests-Flow-en.wikipedia.beta.wmflabs.org-linux-chrome-monobook-sauce build #742: 09FIXED in 25 min: https://integration.wikimedia.org/ci/job/browsertests-Flow-en.wikipedia.beta.wmflabs.org-linux-chrome-monobook-sauce/742/ [10:36:53] 10Browser-Tests-Infrastructure, 10MediaWiki-extensions-RelatedArticles, 13Patch-For-Review, 5WMF-deploy-2016-03-15_(1.27.0-wmf.17): browsertests-RelatedArticles-en.m.wikipedia.beta.wmflabs.org-linux-chrome-sauce job fails with: unknown environment `beta` (M... - https://phabricator.wikimedia.org/T128084#2102450 [10:36:55] 10Browser-Tests-Infrastructure, 5Release-Engineering-Epics, 7Epic, 13Patch-For-Review, 7Tracking: Fix scenarios that fail at en.wikipedia.beta.wmflabs.org or do not run them daily - https://phabricator.wikimedia.org/T94150#2102451 (10zeljkofilipin) [10:37:17] (03PS1) 10Paladox: [Gather] Add jshint and jsonlint to check: [integration/config] - 10https://gerrit.wikimedia.org/r/276129 [10:37:39] 10Continuous-Integration-Infrastructure, 5Continuous-Integration-Scaling, 10OOjs, 13Patch-For-Review, 7WorkType-NewFunctionality: Provide the Chrome binary on the nodepool servers so OOjs, VE core can use it in testing - https://phabricator.wikimedia.org/T128090#2102455 (10hashar) [10:39:22] 10Browser-Tests-Infrastructure, 10MobileFrontend: Net::ReadTimeout in MobileFrontend browser tests - https://phabricator.wikimedia.org/T129328#2102457 (10zeljkofilipin) p:5Triage>3Normal [10:40:17] 10Browser-Tests-Infrastructure, 5Release-Engineering-Epics, 7Epic, 13Patch-For-Review, 7Tracking: Fix scenarios that fail at en.wikipedia.beta.wmflabs.org or do not run them daily - https://phabricator.wikimedia.org/T94150#2102459 (10zeljkofilipin) [10:46:05] Project beta-scap-eqiad build #92977: 04FAILURE in 1 min 25 sec: https://integration.wikimedia.org/ci/job/beta-scap-eqiad/92977/ [10:47:52] (03CR) 10Hashar: [C: 032] dib: override initsystem fact [integration/config] - 10https://gerrit.wikimedia.org/r/276128 (https://phabricator.wikimedia.org/T129320) (owner: 10Hashar) [10:48:55] 10scap, 10Scap3 (Scap3-MediaWiki-MVP): scap3 configuration selection is confusing - https://phabricator.wikimedia.org/T120410#2102474 (10mmodell) [10:48:57] 10scap, 13Patch-For-Review, 10Scap3 (Scap3-MediaWiki-MVP): Parameterize git_server in ops/puppet for /etc/scap.cfg - https://phabricator.wikimedia.org/T126259#2102473 (10mmodell) 5Open>3Resolved [10:49:13] (03Merged) 10jenkins-bot: dib: override initsystem fact [integration/config] - 10https://gerrit.wikimedia.org/r/276128 (https://phabricator.wikimedia.org/T129320) (owner: 10Hashar) [10:52:30] !log Image ci-jessie-wikimedia-1457520493 in wmflabs-eqiad is ready [10:52:33] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL, Master [10:52:47] 10scap, 10Scap3 (Scap3-MediaWiki-MVP): Parameterize git_server in ops/puppet for /etc/scap.cfg - https://phabricator.wikimedia.org/T126259#2102478 (10mmodell) [10:54:18] 5Gerrit-Migration, 10Differential: Find way to use Differential with plain git (i.e.: without requiring arc) - https://phabricator.wikimedia.org/T127#2102479 (10Aklapper) [offtopic] >>! In T127#2101732, @Paladox wrote: > Can the priority be changed since we're moving to phabricator differential soon. @Paladox... [10:55:35] Yippee, build fixed! [10:55:36] Project browsertests-MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-firefox-sauce build #1004: 09FIXED in 35 min: https://integration.wikimedia.org/ci/job/browsertests-MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-firefox-sauce/1004/ [10:56:02] Yippee, build fixed! [10:56:02] 6Release-Engineering-Team, 3releng-201516-q4, 5MW-1.27-release, 5Release: [keyresult] Release MW 1.27 - https://phabricator.wikimedia.org/T129303#2102484 (10Aklapper) [10:56:02] Project beta-scap-eqiad build #92978: 09FIXED in 1 min 21 sec: https://integration.wikimedia.org/ci/job/beta-scap-eqiad/92978/ [10:57:25] 10scap, 10Scap3 (Scap3-MediaWiki-MVP), 7WorkType-NewFunctionality: Remove apache dependency from scap3 deployment host - https://phabricator.wikimedia.org/T116630#2102489 (10mmodell) [10:57:27] 3Scap3, 10scap, 7WorkType-NewFunctionality: [Spike] Benchmark built-in HTTP server options for scap3 fanout - https://phabricator.wikimedia.org/T127733#2052244 (10mmodell) 5Open>3Resolved gpack seems to meet all of our needs. [11:23:54] 5Gerrit-Migration, 10Differential, 7Documentation: Document best practices to amend a change written by another contributor - https://phabricator.wikimedia.org/T121751#2102523 (10Ricordisamoa) >>! In T121751#2095410, @mmodell wrote: > Why not just comment on the diff and let the author fix their mistake? So... [11:55:30] (03PS1) 10Paladox: [GettingStarted] Move jshint to check: [integration/config] - 10https://gerrit.wikimedia.org/r/276142 [12:58:39] 10Continuous-Integration-Infrastructure, 5Continuous-Integration-Scaling, 6Operations, 7WorkType-NewFunctionality: Xvfb service does not start on Nodepool instances - https://phabricator.wikimedia.org/T129345#2102862 (10hashar) [13:02:49] 10Continuous-Integration-Infrastructure, 5Continuous-Integration-Scaling, 6Operations, 7WorkType-NewFunctionality: Xvfb service does not start on Nodepool instances - https://phabricator.wikimedia.org/T129345#2102878 (10hashar) Indeed after rebooting integration-slave-jessie1001: ``` $ systemctl status xvf... [13:04:17] !log cherrypicked patch to deployment-prep which provides a systemd unit for logstash [13:04:21] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL, Master [13:06:31] commute time [13:46:39] 10Continuous-Integration-Infrastructure: mediawiki jobs fail intermittently with "mw-teardown-mysql.sh: Can't revoke all privileges" - https://phabricator.wikimedia.org/T126699#2102948 (10Aklapper) @JanZerebecki: Any progress / news to share? (Asking as you are set as assignee and this has "Unbreak now" priority) [14:09:41] 10Continuous-Integration-Infrastructure, 5Continuous-Integration-Scaling, 6Operations, 7WorkType-NewFunctionality: Xvfb service does not start on Nodepool instances - https://phabricator.wikimedia.org/T129345#2103037 (10hashar) And the xvfb puppet stanza in modules/xvfb/manifests/init.pp is: ``` lang=ruby... [14:13:59] 10Continuous-Integration-Infrastructure: mediawiki jobs fail intermittently with "mw-teardown-mysql.sh: Can't revoke all privileges" - https://phabricator.wikimedia.org/T126699#2103038 (10hashar) p:5Unbreak!>3High That is supposed to be fixed by https://gerrit.wikimedia.org/r/#/c/204528/ I recently rebased i... [14:29:45] 10Continuous-Integration-Infrastructure, 5Continuous-Integration-Scaling, 6Operations, 7WorkType-NewFunctionality: Xvfb service does not start on Nodepool instances - https://phabricator.wikimedia.org/T129345#2103087 (10hashar) I have dig in the systemctl documentation and the unit needs to be enabled: ```... [14:36:46] 10Continuous-Integration-Infrastructure, 5Continuous-Integration-Scaling, 6Operations, 7WorkType-NewFunctionality: Xvfb service does not start on Nodepool instances - https://phabricator.wikimedia.org/T129345#2103101 (10hashar) Now that I have manually enabled the unit, it is started on boot (was not the c... [14:57:04] !log Rebuilding snapshot image to get Xvfb enabled at boot time T129345 [14:57:05] T129345: Xvfb service does not start on Nodepool instances - https://phabricator.wikimedia.org/T129345 [14:57:07] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL, Master [14:59:36] 10Continuous-Integration-Infrastructure, 5Continuous-Integration-Scaling, 6Operations, 13Patch-For-Review, 7WorkType-NewFunctionality: Xvfb service does not start on Nodepool instances - https://phabricator.wikimedia.org/T129345#2103172 (10hashar) Now puppet seems to enable xvfb properly: ``` Debug: Exec... [14:59:54] !log Image ci-jessie-wikimedia-1457535250 in wmflabs-eqiad is ready T129345 [14:59:55] T129345: Xvfb service does not start on Nodepool instances - https://phabricator.wikimedia.org/T129345 [14:59:57] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL, Master [15:08:45] 10Continuous-Integration-Infrastructure, 5Continuous-Integration-Scaling, 10OOjs, 13Patch-For-Review, 7WorkType-NewFunctionality: Provide the Chrome binary on the nodepool servers so OOjs, VE core can use it in testing - https://phabricator.wikimedia.org/T128090#2103197 (10hashar) [15:08:47] 10Continuous-Integration-Infrastructure, 5Continuous-Integration-Scaling, 6Operations, 13Patch-For-Review, 7WorkType-NewFunctionality: Xvfb service does not start on Nodepool instances - https://phabricator.wikimedia.org/T129345#2103195 (10hashar) 5Open>3Resolved ``` jenkins@ci-jessie-wikimedia-47306... [15:09:58] 10Continuous-Integration-Infrastructure, 5Continuous-Integration-Scaling, 10OOjs, 13Patch-For-Review, 7WorkType-NewFunctionality: Provide the Chrome binary on the nodepool servers so OOjs, VE core can use it in testing - https://phabricator.wikimedia.org/T128090#2063621 (10hashar) **status** * Xvfb is r... [15:10:56] hashar: Thanks it works now. [15:10:57] Yay [15:11:01] https://integration.wikimedia.org/ci/job/npm-node-4.3/265/console [15:11:30] hashar: But we need to create a seperate npm test for VisualEditor like we have already but for the newer npm version. [15:11:40] Since it needs to do git submodules updates. [15:11:46] :) [15:12:18] 10Continuous-Integration-Infrastructure, 5Continuous-Integration-Scaling, 10OOjs, 13Patch-For-Review, 7WorkType-NewFunctionality: Provide the Chrome binary on the nodepool servers so OOjs, VE core can use it in testing - https://phabricator.wikimedia.org/T128090#2103205 (10Paladox) It works now see https... [15:13:27] hashar: See https://gerrit.wikimedia.org/r/#/c/274441/ for visualeditor please. [15:23:23] James_F: The chromium build is now avalible and visualeditor now passes see https://integration.wikimedia.org/ci/job/npm-node-4.3/265/console [15:23:24] please. [15:23:37] hashar fixed it all up. [15:23:52] paladox: please comment on the task :) [15:23:59] i am in audios for rest of day sorry! [15:24:10] hashar: Ok. sorry. [15:39:22] 10Continuous-Integration-Infrastructure, 10Scap3 (scap3-adoption): Migrate Zuul deployment of integration/config to scap deploy - https://phabricator.wikimedia.org/T129357#2103265 (10hashar) [15:45:20] hashar: I want to sent a brief message to wikitech letting people know about Job output sections. (I added a few more last week) [15:45:28] hashar: You created them originally, right? [15:52:31] 10Continuous-Integration-Infrastructure, 5Continuous-Integration-Scaling, 10VisualEditor, 7WorkType-NewFunctionality: Migrate VisualEditor core npm CI job to Nodepool - https://phabricator.wikimedia.org/T128093#2103313 (10Paladox) Waiting for https://gerrit.wikimedia.org/r/#/c/274441/ to be merged so Visua... [15:54:55] 10Continuous-Integration-Infrastructure, 5Continuous-Integration-Scaling, 10VisualEditor, 7WorkType-NewFunctionality: Migrate VisualEditor core npm CI job to Nodepool - https://phabricator.wikimedia.org/T128093#2103327 (10Krinkle) Per https://phabricator.wikimedia.org/T119143#2026030, npm still must still... [15:56:24] Krinkle: yup as an experiment with someone I can't remember [15:56:31] (03CR) 10Krinkle: "Should these be generic jobs or created per repository? I don't know what the best practice is for nodepool at the moment." [integration/config] - 10https://gerrit.wikimedia.org/r/274441 (owner: 10Paladox) [15:56:42] hashar: k. Just making sure. npm still needs upgrade. [15:56:55] grunt-cli isn't needed, but npm does need to be upgraded. [15:57:23] The current version is probably a remnant of something. It's definitely not what Node 4.3 ships. [15:57:29] (03CR) 10Paladox: "Well for visualeditor it should be its own test since it needs git submodules updates. It passes but wont test all files without this." [integration/config] - 10https://gerrit.wikimedia.org/r/274441 (owner: 10Paladox) [15:59:07] PROBLEM - SSH on deployment-conftool is CRITICAL: Server answer [15:59:07] (03CR) 10Krinkle: "Depends. We might be able to do a proper git-clone without exclusion of submodules. Depends on whether nodepool has a git cache. I think i" [integration/config] - 10https://gerrit.wikimedia.org/r/274441 (owner: 10Paladox) [15:59:32] Krinkle: VisualEditor passes but skips the modules that would other wise have been tested by doing git submodules update. VisualEditor has its own npm test so im setting up the new one so it can run similar but on jessie. [15:59:57] Krinkle: on Jessie the node.deb package does not provide npm [16:00:10] Krinkle: one has to install the npm.deb package [16:00:16] we had nodejs4.3 backported to Jessie [16:00:38] but we are stuck with the npm.deb at whatever version was available when Jessie got cut [16:00:42] paladox: I know, but the only reason we have a special VE job now is because the generic one doesn't do submodules because that is slow because we don't have a git cache. However in nodepool there is git cache, which means we can have the generic job do submodules (right, hashar ?) [16:00:45] I think there is a task to have the npm package updated [16:01:12] hashar: Alternatively, we have a puppet role for javascript. We can reduce it to just npm [16:01:19] It's simple enough to manually upgrade npm [16:01:20] yeah there is a few repositories in /srv/git/ to act as cache.They are bare git repositories [16:01:27] will have to add a few more in the instances [16:01:41] and figure out how to have git submodule update --init to use the cached ones [16:01:42] hashar: Ah, we're not providing all git repos wholesale yet [16:01:47] nop [16:01:48] Krinkle: So i can update the npm test with 4.3 to use git submodules. [16:01:54] Project browsertests-Wikidata-WikidataTests-linux-firefox-T128097 build #1: 04FAILURE in 9 min 52 sec: https://integration.wikimedia.org/ci/job/browsertests-Wikidata-WikidataTests-linux-firefox-T128097/1/ [16:02:07] paladox: No, not yet. This is more complicated than that. [16:02:11] it is too large, would cause the image to be too big (it is 1GBytes right now, iirc including most repos would end up with an 8GBytes image) [16:02:24] but we can just included the ones that have the most traffic [16:02:50] eg MobileFrontend oo* VisualEditor ec [16:02:59] most popular or larges ones [16:03:21] hashar: disk space is cheap though? Even 20GB is "small" in labs. [16:03:32] if a large repo has only one change per month, I would not bother including it in the cache [16:03:41] the patch can wait a minute or two for the clone to complete [16:03:49] mediawiki/core is definitely ultra fast now [16:03:49] That means nodepool won't be viable for those repos, since it currentl has workspace cache. [16:04:00] Krinkle: Ok. and hashar ok. [16:04:01] Nodepool doens't provide much benefit for end-users, so if it isn't faster, it might not be useful for them. [16:04:11] https://integration.wikimedia.org/ci/job/mediawiki-core-npm-node-4.3/ [16:04:16] Yeah, saw that. Nice one :) [16:04:27] ~ 8 seconds [16:04:39] including refresh from Gerrit [16:04:49] Krinkle hashar we can do something that can only use git submodules if it detects the repo we want to use it for reduces chances of all repos using the git cache. [16:04:52] hashar: https://gerrit.wikimedia.org/r/#/c/206074/ [16:05:40] the reason zuul-cloner does not process submodules is that upstream do not use them at all [16:05:51] and on our setup I wasn't sure when we wanted to use submodules or not [16:06:40] Krinkle: yup sorry about that cache builder .:-/ [16:07:39] the equivalent is https://github.com/wikimedia/integration-config/blob/master/dib/elements/wikimedia/root.d/09-mirror-gerrit-repos [16:07:57] which is a shell script used by the utility that build the CI image [16:08:00] hashar and Krinkle im not sure what we want to do with VisualEditor then. Im not sure if we want to enable git submodules or not. But for now it can be switched it just wont test the modules that would have been provided by the submodule. [16:08:05] it is very rough and lacks a nice configuration file [16:08:18] currently one has to REPOS=('mediawiki/core.git' 'operations/puppet.git' 'integration/config.git') [16:08:23] paladox: If it doesn't have submodules it is not worth switching. Has no benefit. [16:08:31] Newer is not always better. [16:08:39] Krinkle ok. [16:09:15] Krinkle it uses submodules so im not sure what we want to do then. [16:09:46] 5Gerrit-Migration, 10Differential, 7Documentation: Document best practices to amend a change written by another contributor - https://phabricator.wikimedia.org/T121751#2103356 (10Dzahn) +100 to what @Ricordisamoa said above. pleeeeeassse let us keep working with multiple people on patches like we can do with... [16:10:16] hashar: You might be able to re-use some logic from https://gerrit.wikimedia.org/r/#/c/206074/6/bin/git-cache-update.php - I tested it repeatedly in labs to make sure it is resilient against cases where repos change a lot so the cache doesn't get corrupted. [16:10:21] Which is very easy to do in git [16:10:25] (to get it corrupted) [16:11:01] It's mostly there I see. [16:11:16] hashar: So would it work to add essentially all public repos? [16:11:19] Or is there reason not to? [16:11:27] I even gc / prune / repack to reduce it [16:11:43] the concern is the image size [16:12:05] whenever an instance boot on the labs infrastructure, the images is downloaded from the image service and kept around in a cache [16:12:14] so that produce some traffic on the labs infra [16:12:27] and add some disk consumption on the servers hosting instances [16:12:29] hashar: Yes maybe we would wont to veto each repo that wants to save it to the cache like use and if statement that only allows the repos we choose to store in the cache. [16:12:42] might not be too much of concern, but for now I play it nice and try to get a small image size [16:12:52] I havent revisited the list in ages anyway [16:13:22] I am going to migrate a lot of npm jobs soonish (finally). Some repos will probably benefit from being in the cache [16:13:38] hashar: Right. Well, in that case we'll want to be careful about adopting nodepool too widely as it should be a perf improvement, not just an item on a checklist to get done :) [16:14:00] paladox: the cache is already populated from a whitelist (look for REPO in https://github.com/wikimedia/integration-config/blob/master/dib/elements/wikimedia/root.d/09-mirror-gerrit-repos ) [16:14:18] Anything that doens't use Zuul and doesn't have submodules can get switched easily though, since that doesn't need git cache and uses git clone shallow right now in labs [16:14:21] so that'll be fast either way [16:14:27] my aim is to get rid of the permanent slaves. With the Precise ones being the first target [16:14:37] yup [16:14:39] Yeah, but if we want to migrate all, it needs to be suitable for all :) [16:14:43] Krinkle thanks. [16:15:10] and given on nodepool the workspace is empty, instead of git clone shallow, we could just git archive from the Zuul merger [16:15:21] blame "instant" population [16:15:41] that means git commands won't work, which some scripts depend on [16:15:43] that would work for jobs having a single repo [16:15:48] git clone --depth=1 is same speed as archive mostly? [16:15:57] I havent compared [16:16:02] OUr current slaves also have empty workspaces for those jobs [16:16:03] it is broken on Precise for sure [16:16:12] but who care about Precise ? ;-} [16:16:32] hashar: Yep [16:16:35] Anything using git-shallow-clone right now (single repo jobs) has empty workspace and no Zuul. [16:16:58] I havent thought about tests expecting the workspace to be a git repo. That dismiss "git archive" thus. Point taken! [16:17:07] oh [16:17:22] another thing, I don't think the Jenkins git plugin supports --reference and --shallow [16:17:30] probably never make sense anyway [16:17:39] It supports depth (=shallow), we use that [16:18:21] https://github.com/wikimedia/integration-config/blob/0247a90563388732b54b30e921cfe856bde0c247/jjb/defaults.yaml#L84-L91 [16:18:32] yes [16:18:43] but not in conjonction with --reference [16:18:49] but I dont think it makes any sense anyway [16:19:26] k [16:19:34] anyway I think what is left is to migrate the npm jobs for mediawiki/extensions/* [16:19:36] hashar and Krinkle i doint think VisualEditor git submodules anyways. See https://integration.wikimedia.org/ci/job/npm/57386/consoleFull which passes but has the same kind of view as https://integration.wikimedia.org/ci/job/npm-node-4.3/265/console [16:20:00] hashar: Yeh i think there are half done now or nearly half done. [16:20:02] paladox: Thats the wrong repo [16:20:13] paladox: That's VisualEditor/VisualEditor, not mediawiki/extensions/VisualEditor [16:20:20] VisualEditor has no submodules mext-VisualEditor does. [16:20:25] mext-VisualEditor submodule = VisualEditor [16:20:27] yeah we have two VisualEditor repos :) [16:20:33] and the npm-node-4.3 is different from the npm one [16:20:37] Krinkle no thats the right repo see https://gerrit.wikimedia.org/r/#/c/275903/ [16:20:39] please. [16:20:44] I made the npm-node-4.3 (simpler) [16:20:47] No, it isn't. [16:20:56] https://gerrit.wikimedia.org/r/#/c/275903/ Paladox VisualEditor/VisualEditor [16:21:10] anyway I need a break before my next meeting 10 minutes from now [16:21:20] Okay, enjoy your break : [16:21:43] Krinkle oh your talking about mediawiki/extensions oh sorry . [16:21:59] VisualEditor/VisualEditor only needs simple single-repo jobs [16:22:03] no submodule problems, just generic jobs [16:22:25] mediawiki/extensions/VisualEditor is a more one because it has lib/ve submodule [16:22:28] Anyway [16:22:28] o/ [16:22:56] Krinkle ok. Sorry about that. We can switch the VisualEditor/VisualEditor repo. [16:23:12] we can keep a specific job for mediawiki/extensions/VisualEditor [16:23:36] break time [16:27:20] !log Removed cherry-pick of https://gerrit.wikimedia.org/r/#/c/274696 ; manually cleaned up systemd unit and restarted logstash on deployment-logstash2 [16:27:23] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL, Master [16:30:44] 5Gerrit-Migration, 10Differential, 7Documentation: Document best practices to amend a change written by another contributor - https://phabricator.wikimedia.org/T121751#2103397 (10greg) See upstream's https://secure.phabricator.com/T6008 Evan said: >>! In T6008#74784, @epriestley wrote: > Or, put another way... [16:32:34] Krinkle: Ok. [16:32:40] anybody else unable to `vagrant provision` today? ( hhvm-fss : Depends: hhvm-api-20150212 but it is not installable ) [16:33:39] stephanebisson: I haven't tried today, but I know that _joe_ was working on a new hhvm build recently. That could be the root cause [16:34:51] stephanebisson: confirmed that the hhvm and hhvm-fss packages don't match in apt [16:35:34] (03PS1) 10Paladox: [VisualEditor/VisualEditor] Switch npm to npm-node-4.3 [integration/config] - 10https://gerrit.wikimedia.org/r/276200 [16:35:39] Krinkle ^^ [16:35:44] bd808: thanks. any known workaround to get my vagrant back up in the short term? [16:36:44] (03PS2) 10Paladox: [VisualEditor/VisualEditor] Switch npm to npm-node-4.3 [integration/config] - 10https://gerrit.wikimedia.org/r/276200 (https://phabricator.wikimedia.org/T128093) [16:37:30] stephanebisson: Take hhvm-fss out of puppet/modules/hhvm/manifests/init.pp -- I'll get a patch up for mw-vagrant [16:50:50] stephanebisson: https://phabricator.wikimedia.org/T129343 we are chasing a solution. The current HEAD seems to work for provisioning new vms [16:52:30] bd808: fantastic! [16:55:48] 5Gerrit-Migration, 10Differential, 7Documentation: Document best practices to amend a change written by another contributor - https://phabricator.wikimedia.org/T121751#2103491 (10mmodell) @greg: Are you sure you quoted/referenced the right upstream task? This task is about amending/commandeering someone els... [17:01:19] 5Gerrit-Migration, 10Differential, 7Documentation: Document best practices to amend a change written by another contributor - https://phabricator.wikimedia.org/T121751#2103522 (10mmodell) >>! In T121751#2103356, @Dzahn wrote: > +100 to what @Ricordisamoa said above. pleeeeeassse let us keep working with mult... [17:07:17] 5Gerrit-Migration, 10Differential, 7Documentation: Document best practices to amend a change written by another contributor - https://phabricator.wikimedia.org/T121751#2103541 (10Dereckson) > Also, I don't think anything prevents you from submitting a revision without commandeering... It works the same way a... [17:10:40] hashar and Krinkle does that mean we can now switch the qunit tests to npm 4.3. (I know that not always the newest is better but mediawiki/core is already using 4.3.) [17:18:37] paladox: Everything is first dependent on npm being upgraded. [17:18:44] Then we can start migrating generic npm jobs [17:18:59] Krinkle oh ok. [17:19:03] once DISPLAY, Chromium, Firefox and Xvfb work properly, we can also migrate -qunit jobs and probably everything else. [17:19:14] Krinkle chromium now works. [17:19:21] !log Manually cleaning up broken rebase in deployment-tin.deployment-prep:/srv/mediawiki-staging [17:19:24] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL, Master [17:19:53] Krinkle hashar i think spent some time last night and most of today fixing it. it should now work. Ive tested on VisualEditor and loads and works and passes. [17:20:19] Krinkle Im not sure about Binarys for Firefox but i think some said that they were on there. [17:20:32] Iceweasel is installed yes [17:21:00] Krinkle see https://integration.wikimedia.org/ci/job/npm-node-4.3/265/console please. [17:21:12] Krinkle not sure. [17:21:15] Yippee, build fixed! [17:21:16] Project beta-mediawiki-config-update-eqiad build #4452: 09FIXED in 0.89 sec: https://integration.wikimedia.org/ci/job/beta-mediawiki-config-update-eqiad/4452/ [17:21:17] We should do a test. [17:22:27] (03CR) 10Bartosz Dziewoński: "Okay…" [tools/code-utils] - 10https://gerrit.wikimedia.org/r/276095 (owner: 10Tim Starling) [17:22:51] !log Fixed https://integration.wikimedia.org/ci/job/beta-mediawiki-config-update-eqiad/4452/ [17:22:53] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL, Master [17:23:04] Krinkle im testing to see if firefox is avalible here https://gerrit.wikimedia.org/r/#/c/276208/ [17:23:43] I think we may need to make the CI jobs that update beta cluster complain on every failure so people actually notice when they break :/ [17:24:23] busted for 9 hours this time [17:24:28] bd808: :( probably [17:25:25] the repos was in a very messed up state. Not sure if somebody was trying to update the portals submodule manually or what [17:25:51] bd808: probably [17:26:01] the jenkins job is using a bad umask too. Files aren't g+w [17:26:10] yup the portals is updated manually [17:26:14] Krinkle firefox is avalible see https://integration.wikimedia.org/ci/job/npm-node-4.3/271/console please. [17:26:21] and we made the git submodule update to rebase the submodule when possible [17:26:27] tis probably terrible :-( [17:26:30] Krinkle looks like we can migrate the tests now. [17:26:32] yeah. that failed badly [17:26:39] the qa-alerts receive an email on each failure [17:26:51] the IRC notification only send on first failure / recovery iirc [17:27:00] *nod* [17:27:18] Test failied nothing to do with firefox. Firefox is avalible but most likely the tests are meant for chrome not firefox so firefox is used by other repos. [17:27:23] * bd808 returns to his regularly scheduled "OMG HHVM broke mw-vagrant" emergency [17:27:39] that is defined in the jjb/beta.yaml via the publisher "beta-irc" [17:27:42] hehe [17:27:46] gehel: where you having trouble updating the portals in Beta Cluster recently? [17:28:00] bd808: I have seen a patch that changes the location of the /extensions/ dir to no more vary on ABI version [17:28:32] hashar: yeah. we've caught up to that one. Now fighting with apt over uninstalling an old package [17:28:33] bd808: on prod hhvm.ini points to extensions/current and the hhvm upstart job would take care of pointing that "current" symlink to the proper ABI [17:28:34] PROBLEM - App Server Main HTTP Response on deployment-mediawiki02 is CRITICAL: HTTP CRITICAL: HTTP/1.1 500 Internal Server Error - 50553 bytes in 0.022 second response time [17:28:42] bd808: good luck ! ;-} [17:28:50] paladox: oojs, unicodejs, oojs-ui are all meant for Firefox [17:28:50] https://phabricator.wikimedia.org/T129343 [17:28:55] paladox: Maybe verify with one of those [17:28:58] PROBLEM - English Wikipedia Main page on beta-cluster is CRITICAL: HTTP CRITICAL: HTTP/1.1 500 Internal Server Error - 50919 bytes in 0.045 second response time [17:29:03] paladox: (one, not all) [17:29:03] uh [17:29:24] I'm not getting css/js on beta cluster [17:29:29] Krinkle ok. Well we would not be able to switch oojs since in gruntfile for that repo it uses composer which will not be avalible on nodepool. [17:29:43] time to escape! [17:30:08] 503s for uncached pages [17:30:20] PHP fatal error /srv/mediawiki/php-master/includes/GlobalFunctions.php line 169: [17:30:20] PROBLEM - English Wikipedia Main page on beta-cluster is CRITICAL [17:30:23] /srv/mediawiki/php-master/extensions/CharInsert/extension.json does not exist! [17:30:27] (03PS3) 10JanZerebecki: Disable Raita and enable Cucumber pretty formatter for browsertests-Wikidata* jobs. [integration/config] - 10https://gerrit.wikimedia.org/r/275435 (https://phabricator.wikimedia.org/T128065) (owner: 10Zfilipin) [17:30:27] Same for oojs-ui unless im wrong about oojs but defintly oojs-ui carnt be converted yet since it needs an update to its tests to push the composer command to composer. Im going to test with unicodejs [17:30:30] PROBLEM - English Wikipedia Mobile Main page on beta-cluster is CRITICAL: HTTP CRITICAL: HTTP/1.1 500 Internal Server Error - 50886 bytes in 0.049 second response time [17:32:34] PROBLEM - App Server Main HTTP Response on deployment-mediawiki01 is CRITICAL: HTTP CRITICAL: HTTP/1.1 500 Internal Server Error - 50553 bytes in 0.016 second response time [17:32:57] PROBLEM - App Server Main HTTP Response on deployment-mediawiki03 is CRITICAL: HTTP CRITICAL: HTTP/1.1 500 Internal Server Error - 50568 bytes in 0.014 second response time [17:33:51] (03CR) 10JanZerebecki: [C: 032] "Deployed to Jenkins: (['browsertests-CentralAuth-en.wikipedia.beta.wmflabs.org-linux-firefox-sauce', 'browsertests-CentralNotice-en.wikipe" [integration/config] - 10https://gerrit.wikimedia.org/r/275435 (https://phabricator.wikimedia.org/T128065) (owner: 10Zfilipin) [17:37:06] Project beta-code-update-eqiad build #95212: 04FAILURE in 4 min 6 sec: https://integration.wikimedia.org/ci/job/beta-code-update-eqiad/95212/ [17:37:41] Project browsertests-VisualEditor-en.wikipedia.beta.wmflabs.org-linux-firefox-sauce build #41: 04FAILURE in 3.2 sec: https://integration.wikimedia.org/ci/job/browsertests-VisualEditor-en.wikipedia.beta.wmflabs.org-linux-firefox-sauce/41/ [17:37:42] (03CR) 10JanZerebecki: Disable Raita and enable Cucumber pretty formatter for browsertests-Wikidata* jobs. [integration/config] - 10https://gerrit.wikimedia.org/r/275435 (https://phabricator.wikimedia.org/T128065) (owner: 10Zfilipin) [17:37:49] (03CR) 10JanZerebecki: [C: 032] Disable Raita and enable Cucumber pretty formatter for browsertests-Wikidata* jobs. [integration/config] - 10https://gerrit.wikimedia.org/r/275435 (https://phabricator.wikimedia.org/T128065) (owner: 10Zfilipin) [17:39:24] Krinkle Im testing here https://gerrit.wikimedia.org/r/#/c/276212/ [17:39:42] jzerebecki: I see that hashar is gone, do you know how to fix this? [17:39:44] https://integration.wikimedia.org/ci/view/BrowserTests/view/VisualEditor/job/browsertests-VisualEditor-en.wikipedia.beta.wmflabs.org-linux-firefox-sauce/42/console [17:39:56] requests.exceptions.HTTPError: 500 Server Error: Internal Server Error [17:40:06] looks like beta cluster problem [17:40:18] zeljkof: yes [17:40:22] https://phabricator.wikimedia.org/T129371 [17:41:00] greg-g: thanks [17:41:10] 10Beta-Cluster-Infrastructure, 7Beta-Cluster-reproducible: PHP fatal error /srv/mediawiki/php-master/includes/GlobalFunctions.php line 169: /srv/mediawiki/php-master/extensions/CharInsert/extension.json does not exist! - https://phabricator.wikimedia.org/T129371#2103718 (10Legoktm) [17:41:11] (03Merged) 10jenkins-bot: Disable Raita and enable Cucumber pretty formatter for browsertests-Wikidata* jobs. [integration/config] - 10https://gerrit.wikimedia.org/r/275435 (https://phabricator.wikimedia.org/T128065) (owner: 10Zfilipin) [17:41:32] *sigh* [17:42:28] 10scap, 10Scap3 (Scap3-MediaWiki-MVP): Scap3 needs a way to handle large binary file transport - https://phabricator.wikimedia.org/T119443#1826547 (10dduvall) a:3dduvall [17:42:37] 10Beta-Cluster-Infrastructure, 7Beta-Cluster-reproducible: PHP fatal error /srv/mediawiki/php-master/includes/GlobalFunctions.php line 169: /srv/mediawiki/php-master/extensions/CharInsert/extension.json does not exist! - https://phabricator.wikimedia.org/T129371#2103686 (10Legoktm) ``` legoktm@deployment-media... [17:43:09] Krinkle Iceweasel it passes here https://integration.wikimedia.org/ci/job/npm-node-4.3/273/console [17:43:15] :). [17:43:31] paladox: nice [17:44:10] Krinkle: Im going to upload a patch that updates the qunit tests if thats ok with you. [17:44:20] paladox: Coordinate with hashar [17:44:41] Krinkle ok. [17:44:47] Yippee, build fixed! [17:44:47] Project beta-code-update-eqiad build #95213: 09FIXED in 1 min 46 sec: https://integration.wikimedia.org/ci/job/beta-code-update-eqiad/95213/ [17:44:55] greg-g: something is probably broken with scap, no idea what though [17:45:06] greg-g: is it known that betalabs is broken? [17:45:14] greg-g: Fatal error: Uncaught exception 'Exception' with message '/srv/mediawiki/php-master/extensions/CharInsert/extension.json does not exist!' in /srv/mediawiki/php-master/includes/registration/ExtensionRegistry.php:106 [17:45:20] I will have to create a seperate qunit tests for compat reasons. And to make it easier to revert if anything breaks. [17:45:22] 10Beta-Cluster-Infrastructure, 7Beta-Cluster-reproducible: PHP fatal error /srv/mediawiki/php-master/includes/GlobalFunctions.php line 169: /srv/mediawiki/php-master/extensions/CharInsert/extension.json does not exist! - https://phabricator.wikimedia.org/T129371#2103748 (10greg) beta-code-update-eqiad is faili... [17:45:30] etonkovidova: yes, beta cluster [17:45:36] legoktm: yeah [17:45:41] greg-g: yes :) [17:45:46] https://phabricator.wikimedia.org/T129371 [17:46:42] 10Beta-Cluster-Infrastructure: Make Beta Cluster update jobs (eg: beta-scap-eqiad, beta-mediawiki-config-update-eqiad etc) complain in IRC on every failure - https://phabricator.wikimedia.org/T129374#2103749 (10greg) [17:47:54] 10Beta-Cluster-Infrastructure, 7Beta-Cluster-reproducible: PHP fatal error /srv/mediawiki/php-master/includes/GlobalFunctions.php line 169: /srv/mediawiki/php-master/extensions/CharInsert/extension.json does not exist! - https://phabricator.wikimedia.org/T129371#2103773 (10greg) 17:37:04 Failed to recurse into... [17:48:21] !log Git clone at deployment-tin.deployment-prep:/srv/mediawiki-staging/php-master in completely horrible state. Investigating [17:48:24] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL, Master [17:52:05] 10Beta-Cluster-Infrastructure, 7Beta-Cluster-reproducible: PHP fatal error /srv/mediawiki/php-master/includes/GlobalFunctions.php line 169: /srv/mediawiki/php-master/extensions/CharInsert/extension.json does not exist! - https://phabricator.wikimedia.org/T129371#2103785 (10greg) ``` 17:48 < bd808> !log Git... [17:54:37] 10Beta-Cluster-Infrastructure, 7Beta-Cluster-reproducible: PHP fatal error /srv/mediawiki/php-master/includes/GlobalFunctions.php line 169: /srv/mediawiki/php-master/extensions/CharInsert/extension.json does not exist! - https://phabricator.wikimedia.org/T129371#2103686 (10bd808) ``` $ cd /srv/mediawiki-stagin... [17:55:40] scap is running now but not sure what the state will be. I queued another run of beta-code-update-eqiad now that git clone is un-fubar [17:55:52] bd808: thank you sir [17:55:59] also wft is up with git clones on deployment-tin today? [17:56:44] !log Cleaned up git clone state in deployment-tin.deployment-prep:/srv/mediawiki-staging/php-master and queued beta-code-update-eqiad to try again (T129371) [17:56:45] T129371: PHP fatal error /srv/mediawiki/php-master/includes/GlobalFunctions.php line 169: /srv/mediawiki/php-master/extensions/CharInsert/extension.json does not exist! - https://phabricator.wikimedia.org/T129371 [17:56:47] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL, Master [17:58:03] Project browsertests-Math-en.wikipedia.beta.wmflabs.org-linux-firefox-sauce build #842: 04FAILURE in 2.3 sec: https://integration.wikimedia.org/ci/job/browsertests-Math-en.wikipedia.beta.wmflabs.org-linux-firefox-sauce/842/ [18:01:58] bd808: ironically, the deploy triage meeting was happening right now, which is why the usual suspects didn't see it :/ [18:02:27] Project beta-scap-eqiad build #93019: 04FAILURE in 17 min: https://integration.wikimedia.org/ci/job/beta-scap-eqiad/93019/ [18:03:53] Project beta-code-update-eqiad build #95214: 04FAILURE in 1 min 25 sec: https://integration.wikimedia.org/ci/job/beta-code-update-eqiad/95214/ [18:04:15] grrr [18:05:07] * twentyafterfour is looking at it [18:05:37] last failure is "Unable to find current revision in submodule path 'SemanticTitle'" [18:05:52] hmm [18:06:35] the scap failure was due to me messing with the mw/core clone [18:07:04] * bd808 is running submodule update manually [18:07:52] weird [18:10:29] I think the untracked state of extensions/* is normal? [18:12:46] yea there is some untracked because there is both content from the git repo higher up in the path and a clone in that dir [18:13:18] so I'm not sure what "Unable to find current revision in submodule path 'SemanticTitle'" means? [18:13:22] "the git repo higher up in the path" or something like that, don't remember [18:14:41] Yippee, build fixed! [18:14:42] Project beta-code-update-eqiad build #95216: 09FIXED in 1 min 41 sec: https://integration.wikimedia.org/ci/job/beta-code-update-eqiad/95216/ [18:15:25] i think that means the hash commited in the git repo with the submodule defintion is not in the current clone of the submodule, where did you see that error? [18:16:23] it seems to be fixed now [18:16:28] yea [18:17:20] we should really backport the hack fix for the LightProcess warnings [18:17:56] ori fixed it in prod but the config change he made in heira depends on the "role" keyword that isn't used in labs puppet [18:19:45] * bd808 wonders off because https://integration.wikimedia.org/ci/view/Beta/job/beta-scap-eqiad/93020/console is looking like it will be green [18:24:58] 10Beta-Cluster-Infrastructure, 7HHVM: Backport fix for "parent, LightProcess exiting" logspam to Beta Cluster - https://phabricator.wikimedia.org/T129385#2103990 (10greg) [18:25:07] (03PS1) 10Paladox: Add new qunit tests that use npm 4.3 [integration/config] - 10https://gerrit.wikimedia.org/r/276228 [18:25:47] Krinkle ^^ and legoktm and i will ask hashar tonight. [18:26:21] (03CR) 10jenkins-bot: [V: 04-1] Add new qunit tests that use npm 4.3 [integration/config] - 10https://gerrit.wikimedia.org/r/276228 (owner: 10Paladox) [18:28:34] 10Beta-Cluster-Infrastructure: Make Beta Cluster update jobs (eg: beta-scap-eqiad, beta-mediawiki-config-update-eqiad etc) complain in IRC on every failure - https://phabricator.wikimedia.org/T129374#2104014 (10greg) ``` 17:27 <+ hashar> that is defined in the jjb/beta.yaml via the publisher "beta-irc" ``` [18:29:01] (03PS2) 10Paladox: Add new qunit tests that use npm 4.3 [integration/config] - 10https://gerrit.wikimedia.org/r/276228 [18:29:58] (03CR) 10jenkins-bot: [V: 04-1] Add new qunit tests that use npm 4.3 [integration/config] - 10https://gerrit.wikimedia.org/r/276228 (owner: 10Paladox) [18:30:31] RECOVERY - English Wikipedia Mobile Main page on beta-cluster is OK: HTTP OK: HTTP/1.1 200 OK - 29524 bytes in 1.827 second response time [18:30:57] (03PS3) 10Paladox: Add new qunit tests that use npm 4.3 [integration/config] - 10https://gerrit.wikimedia.org/r/276228 [18:31:24] oh thank god, BC is back [18:31:50] greg-g: sorry for the delay, I was cooking dinner (not actually working today) [18:32:13] greg-g: I have not yet updated the portals at all, so I did not have any trouble (yet) :P [18:32:36] RECOVERY - App Server Main HTTP Response on deployment-mediawiki01 is OK: HTTP OK: HTTP/1.1 200 OK - 40271 bytes in 0.807 second response time [18:32:58] RECOVERY - App Server Main HTTP Response on deployment-mediawiki03 is OK: HTTP OK: HTTP/1.1 200 OK - 40279 bytes in 2.195 second response time [18:33:05] gehel: ok, we were just trying to figure out why the checkout was broken [18:33:34] greg-g: let me know if you find out, that should probably be my concern... [18:33:36] RECOVERY - App Server Main HTTP Response on deployment-mediawiki02 is OK: HTTP OK: HTTP/1.1 200 OK - 40273 bytes in 1.355 second response time [18:33:50] Yippee, build fixed! [18:33:51] Project beta-scap-eqiad build #93020: 09FIXED in 19 min: https://integration.wikimedia.org/ci/job/beta-scap-eqiad/93020/ [18:34:00] RECOVERY - English Wikipedia Main page on beta-cluster is OK: HTTP OK: HTTP/1.1 200 OK - 40621 bytes in 0.681 second response time [18:37:32] legoktm and Krinkle doint we need to update the mediawiki extensions qunit test since legoktm switched a ton of jobs from the non generic extension test to the generic one which now injects dependencies. [18:39:10] 10Beta-Cluster-Infrastructure, 7Beta-Cluster-reproducible, 15User-bd808: PHP fatal error /srv/mediawiki/php-master/includes/GlobalFunctions.php line 169: /srv/mediawiki/php-master/extensions/CharInsert/extension.json does not exist! - https://phabricator.wikimedia.org/T129371#2104031 (10greg) 5Open>3Resol... [18:41:21] 10Beta-Cluster-Infrastructure, 7Beta-Cluster-reproducible, 15User-bd808: PHP fatal error /srv/mediawiki/php-master/includes/GlobalFunctions.php line 169: /srv/mediawiki/php-master/extensions/CharInsert/extension.json does not exist! - https://phabricator.wikimedia.org/T129371#2103686 (10JanZerebecki) The pro... [18:42:21] 10Beta-Cluster-Infrastructure, 7Beta-Cluster-reproducible, 15User-bd808: PHP fatal error /srv/mediawiki/php-master/includes/GlobalFunctions.php line 169: /srv/mediawiki/php-master/extensions/CharInsert/extension.json does not exist! - https://phabricator.wikimedia.org/T129371#2104039 (10bd808) The cleanup I... [18:46:28] 10Beta-Cluster-Infrastructure, 7HHVM: Backport fix for "parent, LightProcess exiting" logspam to Beta Cluster - https://phabricator.wikimedia.org/T129385#2104047 (10bd808) Trying via wikitech hiera magic at [18:47:58] 10Beta-Cluster-Infrastructure, 7Beta-Cluster-reproducible, 15User-bd808: PHP fatal error /srv/mediawiki/php-master/includes/GlobalFunctions.php line 169: /srv/mediawiki/php-master/extensions/CharInsert/extension.json does not exist! - https://phabricator.wikimedia.org/T129371#2104062 (10JanZerebecki) The rea... [18:49:31] 10Beta-Cluster-Infrastructure, 7HHVM, 15User-bd808: Backport fix for "parent, LightProcess exiting" logspam to Beta Cluster - https://phabricator.wikimedia.org/T129385#2104065 (10bd808) 5Open>3Resolved a:3bd808 >>! In T129385#2104047, @bd808 wrote: > Trying via wikitech hiera magic at (03PS1) 10Paladox: Add new test mediawiki-extensions-qunit-generic [integration/config] - 10https://gerrit.wikimedia.org/r/276234 [18:54:07] (03CR) 10jenkins-bot: [V: 04-1] Add new test mediawiki-extensions-qunit-generic [integration/config] - 10https://gerrit.wikimedia.org/r/276234 (owner: 10Paladox) [19:00:10] 10Beta-Cluster-Infrastructure, 7HHVM, 15User-bd808: Backport fix for "parent, LightProcess exiting" logspam to Beta Cluster - https://phabricator.wikimedia.org/T129385#2104119 (10greg) yay! thanks! [19:01:06] $drinks_I_owe_bd808++ [19:01:59] greg-g: I get annoyed and fix shit. ostriches taught me that is the wiki way :) [19:02:21] 'tis true! [19:04:10] bd808: So much of my work begins with the phrase "well that's really dumb....." [19:04:57] (03PS1) 10Greg Grossmeier: Announce all failures of beta jobs in -releng [integration/config] - 10https://gerrit.wikimedia.org/r/276238 (https://phabricator.wikimedia.org/T129374) [19:05:16] 6Release-Engineering-Team, 10DBA, 10MediaWiki-Configuration, 6Operations, and 3 others: codfw is in read only according to mediawiki - https://phabricator.wikimedia.org/T124795#2104148 (10jcrespo) [19:05:58] (03PS1) 10Paladox: Add new mediawiki-extensions-{phpflavor}-generic test [integration/config] - 10https://gerrit.wikimedia.org/r/276239 [19:08:02] (03CR) 10jenkins-bot: [V: 04-1] Add new mediawiki-extensions-{phpflavor}-generic test [integration/config] - 10https://gerrit.wikimedia.org/r/276239 (owner: 10Paladox) [19:09:02] (03PS2) 10Paladox: Add new mediawiki-extensions-{phpflavor}-generic test [integration/config] - 10https://gerrit.wikimedia.org/r/276239 [19:10:14] greg-g: keep your eye open for bottles of http://www.beeradvocate.com/beer/profile/220/57912/ at your local brewery if you really want to win my affection ;) [19:12:03] (03PS2) 10Paladox: Add new test mediawiki-extensions-qunit-generic [integration/config] - 10https://gerrit.wikimedia.org/r/276234 [19:13:47] bd808: you got it [19:14:20] (03CR) 10jenkins-bot: [V: 04-1] Add new test mediawiki-extensions-qunit-generic [integration/config] - 10https://gerrit.wikimedia.org/r/276234 (owner: 10Paladox) [19:14:28] (03PS3) 10Paladox: Add new test mediawiki-extensions-qunit-generic [integration/config] - 10https://gerrit.wikimedia.org/r/276234 [19:15:41] zeljkof: in mw-selenium, do you know how to test for visibility of an element that might take a second to load? I know how to use "when_present" but not in an expectation, and googling around is not being so fruitful [19:18:36] zeljkof: nvm, I believe I've figured it out [20:07:58] 10Beta-Cluster-Infrastructure, 7Beta-Cluster-reproducible, 15User-bd808: PHP fatal error /srv/mediawiki/php-master/includes/GlobalFunctions.php line 169: /srv/mediawiki/php-master/extensions/CharInsert/extension.json does not exist! - https://phabricator.wikimedia.org/T129371#2103686 (10hashar) >>! In T12937... [20:25:06] 5Continuous-Integration-Scaling, 7Nodepool, 13Patch-For-Review, 7Upstream: Nodepool delay instance deletions by one minute - https://phabricator.wikimedia.org/T113359#2104478 (10hashar) 5Open>3Resolved Definitely fixed. We had two issues: * a 1 minute delay before delay can happen (removed) * a 10 sec... [20:56:03] 10Continuous-Integration-Infrastructure: Jenkins: Assert no PHP errors (notices, warnings) were raised or exceptions were thrown - https://phabricator.wikimedia.org/T50002#2104622 (10Krinkle) [20:56:06] 10Continuous-Integration-Infrastructure, 10MediaWiki-extensions-WikibaseClient, 10Wikidata, 3Wikidata-Sprint-2016-03-01: Cannot find site jenkins_u3_mw - https://phabricator.wikimedia.org/T121083#2104620 (10Krinkle) 5Resolved>3Open Still happening. Except now with the name `mywiki` and earlier (in upda... [20:59:16] 10Continuous-Integration-Infrastructure, 10Wikidata, 7WorkType-Maintenance: Wikibase QUnit failure blocks Content translation CI - https://phabricator.wikimedia.org/T120349#2104636 (10Krinkle) [21:00:31] 10Continuous-Integration-Infrastructure, 10MediaWiki-extensions-WikibaseClient, 10Wikidata, 3Wikidata-Sprint-2016-03-01: Cannot find site jenkins_u3_mw - https://phabricator.wikimedia.org/T121083#2104644 (10Krinkle) a:5Krinkle>3None [21:03:08] Project beta-mediawiki-config-update-eqiad build #4456: 04FAILURE in 1.6 sec: https://integration.wikimedia.org/ci/job/beta-mediawiki-config-update-eqiad/4456/ [21:09:26] hashar: Hi could you have a look at https://gerrit.wikimedia.org/r/#/c/276228/ and https://gerrit.wikimedia.org/r/#/c/276234/ and https://gerrit.wikimedia.org/r/#/c/276239/ please. [21:09:50] Two of them are to do with adding generic qunit mediawiki extension test and mediawiki php unit generic test. [21:10:29] Since they were still using the old generic code since those extensions were migrated to generic meaning the dependencies are in non generic but in generic. [21:10:46] also the other one is adding some new qunit tests which use npm 4.3. [21:21:25] gehel: portals auto update is failing on Beta Cluster: https://integration.wikimedia.org/ci/job/beta-mediawiki-config-update-eqiad/4456/console [21:21:42] merge conflict it appears based on that log [21:21:51] SMalyshev: ^ ditto, not sure who's the right person to bug :) [21:28:46] I was talking to the sysadmin people at UC Berkeley [21:28:53] and we were discussing how we deploy software [21:29:00] and I was running them through how we used to and how we do it now [21:29:10] they still take down the system for like 3-4h on sunday morning to do it [21:29:28] they were *very* impressed with our system, especially given where we were :D [21:29:36] kudos to all of releng - just passing on some love :D [21:30:12] (03PS1) 10Paladox: [GitHub] Add npm test, Add composer-test [integration/config] - 10https://gerrit.wikimedia.org/r/276274 [21:30:44] yuvipanda: it's amazing to hear the spectrum of current day deployment methods [21:30:49] thanks :) [21:31:03] :D [21:31:41] like, we have so far to go compared to FB or GOOG, but we're so much better than probably 98% of most sites out there, really [21:31:53] and that's pretty cool [21:31:53] yeah [21:31:59] they don't have *any* testing environment [21:32:01] at all [21:32:04] not even locally on someone's laptop [21:37:16] * yuvipanda waves off [21:41:55] (03PS1) 10Paladox: [Gitweb] Add npm test [integration/config] - 10https://gerrit.wikimedia.org/r/276301 [21:59:45] (03PS1) 10Paladox: [GlobalContributions] Add npm test [integration/config] - 10https://gerrit.wikimedia.org/r/276348 [22:03:51] (03PS1) 10Paladox: [GlobalPreferences] Add npm test [integration/config] - 10https://gerrit.wikimedia.org/r/276350 [22:06:13] 5Continuous-Integration-Scaling, 13Patch-For-Review, 7Puppet: Hiera is not properly configured on Nodepool instances - https://phabricator.wikimedia.org/T129092#2104908 (10hashar) `operations/puppet.git` has a hiera utility `/utils/hiera_lookup` but it does not support labs anymore so I had to fix it: https... [22:08:16] (03PS1) 10Paladox: [GoogleAdSense] Add npm test [integration/config] - 10https://gerrit.wikimedia.org/r/276352 [22:09:00] 10Continuous-Integration-Config, 10Mathoid, 13Patch-For-Review, 15User-mobrovac: Enable librsvg-dev on jenkins - https://phabricator.wikimedia.org/T128280#2104914 (10hashar) [22:09:07] 5Continuous-Integration-Scaling, 13Patch-For-Review, 7Puppet: Hiera is not properly configured on Nodepool instances - https://phabricator.wikimedia.org/T129092#2094783 (10hashar) [22:10:41] greg-g: we are much better than 99.99999% of sites ;-} [22:11:41] paladox: I will bulk deploy your npm related changes [22:11:50] hashar: Thanks. [22:12:08] paladox: probably will just cherry pick all the ones in integration/config in a branch, push that, wait for test then merge the branch and push [22:12:22] paladox: did that a couple times. that works well ;} [22:13:21] hashar: Also i found the mediawiki-extensions- and mediawiki-extensions-qunit tests need updating since legoktm migrated them to generic tests with dependencies now set in parameter_functions.py. Thanks will need to be fixed with flow and echo. [22:13:24] hashar: Thanks. [22:13:35] hashar: Hi could you have a look at https://gerrit.wikimedia.org/r/#/c/276228/ and https://gerrit.wikimedia.org/r/#/c/276234/ and https://gerrit.wikimedia.org/r/#/c/276239/ please. [22:13:50] paladox: yeah I have seen the changes to generic jobs [22:14:03] paladox: not much of a prio imho. And for Flow/Echo maybe we can just remove them [22:14:21] paladox: they are already tested in the mediawiki-extensions-* job which should have all the dependencies cloned in [22:14:26] so its kind of redundant [22:14:28] hashar: Looks like im on the letter g. :) There were a ton of extensions with the letter c. [22:14:42] yup [22:14:43] hashar: Yeh should i do that now. [22:16:02] hashar: Also earlier Krinkle said to collaborate with you about migrating the qunit tests to npm 4.3 meaning we will have to create a seperate 4.3 test for that for compat reasons/ [22:16:31] for qunit yes [22:16:32] 10Continuous-Integration-Infrastructure, 10MediaWiki-extensions-WikibaseClient, 10Wikidata, 3Wikidata-Sprint-2016-03-01: Cannot find site jenkins_u3_mw - https://phabricator.wikimedia.org/T121083#2104928 (10daniel) [22:16:35] it is going to be a bit messy [22:16:48] 10Continuous-Integration-Infrastructure, 10MediaWiki-extensions-WikibaseClient, 10Wikidata, 3Wikidata-Sprint-2016-03-01: Cannot find site jenkins_u3_mw - https://phabricator.wikimedia.org/T121083#1868666 (10daniel) Ok, now the error at least makes some sense ;) [22:16:53] that needs a virtual host on the Nodepool machines and a bunch of puppet work [22:17:02] will get the npm jobs migrated first [22:17:11] hashar: Ok. [22:17:15] and try to finish up the mediawiki/services/* migration which have a few blockers [22:18:54] hashar: When we update mediawiki-extensions-{phpflavor} to use the generic test we will want to remove echo, flow and thanks at the same time. So that echo, flow and thanks can be fixed. [22:19:07] I can reproduce that all the way back to REL1_25. [22:19:22] oh [22:19:32] na mediawiki-extensions-* should not be replaced [22:20:05] but I should rename it to something like wmf-deployment-phpunit or something [22:20:30] hashar: I mean instead of doing - zuul-cloner-extdeps: we should just use the normal cloner for mediawiki/core and update parameter_function.py to allow the extension dependacies to be used on mediawiki-extensions. [22:20:56] hashar: Yeh probally. [22:21:29] slightly more complicated. I would like the job to get the list of dependencies from mediawiki/tools/release.git which has the list of repos we deploy [22:21:53] and zuul-cloner all of them instead of the "gatedextension" alias that hardcodes the list [22:22:03] hashar: Ah so that will make everything easisar once we figure out how to do that. [22:22:08] then get the job triggered by all those repositories [22:22:20] in a huge mess of integrating all extensions/skins together [22:22:31] hashar: Yeh. [22:23:04] and potentially we could use operations/mediawiki-config [22:23:16] but he that is a bit overkill for now [22:24:30] hashar: Ok. [22:24:58] I am gone. Have a good night! [22:25:27] hashar: Ok and you too also some the patches will need v+2 due to them having unrelated errors. [22:25:49] paladox: will figure them out :-} [22:26:02] the ApiDocumentationTest from mediawiki core is surely annoying :-((( [22:26:14] * hashar waves [22:26:23] hashar: Ok thanks they are mostly needing an api documentation update. Yes it broke most extensions, i think that will need to be disabled. [22:28:58] (03PS1) 10Paladox: [GoogleAnalyticsTopPages] Add npm test [integration/config] - 10https://gerrit.wikimedia.org/r/276358 [22:30:23] (03PS2) 10Paladox: [GoogleAnalyticsTopPages] Add npm test [integration/config] - 10https://gerrit.wikimedia.org/r/276358 [22:30:32] (03CR) 10jenkins-bot: [V: 04-1] [GoogleAnalyticsTopPages] Add npm test [integration/config] - 10https://gerrit.wikimedia.org/r/276358 (owner: 10Paladox) [22:35:54] (03PS1) 10Paladox: [GoogleAppEngine] Add npm test [integration/config] - 10https://gerrit.wikimedia.org/r/276363 [22:42:31] (03PS1) 10Paladox: [GoogleCustomWikiSearch] Add npm test [integration/config] - 10https://gerrit.wikimedia.org/r/276366 [22:46:11] (03PS1) 10Paladox: [GoogleSiteSearch] Add npm test [integration/config] - 10https://gerrit.wikimedia.org/r/276368 [22:52:18] (03PS1) 10Paladox: [GraphViz] Add npm test and add composer-test [integration/config] - 10https://gerrit.wikimedia.org/r/276371 [23:05:59] 10scap, 10Scap3 (Scap3-Adoption-Phase1): Support git-fat in scap3 deployment - https://phabricator.wikimedia.org/T129420#2105108 (10dduvall) [23:12:24] 10scap, 10Scap3 (Scap3-Adoption-Phase1): Support git-fat in scap3 deployment - https://phabricator.wikimedia.org/T129420#2105140 (10dduvall) [23:12:26] 10Deployment-Systems, 10scap, 10Analytics, 10Analytics-Cluster, 10Scap3 (Scap3-Adoption-Phase1): Deploy analytics-refinery with scap3 - https://phabricator.wikimedia.org/T129151#2105139 (10dduvall) [23:12:36] 10scap, 10Scap3 (Scap3-Adoption-Phase1): Support git-fat in scap3 deployment - https://phabricator.wikimedia.org/T129420#2105108 (10dduvall) [23:12:38] 10Deployment-Systems, 10scap, 6Discovery, 10Wikidata, and 2 others: Deploy wdqs with scap3 - https://phabricator.wikimedia.org/T129144#2096507 (10dduvall) [23:12:56] 10scap, 10Scap3 (Scap3-Adoption-Phase1): Support git-fat in scap3 deployment - https://phabricator.wikimedia.org/T129420#2105108 (10dduvall) [23:12:58] 10scap, 10RESTBase-Cassandra, 10Scap3 (Scap3-Adoption-Phase1): Deploy Cassandra with scap3 - https://phabricator.wikimedia.org/T116340#1746924 (10dduvall)