[00:21:25] banjo banjo banjo...mushroom? [00:23:38] https://github.com/docker/dockercraft [00:26:42] twentyafterfour: that's amazing [00:27:16] trending on github. I visit the github explore page daily ;) [03:39:22] thcipriani|afk: thanks to you my eyes can now only see the "No newline at end of file" with a line number next to it.... http://i.imgur.com/NvTdo12.png (cc twentyafterfour ;) ) [03:40:28] greg-g: use unified instead of side by side diffs, then you won't see that at all [03:40:41] it took your screenshot to make me realize why I wasn't seeing that at all [03:41:01] I thought yours was weird :) [03:41:15] that's what she said! [03:42:02] https://twitter.com/20after4/status/667541263449653248 [04:13:00] Project browsertests-MultimediaViewer-en.wikipedia.beta.wmflabs.org-windows_7-internet_explorer-9-sauce build #628: 04FAILURE in 20 min: https://integration.wikimedia.org/ci/job/browsertests-MultimediaViewer-en.wikipedia.beta.wmflabs.org-windows_7-internet_explorer-9-sauce/628/ [05:13:52] 10Deployment-Systems, 6operations: uid mismatch between tin and mira - https://phabricator.wikimedia.org/T119165#1819881 (10mmodell) 3NEW [09:38:35] Project browsertests-Echo-en.wikipedia.beta.wmflabs.org-linux-chrome-sauce build #679: 04FAILURE in 1 min 33 sec: https://integration.wikimedia.org/ci/job/browsertests-Echo-en.wikipedia.beta.wmflabs.org-linux-chrome-sauce/679/ [09:48:18] (03PS4) 10Hashar: [ArticleComments] Update Jenkins tests [integration/config] - 10https://gerrit.wikimedia.org/r/246170 (owner: 10Paladox) [09:48:41] (03CR) 10Hashar: [C: 032] [ArticleComments] Update Jenkins tests [integration/config] - 10https://gerrit.wikimedia.org/r/246170 (owner: 10Paladox) [09:49:43] (03Merged) 10jenkins-bot: [ArticleComments] Update Jenkins tests [integration/config] - 10https://gerrit.wikimedia.org/r/246170 (owner: 10Paladox) [09:54:46] PROBLEM - Puppet staleness on integration-dev is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [43200.0] [10:33:14] (03Abandoned) 10Hashar: Update extension-gate template [integration/config] - 10https://gerrit.wikimedia.org/r/251715 (owner: 10Paladox) [10:41:39] (03PS3) 10Hashar: [GuidedTour] Update Jenkins tests [integration/config] - 10https://gerrit.wikimedia.org/r/249414 (owner: 10Paladox) [10:42:05] (03CR) 10Hashar: [C: 032] "rebased / fixed conflict with jsduck" [integration/config] - 10https://gerrit.wikimedia.org/r/249414 (owner: 10Paladox) [10:42:57] (03Merged) 10jenkins-bot: [GuidedTour] Update Jenkins tests [integration/config] - 10https://gerrit.wikimedia.org/r/249414 (owner: 10Paladox) [10:49:11] (03PS2) 10Hashar: [Reflect] Add Jenkins tests to extension [integration/config] - 10https://gerrit.wikimedia.org/r/252755 (owner: 10Paladox) [10:49:17] (03CR) 10Hashar: [C: 032] [Reflect] Add Jenkins tests to extension [integration/config] - 10https://gerrit.wikimedia.org/r/252755 (owner: 10Paladox) [10:50:14] (03Merged) 10jenkins-bot: [Reflect] Add Jenkins tests to extension [integration/config] - 10https://gerrit.wikimedia.org/r/252755 (owner: 10Paladox) [10:55:14] (03Abandoned) 10Hashar: Updates tests for extension-qunit-generic [integration/config] - 10https://gerrit.wikimedia.org/r/249891 (owner: 10Paladox) [10:55:35] (03PS3) 10Hashar: [Timeless] Add composer-test test [integration/config] - 10https://gerrit.wikimedia.org/r/251718 (owner: 10Paladox) [10:59:12] (03CR) 10Hashar: [C: 032] [Timeless] Add composer-test test [integration/config] - 10https://gerrit.wikimedia.org/r/251718 (owner: 10Paladox) [11:00:04] (03Merged) 10jenkins-bot: [Timeless] Add composer-test test [integration/config] - 10https://gerrit.wikimedia.org/r/251718 (owner: 10Paladox) [11:15:39] (03PS3) 10Hashar: Add Composer and npm tests to OAuthAuthenticate [integration/config] - 10https://gerrit.wikimedia.org/r/248663 (owner: 10Gergő Tisza) [11:15:44] (03PS4) 10Hashar: Add Composer and npm tests to OAuthAuthenticate [integration/config] - 10https://gerrit.wikimedia.org/r/248663 (owner: 10Gergő Tisza) [11:16:00] (03CR) 10Hashar: [C: 032] Add Composer and npm tests to OAuthAuthenticate [integration/config] - 10https://gerrit.wikimedia.org/r/248663 (owner: 10Gergő Tisza) [11:16:51] (03Merged) 10jenkins-bot: Add Composer and npm tests to OAuthAuthenticate [integration/config] - 10https://gerrit.wikimedia.org/r/248663 (owner: 10Gergő Tisza) [11:49:10] (03PS7) 10Hashar: [MoodBar] Update Jenkins tests [integration/config] - 10https://gerrit.wikimedia.org/r/247067 (owner: 10Paladox) [11:49:35] (03CR) 10Hashar: [C: 032] "rebased / fixed conflict" [integration/config] - 10https://gerrit.wikimedia.org/r/247067 (owner: 10Paladox) [11:51:26] (03Merged) 10jenkins-bot: [MoodBar] Update Jenkins tests [integration/config] - 10https://gerrit.wikimedia.org/r/247067 (owner: 10Paladox) [12:29:38] Project beta-scap-eqiad build #79209: 04FAILURE in 4 min 16 sec: https://integration.wikimedia.org/ci/job/beta-scap-eqiad/79209/ [12:37:47] Yippee, build fixed! [12:37:47] Project beta-scap-eqiad build #79210: 09FIXED in 2 min 53 sec: https://integration.wikimedia.org/ci/job/beta-scap-eqiad/79210/ [12:51:02] (03PS3) 10Hashar: [ProofreadPage] add composer-test [integration/config] - 10https://gerrit.wikimedia.org/r/247069 (owner: 10Paladox) [12:51:15] (03CR) 10Hashar: [C: 032] "rebased, now just adds composer-test" [integration/config] - 10https://gerrit.wikimedia.org/r/247069 (owner: 10Paladox) [12:52:16] (03Merged) 10jenkins-bot: [ProofreadPage] add composer-test [integration/config] - 10https://gerrit.wikimedia.org/r/247069 (owner: 10Paladox) [12:53:53] !log beta cluster: ran git gc --prune=all on /srv/mediawiki-staging git repositories [12:54:17] (03PS3) 10Hashar: [ParserHooks] Update Jenkins tests [integration/config] - 10https://gerrit.wikimedia.org/r/247893 (owner: 10Paladox) [12:56:45] (03CR) 10Paladox: "This can use the new extension unit test composer template." [integration/config] - 10https://gerrit.wikimedia.org/r/247893 (owner: 10Paladox) [12:58:51] (03PS4) 10Hashar: [ParserHooks] run tests with composer [integration/config] - 10https://gerrit.wikimedia.org/r/247893 (owner: 10Paladox) [12:59:21] (03CR) 10Hashar: [C: 032] "Rebased, made it to use the Zuul template "extension-unittests-composer"" [integration/config] - 10https://gerrit.wikimedia.org/r/247893 (owner: 10Paladox) [13:00:43] (03Merged) 10jenkins-bot: [ParserHooks] run tests with composer [integration/config] - 10https://gerrit.wikimedia.org/r/247893 (owner: 10Paladox) [13:05:24] (03CR) 10Paladox: "Thankyou" [integration/config] - 10https://gerrit.wikimedia.org/r/247893 (owner: 10Paladox) [13:07:30] (03CR) 10Hashar: "You are welcome Paladox" [integration/config] - 10https://gerrit.wikimedia.org/r/247893 (owner: 10Paladox) [13:30:40] (03PS6) 10Hashar: [TranslationNotifications] Update tests [integration/config] - 10https://gerrit.wikimedia.org/r/243209 (https://phabricator.wikimedia.org/T90943) (owner: 10Paladox) [13:30:46] (03CR) 10Hashar: [C: 032] [TranslationNotifications] Update tests [integration/config] - 10https://gerrit.wikimedia.org/r/243209 (https://phabricator.wikimedia.org/T90943) (owner: 10Paladox) [13:32:06] (03Merged) 10jenkins-bot: [TranslationNotifications] Update tests [integration/config] - 10https://gerrit.wikimedia.org/r/243209 (https://phabricator.wikimedia.org/T90943) (owner: 10Paladox) [13:57:10] 10Continuous-Integration-Config, 10MediaWiki-Codesniffer, 7Easy, 5Patch-For-Review, 5WMF-deploy-2015-11-10_(1.27.0-wmf.6): Convert existing legacy phpcs jobs to use composer entry point + versioning - https://phabricator.wikimedia.org/T90943#1820481 (10hashar) TranslationNotifications is done; [13:57:37] 10Continuous-Integration-Config, 10MediaWiki-Codesniffer, 7Easy, 5Patch-For-Review, 5WMF-deploy-2015-11-10_(1.27.0-wmf.6): Convert existing legacy phpcs jobs to use composer entry point + versioning - https://phabricator.wikimedia.org/T90943#1820483 (10hashar) [14:06:21] (03PS5) 10Hashar: [cldr] Update jenkins tests [integration/config] - 10https://gerrit.wikimedia.org/r/243394 (owner: 10Paladox) [14:08:03] (03CR) 10Hashar: [C: 032] [cldr] Update jenkins tests [integration/config] - 10https://gerrit.wikimedia.org/r/243394 (owner: 10Paladox) [14:09:39] (03Merged) 10jenkins-bot: [cldr] Update jenkins tests [integration/config] - 10https://gerrit.wikimedia.org/r/243394 (owner: 10Paladox) [14:13:57] 10Continuous-Integration-Config, 10MediaWiki-Codesniffer, 7Easy, 5Patch-For-Review, and 2 others: Convert existing legacy phpcs jobs to use composer entry point + versioning - https://phabricator.wikimedia.org/T90943#1820497 (10hashar) [14:15:01] 10Continuous-Integration-Config, 10MediaWiki-Codesniffer, 7Easy, 5Patch-For-Review, and 2 others: Convert existing legacy phpcs jobs to use composer entry point + versioning - https://phabricator.wikimedia.org/T90943#1348972 (10hashar) [14:24:42] (03PS1) 10Hashar: Remove legacy phpcs jobs and related config [integration/config] - 10https://gerrit.wikimedia.org/r/254398 (https://phabricator.wikimedia.org/T90943) [14:26:28] (03PS1) 10Hashar: Drop bin/run-phpcs-mw.sh [integration/jenkins] - 10https://gerrit.wikimedia.org/r/254400 (https://phabricator.wikimedia.org/T90943) [14:28:57] (03PS2) 10Hashar: Remove legacy phpcs jobs and related config [integration/config] - 10https://gerrit.wikimedia.org/r/254398 (https://phabricator.wikimedia.org/T90943) [14:29:08] (03CR) 10Hashar: [C: 032] Drop bin/run-phpcs-mw.sh [integration/jenkins] - 10https://gerrit.wikimedia.org/r/254400 (https://phabricator.wikimedia.org/T90943) (owner: 10Hashar) [14:30:06] (03Merged) 10jenkins-bot: Drop bin/run-phpcs-mw.sh [integration/jenkins] - 10https://gerrit.wikimedia.org/r/254400 (https://phabricator.wikimedia.org/T90943) (owner: 10Hashar) [14:30:32] !log Jenkins: deleting all phpcs-HEAD jobs https://phabricator.wikimedia.org/T90943 [14:31:05] 10Continuous-Integration-Config, 10MediaWiki-Codesniffer, 7Easy, 5Patch-For-Review, and 2 others: Convert existing legacy phpcs jobs to use composer entry point + versioning - https://phabricator.wikimedia.org/T90943#1820520 (10hashar) I have deleted some old jobs from Jenkins: mediawiki-core-phpcs-HEAD m... [14:32:33] !sal [14:32:34] https://tools.wmflabs.org/sal/releng [14:33:27] qa-morebots: [14:33:27] I am a logbot running on tools-exec-1221. [14:33:27] Messages are logged to https://tools.wmflabs.org/sal/releng. [14:33:27] To log a message, type !log . [14:33:28] !log Jenkins: deleting all phpcs-HEAD jobs https://phabricator.wikimedia.org/T90943 [14:33:33] !log restarted qa-morebots [14:33:34] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL, Master [14:33:39] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL, Master [14:34:25] (03CR) 10Hashar: [C: 032] "Both JJB and Zuul are noop :-}" [integration/config] - 10https://gerrit.wikimedia.org/r/254398 (https://phabricator.wikimedia.org/T90943) (owner: 10Hashar) [14:35:37] (03Merged) 10jenkins-bot: Remove legacy phpcs jobs and related config [integration/config] - 10https://gerrit.wikimedia.org/r/254398 (https://phabricator.wikimedia.org/T90943) (owner: 10Hashar) [14:36:18] 10Continuous-Integration-Infrastructure: Replace project-specific "{name}-thing" jobs with generic "thing" ones - https://phabricator.wikimedia.org/T91997#1820530 (10hashar) [14:36:20] 10Continuous-Integration-Config, 10MediaWiki-Codesniffer, 7Easy, 5Patch-For-Review, and 2 others: Convert existing legacy phpcs jobs to use composer entry point + versioning - https://phabricator.wikimedia.org/T90943#1820528 (10hashar) 5Open>3Resolved All repositories have been migrated, thank you @Pal... [14:39:48] 10Continuous-Integration-Config, 5Patch-For-Review: Deprecate global CodeSniffer rules repo - https://phabricator.wikimedia.org/T66371#1820539 (10hashar) The phpcs-HEAD jobs have been phased out in favor of composer test (T90943). I don't think anything still rely on the code sniffer rules from Gerrit. [14:39:54] 10Continuous-Integration-Config, 5Patch-For-Review: Deprecate global CodeSniffer rules repo - https://phabricator.wikimedia.org/T66371#1820540 (10hashar) 5stalled>3Open [14:40:16] 10Continuous-Integration-Infrastructure: Replace project-specific "{name}-thing" jobs with generic "thing" ones - https://phabricator.wikimedia.org/T91997#1820541 (10hashar) [14:40:33] 10Continuous-Integration-Infrastructure: Replace project-specific "{name}-thing" jobs with generic "thing" ones - https://phabricator.wikimedia.org/T91997#1101137 (10hashar) phpcs repositories have all been moved to use `composer test` [14:43:47] 10Continuous-Integration-Infrastructure, 5Continuous-Integration-Scaling, 5Patch-For-Review, 7Puppet, and 2 others: Puppetize npm/grunt manual setup - https://phabricator.wikimedia.org/T113903#1820545 (10hashar) [14:44:03] 10Continuous-Integration-Config, 5Continuous-Integration-Scaling, 7WorkType-NewFunctionality: Migrate javascript npm CI jobs to Nodepool - https://phabricator.wikimedia.org/T119143#1819116 (10hashar) [14:44:45] 10Continuous-Integration-Config, 5Continuous-Integration-Scaling, 7WorkType-NewFunctionality: Migrate ruby rake CI jobs to Nodepool - https://phabricator.wikimedia.org/T119142#1820547 (10hashar) [14:44:48] hashar: ready for that merge? I can’t remember which patch we’d talked about [14:46:41] 10Continuous-Integration-Config, 5Continuous-Integration-Scaling, 7WorkType-NewFunctionality: Migrate ruby rake CI jobs to Nodepool - https://phabricator.wikimedia.org/T119142#1820548 (10hashar) a:3zeljkofilipin Zeljko is handling them and it is progressing nicely as part of {T117993} Examples: | mediawi... [14:47:25] 10Continuous-Integration-Config, 5Patch-For-Review, 7Ruby: Move Bundler Jenkins jobs to Nodepool instances - https://phabricator.wikimedia.org/T114860#1820553 (10hashar) [14:47:26] 10Continuous-Integration-Config, 5Continuous-Integration-Scaling, 7WorkType-NewFunctionality: Migrate ruby rake CI jobs to Nodepool - https://phabricator.wikimedia.org/T119142#1820552 (10hashar) [14:47:44] 10Continuous-Integration-Config, 5Continuous-Integration-Scaling, 7WorkType-NewFunctionality: Migrate ruby rake CI jobs to Nodepool - https://phabricator.wikimedia.org/T119142#1819110 (10hashar) This was a dupe of {T114860} [14:48:03] 10Continuous-Integration-Config, 5Patch-For-Review, 7Ruby: Move Bundler Jenkins jobs to Nodepool instances - https://phabricator.wikimedia.org/T114860#1708023 (10hashar) [14:48:40] 10Continuous-Integration-Config, 5Continuous-Integration-Scaling, 7WorkType-NewFunctionality: Migrate as many misc CI jobs as possible to Nodepool - https://phabricator.wikimedia.org/T119140#1820560 (10hashar) [14:49:25] 10Continuous-Integration-Config, 5Continuous-Integration-Scaling, 7WorkType-NewFunctionality: Migrate php composer (Zend and HHVM) CI jobs to Nodepool - https://phabricator.wikimedia.org/T119139#1820561 (10hashar) {meme, src=whereismypopcorn} [14:50:25] hashar: https://rubytogether.org/news/2015-10-30-october-2015-monthly-update [14:50:38] Gemstash is able to act as a caching proxy for RubyGems.org... [14:51:16] ohhhhhh [14:52:10] zeljkof: can you fill a sub task of https://phabricator.wikimedia.org/T112560 [14:52:16] so we can evaluate it ? :-} [14:52:36] hashar: will do [14:52:54] zeljkof: you can get it running on pmcache.integration.eqiad.wmflabs [14:53:01] there is already a bunch of other services there [14:53:10] will need to have it run under a specific user [14:53:14] adduser gemstash --system [14:53:17] something like that [14:53:42] and if we can find to have Jenkins job to override the gemsource [14:53:46] that should be straightforward [14:55:31] 5Continuous-Integration-Scaling: Investigate using gemstash - https://phabricator.wikimedia.org/T119196#1820571 (10zeljkofilipin) 3NEW [14:55:49] hashar: ^ [14:56:25] sounds good :) [14:56:37] zeljkof: lets talk about it on monday [14:56:51] deal [14:56:57] just stumbled upon it [15:02:52] well [15:04:14] off [15:04:18] will show up again later this evening [15:19:58] (03CR) 10Zfilipin: "JanZerebecki: rake-jessie job fails only because https://gerrit.wikimedia.org/r/#/c/252686/ is not merged yet" [integration/config] - 10https://gerrit.wikimedia.org/r/252716 (https://phabricator.wikimedia.org/T110019) (owner: 10Zfilipin) [15:28:07] (03CR) 10Paladox: "Thanks." [integration/config] - 10https://gerrit.wikimedia.org/r/243209 (https://phabricator.wikimedia.org/T90943) (owner: 10Paladox) [15:28:45] (03CR) 10Zfilipin: "I have just realized that this patch is not related to rake-jessie job. It just moves existing bundle-rubocop job from experimental to tes" [integration/config] - 10https://gerrit.wikimedia.org/r/252716 (https://phabricator.wikimedia.org/T110019) (owner: 10Zfilipin) [16:09:41] 10Deployment-Systems, 3Scap3: scap3 dsh_target should check the scap directory of a repo as well as `/etc/dsh/groups` - https://phabricator.wikimedia.org/T119200#1820663 (10thcipriani) 3NEW [16:12:21] 10Deployment-Systems, 3Scap3: Switching to scap3, switching back to trebuchet, and then back to scap3 causes directory collisions - https://phabricator.wikimedia.org/T119202#1820678 (10thcipriani) 3NEW a:3thcipriani [16:38:01] PROBLEM - Puppet failure on deployment-tmh01 is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [0.0] [16:44:54] 10Deployment-Systems, 6operations: uid mismatch between tin and mira - https://phabricator.wikimedia.org/T119165#1820818 (10bd808) [[https://phabricator.wikimedia.org/diffusion/OPUP/browse/production/modules/mediawiki/manifests/users.pp;48c6a219b2b5048662cef1f8638bbe1e232c751f$41|Puppet says]] that l10nupdate... [16:45:22] 6Release-Engineering-Team, 7Database: Requests to globally reset a user's skin preferences - https://phabricator.wikimedia.org/T119206#1820821 (10greg) 3NEW a:3demon [16:46:01] (03CR) 10JanZerebecki: "Err, yes that patch I used to test didn't actually trigger the job being moved here." [integration/config] - 10https://gerrit.wikimedia.org/r/252716 (https://phabricator.wikimedia.org/T110019) (owner: 10Zfilipin) [16:46:08] 10Deployment-Systems, 6operations: l10nupdate user uid mismatch between tin and mira - https://phabricator.wikimedia.org/T119165#1820836 (10bd808) [16:46:29] 10Deployment-Systems, 6operations: l10nupdate user uid mismatch between tin and mira - https://phabricator.wikimedia.org/T119165#1819881 (10bd808) [16:46:30] 10Deployment-Systems, 3Scap3, 5Patch-For-Review: [scap] Add support for syncing /srv/mediawiki-staging including fully working git data to warm spare deploy server - https://phabricator.wikimedia.org/T104826#1428530 (10bd808) [16:49:46] PROBLEM - Puppet failure on mira is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [0.0] [16:51:56] PROBLEM - Puppet failure on deployment-mediawiki03 is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [0.0] [16:57:31] PROBLEM - Puppet failure on deployment-eventlogging03 is CRITICAL: CRITICAL: 55.56% of data above the critical threshold [0.0] [17:05:42] 6Release-Engineering-Team, 10Wikimedia-Developer-Summit-2016: Code-review migration status/discussion - https://phabricator.wikimedia.org/T114320#1820893 (10greg) [17:29:47] 10Continuous-Integration-Config, 10MediaWiki-Codesniffer, 7Easy, 5Patch-For-Review, and 2 others: Convert existing legacy phpcs jobs to use composer entry point + versioning - https://phabricator.wikimedia.org/T90943#1820952 (10Legoktm) Awesome work @paladox and @hashar :D [17:32:36] RECOVERY - Puppet failure on deployment-eventlogging03 is OK: OK: Less than 1.00% above the threshold [0.0] [17:48:52] 3releng-201516-q3: [keyresult] Migrate majority of CI jobs to Nodepool (part 2) - https://phabricator.wikimedia.org/T119138#1820992 (10Jdforrester-WMF) [17:49:18] 3releng-201516-q2: [keyresult] Migrate majority of CI jobs to Nodepool (part 1) - https://phabricator.wikimedia.org/T114315#1691169 (10Jdforrester-WMF) [17:49:20] 10Deployment-Systems, 3Scap3: Switching to scap3, switching back to trebuchet, and then back to scap3 causes directory collisions - https://phabricator.wikimedia.org/T119202#1821002 (10thcipriani) [17:49:39] 3releng-201516-q2: [keyresult] Migrate majority of CI jobs to Nodepool (part 1) - https://phabricator.wikimedia.org/T114315#1691169 (10Jdforrester-WMF) [18:34:27] 10Continuous-Integration-Config, 10Continuous-Integration-Infrastructure, 7Jenkins: Update node_js to latest 0.10.x release - https://phabricator.wikimedia.org/T119218#1821188 (10Paladox) 3NEW [19:05:19] (03CR) 10Kghbln: "Thanks a ton for your trust and confidence! Cheers" [integration/config] - 10https://gerrit.wikimedia.org/r/254208 (owner: 10Legoktm) [19:08:31] 10Continuous-Integration-Config, 10Continuous-Integration-Infrastructure, 7Jenkins: Update node_js to latest 0.10.x release - https://phabricator.wikimedia.org/T119218#1821337 (10hashar) We run CI based on the same version that are used on the Wikimedia cluster. The breakdown being: | Precise | **0.8.2**-1c... [19:29:56] thcipriani, twentyafterfour: Is there anything we should especially get into scap before we declare 3.0? [19:30:54] ostriches: yeah, 2 things aside from the patches that I need to land [19:31:19] https://phabricator.wikimedia.org/T116207 doing right now [19:31:44] and I'd like to get https://phabricator.wikimedia.org/T119200 done, too. [19:31:53] I wonder if we should get a successful production `deploy` before declaring 3.0? [19:32:02] I could imagine a flurry of last minute things leading to a 3.1 [19:32:29] I would also be fine with that. Everytime we do a beta deploy there are a handful of things that are discovered. [19:32:55] (beta deploy this morning, hence the handful of bugs to fix :)) [19:36:21] How do we test in CI php documentation as being valid (akin to mediawiki-core-jsduck)? [19:36:39] James_F: doxygen for example? [19:36:40] untested [19:36:48] hashar: Yeah. Oh. :-( [19:36:49] cause it takes 10-15 minutes to run afaik and is full of errors [19:37:00] and {bug|1} anyway [19:37:02] :-D [19:37:04] Can I add it to composer for OOUI? [19:37:15] I mean, core might be a lost cause but some of us write actual documentation. ;-) [19:37:25] jsduck ? [19:37:33] doxygen [19:37:34] it is ruby based, so you can really use composer :-D [19:38:07] https://phabricator.wikimedia.org/T91996 seems relevant. [19:39:21] we might add a doxygen job template [19:40:04] * James_F will just try out. [19:40:17] make it use a shallow clone [19:40:20] and execute 'doxygen' [19:40:23] straightforward [19:40:34] though you will not get the doc published anywhere -:-\ [19:40:39] thcipriani: I went ahead and landed your iso dir fix. [19:40:52] ostriches: thanks! [19:40:56] hashar: The publish step is in post-merge. [19:41:05] And we already have it. [19:42:22] And D49, the git repo cleanu [19:42:23] *p [19:42:31] land alllll the things [19:43:05] ostriches: bravely done. [19:49:52] thcipriani: I'll do T119200, should be quick. [19:49:56] I need a break from other stuff [19:50:15] ostriches: awesome! thanks. [20:25:15] (03PS3) 10Hashar: [ApiFeatureUsage] Update Jenkins tests [integration/config] - 10https://gerrit.wikimedia.org/r/247805 (owner: 10Paladox) [20:27:08] (03CR) 10Hashar: [C: 032] [ApiFeatureUsage] Update Jenkins tests [integration/config] - 10https://gerrit.wikimedia.org/r/247805 (owner: 10Paladox) [20:27:49] 10Deployment-Systems, 10MediaWiki-extensions-LocalisationUpdate, 7I18n, 7Wikimedia-log-errors: l10n-update not updating Vector and extensions - https://phabricator.wikimedia.org/T103879#1821682 (10Nemo_bis) [20:28:05] (03CR) 10Paladox: "Thankyou." [integration/config] - 10https://gerrit.wikimedia.org/r/247805 (owner: 10Paladox) [20:28:33] 10Deployment-Systems, 10MediaWiki-extensions-LocalisationUpdate, 7I18n, 7Wikimedia-log-errors: l10n-update not updating Vector and extensions - https://phabricator.wikimedia.org/T103879#1401459 (10Nemo_bis) [20:30:13] (03Merged) 10jenkins-bot: [ApiFeatureUsage] Update Jenkins tests [integration/config] - 10https://gerrit.wikimedia.org/r/247805 (owner: 10Paladox) [20:33:59] (03CR) 10Hashar: "paladox you are welcome" [integration/config] - 10https://gerrit.wikimedia.org/r/247805 (owner: 10Paladox) [20:35:55] andrewbogott: chasemp: by any chance, does one of you has some spare time for the puppet patches that provides zuul-merger ssh key? [20:36:13] I have added the private key manually on scandium for the time being, so no urgency :-} [20:36:21] where is that? [20:36:23] patch [20:36:40] I guess there can't be one since it's private [20:36:41] :) [20:36:46] https://gerrit.wikimedia.org/r/#/c/253925/ :) [20:37:10] so you need that + the secret() placed on palladium? [20:37:20] andrew is currently fighting a bit of fire and I have some big stuff to push out so [20:37:25] either last thing today or monday [20:37:27] if you can wait [20:37:39] apparently it is already on palladium but he who know :-} [20:37:51] will poke andrew when labs dusts have settled down [20:38:20] once that lands, I got a few patches to get rid of root access on scandium and then I think the service implementation is complete :-} [20:41:39] 6Release-Engineering-Team, 7Database: Requests to globally reset a user's skin preferences - https://phabricator.wikimedia.org/T119206#1821716 (10Nemo_bis) Will this procedure be notified to all the affected users? [20:43:56] (03PS1) 10Paladox: [OAuthAuthentication] Update Jenkins tests [integration/config] - 10https://gerrit.wikimedia.org/r/254478 [20:45:39] (03PS2) 10Paladox: [OAuthAuthentication] Update Jenkins tests [integration/config] - 10https://gerrit.wikimedia.org/r/254478 [20:46:05] (03PS3) 10Paladox: [OAuthAuthentication] Update Jenkins tests [integration/config] - 10https://gerrit.wikimedia.org/r/254478 [20:51:22] 6Release-Engineering-Team, 7Database, 7user-notice: Requests to globally reset a user's skin preferences - https://phabricator.wikimedia.org/T119206#1821750 (10ori) [20:55:18] (03PS1) 10Hashar: Generic 'maven' job [integration/config] - 10https://gerrit.wikimedia.org/r/254484 [20:55:31] (03CR) 10Hashar: [C: 032] Generic 'maven' job [integration/config] - 10https://gerrit.wikimedia.org/r/254484 (owner: 10Hashar) [20:56:50] (03Merged) 10jenkins-bot: Generic 'maven' job [integration/config] - 10https://gerrit.wikimedia.org/r/254484 (owner: 10Hashar) [21:00:13] 10Deployment-Systems, 3Scap3: Debian Packaging for scap - https://phabricator.wikimedia.org/T118015#1821768 (10dduvall) 5Open>3Resolved [21:02:47] (03PS1) 10Hashar: Add 'maven' to analytics/refinery/source [integration/config] - 10https://gerrit.wikimedia.org/r/254487 [21:02:57] (03CR) 10Hashar: [C: 032] Add 'maven' to analytics/refinery/source [integration/config] - 10https://gerrit.wikimedia.org/r/254487 (owner: 10Hashar) [21:03:28] 6Release-Engineering-Team, 7Database, 7user-notice: Requests to globally reset a user's skin preferences - https://phabricator.wikimedia.org/T119206#1821782 (10greg) I like @ori's suggestion of "On the next edition of Tech News, include a notice that invites users who were affected by this bug to get in touc... [21:08:49] Meh. Doxygen supports `@var string` and `@var array` but not `@var string[]`. [21:17:48] (03Merged) 10jenkins-bot: Add 'maven' to analytics/refinery/source [integration/config] - 10https://gerrit.wikimedia.org/r/254487 (owner: 10Hashar) [21:20:01] Project browsertests-QuickSurveys-en.m.wikipedia.beta.wmflabs.org-linux-chrome-sauce build #76: 04FAILURE in 3 min 58 sec: https://integration.wikimedia.org/ci/job/browsertests-QuickSurveys-en.m.wikipedia.beta.wmflabs.org-linux-chrome-sauce/76/ [21:25:21] hashar: Please merge https://gerrit.wikimedia.org/r/#/c/254174/ because it was c+2 by @TheDJ But the merge process didn't start please could you c+2 [21:26:06] hashar: also this https://gerrit.wikimedia.org/r/#/c/254179/ too please. [21:26:13] Project beta-scap-eqiad build #79256: 04FAILURE in 41 min: https://integration.wikimedia.org/ci/job/beta-scap-eqiad/79256/ [21:26:32] paladox: if it got C+2 it should enter gate-and-submit . You can verify at https://integration.wikimedia.org/zuul/ [21:26:51] hashar: It was done this morning but didn't [21:27:00] oops [21:27:10] hashar: So a re uploded the patch so it could be c+2 again. [21:27:32] paladox: no need to reupload [21:27:36] one can just remove its CR+2 and revote CR+2 [21:27:40] hashar: Oh ok. [21:27:42] -) [21:27:53] Gerrit will happily do the merge process for us [21:29:19] (03CR) 10Paladox: [CodeReview] Update Jenkins tests [integration/config] - 10https://gerrit.wikimedia.org/r/254179 (owner: 10Paladox) [21:29:27] hashar: ok thanks [21:29:39] hashar: Also needs https://gerrit.wikimedia.org/r/#/c/254179/ to be merged first. [21:30:40] hashar: I think it didn't merge because of Depends-On: [21:31:02] since it requires any change-id in Depends-On: to be merged first. [21:34:53] ahyeah [21:34:57] haven't noticed the depends-on [21:35:05] (03PS4) 10Hashar: [CodeReview] Update Jenkins tests [integration/config] - 10https://gerrit.wikimedia.org/r/254179 (owner: 10Paladox) [21:35:27] (03CR) 10Hashar: [C: 032] [CodeReview] Update Jenkins tests [integration/config] - 10https://gerrit.wikimedia.org/r/254179 (owner: 10Paladox) [21:36:40] (03CR) 10Paladox: "Thanks." [integration/config] - 10https://gerrit.wikimedia.org/r/254179 (owner: 10Paladox) [21:37:15] paladox: I dropped the Depends-On: I526c60fe61e3f3e97f5e9488d9cdd87c9852897a [21:37:32] cause that would have merged the source change BEFORE the CI one get deployed :D [21:37:33] hashar: Thanks. [21:37:37] or maybe I could just have removed my CR+2 :D [21:37:52] ok [21:38:03] (03Merged) 10jenkins-bot: [CodeReview] Update Jenkins tests [integration/config] - 10https://gerrit.wikimedia.org/r/254179 (owner: 10Paladox) [21:38:45] here we go [21:38:51] hashar: Maybe https://gerrit.wikimedia.org/r/#/c/254174/ needs re c+2 looking at https://integration.wikimedia.org/zuul/ it dosen't show the test running because a patch was uploaded after c+2 [21:39:04] hashar: Thanks [21:40:02] paladox: earlier today i finished the migration of PHPCodeSniffer to composer [21:40:08] cldr and translationNotifications were the last ones [21:40:21] I cleaned up the old JJB config :-} [21:40:25] congratulations!!!!!!! [21:40:28] hashar: Yes. and thanks for reviewing my patches. [21:40:31] your welcome [21:40:36] :) [21:41:33] hashar: Ive updated the patches for cldr and translationNotifications extensions they all pass the test just needs c+2 now. [21:41:58] https://gerrit.wikimedia.org/r/#/c/243391/ [21:42:16] https://gerrit.wikimedia.org/r/#/c/243208/ [21:46:08] Is all the scary, red, "IOError: [Errno 13] Permission denied: u'/srv/mediawiki-staging/php-1.27.0-wmf.7/cache/l10n/l10n_cache-mn.cdb.tmp' [21:46:08] " expected during a sync now? [21:47:36] paladox: doing them will amend as needed [21:47:55] ok. [21:47:58] thanks. [21:48:03] csteipp: ouch is that on prod ? [21:48:17] hashar: Yeah, when I just did a sync-file [21:48:23] (03PS1) 10Niedzielski: Remove Android dependency workaround [integration/config] - 10https://gerrit.wikimedia.org/r/254505 [21:48:37] thcipriani: ostriches: bd808: we got yet another permission error while running scap "IOError: [Errno 13] Permission denied: u'/srv/mediawiki-staging/php-1.27.0-wmf.7/cache/l10n/l10n_cache-mn.cdb.tmp' [21:49:00] csteipp: yeah the users / perms are more or less impacted by the co-master work going. Ie being able to deploy from either tin or mira [21:49:06] but but but we fixed that [21:49:09] csteipp: but I lack the background / context [21:49:22] bd808: Did we deploy the fix? [21:49:34] csteipp: yeah that error is "ok" in prod right now [21:49:36] I am surprised we still don't have a RESTBAse entry point for l10n that would hit l10noid [21:49:38] bd808: Let me know if the whole screen of error messages will help, and I can paste it somewhere [21:49:43] bd808: Yeah, 2 mins ago [21:50:05] sigh, yeah, we deployed the fix. But it looks like it's back: https://integration.wikimedia.org/ci/job/beta-scap-eqiad/79256/console [21:50:19] csteipp: it's this bug -- https://phabricator.wikimedia.org/T79786 [21:52:04] thcipriani: hmm... the perms look right on mira -- rwxr-xr-x 3 l10nupdate wikidev [21:52:15] indeed. [21:52:16] paladox: so for cldr ( https://gerrit.wikimedia.org/r/#/c/243391/ ) you forgot to add jshint/jsonlint as default targets. Fixed and I CR+2 the change \O/ [21:52:36] hashar: Oh sorry and thankyou [21:52:41] the file ownership is correct on the files that jenkins highlights [21:52:54] Yippee, build fixed! [21:52:54] Project beta-scap-eqiad build #79259: 09FIXED in 7 min 41 sec: https://integration.wikimedia.org/ci/job/beta-scap-eqiad/79259/ [21:53:00] ^^^^ [21:53:13] IT MAGICALLY FIXED ITSELF !!!!!!!!!!!!!! [21:53:25] (there is exactly 0.0000% change Jenkins fixed it) [21:53:33] chance [21:53:42] heisenbug :( [21:54:06] Maybe we should just throw our hands up and make everything 0777 [21:54:12] One way to make the problem go away ^ [21:54:17] or run everything as root [21:54:21] Or that [21:54:25] thcipriani: shadow uid for l10nupdate on mira :/ [21:54:51] more seriously, could those be verified beforehand? [21:54:56] some kind of pre flight check list [21:55:04] $ grep l10nupdate /etc/passwd -- l10nupdate:x:52619:10002::/home/l10nupdate:/bin/bash [21:55:08] figures. Is there a ticket for that? [21:55:20] $ id l10nupdate -- uid=10002(l10nupdate) gid=10002(l10nupdate) groups=10002(l10nupdate) [21:56:02] bd808: is that on prod? [21:56:04] thcipriani: will it would basically be the same bug as https://phabricator.wikimedia.org/T119165 [21:56:04] we should keep track of the number of times that has to be fixed. Does sssd keep a local cache of ldap things? Could we use that (I looked at this somewhat this morning). [21:56:19] hashar: that is in beta cluster but prod has kind of the same problem [21:56:27] so yeah on labs [21:56:50] whenever puppet runs and LDAP/DNS fails for some random reason ... puppet think he should create the user locally [21:56:53] and for good reason [21:57:19] yes, but we should be pinning ht uid in puppet so it doesn't matter [21:57:24] *the uid [21:57:44] I bitched about it on some old tasks we had related to mwdeploy being magically created by puppet [21:57:53] and mentionned puppet supports providers for user resources [21:57:55] we explictly ping the gid for l10nupdate in the puppet config but we let the local sysem randomly pick a uid [21:58:01] s/ping/pin/ [21:58:10] so in theory we could: user { 'l10nupdate': provider => 'ldap' } [21:58:10] https://docs.puppetlabs.com/references/latest/type.html#user-provider-ldap [21:58:21] only in labs [21:58:24] yeah [21:58:32] or pin the uid in puppet [21:58:32] we have no ladp for that in prod (and shouldn't) [21:58:52] and iirc mwdeploy UID ended up being pinned on prod [21:59:40] !log Removed shadow l10nupdate user from /etc/passwd & /etc/shadow on mira.deployment-prep.eqiad.wmflabs [21:59:45] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL, Master [22:00:43] forget me [22:00:48] mwdeploy is not pinned in prod [22:01:15] bd808: congratulations [22:02:57] sleep sleep [22:03:01] have a good week-end folks [22:03:08] these mismatches are only really a problem when root gets involved. it doesn't matter what the uid/gids are *except* when you start using rsync/tar/whatever as root to make exact copies from system to system [22:10:19] (03CR) 10Niedzielski: "I've deployed but I think it's still using integration-slave-trusty-1023 for some reason? @hashar, any ideas?" [integration/config] - 10https://gerrit.wikimedia.org/r/254505 (owner: 10Niedzielski) [22:10:39] 10Deployment-Systems, 6operations: l10nupdate user uid mismatch between tin and mira - https://phabricator.wikimedia.org/T119165#1821924 (10bd808) These mismatches are only really a problem when root gets involved. It doesn't matter what the uid/gids are **until** you start using rsync/tar/whatever as root to... [22:15:55] bd808: +1 on archiving IRC discussions to phab :-) [22:16:57] Nikerabbit: hello , are you now embedding the android emulator ? :-))))))) [22:19:29] (03CR) 10Hashar: "The -publish job https://integration.wikimedia.org/ci/job/apps-android-wikipedia-publish/ is still using the label AndroidEmulator !" [integration/config] - 10https://gerrit.wikimedia.org/r/254505 (owner: 10Niedzielski) [22:19:34] Nikerabbit: wrong tell [22:19:40] niedzielski: hello , are you now embedding the android emulator ? :-))))))) [22:19:52] niedzielski: your publish job is still on AndroidEmulator :-/ [22:20:13] hashar: hey! we are not. the publish job doesn't actually run any tests [22:20:30] hashar: so no emulator is needed [22:21:02] niedzielski: I am not sure what happened with https://gerrit.wikimedia.org/r/#/c/254505/ [22:21:26] hashar: so i tested the deployment by hitting "rebuild last". would that not work in this case? [22:21:34] niedzielski: being logged in, you can look at the job config history https://integration.wikimedia.org/ci/job/apps-android-wikipedia-publish/ then in side bar [Job Config History] [22:21:48] hashar: mh, ok i will try again. thank you [22:21:53] yeah rebuild should work [22:22:04] but JJB hasn't changed the conf :-\ [22:24:19] hashar: i installed a new os since the last time i did this. i'm sure this is on my end. thank you [22:24:33] niedzielski: good luck! [22:24:47] hashar: :) [22:25:08] 10Deployment-Systems, 3Scap3: enforcing deployment from `/srv/deployment` is wrong - https://phabricator.wikimedia.org/T116207#1821949 (10thcipriani) [22:26:53] 10Deployment-Systems, 3Scap3: enforcing deployment from `/srv/deployment` is wrong - https://phabricator.wikimedia.org/T116207#1821952 (10hashar) The beta deployment-bastion uses `/mnt` for legacy reasons and the symlink was a hack to match prod. Nowadays its recommended to use `/srv/` on labs. Maybe we can... [22:27:12] sleep sleep sleep [23:06:44] 6Release-Engineering-Team, 5Testing-Initiative-2015, 10Browser-Tests-Infrastructure, 10MediaWiki-extensions-Examples, 7Documentation: Improve documentation around running/writing (with lots of examples) browser tests - https://phabricator.wikimedia.org/T108108#1822054 (10dduvall) @zeljkofilipin, I haven'... [23:11:11] 10Deployment-Systems, 3Scap3: enforcing deployment from `/srv/deployment` is wrong - https://phabricator.wikimedia.org/T116207#1822065 (10mobrovac) I think D58 is going in the right direction - `scap3` shouldn't make assumptions about the deployment host's dir layout; it should only matter to it that it is in... [23:11:48] (03CR) 10Niedzielski: [C: 04-1] "I don't know how it ran before. I tried again and got some JJB errors. I worked around them by adding a decode('utf-8') call to jenkins_jo" [integration/config] - 10https://gerrit.wikimedia.org/r/254505 (owner: 10Niedzielski) [23:18:08] 5Testing-Initiative-2015: Establish onboarding protocol - https://phabricator.wikimedia.org/T115535#1726763 (10ggellerman) Created protype board: https://phabricator.wikimedia.org/tag/engineering_onboarding_template/ [23:18:25] 5Testing-Initiative-2015: Establish onboarding protocol - https://phabricator.wikimedia.org/T115535#1822108 (10ggellerman) 5Open>3Resolved [23:19:06] 5Testing-Initiative-2015: Add descriptions to onboarding tasks - https://phabricator.wikimedia.org/T119251#1822109 (10dduvall) 3NEW a:3dduvall [23:32:47] (03CR) 10Niedzielski: "Ok, seems to be working now. I removed the /mnt/home/jenkins-deploy/.android-sdk directory and it magically started working again[0]. Read" [integration/config] - 10https://gerrit.wikimedia.org/r/254505 (owner: 10Niedzielski)