[00:03:21] 10Scap, 06Operations: Decide on /var/lib vs /home as locations of homedir for l10nupdate - https://phabricator.wikimedia.org/T163288#3192421 (10demon) [00:09:28] 10Scap: Refactor linters to make them extendable, configurable and reusable - https://phabricator.wikimedia.org/T163289#3192438 (10demon) [00:09:34] 10Scap: Refactor linters to make them extendable, configurable and reusable - https://phabricator.wikimedia.org/T163289#3192451 (10demon) p:05Triage>03Low [00:09:40] thcipriani: Filed ^ [00:12:39] Downside of linting everything means we have to install each of these libraries on the deploy master :p [00:12:44] Lint go? Probably need go [00:12:58] Could be a rabbit hole! [01:18:25] PROBLEM - Puppet staleness on deployment-jobrunner02 is CRITICAL: CRITICAL: 20.00% of data above the critical threshold [43200.0] [01:26:42] 05Gitblit-Deprecate, 10Diffusion: Redirect git.wikimedia.org HEAD URLs to Diffusion - https://phabricator.wikimedia.org/T141965#2518118 (10Krinkle) It seems Diffusion breaks when trying to "Browse tags" on a repo that doesn't yet have tags. For example, 10Deployment-Systems, 06Operations, 13Patch-For-Review: l10nupdate user uid mismatch between tin and mira - https://phabricator.wikimedia.org/T119165#3192622 (10Dzahn) now: https://gerrit.wikimedia.org/r/#/c/348884/ [01:40:32] 10Deployment-Systems, 06Operations: l10nupdate user uid mismatch between tin and mira - https://phabricator.wikimedia.org/T119165#3192623 (10Dzahn) [02:08:41] 10Gerrit, 06Developer-Relations, 10Diffusion: Implement a real way to request new repositories - https://phabricator.wikimedia.org/T38269#3192713 (10Krinkle) [02:14:58] 10Gerrit, 13Patch-For-Review: REL1_28 checkout of extensions.git is broken - https://phabricator.wikimedia.org/T162884#3192727 (10demon) a:05demon>03None [02:18:46] 10Gerrit, 06Developer-Relations, 10Diffusion: Implement a real way to request new repositories - https://phabricator.wikimedia.org/T38269#3192730 (10demon) This is basically already done with [[ /maniphest/task/edit/form/31/ | this form ]]. But needs doc updating on mw.org. There's another task where I menti... [02:35:44] 06Release-Engineering-Team, 06Operations, 05DC-Switchover-Prep-Q3-2016-17: Understand the preparedness of misc services for datacenter switchover - https://phabricator.wikimedia.org/T156937#3192764 (10Krinkle) [02:50:24] 10Continuous-Integration-Config, 10MediaWiki-extensions-FlaggedRevs: Add composer-test job for FlaggedRevs repo - https://phabricator.wikimedia.org/T163301#3192773 (10Jdforrester-WMF) [02:51:59] (03PS1) 10Jforrester: [FlaggedRevs] Add composer-test template [integration/config] - 10https://gerrit.wikimedia.org/r/348896 (https://phabricator.wikimedia.org/T163301) [02:58:27] (03CR) 10Krinkle: [C: 032] [FlaggedRevs] Add composer-test template [integration/config] - 10https://gerrit.wikimedia.org/r/348896 (https://phabricator.wikimedia.org/T163301) (owner: 10Jforrester) [02:58:56] !log Reloading Zuul to deploy https://gerrit.wikimedia.org/r/348896 [02:59:00] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [03:02:16] 10Continuous-Integration-Config, 10MediaWiki-extensions-FlaggedRevs, 13Patch-For-Review: Add composer-test job for FlaggedRevs repo - https://phabricator.wikimedia.org/T163301#3192797 (10Krinkle) 05Open>03Resolved [04:18:15] Project selenium-MultimediaViewer » firefox,beta,Linux,BrowserTests build #366: 04FAILURE in 22 min: https://integration.wikimedia.org/ci/job/selenium-MultimediaViewer/BROWSER=firefox,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=Linux,label=BrowserTests/366/ [06:27:31] Project selenium-Wikibase » chrome,test,Linux,BrowserTests build #335: 04FAILURE in 1 hr 47 min: https://integration.wikimedia.org/ci/job/selenium-Wikibase/BROWSER=chrome,MEDIAWIKI_ENVIRONMENT=test,PLATFORM=Linux,label=BrowserTests/335/ [07:55:53] 10Continuous-Integration-Infrastructure, 10WikimediaUI Style Guide: stylelint-config-wikimedia: Add rule to check for one space between selector and open brace - https://phabricator.wikimedia.org/T163111#3193072 (10Umherirrender) 05Open>03Invalid Moved to https://github.com/wikimedia/stylelint-config-wikim... [07:56:41] 10Continuous-Integration-Infrastructure, 10WikimediaUI Style Guide: stylelint-config-wikimedia: Add rule for two or more newline before eof - https://phabricator.wikimedia.org/T163136#3193074 (10Umherirrender) Moved to https://github.com/wikimedia/stylelint-config-wikimedia/issues/58 [07:59:54] 06Release-Engineering-Team, 10Wikidata, 07Story: [Story] Use composer-merge-plugin to include Wikidata components in mediawiki-vendor - https://phabricator.wikimedia.org/T95663#3193075 (10hoo) @Reedy We have our "dependency template" in the `wikidata/build-resources` repo. It's mostly just straight-forward p... [09:08:00] (03CR) 10Hashar: castor: cache binaries on a per job basis (034 comments) [integration/config] - 10https://gerrit.wikimedia.org/r/346152 (https://phabricator.wikimedia.org/T159591) (owner: 10Hashar) [09:08:05] (03PS5) 10Hashar: castor: cache binaries on a per job basis [integration/config] - 10https://gerrit.wikimedia.org/r/346152 (https://phabricator.wikimedia.org/T159591) [09:10:18] (03CR) 10Hashar: [C: 04-1] "That is going to mess-up the mediawiki/services/*/deploy repositories that have node_modules committed in :(" [integration/config] - 10https://gerrit.wikimedia.org/r/346152 (https://phabricator.wikimedia.org/T159591) (owner: 10Hashar) [09:16:53] !log apt-get upgrade on deployment-mx deployment-redis01 deployment-redis02 deployment-cache-text04 [09:16:56] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [09:20:28] !log apt-get upgrade deployment-tin deployment-mira [09:20:31] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [09:27:27] PROBLEM - Puppet run on deployment-tin is CRITICAL: CRITICAL: 44.44% of data above the critical threshold [0.0] [09:47:28] RECOVERY - Puppet run on deployment-tin is OK: OK: Less than 1.00% above the threshold [0.0] [10:20:35] 10Beta-Cluster-Infrastructure, 06Operations, 07Puppet: grain-ensure erroneous mismatch with (bool)True vs (str)true - https://phabricator.wikimedia.org/T146914#3193190 (10hashar) Looked again at this one, the root cause is salt grains.set uses yaml to save the grain value and that is processed via YAML. Henc... [11:25:02] 10Deployment-Systems, 06Operations, 07Beta-Cluster-reproducible, 07Puppet: grain-ensure erroneous mismatch with (bool)True vs (str)true - https://phabricator.wikimedia.org/T146914#3193275 (10hashar) [11:33:29] PROBLEM - Puppet run on deployment-tin is CRITICAL: CRITICAL: 30.00% of data above the critical threshold [0.0] [11:45:48] 10Deployment-Systems, 06Operations, 07Beta-Cluster-reproducible, 13Patch-For-Review, 07Puppet: grain-ensure erroneous mismatch with (bool)True vs (str)true - https://phabricator.wikimedia.org/T146914#3193330 (10hashar) https://gerrit.wikimedia.org/r/#/c/348928/ changes grain-ensure so it normalizes the v... [11:53:26] RECOVERY - Puppet run on deployment-tin is OK: OK: Less than 1.00% above the threshold [0.0] [12:50:02] (03PS2) 10Hashar: Add standard tests for testing-access-wrapper library [integration/config] - 10https://gerrit.wikimedia.org/r/348770 (owner: 10Gergő Tisza) [12:50:13] (03CR) 10Hashar: [C: 032] Add standard tests for testing-access-wrapper library [integration/config] - 10https://gerrit.wikimedia.org/r/348770 (owner: 10Gergő Tisza) [12:50:15] (03PS1) 10Rammanojpotla: mediawiki_selenium should document SauceLabs usage [selenium] - 10https://gerrit.wikimedia.org/r/348935 [12:51:29] (03Merged) 10jenkins-bot: Add standard tests for testing-access-wrapper library [integration/config] - 10https://gerrit.wikimedia.org/r/348770 (owner: 10Gergő Tisza) [12:52:45] (03PS1) 10Hashar: Doc: add TestingAccessWrapper [integration/docroot] - 10https://gerrit.wikimedia.org/r/348936 [12:53:07] (03CR) 10Hashar: [C: 032] Doc: add TestingAccessWrapper [integration/docroot] - 10https://gerrit.wikimedia.org/r/348936 (owner: 10Hashar) [12:58:16] (03CR) 10Hashar: "another oddity I found: on wikimedia/portals:" [integration/config] - 10https://gerrit.wikimedia.org/r/346152 (https://phabricator.wikimedia.org/T159591) (owner: 10Hashar) [12:58:48] hashar woop my backport to stable-2.14 for polygerrit has been merged https://gerrit-review.googlesource.com/#/c/102873/ :) so polygerrit will now fully work on prefixed urls as far as i can tell :) [13:00:56] 10Gerrit, 06Release-Engineering-Team, 13Patch-For-Review: Update gerrit to 2.14 - https://phabricator.wikimedia.org/T156120#3193458 (10Paladox) @demon the rc0 was released last week. When ever they will release the final release i will test on gerrit-test3 :). My polygerrit fixes were merged so polygerrit wi... [13:03:08] 10Gerrit, 06Release-Engineering-Team: Update gerrit to 2.13.7 - https://phabricator.wikimedia.org/T158946#3193472 (10Paladox) There looks to be a schema upgrade in the next 2.13.x release which might be 2.13.7. But it will be a performance upgrade as the h2 database is known to be slow if you keep opening conn... [13:04:32] (03CR) 10EddieGP: [C: 04-1] mediawiki_selenium should document SauceLabs usage (033 comments) [selenium] - 10https://gerrit.wikimedia.org/r/348935 (owner: 10Rammanojpotla) [13:05:44] (03Merged) 10jenkins-bot: Doc: add TestingAccessWrapper [integration/docroot] - 10https://gerrit.wikimedia.org/r/348936 (owner: 10Hashar) [13:05:51] (03CR) 10jenkins-bot: Doc: add TestingAccessWrapper [integration/docroot] - 10https://gerrit.wikimedia.org/r/348936 (owner: 10Hashar) [13:17:46] (03PS2) 10Rammanojpotla: mediawiki_selenium should document SauceLabs usage [selenium] - 10https://gerrit.wikimedia.org/r/348935 [13:49:09] PROBLEM - Puppet run on buildlog is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [0.0] [14:05:39] 10Gerrit: Creating a patch on the inline editor has some problems in gerrit 2.13 - https://phabricator.wikimedia.org/T152931#3193629 (10Paladox) Fixed in https://gerrit-review.googlesource.com/#/c/103914/ [14:05:58] 10Gerrit: Fake changeset updates in Gerrit - https://phabricator.wikimedia.org/T156525#3193631 (10Paladox) Fixed in https://gerrit-review.googlesource.com/#/c/103914/ [14:18:58] (03PS4) 10Hashar: Decouple repos from mediawiki gate queue [integration/config] - 10https://gerrit.wikimedia.org/r/313028 (https://phabricator.wikimedia.org/T107529) [14:20:41] (03CR) 10jerkins-bot: [V: 04-1] Decouple repos from mediawiki gate queue [integration/config] - 10https://gerrit.wikimedia.org/r/313028 (https://phabricator.wikimedia.org/T107529) (owner: 10Hashar) [14:22:58] (03PS3) 10Rammanojpotla: mediawiki_selenium should document SauceLabs usage [selenium] - 10https://gerrit.wikimedia.org/r/348935 [14:24:42] (03CR) 10EddieGP: "recheck" [selenium] - 10https://gerrit.wikimedia.org/r/348935 (owner: 10Rammanojpotla) [14:26:13] (03CR) 10EddieGP: "With some talk on IRC, we fixed the issue that this was based on another unrelated not-yet-merged commit by rammanoj. Looks good code-wise" [selenium] - 10https://gerrit.wikimedia.org/r/348935 (owner: 10Rammanojpotla) [14:33:36] Project selenium-WikiLove » firefox,beta,Linux,BrowserTests build #367: 04FAILURE in 1 min 35 sec: https://integration.wikimedia.org/ci/job/selenium-WikiLove/BROWSER=firefox,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=Linux,label=BrowserTests/367/ [15:59:57] 10Gerrit, 06Release-Engineering-Team, 13Patch-For-Review: Update gerrit to 2.14 - https://phabricator.wikimedia.org/T156120#2964656 (10demon) As I've said a dozen times, we're not upgrading until at least 2.14.1, so there's no rush. I'm unsubscribing from this until I'm ready. [16:02:10] (03PS5) 10Hashar: Decouple repos from mediawiki gate queue [integration/config] - 10https://gerrit.wikimedia.org/r/313028 (https://phabricator.wikimedia.org/T107529) [16:03:52] (03CR) 10jerkins-bot: [V: 04-1] Decouple repos from mediawiki gate queue [integration/config] - 10https://gerrit.wikimedia.org/r/313028 (https://phabricator.wikimedia.org/T107529) (owner: 10Hashar) [16:34:00] !log deleted nodepool alien ci-jessie-wikimedia-613597 [16:34:03] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [16:34:29] it is gone :) [17:40:29] hey, we have a phab user spam some of our tasks, and haven't had success in contacting that person [17:40:50] is blocking an option? [17:41:06] andre__ or Reedy ^^ [17:41:17] gwicke, links please [17:41:20] paladox, thanks for the ping [17:41:28] Your welcome :) [17:41:40] https://phabricator.wikimedia.org/T94187#3194668 [17:41:59] thanks, i'll take a look [17:42:00] BioPseudo and DavidGreens [17:42:34] the latter has not been active since Aug 2016 it seems? [17:42:47] (oh, and this is probably a conversation for -devtools instead of -releng ) [17:43:29] ah. same person, likely. Got it. [17:43:30] yeah, BioPseudo is the active one [17:43:42] joining -devtools [17:58:04] Hello,I'm interested in contribution. My skills include Starter level python,Java,Jenkins,Knowledge of puppet,HTML,CSS,JavaScript. I'm interested in DevOps/Release engineering . Can anybody help me where to look for and how to start? Thanks [18:06:53] Who do i ping for ^^ [18:09:53] mk__ hi, for puppet please see the opensource repo at https://gerrit.wikimedia.org/r/#/admin/projects/operations/puppet [18:10:05] paladox: I got it. [18:10:09] ok [18:10:24] mk__: hi, can you tell me more about what you are interested in? I'm guessing CI or ? [18:12:15] Thanks for your reply. Yes I'm interested in CI. I do have knowledge in Jenkins. [18:12:21] I'm a computer Science student. [18:13:00] I'm trying to understand where I fit best. Could you please help me ? [18:13:03] great. Well, we have a lot of CI related things here :) [18:13:16] welcome mk__! [18:14:19] Here's the main documentation page for our CI: https://www.mediawiki.org/wiki/Continuous_integration [18:14:30] Hello @andre. Thanks. :) [18:14:44] Do you have any familiarity with MediaWiki or Wikipedia? [18:17:00] Yes, I mean I use wikipedia everday. When I saw a donation campaign run by Wiki that got me thinking to contribute and after some research I understood a little about mediawiki too. [18:17:43] Apart from that I know just a little technical details regarding MediaWiki and Wikipedia. [18:17:47] * greg-g nods [18:18:15] well, take a look around that documentation and subscribe to the QA mailing list: https://lists.wikimedia.org/mailman/listinfo/qa [18:18:29] introduce yourself there with what your interests are etc and with any questions [18:19:17] Sure! thanks [18:36:23] 05Gerrit-Migration, 10Differential, 10Utilities-mwdumper: Migrate mwdumper to Differential - https://phabricator.wikimedia.org/T134434#3195022 (10Jdforrester-WMF) a:05Jdforrester-WMF>03None I'm not working on this right now, sorry. [18:42:19] greg-g: Would like a small window ASAP to cherry-pick a fix for a fatal JS error that is affecting many pages in prod. Low-risk, just declaring a module dependency in WikimediaEvents/extensions.json [18:42:43] Not related to switchover, should've been caught last week, but wasn't. [18:42:51] actually, it was but backport was forgotten. [18:44:55] 06Release-Engineering-Team (Deployment-Blockers), 05Release: MW-1.29.0-wmf.20 deployment blockers - https://phabricator.wikimedia.org/T160552#3195083 (10Krinkle) [18:50:28] PROBLEM - Puppet run on swift-storage-01 is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [0.0] [18:52:36] PROBLEM - Puppet run on swift is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [0.0] [18:52:58] Krinkle: Can it really be a blocker to an already-deployed branch ^? [18:53:26] RainbowSprinkles: I just wanna track it somewhere to make sure it's not forgotten. [18:53:41] We don't have a Prod-Blockers tag so using this one for now [18:53:52] Hm. looks like we do. [18:53:56] Well, is it really a blocker at all, I guess [18:54:01] I mean, it's already deployed :) [18:54:06] Yes yes.. [18:54:45] If there's already a fix in master, we could do a quick backport if you're worried about it [18:56:19] RainbowSprinkles: It is and that's what I asked for indeed. [18:56:35] So let's jfdi :) [18:57:21] RainbowSprinkles: So.. naos? [18:57:37] * Krinkle checks deployment alias [18:57:41] Yep [19:27:55] 06Release-Engineering-Team (Deployment-Blockers), 05Release: MW-1.29.0-wmf.20 deployment blockers - https://phabricator.wikimedia.org/T160552#3195252 (10Krinkle) [20:03:50] (03PS6) 10Ejegg: Use upstream civicrm-buildkit [integration/config] - 10https://gerrit.wikimedia.org/r/336960 [20:04:59] Hi releng! [20:05:15] Anyone have a minute to review / deploy that one? ^^^ [20:19:13] Krinkle: hey, sorry, was taking a longer than normal lunch, glad you got it figured out with chad [20:50:23] (03Draft2) 10Cicalese: Add dependency for SimpleSAMLphp on PluggableAuth. [integration/config] - 10https://gerrit.wikimedia.org/r/349017 [20:54:11] (03CR) 10Cicalese: "I'm modeling this change after the configuration for OpenIDConnect. I'm trying to get patch https://gerrit.wikimedia.org/r/#/c/348986/ to " [integration/config] - 10https://gerrit.wikimedia.org/r/349017 (owner: 10Cicalese) [20:56:35] 06Release-Engineering-Team, 15User-greg: skill matrix updates - https://phabricator.wikimedia.org/T140507#3195648 (10greg) 05Open>03declined Meh, not yet... [20:58:28] 05Gerrit-Migration, 10OOjs-UI: Move the OOUI library's development from gerrit to differential - https://phabricator.wikimedia.org/T122834#3195660 (10Volker_E) p:05Normal>03Lowest [22:03:59] 05Gerrit-Migration, 10OOjs-UI: Move the OOUI library's development from gerrit to differential - https://phabricator.wikimedia.org/T122834#3195898 (10Jdforrester-WMF) 05Open>03stalled Awaiting a steer from RelEng as to whether this is really the future. [22:43:29] PROBLEM - Long lived cherry-picks on puppetmaster on deployment-puppetmaster02 is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [0.0] [23:12:36] 10Deployment-Systems, 06Services: Evaluate Ansible as a deployment tool - https://phabricator.wikimedia.org/T93433#3196082 (10GWicke) 05Open>03declined We have used ansible for restbase deployments until recently, and have now migrated to WMF's own scap 3 tool. Longer term (over the next year) we are plann... [23:12:38] 10Deployment-Systems, 06Release-Engineering-Team, 06Operations, 06Services: Streamline our service development and deployment process - https://phabricator.wikimedia.org/T93428#3196085 (10GWicke) [23:13:18] 10Scap (Scap3-MediaWiki-MVP), 10scap2, 13Patch-For-Review, 07WorkType-NewFunctionality: Basic scap{2,3} canary deployment process & checks - https://phabricator.wikimedia.org/T110068#3196086 (10GWicke) a:05GWicke>03None [23:29:29] 10Deployment-Systems, 06Release-Engineering-Team, 07Epic: [EPIC] The future of MediaWiki deployment: Tooling - https://phabricator.wikimedia.org/T94620#3196130 (10GWicke) [23:29:36] 10Deployment-Systems, 06Release-Engineering-Team, 06Operations, 06Services: Streamline our service development and deployment process - https://phabricator.wikimedia.org/T93428#3196127 (10GWicke) 05Open>03Resolved a:03GWicke Changing status to resolved, as much (but not all) of the requirements discu... [23:46:16] 10Deployment-Systems, 10Scap, 07WorkType-NewFunctionality: Create canary deploy process for MediaWiki - https://phabricator.wikimedia.org/T136883#3196170 (10greg) [23:46:19] 10Scap (Scap3-MediaWiki-MVP), 10scap2, 13Patch-For-Review, 07WorkType-NewFunctionality: Basic scap{2,3} canary deployment process & checks - https://phabricator.wikimedia.org/T110068#3196168 (10greg) 05Open>03Resolved I don't believe there is anything left to do here to complete this task as stated. "B...