[00:30:18] 06Release-Engineering-Team, 06Discovery, 06Discovery-Search, 10Elasticsearch, 10Phabricator: Determine if we can run both elasticsearch and myisam fulltext backends in parallel - https://phabricator.wikimedia.org/T150223#2778409 (10mmodell) [01:11:07] need some Gerrit help. I just created an empty repo and now trying to import a project from github - what am I doing wrong? $ git push --force --set-upstream origin master [01:11:07] error: src refspec master does not match any. [01:13:11] Why are you trying ot push if you're importing from github? [01:18:42] Reedy, so what's the correct course of actions? [01:19:03] Add a remote, and git pull? [01:19:10] Or, clone from github [01:19:14] add a new remote [01:19:16] then push to said remote? [01:22:31] Reedy, same feces. remote master just doesn't exist :P [01:22:59] When I renamed WikimediaPageViewInfo to PageViewInfo... [01:23:09] I cloned the original, added a remote... and pushed [01:24:16] git push origin-new --all [01:24:27] And to bring all the branches [01:24:27] for remote in `git branch -r | grep -v master `; do git checkout --track $remote ; done [01:24:29] and push again [01:25:14] From where to where? [01:34:48] 10Beta-Cluster-Infrastructure, 10Analytics, 10WikimediaPageViewInfo, 13Patch-For-Review: Deploy WikimediaPageViewInfo extension to beta cluster - https://phabricator.wikimedia.org/T129602#2778514 (10Reedy) [01:37:00] meh, the right way was git push gerrit master:master [04:41:28] PROBLEM - App Server Main HTTP Response on deployment-mediawiki05 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [04:46:20] RECOVERY - App Server Main HTTP Response on deployment-mediawiki05 is OK: HTTP OK: HTTP/1.1 200 OK - 45148 bytes in 1.367 second response time [05:42:41] 10Beta-Cluster-Infrastructure, 10Mobile-Content-Service, 10RESTBase, 06Services, 15User-mobrovac: Set up MCS in BetaCluster - https://phabricator.wikimedia.org/T149671#2759340 (10bearND) I think this would also require a beta cluster specific config.yaml in MCS. [06:15:56] 10Beta-Cluster-Infrastructure, 10Mobile-Content-Service, 10RESTBase, 06Services, 15User-mobrovac: Set up MCS in BetaCluster - https://phabricator.wikimedia.org/T149671#2778690 (10bearND) [06:50:59] 03Scap3, 06Services, 10service-runner, 10service-template-node, 15User-mobrovac: Enable config deploys for service::node services - https://phabricator.wikimedia.org/T144542#2602980 (10KartikMistry) Should we also do this for cxserver? [06:51:53] 03Scap3, 06Services, 10service-runner, 10service-template-node, 15User-mobrovac: Enable config deploys for service::node services - https://phabricator.wikimedia.org/T144542#2778710 (10KartikMistry) OK. There is, https://phabricator.wikimedia.org/T147634 [06:58:39] 10Beta-Cluster-Infrastructure, 10Mobile-Content-Service, 10RESTBase, 06Services, 15User-mobrovac: Set up MCS in BetaCluster - https://phabricator.wikimedia.org/T149671#2778714 (10bearND) [07:37:59] 06Release-Engineering-Team, 06Discovery, 06Discovery-Search, 10Elasticsearch, 10Phabricator: Determine if we can run both elasticsearch and myisam fulltext backends in parallel - https://phabricator.wikimedia.org/T150223#2778730 (10Paladox) We could use phab-01 to test any changes that will allow us to u... [08:53:18] 10Gerrit, 13Patch-For-Review: Update gerrit to 2.12.6 - https://phabricator.wikimedia.org/T143089#2778814 (10Paladox) [08:53:50] 10Gerrit, 13Patch-For-Review: Update gerrit to 2.12.6 - https://phabricator.wikimedia.org/T143089#2556665 (10Paladox) @demon we should go with gerrit 2.12.6 instead as it was just released. [10:23:24] !log refreshing all jenkins jobs to clear out potential live hack I made but can't remember on which jobs I did [10:23:27] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [10:26:17] (03PS2) 10Hashar: (WIP) Inject gated extensions from Zuul (WIP) [integration/config] - 10https://gerrit.wikimedia.org/r/320191 [10:27:18] (03CR) 10Hashar: [C: 032] "Trying out live!" [integration/config] - 10https://gerrit.wikimedia.org/r/320191 (owner: 10Hashar) [10:28:08] (03Merged) 10jenkins-bot: (WIP) Inject gated extensions from Zuul (WIP) [integration/config] - 10https://gerrit.wikimedia.org/r/320191 (owner: 10Hashar) [10:40:02] 06Release-Engineering-Team, 13Patch-For-Review, 05WMF-deploy-2016-11-01_(1.29.0-wmf.1): Remove .gitreview from MediaWiki and Extensions - https://phabricator.wikimedia.org/T146293#2779010 (10Jonas) >>! In T146293#2773093, @Catrope wrote: > `git review -d` is broken for me too, but only for https remotes. If... [10:47:54] hi, I'd like to add a unit to my mw extension and this new test depends on another extension [10:48:15] but this extension does not seem to be loaded automatically by the php unit test framework [10:48:57] tried wfLoadExtension in setUp with no luck, importing manually the class I need from this extension works [10:56:22] dcausse: busy for a minute, be back in a minute or so :D [10:56:45] dcausse: yeah sorry so [10:57:04] 06Release-Engineering-Team, 10GitHub-Mirrors, 10Malu, 15User-zeljkofilipin: Add Malu to releng team on Github - https://phabricator.wikimedia.org/T150171#2779056 (10zeljkofilipin) Thanks! [10:57:05] dcausse: the Jenkins job has to clone the additional extension [10:57:15] the way we do it is that we have a list of such dependencies in the CI configuration system [10:57:34] and the list of extensions to clone is injected in the job when it starts, it then git clone all of them and wfLoadExtension() each [10:58:39] a recent example adds ParserFunctions as a dependency of Kartographer ( https://gerrit.wikimedia.org/r/#/c/318032/2/zuul/parameter_functions.py ) [10:58:40] hashar: I'm currently testing locally, what would be the phpunit command to load these extension? [10:59:19] given you use mediawiki core phpunit wrapper ( tests/phpunit/phpunit.php ) [10:59:20] currently I run: php /vagrant/mediawiki/tests/phpunit/phpunit.php wiki ../../extensions/CirrusSearch/tests/unit/InterwikiResolverTest.php [10:59:26] it loads whatever you have mentioned in LocalSettings.php [10:59:37] so you would need the extension under /extensions/ then wfLoadExtension() it [11:00:52] hm... so I understand that it should be completely automatic, my setup must be wrong somewhere [11:01:13] I'll continue to debug, thanks hashar! [11:09:07] 10Gerrit, 13Patch-For-Review: Update gerrit to 2.12.6 - https://phabricator.wikimedia.org/T143089#2779111 (10Paladox) We could always do 2.12.5 first and then 2.12.6 after [11:17:48] (03PS1) 10Hashar: jjb: drop unused sort-deps macro [integration/config] - 10https://gerrit.wikimedia.org/r/320364 [11:19:19] (03CR) 10Hashar: [C: 032] jjb: drop unused sort-deps macro [integration/config] - 10https://gerrit.wikimedia.org/r/320364 (owner: 10Hashar) [11:20:11] (03Merged) 10jenkins-bot: jjb: drop unused sort-deps macro [integration/config] - 10https://gerrit.wikimedia.org/r/320364 (owner: 10Hashar) [11:29:07] (03PS1) 10Jdlrobson: Add CI to trending-edits repo [integration/config] - 10https://gerrit.wikimedia.org/r/320366 (https://phabricator.wikimedia.org/T149601) [11:30:41] (03PS1) 10Hashar: jjb: drop 'bundle' macro, no more used [integration/config] - 10https://gerrit.wikimedia.org/r/320368 [11:32:19] 10Browser-Tests-Infrastructure, 13Patch-For-Review, 15User-zeljkofilipin: Absence of environments.yml causing endless recursion - https://phabricator.wikimedia.org/T149311#2779167 (10zeljkofilipin) [11:34:47] 10Browser-Tests-Infrastructure, 07Ruby: Mediawiki Ruby gem incorrectly assumes path to index.php - https://phabricator.wikimedia.org/T149169#2779174 (10zeljkofilipin) [11:35:44] (03CR) 10Hashar: [C: 032] "Thanks! I have created the Jenkins job trending-edits-deploy-npm-node-4-jessie" [integration/config] - 10https://gerrit.wikimedia.org/r/320366 (https://phabricator.wikimedia.org/T149601) (owner: 10Jdlrobson) [11:36:38] (03Merged) 10jenkins-bot: Add CI to trending-edits repo [integration/config] - 10https://gerrit.wikimedia.org/r/320366 (https://phabricator.wikimedia.org/T149601) (owner: 10Jdlrobson) [11:38:11] jdlrobson: I have pushed the trending-edits repo cconfiguration [11:38:15] the job fails though on https://integration.wikimedia.org/ci/job/npm-node-4/14174/console [11:38:19] hashar: w00t [11:38:23] 00:00:34.703 Error: ENOENT: no such file or directory, open '/home/jenkins/workspace/npm-node-4/test/utils/../../config.yaml' [11:38:36] did a recheck on the last merged change https://gerrit.wikimedia.org/r/#/c/318507/3 [11:39:26] 10Continuous-Integration-Config, 10Reading Web Trending service, 06Reading-Web-Backlog, 06Services, 13Patch-For-Review: Add CI to trending-edits repo - https://phabricator.wikimedia.org/T149601#2757540 (10hashar) did a recheck on the last merged change https://gerrit.wikimedia.org/r/#/c/318507/3 but the... [11:39:35] hashar: im glad that job fails :) [11:39:40] :-} [11:39:41] hashar: that test is -1ed for that exact reason [11:39:43] are the other ones okay :) [11:39:57] hashar: it's what motivated me to setup CI hehe [11:39:58] can't tell what will happen on the /deploy repo [11:40:02] there is no commit there apparently [11:40:11] 10Browser-Tests-Infrastructure, 07Ruby: Mediawiki Ruby gem incorrectly assumes path to index.php - https://phabricator.wikimedia.org/T149169#2744054 (10zeljkofilipin) @Oreolek: could you please provide information on where is this causing a problem? Is it related to {T144912}? [11:40:23] 10Browser-Tests-Infrastructure, 07Ruby, 15User-zeljkofilipin: Mediawiki Ruby gem incorrectly assumes path to index.php - https://phabricator.wikimedia.org/T149169#2779188 (10zeljkofilipin) [11:40:59] (03PS2) 10Hashar: jjb: drop 'bundle' macro, no more used [integration/config] - 10https://gerrit.wikimedia.org/r/320368 [11:41:11] hashar: can i add jenkins to the existing patchsets? [11:41:26] jdlrobson: I guess you can just comment 'recheck' [11:41:29] 10Continuous-Integration-Config, 10Reading Web Trending service, 06Reading-Web-Backlog, 06Services, and 2 others: Add CI to trending-edits repo - https://phabricator.wikimedia.org/T149601#2779191 (10Jdlrobson) [11:41:31] then they will probably all fail with the same reason [11:41:50] 10Continuous-Integration-Config, 10Reading Web Trending service, 06Reading-Web-Backlog, 06Services, and 2 others: Add CI to trending-edits repo - https://phabricator.wikimedia.org/T149601#2757540 (10Jdlrobson) @bearnd are you able to sign off on this? [11:43:16] 10Browser-Tests-Infrastructure, 13Patch-For-Review, 15User-zeljkofilipin: Absence of environments.yml causing endless recursion - https://phabricator.wikimedia.org/T149311#2748445 (10zeljkofilipin) @Tobi_WMDE_SW Is this causing a problem in a repository? Should we release a new version of the gem, since the... [11:44:54] (03CR) 10Hashar: [C: 032] jjb: drop 'bundle' macro, no more used [integration/config] - 10https://gerrit.wikimedia.org/r/320368 (owner: 10Hashar) [11:45:44] zeljkof: dont we need a new release for the Pin selenium-webdriver < 3 ? [11:45:50] (03Merged) 10jenkins-bot: jjb: drop 'bundle' macro, no more used [integration/config] - 10https://gerrit.wikimedia.org/r/320368 (owner: 10Hashar) [11:45:58] I would just cut a 1.7.3 and fix both bugs at once [11:46:09] eg T149311 and T149319 [11:48:41] 10Browser-Tests-Infrastructure, 13Patch-For-Review, 15User-zeljkofilipin: mediawiki_selenium integration test fails: Unable to find Mozilla geckodriver. - https://phabricator.wikimedia.org/T149319#2779256 (10zeljkofilipin) 05Open>03Resolved I think this is resolved. There is no need to release new versio... [11:49:15] hashar: actually, no :) https://phabricator.wikimedia.org/T149319#2779256 [11:50:11] and if the bug with environments.yml is not causing a problem anywhere, there is no need to release a new version of the gem [11:50:25] we _could_ do it, it is not a lot of work [11:57:12] 10Browser-Tests-Infrastructure, 13Patch-For-Review, 15User-zeljkofilipin: mediawiki_selenium feature to show/capture Selenium WebDriver requests to remote browser. - https://phabricator.wikimedia.org/T94577#2779272 (10zeljkofilipin) a:05zeljkofilipin>03None [11:58:49] 10Browser-Tests-Infrastructure, 13Patch-For-Review, 15User-zeljkofilipin: Absence of environments.yml causing endless recursion - https://phabricator.wikimedia.org/T149311#2779278 (10Tobi_WMDE_SW) @zeljkofilipin not that I know of. Unless you forget to check in environments.yml. [12:09:01] 10Continuous-Integration-Config, 10Reading Web Trending service, 06Reading-Web-Backlog, 06Services, and 2 others: Add CI to trending-edits repo - https://phabricator.wikimedia.org/T149601#2779306 (10Jdlrobson) @bearnd @mobrovac Jenkins is currently complaining with: ``` fs.js:549 12:00:02 return binding.... [12:10:03] 10Beta-Cluster-Infrastructure, 10Mobile-Content-Service, 10RESTBase, 06Services, 15User-mobrovac: Set up MCS in BetaCluster - https://phabricator.wikimedia.org/T149671#2779309 (10mobrovac) YEs, @bearND that's the second point in the task desc and can be probably dealt with in {T144598}. [12:12:17] 10Browser-Tests-Infrastructure, 13Patch-For-Review, 15User-zeljkofilipin: Absence of environments.yml causing endless recursion - https://phabricator.wikimedia.org/T149311#2779316 (10zeljkofilipin) 05Open>03Resolved In that case, I think this task can be resolved. We can release the gem when needed. [12:19:07] 10Continuous-Integration-Config, 10Reading Web Trending service, 06Reading-Web-Backlog, 06Services, and 2 others: Add CI to trending-edits repo - https://phabricator.wikimedia.org/T149601#2779320 (10hashar) The root of the repository has: ``` config.dev.yaml config.prod.yaml ``` I have no idea how that is... [12:21:40] 10Continuous-Integration-Config, 10Reading Web Trending service, 06Reading-Web-Backlog, 06Services, and 2 others: Add CI to trending-edits repo - https://phabricator.wikimedia.org/T149601#2779322 (10Jdlrobson) ah... i see what's happening here. I have one but .gitignore is hiding it. @mobrovac what's the c... [12:28:20] (03PS1) 10Hashar: Move mediawiki vagrant publish job to Nodepool [integration/config] - 10https://gerrit.wikimedia.org/r/320377 [12:30:30] (03CR) 10Hashar: [C: 032] Move mediawiki vagrant publish job to Nodepool [integration/config] - 10https://gerrit.wikimedia.org/r/320377 (owner: 10Hashar) [12:31:25] (03Merged) 10jenkins-bot: Move mediawiki vagrant publish job to Nodepool [integration/config] - 10https://gerrit.wikimedia.org/r/320377 (owner: 10Hashar) [12:36:35] (03PS1) 10Hashar: debian-glue voting on varnish4 [integration/config] - 10https://gerrit.wikimedia.org/r/320378 [12:38:28] (03CR) 10Hashar: "That will make the job that build the .deb package to vote Verified-1 on failure, when currently it always vote V+1 regardless of the job " [integration/config] - 10https://gerrit.wikimedia.org/r/320378 (owner: 10Hashar) [12:39:13] (03CR) 10Hashar: [C: 032] "Per ema. It is election day!" [integration/config] - 10https://gerrit.wikimedia.org/r/320378 (owner: 10Hashar) [12:39:55] (03Merged) 10jenkins-bot: debian-glue voting on varnish4 [integration/config] - 10https://gerrit.wikimedia.org/r/320378 (owner: 10Hashar) [12:53:29] (03PS1) 10Hashar: operations/puppet remove check pipeline [integration/config] - 10https://gerrit.wikimedia.org/r/320384 [12:53:42] (03PS2) 10Hashar: operations/puppet remove check pipeline [integration/config] - 10https://gerrit.wikimedia.org/r/320384 [12:57:48] (03Abandoned) 10Hashar: operations/puppet remove check pipeline [integration/config] - 10https://gerrit.wikimedia.org/r/320384 (owner: 10Hashar) [13:06:51] 06Release-Engineering-Team, 10Elasticsearch, 10Phabricator: Determine if we can run both elasticsearch and myisam fulltext backends in parallel - https://phabricator.wikimedia.org/T150223#2779496 (10Deskana) [13:07:12] 06Release-Engineering-Team, 10Elasticsearch, 10Phabricator: Determine if we can run both elasticsearch and myisam fulltext backends in parallel - https://phabricator.wikimedia.org/T150223#2778409 (10Deskana) Removing #discovery and #discovery-search since we focus on search on the Wikimedia wikis. [13:09:24] 10Continuous-Integration-Config, 10Reading Web Trending service, 06Reading-Web-Backlog, 03Reading-Web-Sprint-85-💩, and 3 others: Add CI to trending-edits repo - https://phabricator.wikimedia.org/T149601#2779500 (10mobrovac) p:05Triage>03High a:03mobrovac This is indeed strange, the CI job should crea... [13:10:25] PROBLEM - App Server Main HTTP Response on deployment-mediawiki04 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [13:13:53] 10Gerrit, 13Patch-For-Review: Update gerrit to 2.12.6 - https://phabricator.wikimedia.org/T143089#2779505 (10Aklapper) This task is about 2.12.5. Please do not change the scope of a task without arguments why. [13:14:04] 10Gerrit, 13Patch-For-Review: Update gerrit to 2.12.5 - https://phabricator.wikimedia.org/T143089#2779506 (10Aklapper) [13:15:28] RECOVERY - App Server Main HTTP Response on deployment-mediawiki04 is OK: HTTP OK: HTTP/1.1 200 OK - 45126 bytes in 9.350 second response time [13:21:05] 10Gerrit, 13Patch-For-Review: Update gerrit to 2.12.5 - https://phabricator.wikimedia.org/T143089#2779510 (10Paladox) @Aklapper well 2.12.6 was just released so there's no point in upgrading to 2.12.5 if there's 2.12.6. But we could upgrade to 2.12.5 and then to 2.12.6 since we built 2.12.5 already just need... [13:26:39] (03PS1) 10Hashar: Use fullclone for pplint/erblint HEAD jobs [integration/config] - 10https://gerrit.wikimedia.org/r/320389 [13:28:45] (03CR) 10Hashar: [C: 032] "INFO:jenkins_jobs.builder:Reconfiguring jenkins job pplint-HEAD" [integration/config] - 10https://gerrit.wikimedia.org/r/320389 (owner: 10Hashar) [13:29:57] (03Merged) 10jenkins-bot: Use fullclone for pplint/erblint HEAD jobs [integration/config] - 10https://gerrit.wikimedia.org/r/320389 (owner: 10Hashar) [13:37:05] 10Continuous-Integration-Infrastructure, 06Release-Engineering-Team, 14meta-ci-jessie: "npm test" fails with phabricator-jessie-commits where phabricator-jessie-diffs is successful - https://phabricator.wikimedia.org/T150259#2779578 (10Gilles) [14:33:52] Project selenium-WikiLove » firefox,beta,Linux,contintLabsSlave && UbuntuTrusty build #201: 04FAILURE in 1 min 51 sec: https://integration.wikimedia.org/ci/job/selenium-WikiLove/BROWSER=firefox,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=Linux,label=contintLabsSlave%20&&%20UbuntuTrusty/201/ [14:37:16] Yippee, build fixed! [14:37:17] Project selenium-WikiLove » firefox,beta,Linux,contintLabsSlave && UbuntuTrusty build #202: 09FIXED in 1 min 49 sec: https://integration.wikimedia.org/ci/job/selenium-WikiLove/BROWSER=firefox,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=Linux,label=contintLabsSlave%20&&%20UbuntuTrusty/202/ [15:22:47] (03PS1) 10Hashar: ops/puppet rake job needs a full clone [integration/config] - 10https://gerrit.wikimedia.org/r/320407 [15:25:44] 10Gerrit, 13Patch-For-Review: Update gerrit to 2.12.5 - https://phabricator.wikimedia.org/T143089#2779880 (10Aklapper) >>! In T143089#2779510, @Paladox wrote: > well 2.12.6 was just released so there's no point in upgrading to 2.12.5 if there's 2.12.6. That statement is too vague to be correct: Whether there... [15:35:56] 10Gerrit, 13Patch-For-Review: Update gerrit to 2.12.5 - https://phabricator.wikimedia.org/T143089#2556665 (10hashar) Just hold commenting on this task please. Lets wait for @demon :) [15:39:53] (03CR) 10Hashar: [C: 032] ops/puppet rake job needs a full clone [integration/config] - 10https://gerrit.wikimedia.org/r/320407 (owner: 10Hashar) [15:41:52] (03Merged) 10jenkins-bot: ops/puppet rake job needs a full clone [integration/config] - 10https://gerrit.wikimedia.org/r/320407 (owner: 10Hashar) [15:47:10] (03PS1) 10Hashar: Fix operations-puppet-rake-jessie reference repo [integration/config] - 10https://gerrit.wikimedia.org/r/320413 [15:47:27] (03CR) 10Hashar: [C: 032] Fix operations-puppet-rake-jessie reference repo [integration/config] - 10https://gerrit.wikimedia.org/r/320413 (owner: 10Hashar) [15:48:42] (03Merged) 10jenkins-bot: Fix operations-puppet-rake-jessie reference repo [integration/config] - 10https://gerrit.wikimedia.org/r/320413 (owner: 10Hashar) [15:53:13] 10Browser-Tests-Infrastructure, 07Ruby, 15User-zeljkofilipin: Mediawiki Ruby gem incorrectly assumes path to index.php - https://phabricator.wikimedia.org/T149169#2779916 (10Oreolek) No, it's not related; it's making Ruby gem unusable as-is on some wikis. To make it work one would extend MWClient class — lik... [16:17:49] zeljkof: still around? [16:18:24] hashar: yes, but leaving in a minute, literally [16:18:33] zeljkof: I am deleting https://integration.wikimedia.org/ci/job/UploadWizard-api-commons.wikimedia.beta.wmflabs.org/ [16:18:39] each time it breaks nobody notices [16:18:45] so there is no point in keeping it around :D [16:19:03] hashar: fine with me [16:19:54] zeljkof: that is all :} [16:21:17] (03PS1) 10Hashar: Remove UploadWizard-api-commons.wikimedia.beta.wmflabs.org [integration/config] - 10https://gerrit.wikimedia.org/r/320418 [16:22:42] (03CR) 10Hashar: [C: 032] Remove UploadWizard-api-commons.wikimedia.beta.wmflabs.org [integration/config] - 10https://gerrit.wikimedia.org/r/320418 (owner: 10Hashar) [16:24:47] (03Merged) 10jenkins-bot: Remove UploadWizard-api-commons.wikimedia.beta.wmflabs.org [integration/config] - 10https://gerrit.wikimedia.org/r/320418 (owner: 10Hashar) [16:38:02] 03Scap3: scap rollback behavior problems - https://phabricator.wikimedia.org/T150267#2780036 (10thcipriani) [16:38:33] 03Scap3: scap rollback behavior problems - https://phabricator.wikimedia.org/T150267#2780051 (10thcipriani) p:05Triage>03Normal a:03dduvall [16:39:11] 03Scap3: scap rollback behavior problems - https://phabricator.wikimedia.org/T150267#2780036 (10thcipriani) [17:09:22] 10Beta-Cluster-Infrastructure, 06Labs, 10Wikimedia-General-or-Unknown: rename -labs.php to -beta.php - https://phabricator.wikimedia.org/T150268#2780096 (10Reedy) [17:41:07] Heads up... I'm gonna deploy the patch for the above task [17:41:11] But I'll babysit it [17:41:18] Uh [17:41:20] I mean, in the near future [17:41:23] Not *now* [17:41:33] As although tests pass.. It wouldn't surprise me if something weird and wonderful breaks in beta [17:44:32] yeah, that sounds highly tricky with crazy unknowns everywhere :) [17:44:40] not as bad as php-, but :) [17:44:42] heh [17:44:44] Maybe... [17:44:49] We stop jenkins deploying for a bit [17:44:54] I'll cherry pick, deploy manually [17:44:56] and deal with as is [17:45:07] jenkins deciding to do whatever in between... is not likely to be helpful [17:45:22] hashar: How much of a pain is it to disable the beta scap jobs temporarily? [17:46:10] Reedy: https://integration.wikimedia.org/ci/view/Beta/ [17:46:37] then I guess press the Disable button on each of: [17:46:38] https://integration.wikimedia.org/ci/view/Beta/job/beta-scap-eqiad/ [17:46:42] https://integration.wikimedia.org/ci/view/Beta/job/beta-code-update-eqiad/ [17:46:45] https://integration.wikimedia.org/ci/view/Beta/job/beta-update-databases-eqiad/ [17:46:46] or [17:47:01] since all jobs run on a single slave [17:47:04] put https://integration.wikimedia.org/ci/computer/deployment-tin.eqiad/ offline :} [17:47:12] heh, WFM [17:47:15] actually that is probably the easiest way to do it [17:47:19] put node offline [17:47:24] cool [17:47:26] and that prevent everything from running [17:47:33] I'll try and decide when I shall have a go :) [17:47:34] the jobs will pill up in zuul/jenkins [17:47:40] and whenever the node is back up, they will run [17:47:57] I am off gotta commute back home for dinner [17:49:56] PROBLEM - Puppet run on deployment-pdfrender is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [0.0] [18:22:34] 10Continuous-Integration-Config, 10Reading Web Trending service, 06Reading-Web-Backlog, 03Reading-Web-Sprint-85-💩, and 2 others: Add CI to trending-edits repo - https://phabricator.wikimedia.org/T149601#2780320 (10MBinder_WMF) [18:24:21] PROBLEM - Host integration-puppetmaster is DOWN: CRITICAL - Host Unreachable (10.68.16.42) [19:07:12] 06Release-Engineering-Team, 10Elasticsearch, 10Phabricator: Determine if we can run both elasticsearch and myisam fulltext backends in parallel - https://phabricator.wikimedia.org/T150223#2780493 (10mmodell) @deskana sorry, the projects were inherited from the parent task. Should probably remove them from th... [19:09:10] 06Release-Engineering-Team, 10Elasticsearch, 10Phabricator: Determine if we can run both elasticsearch and myisam fulltext backends in parallel - https://phabricator.wikimedia.org/T150223#2780498 (10Deskana) >>! In T150223#2780493, @mmodell wrote: > @deskana sorry, the projects were inherited from the parent... [19:09:14] 06Release-Engineering-Team, 10Elasticsearch, 10Phabricator: Determine if we can run both elasticsearch and myisam fulltext backends in parallel - https://phabricator.wikimedia.org/T150223#2780499 (10mmodell) Oh no, I was wrong, I guess the projects were from a herald rule related to elasticsearch? Oh well, i... [19:12:35] Should we be renaming the realm from labs to beta? [19:12:37] I'm thinking not [19:12:38] https://github.com/wikimedia/operations-puppet/blob/production/modules/base/manifests/environment.pp#L75-L85 [19:15:42] no [20:35:23] Reedy: naming things man... [20:37:43] greg-g: That's why I use Special:Random to name vm's [20:42:20] :) [20:45:14] there's some unstages changes on deployment-puppetmaster02 regarding logstash and I can't update puppet because of these. Are these remaining of some testing? Are they needed? [20:45:21] can I just checkout them? [20:45:55] Reedy: Krenair ^^ you? [20:46:08] Not me, sorry [20:47:29] looking [20:48:12] i had a rule for logstash iirc [20:48:52] Krenair: Pchelolo: maybe a conflict during the autorebase [20:48:53] PROBLEM - Puppet run on deployment-fluorine02 is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [0.0] [20:50:32] does not look familiar to me [20:51:20] yes [20:51:24] those are mine [20:51:54] at least one of those is needed to fix puppet [20:54:09] Pchelolo, updated [20:54:19] thank you Krenair [20:54:31] I've committed it so it won't break auto-updating again [20:54:40] will sort out getting it fixed properly when I have time [21:01:58] gwicke: Hello [21:02:24] Krenair: did you see meeple27's post under that user name, or some other? [21:02:43] um [21:02:46] 18<meeple2418> gwicke: Hello [21:07:54] (03PS3) 10Hashar: Integration tests with make-wmf-branch [integration/config] - 10https://gerrit.wikimedia.org/r/256413 [21:09:47] (03CR) 10jenkins-bot: [V: 04-1] Integration tests with make-wmf-branch [integration/config] - 10https://gerrit.wikimedia.org/r/256413 (owner: 10Hashar) [21:17:57] (03PS3) 10Paladox: Drop script mw-install-postgre since it is a duplicate of mw-install-postgresql [integration/jenkins] - 10https://gerrit.wikimedia.org/r/316231 [21:18:05] (03PS2) 10Paladox: Update mw-install-postgresql to include the install script [integration/jenkins] - 10https://gerrit.wikimedia.org/r/316232 (https://phabricator.wikimedia.org/T22343) [21:38:00] Not sure who to contact about this, but I think something may be borked with the instructions for setting up git-review on Windows [21:38:31] no one on releng has a windows machine, we're kind of useless here :) [21:38:51] there are some volunteers who have it though ( paladox ) [21:39:00] damn, I'm setting up a new workstation on Windows to see what it's like for new contributors and `git review -d` is grabbing from the wrong URL and throwing a 4040 [21:39:01] 404* [21:39:11] Yep i have windows :) [21:39:33] Oh your using git-review, never used that on windows, i used git for windows though [21:40:08] ah, so you just alias `push-for-review` (or some other name)? [21:40:23] jhobs hi, are you getting the same error's as others, see https://phabricator.wikimedia.org/T146293 (near to bottom please) [21:40:24] ? [21:41:20] paladox: yeah, same issue as https://phabricator.wikimedia.org/T146293#2768233 [21:41:30] Ok, greg-g ^^ [21:41:33] looks like there's a workaround, thanks for pointing me in the right direction! [21:41:43] jhobs: did you run "git review -s" one time to set it up? [21:41:47] yep [21:41:53] Your welcome [21:41:57] wrong URL = wrong protocol? [21:41:59] jhobs try ssh? [21:42:04] do you mean it's https vs ssh ? [21:42:06] Seems http dosent work [21:42:23] mutante: see link above if you want the exact error [21:43:11] I wonder if instead of doing host=gerrit.wikimedia.org we do host=gerrit.wikimedia.org/r [21:43:18] in the .gitreview file will that work [21:43:23] ostriches twentyafterfour ^^ [21:43:45] hmm I don't know [21:43:48] Or people could stop using git-review. [21:43:54] +1 [21:44:02] And no, it probably won't because it would break SSH I'd imagine [21:44:05] jhobs: it's missing the /r/ like paladox said [21:44:23] Oh [21:44:44] https://gerrit.wikimedia.org/changes/?q=316780&o=CURRENT_REVISION 404 [21:44:44] mutante, paladox: yeah, I'm reading the task now. I'll fix the remote, thanks for the assistance [21:44:47] https://gerrit.wikimedia.org/r/changes/?q=316780&o=CURRENT_REVISION works [21:44:51] ostriches: well, our documentation still recommends it [21:45:00] and so it has nothing to do with git-review being bad [21:45:00] ostriches could we write a redirect in gerrit? [21:45:02] for this [21:45:09] it's just the wrong remote [21:45:20] jhobs: Docs I never endorsed or wrote. [21:45:21] neither related to windows i guess [21:45:29] I've told people since day 1 to not use that flaming pile of horse shit [21:45:37] how is that even related to git-review as a tool [21:45:48] you could use the wrong remote with any tool [21:45:52] moves on [21:46:01] seems git review -s doesn't set the right remote [21:46:08] But nobody fucking listens to me. [21:46:17] but those on the task are aware, so I'm sure it will get fixed [21:46:19] LOL [21:46:23] * paladox does not use git-review [21:46:28] 10Continuous-Integration-Infrastructure (phase-out-gallium), 10releng-201617-q1, 13Patch-For-Review, 07Wikimedia-Incident: Phase out gallium.wikimedia.org - https://phabricator.wikimedia.org/T95757#2781228 (10hashar) Thank you @Dzahn :] It is all done from my point of view. [21:48:30] https://www.mediawiki.org/w/index.php?title=Gerrit%2Fgit-review&type=revision&diff=2280171&oldid=2273242 [21:48:34] {{fixed}} [21:49:36] :) [21:49:58] https://www.mediawiki.org/w/index.php?title=Gerrit%2FAlternatives_to_git-review&type=revision&diff=2280174&oldid=2146108 [21:50:44] There's a dozen other pages too... [21:50:45] Ugh [21:51:02] LOL [21:51:28] It's not funny. [21:51:38] It's fucking sad we've kept giving this terrible advice to people [21:51:53] Everyone would've been better off if we'd stuck to plain git instead of that insane tool [21:52:17] Yep, plain git is really good [21:52:25] I havent had any problems with it [21:59:12] 10Continuous-Integration-Infrastructure, 05Continuous-Integration-Scaling: Reduce number of CI permanent slaves - https://phabricator.wikimedia.org/T148183#2781265 (10hashar) [22:08:26] 10Continuous-Integration-Infrastructure, 05Continuous-Integration-Scaling: Reduce number of CI permanent slaves - https://phabricator.wikimedia.org/T148183#2781289 (10hashar) Rest will be deleted/removed as we migrate the MediaWiki/PHP jobs to Nodepool instances. We will need a new kind of slaves to host the... [22:20:31] 10Gerrit, 13Patch-For-Review: Update gerrit to 2.12.5 - https://phabricator.wikimedia.org/T143089#2781360 (10demon) Meh, we've already got 2.12.5 packaged, so might as well install & upgrade. I'm not seeing anything super interesting from 2.12.6's release notes that's pressing an upgrade... Tbh, I'd rather in... [22:21:37] 10Gerrit, 13Patch-For-Review: Update gerrit to 2.12.5 - https://phabricator.wikimedia.org/T143089#2781364 (10Paladox) @demon do you know when we will update to 2.12.5 please? [22:43:15] if folks wonder whether CI is slow... it is! [22:43:29] there are not enough instance to run jobs given the current load [22:43:38] pool state is at https://grafana.wikimedia.org/dashboard/db/nodepool?panelId=1&fullscreen [22:45:32] :/ [22:50:58] (03PS1) 10Hashar: operations/software/nginx: non voting debian glue [integration/config] - 10https://gerrit.wikimedia.org/r/320536 [22:51:47] Demand from gearman: ci-jessie-wikimedia: 49 [22:52:19] at least gate-and-submit is prioritized :d [22:53:43] alright, I'm not able to think (head cold, not election). I need to lay down [22:54:17] greg-g: have a good nap and see you tomorr [22:54:18] w [22:54:53] indeed, thanks! [22:56:51] (03CR) 10Hashar: [C: 032] operations/software/nginx: non voting debian glue [integration/config] - 10https://gerrit.wikimedia.org/r/320536 (owner: 10Hashar) [22:58:48] * paladox is watching the elections from bbc [23:08:56] (03Merged) 10jenkins-bot: operations/software/nginx: non voting debian glue [integration/config] - 10https://gerrit.wikimedia.org/r/320536 (owner: 10Hashar) [23:19:04] help. i broke CI [23:19:32] https://gerrit.wikimedia.org/r/#/c/305432/ is failing tests: https://integration.wikimedia.org/ci/job/mediawiki-extensions-hhvm/81559/console [23:19:45] but i alreayd fixed the issue which is causing them to fail: https://gerrit.wikimedia.org/r/320516 [23:19:52] is CI caching the old code or something? [23:19:55] greg-g: hashar: ^ [23:20:41] guess it is not fixed ? [23:21:01] or the code is not included [23:21:09] but that passed the same tests [23:21:34] the top of the console https://integration.wikimedia.org/ci/job/mediawiki-extensions-hhvm/81559/consoleFull [23:21:41] has the zuul-cloner which does all the git clone / checkout [23:21:54] twist [23:21:57] it does not use Wikibase [23:22:07] but mediawiki/extensions/Wikidata [23:22:21] so one needs to port the Wikibase change to Wikidata [23:22:27] aaaaaaaaaaaaa [23:22:29] D: [23:22:42] why is that even a thing [23:22:46] yeah that is all super confusing [23:22:48] and how do i do it D: [23:22:56] I am not sure why the Wikidata build passed tests though [23:23:00] so easiest [23:23:07] if https://gerrit.wikimedia.org/r/#/c/320516/ is your fix [23:23:13] try to copy paste it in Wikidata extension? [23:23:29] that's ridiculous. okay. [23:23:41] (me looks at project:mediawiki/extensions/Wikidata ) [23:23:49] there must be a better fix [23:24:05] but past midnight while I watch vine.co last moments and having my second beer... I am not very creative :D [23:24:27] the last Wikidata change is https://gerrit.wikimedia.org/r/#/c/320356/ [23:24:28] project description of mw/ext/Wikidata says "Daily updated Wikidata build" [23:24:50] addshore: can that update be triggered manually? and will it be faster than doing it by hand? [23:25:20] aude: ^^ [23:25:34] they are probably asleep [23:25:44] aude is in the US atm I think [23:25:47] the thing is that the mediawiki-extensions-* jobs are triggered by Wikidata [23:25:56] so that should all pass together just fine [23:26:22] FB suggests she is in NY [23:27:38] meh [23:27:49] https://gerrit.wikimedia.org/r/#/c/320539/ that should work? [23:27:54] please don't wake folks up yet :) [23:28:11] yeah [23:28:28] and then the revert partch on mediawiki/core ( https://gerrit.wikimedia.org/r/#/c/305432/ ) [23:28:34] can be made to depends-on that Wikidata proposed patch [23:28:38] and test would magically work [23:29:10] hashar: i've just force-merged it, i apparently broke CI for everyone for like an hour by now, and i feel bad [23:29:23] dont [23:29:27] hope it works [23:29:27] dont feel bad [23:29:30] shit happens [23:29:31] :] [23:29:52] you are taking follow up actions to fix it up,which is what matter really [23:30:08] else we would all fire ourselves and nobody would be left around ! [23:30:43] right. but if someone else broke CI for an hour, and i couldn't merge my stuff, i'd be somewhat irritated at them. so now i'm irritated at myself [23:30:56] (i've got a long queue of stuff to merge today :P) [23:31:01] thanks for the help hashar <3 [23:31:06] yeah CI noticed :D [23:31:18] MatmaRex: please pelase fill a task somewhere so WMDE/Wikidata people knows about it [23:31:42] they will probably need to craft a new Wikidata build with that patch [23:31:47] and bump the wmf deployed version [23:32:04] I think it's a daily process? [23:32:04] if the bumps are daily, it should be done tomorrow, i guess? [23:32:10] Well... [23:32:12] The bump isn't [23:32:17] i'm glad i decided to do this after the wmf branch cut, not before :) [23:32:20] I cant say [23:32:21] They periodically tag, and change make-wmf-branch [23:32:40] I dont know whether today Wikidata build has been cut in the wmf branches [23:32:59] maybe it is not deployed yet, so yeah tomorrow build will catch up [23:33:11] https://github.com/wikimedia/mediawiki-tools-release/commit/19811192f78c6045aa77b4377d0247876700cfd6 [23:33:13] i think whatever i broke, we have a week to fix it [23:33:16] "Bump Wikidata branch to wmf/1.28.0-wmf.23" [23:33:22] I'd suggest they might've missed it [23:33:25] i'll drop wmde folks an email [23:35:10] Reedy: MatmaRex it can be done manually [23:35:18] addshore: behave [23:35:22] :0 [23:35:24] addshore <3 [23:35:32] Tell the us exit polls be behave [23:36:52] Do you all need something ? :) [23:37:10] addshore: hopefully not immediately, but kind of [23:37:21] Haha, okay [23:37:55] addshore: https://gerrit.wikimedia.org/r/#/q/owner:matmarex+is:merged in the last few wikibase/wikidata changes, i probably made a booboo you'll have to fix [23:38:38] addshore: i reverted a breaking change in MW core, and then it turned out wikibase was already fixed after that breaking change and reverting it broke it; and it snowballed from there [23:39:23] the master of mw/core and mw/ext/Wikibase should be fine together, but i don't know what about mw/ext/Wikidata, and i'm not sure what about REL1_28 [23:41:17] addshore: Are the exit polls misbehaving? [23:44:00] Debra: so far the east coast sucks (no offence) [23:46:05] MatmaRex: I wouldn't be able to check until tomorrow, but yeh, an email wouldn't hurt, but generally wikibase deployments don't follow the regular stuff [23:46:45] i imagine you don't normally backport whole new releases into wmf branches though [23:46:56] i'll send an email, thanks [23:47:08] MatmaRex: feel free to cc me to it (hashar at free dot fr) [23:47:14] will do [23:47:30] meanwhile [23:47:47] its largely time to bed here [23:48:15] MatmaRex: thanks for the fix ! [23:49:20] addshore: It's awful early. [23:49:22] thanks for the help. good night [23:49:30] * Debra NP: "Fight Song" by Rachel Platten from "Fight Song - EP" [23:49:38] Night, MatmaRex. [23:50:04] Debra: indeed [23:50:16] well i'm not sleeping yet. i want to finish a bunch of stuff that was waiting because i broke CI! [23:50:21] Debra: there are about 12 of us here staying up all night [23:50:44] addshore: D: [23:51:00] MatmaRex: Nice try with that "good night"! [23:51:24] why are y'all talking politics in #-releng anyway. shooo [23:52:16] It's Election Day. [23:52:29] It's being talked about everywhere! [23:53:05] it's only election day in one unimportant country! [23:53:17] did you hear, india abandoned their highest-value bills today? [23:55:49] ok https://gerrit.wikimedia.org/r/#/c/305432/ finally passed. that only took forever. [23:55:55] my work here is done. [23:56:08] MatmaRex: \o/ [23:56:19] * MatmaRex mic drop [23:56:24] MatmaRex: RELEASE-NOTES [23:56:36] Reedy: i haven't even backported it yet [23:56:40] gj