[00:01:13] (03PS1) 10Krinkle: Update references to mw-set-env-localhost.sh [integration/config] - 10https://gerrit.wikimedia.org/r/220656 (https://phabricator.wikimedia.org/T103766) [00:02:50] (03CR) 10Krinkle: [C: 032] Rename mw-set-env-qunit to mw-set-env-localhost [integration/jenkins] - 10https://gerrit.wikimedia.org/r/220655 (https://phabricator.wikimedia.org/T103766) (owner: 10Krinkle) [00:03:21] (03Merged) 10jenkins-bot: Rename mw-set-env-qunit to mw-set-env-localhost [integration/jenkins] - 10https://gerrit.wikimedia.org/r/220655 (https://phabricator.wikimedia.org/T103766) (owner: 10Krinkle) [00:05:08] (03CR) 10Krinkle: [C: 032] "Deployed mediawiki-core-qunit, mediawiki-extensions-qunit, mwext-*-qunit, and mwext-*-qunit-mobile." [integration/config] - 10https://gerrit.wikimedia.org/r/220656 (https://phabricator.wikimedia.org/T103766) (owner: 10Krinkle) [00:05:37] (03PS1) 10Dduvall: Source generic mw-set-env-localhost.sh [integration/jenkins] - 10https://gerrit.wikimedia.org/r/220659 [00:05:41] (03Abandoned) 10Legoktm: global-set-env: Create "composer" alias for convenience [integration/jenkins] - 10https://gerrit.wikimedia.org/r/220364 (owner: 10Legoktm) [00:07:04] (03Merged) 10jenkins-bot: Update references to mw-set-env-localhost.sh [integration/config] - 10https://gerrit.wikimedia.org/r/220656 (https://phabricator.wikimedia.org/T103766) (owner: 10Krinkle) [00:09:45] (03CR) 10Dduvall: [C: 032] Source generic mw-set-env-localhost.sh [integration/jenkins] - 10https://gerrit.wikimedia.org/r/220659 (owner: 10Dduvall) [00:10:17] (03Merged) 10jenkins-bot: Source generic mw-set-env-localhost.sh [integration/jenkins] - 10https://gerrit.wikimedia.org/r/220659 (owner: 10Dduvall) [00:10:40] Krinkle: we could probably generalize the prepare-qunit-localhost builder, too [00:10:53] marxarelli: yeah, but renaming the /srv/ directory first [00:11:13] ah, right [00:11:23] a few minutes :) [00:11:29] which requires puppet changes [00:11:37] which means I have to think really really hard :P [00:11:56] hahah [00:12:23] it might be a little late in my day for thinking hard [00:12:33] there's a hammock and a beer waiting for me :) [00:39:20] 6Release-Engineering, 6Phabricator: Phabricator: new users get "Login cookie was set correctly, but your login session is not valid." - https://phabricator.wikimedia.org/T102276#1398654 (10mmodell) [00:49:37] 6Release-Engineering, 6Phabricator: Phabricator: new users get "Login cookie was set correctly, but your login session is not valid." - https://phabricator.wikimedia.org/T102276#1398666 (10mmodell) Have there been any new reports of this happening? I'm pretty sure it's resolved now, please reopen if there are... [00:49:45] 6Release-Engineering, 6Phabricator: Phabricator: new users get "Login cookie was set correctly, but your login session is not valid." - https://phabricator.wikimedia.org/T102276#1398667 (10mmodell) 5Open>3Resolved [00:58:34] Looks like you guys are onto this one? [00:58:34] [mwext-qunit] $ /bin/bash -xe /tmp/hudson780356142644053216.sh [00:58:34] 00:14:52 + . /srv/deployment/integration/slave-scripts/bin/mw-set-env-qunit.sh [00:58:35] 00:14:52 /tmp/hudson780356142644053216.sh: line 3: /srv/deployment/integration/slave-scripts/bin/mw-set-env-qunit.sh: No such file or directory [00:58:35] 00:14:52 Build step 'Execute shell' marked build as failure [00:59:05] https://integration.wikimedia.org/ci/job/mwext-qunit/2461/console [00:59:49] Krinkle: [00:59:50] [00:59:52] ^ [01:00:13] AndyRussG: That was only there for 2 seconds when deploying a change [01:00:16] is is still broken? [01:00:31] Just tried it a minute ago... [01:00:41] should've been fixed half an hour ago [01:00:43] https://gerrit.wikimedia.org/r/#/c/219120/ [01:00:45] ah, mwext-*-qunit [01:00:49] doens't match mwext-qunit [01:00:53] Fixed [01:00:56] AndyRussG: try again [01:01:44] jenkins-waiting... [01:03:22] Krinkle: Hmmm something else now, may not be CI related.... https://integration.wikimedia.org/ci/job/mwext-qunit/2462/console [01:04:14] Why is there a merge commit in gerrit [01:04:18] 01:01:19 npm WARN package.json mediawiki@0.0.0 No repository field. [01:04:18] 01:01:26 npm WARN optional dep failed, continuing fsevents@0.3.6 [01:04:26] unrelated [01:04:27] and works fine [01:04:32] Krinkle: it's to merge our master into the feature branch [01:04:35] the problem is that there are no tests regisitered [01:04:51] Probably the run time fatals before it starts [01:04:53] try locally [01:05:12] 01:01:48 WARN [web-server]: 404: /favicon.ico [01:07:03] Krinkle: so...npm runs on trusty, but composer-test is still on precise for 5.3 linting... :/ [01:07:11] Krinkle: Locally tests run fin here: Special:JavaScriptTest [01:07:21] AndyRussG: Special:JavaScriptTest/qunit/plain in Chrome? [01:08:26] Krinkle: yep all good like that [01:08:35] Should I try running with grunt? [01:08:49] AndyRussG: Sure, [01:10:52] "01:01:18 HTTP/1.1 404 Not Found " [01:10:54] https://integration.wikimedia.org/ci/job/mwext-qunit/2462/consoleFull [01:10:58] curl --include 'http://localhost:9412//jenkins-mwext-qunit-2462/index.php?title=Special:BlankPage' [01:11:17] that is a problem [01:13:38] AndyRussG: OK. Fixed now. I didn't cleanly deploy that last update. Didn't match what was in the repo (local change that broke it). The mwext-*-qunit was clean but then the one I did after for you was when I had a different branch checked out. [01:13:40] Fixed now [01:14:36] Heh "recheck" collisions [01:15:00] FWIW it was also not working locally [01:15:27] AndyRussG: oh [01:15:28] ? [01:15:30] What did you get locally [01:16:40] (03PS1) 10Dduvall: Generalize qunit setup/cleanup of MW localhost [integration/config] - 10https://gerrit.wikimedia.org/r/220682 [01:17:00] Krinkle: Could be something totally unrelated https://tools.wmflabs.org/paste/view/1fa1d343 [01:17:42] Krinkle: all good on Jenkins now, though! [01:18:02] Krinkle: ^ for when your ops/puppet patch is merged [01:18:28] marxarelli: OK. Will take a look. [01:18:34] I may have written a similar patch locally [01:18:50] I'll actualy rename it to localhost/jenkins [01:18:57] since I plan to use it for non-mediawiki testing as well [01:19:06] eg. screenshot visual regression testing for standalone libraries like oojs [01:19:30] Krinkle: OOUI, you mean? [01:19:37] yeah [01:19:43] Krinkle: thanks BTW! [01:19:44] OK, good. [01:19:49] AndyRussG: What are the environemnt varirables MW_SERVEr and MW_SCRIPT_PATH set to? [01:19:57] I was worried that we'd accidentally added user-facing features to OOjs. :-) [01:20:09] AndyRussG: does http://localhost/mw1/mw1/index.php actually exist? [01:20:11] (for you) [01:20:17] because that's what it's trying to access [01:20:19] Krinkle: aaarrrggggg [01:20:32] James_F: :) [01:21:09] Krinkle: cool. whichever you want to use. i'll rebase my patch for the mw-selenium builder tomorrow [01:21:28] see y'all! [01:21:41] marxarelli: Thx for bringing thi up [01:22:22] Krinkle: yes that was it, apparently: Chrome 43.0.2357 (Linux 0.0.0): Executed 345 of 345 SUCCESS (2.449 secs / 2.407 secs) [01:22:36] That seems awfully fast [01:22:37] Yay [01:22:47] Lemme make a test fail to see [01:23:04] Tests completed in 3068 milliseconds. [01:23:04] 2162 assertions of 2162 passed, 0 failed. [01:23:14] I'm getting that^ on mediawiki + centralnotice [01:23:31] 345 tests indeed [01:23:36] looks right [01:24:05] javascript isn't slow, the DOM is. [01:24:52] Krinkle: yeah! running on the command line did catch the failure [01:35:11] (03PS1) 10Legoktm: [WIP] Add generic 'test' job to run npm and composer [integration/config] - 10https://gerrit.wikimedia.org/r/220689 [01:35:58] (03CR) 10Legoktm: [C: 04-1] "* npm runs on trusty, but composer needs precise for 5.3 linting" [integration/config] - 10https://gerrit.wikimedia.org/r/220689 (owner: 10Legoktm) [01:40:50] James_F|Away: https://www.mediawiki.org/wiki/Banana-checker since people are asking me wtf banana-checker is [01:44:12] (03PS1) 10Krinkle: contint: Rename re-usable 'qunit-localhost' macros to 'localhost' [integration/config] - 10https://gerrit.wikimedia.org/r/220690 (https://phabricator.wikimedia.org/T103766) [01:44:30] (03Abandoned) 10Krinkle: Generalize qunit setup/cleanup of MW localhost [integration/config] - 10https://gerrit.wikimedia.org/r/220682 (owner: 10Dduvall) [01:50:57] (03PS2) 10Krinkle: contint: Rename re-usable 'qunit-localhost' macros to 'localhost' [integration/config] - 10https://gerrit.wikimedia.org/r/220690 (https://phabricator.wikimedia.org/T103766) [01:59:47] 10Continuous-Integration-Infrastructure, 10Wikibase-Quality-Constraints, 10Wikidata, 3Wikidata-Sprint-2015-06-16: MW_INSTALL_PATH incorrect for WikibaseQualityConstraints jenkins jobs - https://phabricator.wikimedia.org/T103626#1398777 (10Krinkle) This job creates LocalSettings.php (mw-apply-settings.sh),... [02:06:55] 10Continuous-Integration-Infrastructure, 7Pywikibot-tests: Python requests[security] requires libffi which isnt on the CI workers - https://phabricator.wikimedia.org/T103775#1398785 (10jayvdb) 3NEW [02:11:45] 10Continuous-Integration-Infrastructure, 7Pywikibot-tests: Python requests[security] requires libffi which isnt on the CI workers - https://phabricator.wikimedia.org/T103775#1398797 (10Legoktm) a:3Legoktm [02:14:21] 10Continuous-Integration-Infrastructure, 7Pywikibot-tests: Python requests[security] requires libffi which isnt on the CI workers - https://phabricator.wikimedia.org/T103775#1398808 (10jayvdb) The dependency tree is requests[security] -> pyOpenSSL [[https://github.com/pyca/pyopenssl/blob/master/setup.py#L117 |... [02:17:18] 10Continuous-Integration-Infrastructure, 6operations, 7Blocked-on-Operations, 5Patch-For-Review: Build Debian package ruby-jsduck for Jessie - https://phabricator.wikimedia.org/T95008#1398829 (10Dzahn) a:5Dzahn>3None [02:36:12] 10Continuous-Integration-Infrastructure, 10pywikibot-core: Travis-CI access for pywikibot project - https://phabricator.wikimedia.org/T103434#1398862 (10jayvdb) 5Open>3Resolved a:3jayvdb Somehow this has magically fixed itself, as I can now access the wikimedia account on Travis, and restart builds. [02:49:44] 10Continuous-Integration-Infrastructure, 5Patch-For-Review: Generalise localhost/qunit infrastructure - https://phabricator.wikimedia.org/T103766#1398877 (10Krinkle) After deploying https://gerrit.wikimedia.org/r/220666 Puppet ensures present: ``` /srv/localhost-worker (created) /etc/apache2/sites-availabl... [03:05:01] (03CR) 10Krinkle: [C: 032] "Deployed 'mediawiki-core-qunit' 'mediawiki-extensions-qunit' 'mwext-qunit' 'mwext-*-qunit' 'mwext-*-qunit-mobile'" [integration/config] - 10https://gerrit.wikimedia.org/r/220690 (https://phabricator.wikimedia.org/T103766) (owner: 10Krinkle) [03:06:54] (03Merged) 10jenkins-bot: contint: Rename re-usable 'qunit-localhost' macros to 'localhost' [integration/config] - 10https://gerrit.wikimedia.org/r/220690 (https://phabricator.wikimedia.org/T103766) (owner: 10Krinkle) [03:19:26] 10Continuous-Integration-Infrastructure, 7Technical-Debt: Generalise localhost/qunit infrastructure - https://phabricator.wikimedia.org/T103766#1398916 (10Krinkle) 5Open>3Resolved p:5Triage>3Normal [03:38:07] 10Deployment-Systems, 5Patch-For-Review: Jouncebot should not mix SWATters and patch owners - https://phabricator.wikimedia.org/T101329#1398952 (10Krenair) a:3bd808 [03:38:13] 10Deployment-Systems, 5Patch-For-Review: Jouncebot should not mix SWATters and patch owners - https://phabricator.wikimedia.org/T101329#1398953 (10Krenair) 5Open>3Resolved [05:19:48] (03PS1) 10Krinkle: Generalise cdb-coverage into phpunit-coverage-publish [integration/config] - 10https://gerrit.wikimedia.org/r/220705 [05:50:56] ooh yay [05:59:46] legoktm: Any ideas what to do about this error? https://gist.githubusercontent.com/Krinkle/26f5f061555c699137bf/raw/26d58d2182df3904ecef20c099adbf57522f08cf/gistfile1.txt [05:59:50] Im stil all of a sudden [06:00:01] jenkins-jobs worked one minute and now it's failing every time [06:00:11] 'test' works but 'update' is broken [06:00:13] wtf [06:00:21] (chatlog from #openstack-infa) [06:00:23] infra [06:00:40] full stack: https://gist.githubusercontent.com/Krinkle/45490f91459086e5378d/raw [06:02:04] um what [06:02:15] oh [06:02:21] maybe you don't have the proper root certs? [06:02:44] I don't know. It worked earlier today [06:02:48] I must've done something. [06:03:00] How do I check? [06:03:56] doing e.g. curl -i 'https://integration.wikimedia.org/ci/' works fine. No error there. [06:04:01] >>> import urllib2 [06:04:01] >>> urllib2.urlopen('https://integration.wikimedia.org/ci') [06:04:01] > [06:04:03] try that? [06:04:21] same error [06:04:27] File "/usr/local/Cellar/python/2.7.10/Frameworks/Python.framework/Versions/2.7/lib/python2.7/urllib2.py", line 1197, in do_open [06:04:27] raise URLError(err) [06:04:27] urllib2.URLError: [06:04:42] Python 2.7.10 (default, Jun 10 2015, 19:42:47) [06:04:47] From Homebrew [06:04:50] did a fresh install just in case [06:05:13] yeah, I think you're missing the root cert [06:05:26] which is weird...because you shouldn't be [06:06:05] I can reproduce on my macbook using python from homebrew [06:06:06] weird [06:06:43] If I use the default python from mac (2.7.6) it works [06:06:46] Krinkle: if I use built-in python through /usr/bin/python (2.7.6) it works fine [06:06:48] heh [06:06:55] presumably because validation was new in 2.7.9 [06:07:04] but jenkins-jobs doesn't work on 2.7.6 or at least not on Mac [06:07:11] Or can you get it to work? [06:07:17] 2.7.9 added SNI support [06:07:40] using 'sudo python setup.py install' and then e.g. doing a 'test' build with jjb [06:09:22] in pywikibot we just ended up bundling root certs with the library we were using [06:09:22] that's what requests does too [06:09:59] if I can get jjb to work on default python thats fine too [06:12:06] it installs... [06:14:16] after installing and running test I get: [06:14:17] from six.moves.http_client import BadStatusLine [06:14:18] ImportError: No module named http_client [06:14:41] File "/Users/krinkle/Development/wikimedia/integration/jenkins-job-builder/jenkins_jobs/builder.py", line 27, in [06:14:42] import jenkins [06:14:42] File "/Library/Python/2.7/site-packages/jenkins/__init__.py", line 52, in [06:14:43] from six.moves.http_client import BadStatusLine [06:14:45] ImportError: No module named http_client [06:14:49] pip install six [06:15:08] pip not found :) - because I removed homebrew python [06:15:14] no pip on default mac [06:15:18] from easy install? [06:15:26] oh argh [06:15:30] use a virtualenv :| [06:15:38] virtualenv -p /usr/bin/python [06:15:46] it says six is already installed [06:15:52] maybe an older version? [06:15:55] trying virt [06:16:03] no, too new version probably [06:16:08] I did with --upgrade as well [06:16:11] same error in jjb [06:16:12] that will set you up using your system python, but gives you pip and lets you mess with things without root [06:16:38] I got: ImportError: No module named six.moves with a different traceback [06:16:51] installing six 1.9.0 fixed that, now it's installing pyyaml [06:18:02] wait how does that virt work? I installed virtualenv using pip just now [06:18:10] $ virtualenv -p /usr/bin/python [06:18:10] Running virtualenv with interpreter /usr/bin/python2.7 [06:18:11] You must provide a DEST_DIR [06:18:16] oh [06:18:29] virtualenv -p /usr/bin/python foobar [06:18:32] source foobar/bin/activate [06:19:19] and then re-install jjb? [06:19:25] yes [06:20:18] OK. will stick with foobar :P [06:20:36] after activating that and having python resolve to the local one (which python = foobar/bin/..) running setup.py install gives [06:20:38] writing requirements to jenkins_job_builder.egg-info/requires.txt [06:20:38] error: jenkins_job_builder.egg-info/requires.txt: Permission denied [06:20:44] let me clear a few things [06:21:00] o.o [06:21:09] doing git clean -dffx [06:21:14] probably from earlier installs it's now root [06:21:16] and it's re-using that [06:23:00] OK.... jenkins-job is now /foobar/bin/jenkins-jobs, running it still gives : [06:23:00] ImportError: No module named six.moves [06:23:05] https://stackoverflow.com/questions/27835619/ssl-certificate-verify-failed-error/30209998#30209998 claims that this is a homebrew specific problem [06:23:07] woo progress! [06:23:10] pip install six [06:23:12] and installing then [06:23:13] yaml [06:23:18] pip install pyyaml :P [06:23:23] and probably `pbr` [06:23:44] does it have no dependency list or something? [06:24:05] ImportError: No module named pbr.version [06:24:05] yeah [06:24:16] ImportError: No module named jenkins [06:24:33] AttributeError: 'module' object has no attribute 'Jenkins' [06:24:43] (after installing pbr and jenkins) [06:24:46] uhh, idk what jenkins is [06:25:16] https://github.com/openstack-infra/jenkins-job-builder/blob/master/requirements.txt [06:25:20] ah there's a list [06:25:21] .. [06:25:26] oh [06:25:32] pip install -r requirements.txt :P [06:25:46] Hm.. used pip install -e . instead [06:26:07] which is supposed to be requirements + setup.py [06:26:21] OK. Now the 'test' command is working [06:26:35] https://github.com/Homebrew/homebrew/issues/39870 says brew's openssl has expired certs [06:26:59] so now you can use /path/to/foobar/bin/jenkins-job directly without activating the venv [06:27:55] woo, pushing jenkins jobs [06:28:07] Ill keep this tab and env open and never touch it again [06:28:24] (03CR) 10Krinkle: [C: 032] "Deployed phpunit-coverage-publish." [integration/config] - 10https://gerrit.wikimedia.org/r/220705 (owner: 10Krinkle) [06:28:32] https://github.com/Homebrew/homebrew/issues/38226 suggests `brew reinstall openssl python` might work [06:28:53] legoktm: thx, the virtualenv is what did it. From there a plain 'pip install [-e] .' is all I need. [06:29:00] WOOT [06:29:07] accidental caps lock :P [06:29:19] I imagine the virt will not work on homebrew python [06:29:28] the old python is what makes it 'work' [06:30:00] though for whatever reason the pip and old python without virtualenv don't install some dependencies properly [06:30:05] because homebrew python is linked against brew's openssl which has the old cert [06:30:12] yeah [06:30:12] (03Merged) 10jenkins-bot: Generalise cdb-coverage into phpunit-coverage-publish [integration/config] - 10https://gerrit.wikimedia.org/r/220705 (owner: 10Krinkle) [06:32:13] re-installs fabric [06:32:41] legoktm: I've already re-installed both. Didn't work [06:33:39] !log Reloading Zuul to deploy https://gerrit.wikimedia.org/r/220705 [06:33:45] Logged the message, Master [06:33:50] $ zuul enqueue --trigger gerrit --pipeline postmerge --project cdb --change 219468,3 [06:33:55] legoktm: btw, I love this^ [06:34:07] yeah :D hashar taught me that in lyon [06:35:09] * Krinkle re-installs git-review [06:35:11] darn [06:35:13] this is gonna be a long day [06:35:31] err [06:35:38] dont [06:35:50] just alias jenkins-jobs=foobar/bin/jenkins-jobs [06:35:50] (03PS1) 10Krinkle: Add doxygen and coverage publish for IPSet [integration/config] - 10https://gerrit.wikimedia.org/r/220712 [06:36:11] legoktm: still, I lost python/pip because I cleared out all stuff from homebrew python [06:36:18] oh :( [06:36:19] 6Release-Engineering, 10MediaWiki-File-management, 10MediaWiki-Tarball-Backports, 6Multimedia, and 6 others: InstantCommons broken by switch to HTTPS - https://phabricator.wikimedia.org/T102566#1399147 (10Legoktm) >>! In T102566#1384154, @faidon wrote: > Our CA for production is GlobalSign. It is one of th... [06:36:31] legoktm: but yeah, I'll re-add the homebrew version tomorrow or so [06:36:45] (03CR) 10Krinkle: [C: 032] Add doxygen and coverage publish for IPSet [integration/config] - 10https://gerrit.wikimedia.org/r/220712 (owner: 10Krinkle) [06:37:23] !log Reloading Zuul to deploy https://gerrit.wikimedia.org/r/220712 [06:37:28] Logged the message, Master [06:38:25] (03Merged) 10jenkins-bot: Add doxygen and coverage publish for IPSet [integration/config] - 10https://gerrit.wikimedia.org/r/220712 (owner: 10Krinkle) [06:38:56] Krinkle: also, I started working on the generic npm+composer job, except I ran into an issue that npm runs on trusty, and composer runs on precise: https://gerrit.wikimedia.org/r/220689 [06:39:23] don't cross the streams! [06:39:32] Yeah, that sucks. [06:39:55] legoktm: we should be able to install php53 on trusty though [06:40:22] ...really? [06:40:57] I would think it needs to link against other libs on precise... [06:41:24] (03PS1) 10Krinkle: Add IPSet to doc.wikimedia.org index [integration/docroot] - 10https://gerrit.wikimedia.org/r/220713 [06:41:45] legoktm: maybe, dunno. I've seen it done at least. [06:41:55] and Travis is doing it as well [06:42:07] They compile php5.3-5.6 on precise [06:42:16] and "soon" they'll do it for trusty as well [06:42:16] huh [06:42:24] how hard do you think it'll be? [06:42:36] like ops will get it done in a day or 5 months? :P [06:42:38] There's standard php-env libraries and stuff [06:42:46] should be pretty straight forward [06:43:25] they do require taking all php --options (there is no defaults, is there never are for php) but we can use something that resembles the ubuntu php install [06:43:42] (03CR) 10Krinkle: [C: 032] Add IPSet to doc.wikimedia.org index [integration/docroot] - 10https://gerrit.wikimedia.org/r/220713 (owner: 10Krinkle) [06:45:13] (03Merged) 10jenkins-bot: Add IPSet to doc.wikimedia.org index [integration/docroot] - 10https://gerrit.wikimedia.org/r/220713 (owner: 10Krinkle) [06:47:26] 10Continuous-Integration-Infrastructure: Investigate installing php5.3 on a trusty instance - https://phabricator.wikimedia.org/T103786#1399172 (10Legoktm) 3NEW [06:48:11] Krinkle: is #openstack-infa on a different network? I just realized I'm the only one in the channel :/ [06:48:28] infra [07:21:52] 10Continuous-Integration-Infrastructure, 10ContentTranslation-Deployments, 5Patch-For-Review: Fix npm oid jobs - https://phabricator.wikimedia.org/T92369#1399347 (10KartikMistry) [07:37:47] (03PS7) 10Krinkle: Builder for running MW-Selenium integration tests [integration/config] - 10https://gerrit.wikimedia.org/r/219513 (https://phabricator.wikimedia.org/T103039) (owner: 10Dduvall) [07:39:12] (03CR) 10Krinkle: [C: 04-1] "This can now use the 'prepare-localhost' macro." [integration/config] - 10https://gerrit.wikimedia.org/r/219513 (https://phabricator.wikimedia.org/T103039) (owner: 10Dduvall) [07:49:02] (03CR) 10Krinkle: Builder for running MW-Selenium integration tests (031 comment) [integration/config] - 10https://gerrit.wikimedia.org/r/219513 (https://phabricator.wikimedia.org/T103039) (owner: 10Dduvall) [08:04:57] !log apt-get upgrade deployment-pdf01 [08:05:01] Logged the message, Master [08:08:38] !log deployment-pdf01 deleted /var/log/ocg/ content. Last entry is from July 25th 2014 and puppet complains with e[/var/log/ocg]: Not removing directory; use 'force' to override [08:08:43] Logged the message, Master [08:13:28] 10Beta-Cluster, 10OCG-General-or-Unknown, 10OCG-PDF-renderer, 7Puppet: Error: Sysctl::Parameters[wikimedia base]: Could not evaluate: can't dup Symbol on deployment-pdf01 - https://phabricator.wikimedia.org/T87197#1399393 (10hashar) Unrelated but on deployment-pdf01 I have deleted /var/log/ocg/ content. Th... [08:39:44] !log apt-get upgrade deployment-salt [08:39:49] Logged the message, Master [08:47:40] 10Beta-Cluster, 10Continuous-Integration-Infrastructure, 10pywikibot-core, 5Patch-For-Review: Run pywikibot test suite regularly on beta cluster as part of MediaWiki/Wikimedia CI - https://phabricator.wikimedia.org/T100903#1399474 (10jayvdb) The from_url error was a case of T85658 which I had not fixed pro... [08:55:13] Yippee, build fixed! [08:55:13] Project browsertests-MultimediaViewer-en.wikipedia.beta.wmflabs.org-os_x_10.9-safari-sauce build #641: FIXED in 45 min: https://integration.wikimedia.org/ci/job/browsertests-MultimediaViewer-en.wikipedia.beta.wmflabs.org-os_x_10.9-safari-sauce/641/ [08:56:19] 10Beta-Cluster, 10OCG-General-or-Unknown, 10OCG-PDF-renderer, 7Puppet: Error: Sysctl::Parameters[wikimedia base]: Could not evaluate: can't dup Symbol on deployment-pdf01 - https://phabricator.wikimedia.org/T87197#1399486 (10hashar) 5Open>3Resolved a:3hashar I removed puppet and ruby from deployment-... [08:56:58] !log Fixed puppet "Can't dup Symbol" on deployment-pdf01 by deleting puppet, /var/lib/puppet and reinstalling it from scratch https://phabricator.wikimedia.org/T87197 [08:57:00] \O/ [08:57:03] Logged the message, Master [08:58:05] 10Beta-Cluster, 6Labs: Disable NFS home directories on deployment-prep - https://phabricator.wikimedia.org/T102169#1399502 (10hashar) [08:58:08] 10Beta-Cluster: deployment-parsoid01-test fails puppet: Could not find class role::parsoid - https://phabricator.wikimedia.org/T103731#1399499 (10hashar) 5Open>3Resolved a:3hashar I have deleted the instance. [09:09:43] 10Continuous-Integration-Infrastructure, 6operations, 7Blocked-on-Operations, 5Patch-For-Review: Build Debian package ruby-jsduck for Jessie - https://phabricator.wikimedia.org/T95008#1399511 (10akosiaris) @hashar Indeed. And, you are obviously right about bundler/gems. I did the porting of ruby-rkelly-re... [09:18:35] 10Beta-Cluster, 10Wikimedia-Logstash: deployment-logstash02 fails puppet: Apache2 can't start - https://phabricator.wikimedia.org/T103804#1399518 (10hashar) 3NEW [09:23:27] 10Beta-Cluster, 10Wikimedia-Logstash: deployment-logstash02 fails puppet: Apache2 can't start - https://phabricator.wikimedia.org/T103804#1399526 (10hashar) The instance runs Debian Jessie. It has apache 2.4 The `AuthGroupFile` seems to be provided by [[ http://httpd.apache.org/docs/2.4/mod/mod_authz_groupfil... [09:23:49] 10Beta-Cluster, 10Wikimedia-Logstash: deployment-logstash02 fails puppet: Apache2 can't start, mod_authz_groupfile not enabled on Jessie - https://phabricator.wikimedia.org/T103804#1399527 (10hashar) [09:27:09] 10Beta-Cluster, 10Wikimedia-Logstash: deployment-logstash02 fails puppet: Apache2 can't start, mod_authz_groupfile not enabled on Jessie - https://phabricator.wikimedia.org/T103804#1399534 (10hashar) For reference deployment-logtash1 is a Precise instance with Apache 2.2. ``` $ grep -R AuthGroupFile /etc/apac... [09:57:13] (03PS1) 10Polybuildr: Ignore languages/messages/Message*.php in line length sniff [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/220728 (https://phabricator.wikimedia.org/T103806) [10:19:20] 10Continuous-Integration-Infrastructure, 5Patch-For-Review, 7Pywikibot-tests: Python requests[security] requires libffi which isnt on the CI workers - https://phabricator.wikimedia.org/T103775#1399687 (10hashar) Cherry picked https://gerrit.wikimedia.org/r/220694 on integration puppetmaster. I have installe... [10:39:50] 10Beta-Cluster, 6Labs: Disable NFS home directories on deployment-prep - https://phabricator.wikimedia.org/T102169#1399716 (10hashar) Still has a bunch: ``` ^[[Aroot@deployment-salt:~# salt '*' cmd.run 'grep /home /etc/fstab|egrep ^labstore' deployment-fluorine.deployment-prep.eqiad.wmflabs: deployment-sca02.d... [10:45:11] !log deployment-sca02 deleted /var/lib/puppet/state/agent_catalog_run.lock from June 5th [10:45:17] Logged the message, Master [10:54:27] 10Beta-Cluster, 6Labs: Disable NFS home directories on deployment-prep - https://phabricator.wikimedia.org/T102169#1399818 (10hashar) a:5yuvipanda>3hashar I have cleaned up in /etc/fstab the #labstore... lines with: `salt '*' cmd.run "sed -i '/^#labstore/d' /etc/fstab"` Manually cleaned the /home entry on... [10:54:43] 10Beta-Cluster, 6Labs: Disable NFS home directories on deployment-prep - https://phabricator.wikimedia.org/T102169#1399820 (10hashar) p:5Triage>3High [10:55:02] 10Beta-Cluster, 6Labs: Disable NFS home directories on deployment-prep - https://phabricator.wikimedia.org/T102169#1399822 (10hashar) 5Open>3Resolved [10:56:35] 10Continuous-Integration-Infrastructure: Package / puppetize zuul-clear-refs.py - https://phabricator.wikimedia.org/T103529#1399839 (10hashar) a:5hashar>3None [11:00:54] 10Beta-Cluster, 6Labs: Disable NFS home directories on deployment-prep - https://phabricator.wikimedia.org/T102169#1399868 (10yuvipanda) Thank you very much :) [11:01:26] !log Unmounting /data/project and /home NFS mounts from integration-raita and integration-vmbuilder-trusty https://phabricator.wikimedia.org/T90610 [11:01:31] Logged the message, Master [11:02:32] (03PS1) 10Thiemo Mättig (WMDE): Run PHPCS for Wikibase [integration/config] - 10https://gerrit.wikimedia.org/r/220737 [11:03:26] !log Rebooting integration-raita and integration-vmbuilder-trusty [11:03:31] Logged the message, Master [11:04:00] 10Continuous-Integration-Infrastructure, 6Labs: Continuous integration should not depend on labs NFS - https://phabricator.wikimedia.org/T90610#1399888 (10hashar) labstore is gone from /etc/fstab ``` root@integration-saltmaster:~# salt '*' cmd.run 'grep labstore /etc/fstab' integration-dev.integration.eqiad.wm... [11:05:41] 10Continuous-Integration-Infrastructure, 6Labs, 10Labs-Infrastructure: Cant ssh to integration-slave-jessie-1001.integration.eqiad.wmflabs - https://phabricator.wikimedia.org/T103312#1399893 (10yuvipanda) Hmm, the bastion-01 IP was added to puppet when it was created, are you sure these were running up to da... [11:06:34] 10Continuous-Integration-Infrastructure, 6Labs: Continuous integration should not depend on labs NFS - https://phabricator.wikimedia.org/T90610#1399897 (10hashar) 5Open>3Resolved All fixed as far as I can tell. labstore is no more mounted nor in fstab. [11:07:43] 10Continuous-Integration-Infrastructure, 6Labs, 10Labs-Infrastructure: Cant ssh to integration-slave-jessie-1001.integration.eqiad.wmflabs - https://phabricator.wikimedia.org/T103312#1399900 (10hashar) For some reason ferm is no more applied on the CI instances, so it could not receive the new rules update. [11:08:09] 10Continuous-Integration-Infrastructure, 6Labs, 10Labs-Infrastructure: Cant ssh to integration-slave-jessie-1001.integration.eqiad.wmflabs - https://phabricator.wikimedia.org/T103312#1399901 (10yuvipanda) Ah, that makes sense :) [11:09:31] 10Continuous-Integration-Infrastructure: Zuul repositories have too many refs causing slow updates - https://phabricator.wikimedia.org/T70481#1399908 (10hashar) a:5hashar>3None I am not actively working on this. See list of blockers to make the clean up automatic. This task detail has the long command to ru... [11:27:33] addshore: if free, please tell me what you think about https://phabricator.wikimedia.org/T103806 [11:52:23] (03CR) 10Addshore: [C: 031] "IMO this is a good idea" [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/220728 (https://phabricator.wikimedia.org/T103806) (owner: 10Polybuildr) [11:52:45] addshore: thanks! [11:52:50] :) [12:22:52] 10Continuous-Integration-Infrastructure: Investigate installing php5.3 on a trusty instance - https://phabricator.wikimedia.org/T103786#1400131 (10hashar) To switch between PHP versions, we could go with https://github.com/phpenv/phpenv (pointed by Bryan Davis on T75356#834917 and T54303#580327). I am not a fan... [12:31:18] 6Release-Engineering, 10MediaWiki-File-management, 10MediaWiki-Tarball-Backports, 6Multimedia, and 6 others: InstantCommons broken by switch to HTTPS - https://phabricator.wikimedia.org/T102566#1400166 (10hashar) >>! In T102566#1399147, @Legoktm wrote: > > Today @Krinkle and I discovered that using homebr... [12:35:13] 10Continuous-Integration-Infrastructure, 7Technical-Debt: Delete old jobs not (or no longer) managed by JJB - https://phabricator.wikimedia.org/T91410#1400173 (10hashar) [12:35:15] 10Continuous-Integration-Infrastructure, 5Patch-For-Review: Migrate all jobs to labs slaves - https://phabricator.wikimedia.org/T86659#1400174 (10hashar) [13:04:32] Yippee, build fixed! [13:04:33] Project browsertests-MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-chrome-sauce build #695: FIXED in 32 min: https://integration.wikimedia.org/ci/job/browsertests-MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-chrome-sauce/695/ [13:15:10] (03PS1) 10Hashar: Remove mwext-Flow-qunit job (now uses mwext-qunit) [integration/config] - 10https://gerrit.wikimedia.org/r/220757 (https://phabricator.wikimedia.org/T103839) [13:18:34] (03CR) 10Hashar: [C: 032] Remove mwext-Flow-qunit job (now uses mwext-qunit) [integration/config] - 10https://gerrit.wikimedia.org/r/220757 (https://phabricator.wikimedia.org/T103839) (owner: 10Hashar) [13:18:48] (03CR) 10Addshore: Ignore languages/messages/Message*.php in line length sniff (031 comment) [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/220728 (https://phabricator.wikimedia.org/T103806) (owner: 10Polybuildr) [13:20:13] (03Merged) 10jenkins-bot: Remove mwext-Flow-qunit job (now uses mwext-qunit) [integration/config] - 10https://gerrit.wikimedia.org/r/220757 (https://phabricator.wikimedia.org/T103839) (owner: 10Hashar) [13:25:01] (03CR) 10Polybuildr: Ignore languages/messages/Message*.php in line length sniff (031 comment) [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/220728 (https://phabricator.wikimedia.org/T103806) (owner: 10Polybuildr) [13:45:06] will be back later tonight [14:07:38] (03CR) 10JanZerebecki: [C: 032] Run PHPCS for Wikibase [integration/config] - 10https://gerrit.wikimedia.org/r/220737 (owner: 10Thiemo Mättig (WMDE)) [14:07:49] (03PS2) 10JanZerebecki: Run PHPCS for Wikibase [integration/config] - 10https://gerrit.wikimedia.org/r/220737 (owner: 10Thiemo Mättig (WMDE)) [14:07:56] (03CR) 10JanZerebecki: [C: 032] Run PHPCS for Wikibase [integration/config] - 10https://gerrit.wikimedia.org/r/220737 (owner: 10Thiemo Mättig (WMDE)) [14:10:06] (03Merged) 10jenkins-bot: Run PHPCS for Wikibase [integration/config] - 10https://gerrit.wikimedia.org/r/220737 (owner: 10Thiemo Mättig (WMDE)) [14:12:56] legoktm: Thanks. [14:17:48] *sigh* someone is hogging sudo -u zuul on gallium but is not in this channel [14:20:27] !log killing a fellows idle shell zuul@gallium:~$ kill 13602 [14:20:31] Logged the message, Master [14:22:44] !log reloading zuul for https://gerrit.wikimedia.org/r/#/c/220737/2 [14:22:48] Logged the message, Master [15:18:39] Yippee, build fixed! [15:18:40] Project browsertests-CentralNotice-en.wikipedia.beta.wmflabs.org-os_x_10.9-chrome-sauce build #98: FIXED in 39 sec: https://integration.wikimedia.org/ci/job/browsertests-CentralNotice-en.wikipedia.beta.wmflabs.org-os_x_10.9-chrome-sauce/98/ [16:01:34] 10Deployment-Systems, 6Release-Engineering, 10RESTBase, 6Services, 6operations: Get ops feedback regarding the use of SSH for deployment system control channel. - https://phabricator.wikimedia.org/T102687#1400870 (10mmodell) >>! In T102687#1395521, @Joe wrote: > I strongly oppose to using mcollective, F... [16:02:42] ostriches: If you have a bit of time, I'd love a +2 on https://gerrit.wikimedia.org/r/#/c/217769/ (mw-vagrant $wgUploadPath fixes) [16:26:45] lgtm, but haven't tested. [17:10:42] 6Release-Engineering, 10MediaWiki-File-management, 10MediaWiki-Tarball-Backports, 6Multimedia, and 6 others: InstantCommons broken by switch to HTTPS - https://phabricator.wikimedia.org/T102566#1401372 (10Krinkle) >>! In T102566#1400166, @hashar wrote: >>>! In T102566#1399147, @Legoktm wrote: >> >> Today... [17:18:24] 10Beta-Cluster, 6operations, 7Blocked-on-Operations, 7Puppet: Setup a mediawiki033 on Beta Cluster that we can direct the security scanning work to - https://phabricator.wikimedia.org/T72181#1401396 (10greg) [17:29:19] 10Deployment-Systems, 7I18n: l10n-update not updating Vector - https://phabricator.wikimedia.org/T103879#1401459 (10Nemo_bis) 3NEW [17:31:25] 10Deployment-Systems, 7I18n, 7Wikimedia-log-errors: l10n-update not updating Vector - https://phabricator.wikimedia.org/T103879#1401477 (10Krenair) I have a feeling this is something to do with: > 18922 Unknown modifier 'b': [/^Vector\-action\-move/bs/i] in /srv/mediawiki/php-1.26wmf10/includes/specials/Spec... [17:45:02] 10Deployment-Systems, 7I18n, 7Wikimedia-log-errors: l10n-update not updating Vector - https://phabricator.wikimedia.org/T103879#1401521 (10matmarex) >>! In T103879#1401477, @Krenair wrote: > I have a feeling this is something to do with: >> 18922 Unknown modifier 'b': [/^Vector\-action\-move/bs/i] in /srv/me... [18:29:24] 10Deployment-Systems, 6Release-Engineering, 6Performance-Team, 6operations, 7HHVM: Translation cache exhaustion caused by changes to PHP code in file scope - https://phabricator.wikimedia.org/T103886#1401646 (10ori) 3NEW [18:31:16] 10Deployment-Systems, 6Release-Engineering, 6Performance-Team, 6operations, 7HHVM: Translation cache exhaustion caused by changes to PHP code in file scope - https://phabricator.wikimedia.org/T103886#1401657 (10Krenair) [18:34:10] 10Deployment-Systems, 10MediaWiki-ResourceLoader, 6operations: Bad cache stuck due to race condition with scap between different web servers - https://phabricator.wikimedia.org/T47877#1401662 (10Krinkle) [18:34:54] 10Deployment-Systems, 6operations, 7HHVM, 5Patch-For-Review, 15User-Bd808-Test: Scap should restart HHVM - https://phabricator.wikimedia.org/T103008#1401664 (10ori) [18:34:57] 10Deployment-Systems, 6Release-Engineering, 6Performance-Team, 6operations, 7HHVM: Translation cache exhaustion caused by changes to PHP code in file scope - https://phabricator.wikimedia.org/T103886#1401667 (10ori) [18:38:35] 10Deployment-Systems, 6Release-Engineering, 6Performance-Team, 6operations, 7HHVM: Translation cache exhaustion caused by changes to PHP code in file scope - https://phabricator.wikimedia.org/T103886#1401682 (10Legoktm) [18:47:24] 10Deployment-Systems, 6Release-Engineering, 6Performance-Team, 6operations, 7HHVM: Translation cache exhaustion caused by changes to PHP code in file scope - https://phabricator.wikimedia.org/T103886#1401731 (10Manybubbles) Do you mean: HHVM's translation cache does *not* have an eviction mechanism, or i... [18:51:28] 10Deployment-Systems, 6Release-Engineering, 6Performance-Team, 6operations, 7HHVM: Translation cache exhaustion caused by changes to PHP code in file scope - https://phabricator.wikimedia.org/T103886#1401738 (10ori) [18:52:24] 10Deployment-Systems, 6Release-Engineering, 6Performance-Team, 6operations, 7HHVM: Translation cache exhaustion caused by changes to PHP code in file scope - https://phabricator.wikimedia.org/T103886#1401646 (10ori) [18:53:52] marxarelli|away: so basically the problem with https://doc.wikimedia.org/rubygems/mediawikiselenium/file.UPGRADE.html#Convert_page_object_URLs is it doesn't explain what to do in the case of page_url '<%=params[:article_name]%><%=params[:hash]%>' [18:53:53] 10Continuous-Integration-Infrastructure: Request Jenkins shell access for account "sniedzielski" - https://phabricator.wikimedia.org/T103192#1401763 (10hashar) I forgot to grant you sudo, that is now granted. The allowed user is: Sniedzielski Looking at the auth.log that is the proper username, but ssh reject... [18:54:01] i get bad URI(is not URI?): Selenium_Gather test (URI::InvalidURIError) [18:54:41] jdlrobson: he may not reply soon, he had a family emergency this morning [18:55:22] ohhh thanks for letting me know. Hoping someone else can help me here (context upgrading selenium gem - https://gerrit.wikimedia.org/r/220566 ) [18:56:27] i'm guessing it is something super trivial - i bet zeljkof-conferen knows the answer .. :/ [18:56:51] unfortunately not anyone right now /me grumbles about losing his backfill [18:58:41] i'll have to learn Ruby!! :D [18:59:40] jdlrobson: context of my grumble: I had a backfill to fill which would be someone who could help here, but I lost it in the great budget crunch of 2015. :/ [19:00:00] (03PS1) 10JanZerebecki: Only merge composer.json from extensions that are requested. [integration/config] - 10https://gerrit.wikimedia.org/r/220924 [19:00:30] basically, for next year, my team sizze (not counting manual testers that moved into other teams) was reduced by 1 [19:00:39] * jdlrobson hugs greg-g [19:00:46] s/my/our/ [19:00:51] yeh Arthur was telling me [19:01:43] 10Deployment-Systems, 6Performance-Team, 6operations: During deployment old servers may populate new cache URIs - https://phabricator.wikimedia.org/T47877#1401779 (10Krinkle) [19:02:21] hey [19:02:34] hola [19:03:32] 10Deployment-Systems, 6Performance-Team, 6operations: During deployment old servers may populate new cache URIs - https://phabricator.wikimedia.org/T47877#510379 (10Krinkle) >>! In T47877#979631, @Jdforrester-WMF wrote: > It's an over-optimisation in ResourceLoader which creates a bug exposed by the way we d... [19:08:01] (03PS2) 10JanZerebecki: Only merge composer.json from extensions that are requested. [integration/config] - 10https://gerrit.wikimedia.org/r/220924 [19:09:30] !log purged all WikidataQuality workspaces. Got renamed to WikibaseQuality* [19:09:36] Logged the message, Master [19:11:57] 10Deployment-Systems, 6Release-Engineering, 6Performance-Team, 6operations, 7HHVM: Translation cache exhaustion caused by changes to PHP code in file scope - https://phabricator.wikimedia.org/T103886#1401821 (10Joe) @manybubbles it does not have an eviction mechanism at all. [19:12:09] (03CR) 10JanZerebecki: [C: 032] Only merge composer.json from extensions that are requested. [integration/config] - 10https://gerrit.wikimedia.org/r/220924 (owner: 10JanZerebecki) [19:12:47] 10Deployment-Systems, 6Release-Engineering, 6Performance-Team, 6operations, 7HHVM: Translation cache exhaustion caused by changes to PHP code in file scope - https://phabricator.wikimedia.org/T103886#1401824 (10Manybubbles) >>! In T103886#1401821, @Joe wrote: > @manybubbles it does not have an eviction m... [19:14:02] (03Merged) 10jenkins-bot: Only merge composer.json from extensions that are requested. [integration/config] - 10https://gerrit.wikimedia.org/r/220924 (owner: 10JanZerebecki) [19:15:53] (03CR) 10Legoktm: "Errr, maybe this should be moved to a script in integration/jenkins?" [integration/config] - 10https://gerrit.wikimedia.org/r/220924 (owner: 10JanZerebecki) [19:20:23] 10Beta-Cluster, 6operations, 7Blocked-on-Operations, 5Patch-For-Review, 7Puppet: Setup a mediawiki033 on Beta Cluster that we can direct the security scanning work to - https://phabricator.wikimedia.org/T72181#1401847 (10greg) >>! In T72181#1147999, @yuvipanda wrote: > Note that the old mediawiki03 doesn... [19:23:04] (03PS1) 10Legoktm: Publish phpunit coverage for utfnormal, at-ease & AhoCorasick [integration/config] - 10https://gerrit.wikimedia.org/r/220937 [19:28:24] Krinkle: thanks for your help w/ Jenkins yesterday! Quick question if you have a sec (np if not): I'm kinda going to town with this CN refactor and deprecating RL modules, just because better names. Can you think of any significant reasons not to, say, performancewise? Basically all the modules currently loaded from our cached HTML will be depreacted. Most will be empty with no dependencies. A couple will be empty and will just have as [19:28:24] dependencies the new modules I want to bring in. Should I be worried about anything? [19:29:49] 10Deployment-Systems, 6Release-Engineering, 6Performance-Team, 6operations, 7HHVM: Translation cache exhaustion caused by changes to PHP code in file scope - https://phabricator.wikimedia.org/T103886#1401890 (10bd808) > Avoid deploying changes to StartProfile.php and wikitech.php in quiet hours. I'm not... [19:30:39] (03PS1) 10BryanDavis: Add an hhvm-graceful-all command [tools/scap] - 10https://gerrit.wikimedia.org/r/220941 (https://phabricator.wikimedia.org/T103886) [19:31:10] (03CR) 10jenkins-bot: [V: 04-1] Add an hhvm-graceful-all command [tools/scap] - 10https://gerrit.wikimedia.org/r/220941 (https://phabricator.wikimedia.org/T103886) (owner: 10BryanDavis) [19:33:59] (03PS2) 10BryanDavis: Add an hhvm-graceful-all command [tools/scap] - 10https://gerrit.wikimedia.org/r/220941 (https://phabricator.wikimedia.org/T103886) [19:37:30] (03CR) 10JanZerebecki: "Yes." [integration/config] - 10https://gerrit.wikimedia.org/r/220924 (owner: 10JanZerebecki) [19:45:47] 10Beta-Cluster, 6operations, 7Blocked-on-Operations, 5Patch-For-Review, 7Puppet: Setup a mediawiki033 on Beta Cluster that we can direct the security scanning work to - https://phabricator.wikimedia.org/T72181#1401958 (10yuvipanda) It's a different mediawiki03! Just because it's the same name and runs th... [19:50:47] 10Beta-Cluster, 6Security-Team, 6operations, 7Blocked-on-Operations, and 2 others: Setup a dedicated mediawiki host in Beta Cluster that we can use for security scanning - https://phabricator.wikimedia.org/T72181#1401976 (10greg) [20:01:12] 10Beta-Cluster, 6Labs, 10Mathoid, 7Shinken: Shinken is showing HTTP 404 warnings for deployment-mathoid/sca02 mathoid services - https://phabricator.wikimedia.org/T103595#1402018 (10hashar) In operations/puppet.git `modules/beta/files/shinken.cfg` define the check as: ``` define service { service_descr... [20:02:48] 10Beta-Cluster, 6Labs, 10Mathoid, 7Shinken: Shinken is showing HTTP 404 warnings for deployment-mathoid/sca02 mathoid services - https://phabricator.wikimedia.org/T103595#1402042 (10Krenair) Huh. Not sure how I missed that service definition in shinken.cfg. Can we make it GET /_info like prod? [20:05:04] 10Beta-Cluster, 6Labs, 10Mathoid, 7Shinken: Shinken is showing HTTP 404 warnings for deployment-mathoid/sca02 mathoid services - https://phabricator.wikimedia.org/T103595#1402059 (10hashar) a:3hashar [20:05:37] 10Beta-Cluster, 6Labs, 10Mathoid, 7Monitoring, 7Shinken: Shinken is showing HTTP 404 warnings for deployment-mathoid/sca02 mathoid services - https://phabricator.wikimedia.org/T103595#1394154 (10hashar) [20:06:09] 10Beta-Cluster, 6Labs, 10Mathoid, 7Monitoring, 7Shinken: Shinken is showing HTTP 404 warnings for deployment-mathoid/sca02 mathoid services - https://phabricator.wikimedia.org/T103595#1394154 (10hashar) p:5Triage>3Normal [20:07:01] 10Beta-Cluster, 10Mathoid, 7Monitoring, 5Patch-For-Review, 7Shinken: Shinken is showing HTTP 404 warnings for deployment-mathoid/sca02 mathoid services - https://phabricator.wikimedia.org/T103595#1402068 (10greg) [20:09:52] 10Beta-Cluster, 10Mathoid, 7Monitoring, 5Patch-For-Review, 7Shinken: Shinken is showing HTTP 404 warnings for deployment-mathoid/sca02 mathoid services - https://phabricator.wikimedia.org/T103595#1402074 (10hashar) [20:11:42] 10Beta-Cluster, 10Mathoid, 7Monitoring, 5Patch-For-Review, 7Shinken: Shinken is showing HTTP 404 warnings for deployment-mathoid/sca02 mathoid services - https://phabricator.wikimedia.org/T103595#1394154 (10hashar) Seems Mathoid changed recently and no more honors `GET /` and now requires a POST and the... [20:12:53] AndyRussG: Performance-wise I wouldn't worry. [20:13:17] AndyRussG: UX-wise, and for sake for analytics and fundraising, be sure to keep the old module names as aliases to the new ones for at least 30 days. [20:13:36] and if you split up or merge any modules, make sure the logic of the old module name still works. [20:33:32] 10Beta-Cluster, 10Mathoid, 7Monitoring, 5Patch-For-Review, 7Shinken: Shinken is showing HTTP 404 warnings for deployment-mathoid/sca02 mathoid services - https://phabricator.wikimedia.org/T103595#1402226 (10mobrovac) @Krenair is right, the check needs to be changed to `GET /_info`, that happened with Mat... [20:42:21] Krinkle: thanks! What exactly do you mean by "if you split up or merge any modules, make sure the logic of the old module name still works" ? [20:43:08] If you mean support access to CN API features that may be called on publicly viewable objects, yes, we're doing that [20:43:38] AndyRussG: If you split up a module into two separate modules or logically re-arrange how the whole thing works, make sure that pages loading the old module name (and nothing else, no extra mw.config vars, the same page as it was loading that (new) module) will still work [20:43:39] But scripts and methods are in fact moving around, so there'll be a new API too [20:44:34] Krinkle: ah yes. So the old modules will just bring in the new ones as dependencies and old API calls that we may find in banners are still supported [20:44:57] Krinkle: https://www.mediawiki.org/wiki/Extension:CentralNotice/Notes/Banner_controller_refactoring#RL_module_deprecation [20:45:32] Yes it's a big change, though! [20:45:42] AndyRussG: cool [20:46:53] Yeah, just be aware that while the new modules will be deployed instantly (through the old name) the surrounding page is still old. So if you depend on any specific mw.config values or something in the skin html, that wil still be outdated. It's easy to miss that in local development where there's no old html and just think that the old module will load the new and that's all. [20:47:00] 10Beta-Cluster, 10Mathoid, 7Monitoring, 5Patch-For-Review, 7Shinken: Shinken is showing HTTP 404 warnings for deployment-mathoid/sca02 mathoid services - https://phabricator.wikimedia.org/T103595#1402266 (10hashar) Sorry I have missed krenair comment. That works indeed: ``` $ curl http://localhost:100has... [20:47:07] I'm emphasising it because it bit me more than once :P [20:57:24] Krinkle: got it! Yeah, I don't think we'll be changing any config values [20:58:50] But yea, just to recap, anything in the HTML returned by the initial request is 30-day-cached, but whatever is actually loaded by calls to mw.loader.load() is only cached a few minutes as per standard RL module cache times, and that includes which modules depend on which others .... correct? [21:00:52] Krinkle: ^ [21:01:17] AndyRussG: Effectively yes. [21:01:44] AndyRussG: load.php is actually cached indefinitely, with the exception of the startup module (which is purged within 5 minutes if a change happened) [21:01:54] and the mw.loader makes load.php requests that contain the version number [21:02:08] so all clients discover the latest manifest of modules, versions and dependencies in < 5min [21:13:48] 6Release-Engineering, 6Team-Practices: Do 90 day review of post-offsite actions in early August '15 - https://phabricator.wikimedia.org/T103917#1402373 (10greg) 3NEW a:3demon [21:20:18] Krinkle: got it ;) [21:21:56] !log updated deployment-salt to match puppet by rm /var/lib/git/operations/puppet/modules/cassandra per godog's instructions [21:22:01] Logged the message, Master [21:32:57] 10Deployment-Systems, 6Release-Engineering, 6Performance-Team, 6operations, and 2 others: Translation cache exhaustion caused by changes to PHP code in file scope - https://phabricator.wikimedia.org/T103886#1402487 (10Quiddity) [21:59:36] 6Release-Engineering, 3releng-201415-Q3, 3releng-201415-Q4: [Quarterly Success Metric] RelEng+TPG process discussion and improvements (tracking) - https://phabricator.wikimedia.org/T88708#1402607 (10greg) 5stalled>3Resolved Closing this after our offsite. Pictures of the flip charts (private for now, ju... [22:31:10] 10Deployment-Systems, 6Release-Engineering, 6Performance-Team, 6operations, and 2 others: Translation cache exhaustion caused by changes to PHP code in file scope - https://phabricator.wikimedia.org/T103886#1402775 (10faidon) > Iterate on the graceful restart procedure until it no longer generates alerts o... [22:33:17] can i get v+1 rights added to Cindy-the-browser-test-bot in gerrit for the mediawiki/extensions/CirrusSearch repo? [22:33:37] * ebernhardson has no clue how that stuff is managed [22:34:16] there's Cindy now, too? [22:34:24] what happened to Arthur? [22:34:27] he wouldn't let me reuse the Bob account :P [22:34:47] :) [22:55:47] ebernhardson: You'll need a repo owner of CirrusSearch or a gerrit admin to grant that permission in the ACL of hta trepo [22:56:37] Although MobileFrontend doesn't do that. [22:56:38] Interesting [22:57:08] ebernhardson: The bot does CR+1 which is fine. [22:57:15] V+1 would be tricky as it would conflict with Jenkins [23:00:36] Krinkle: seems sane enough, i'll do that [23:01:12] ebernhardson: At least, that's what MobileFrontend does right now. Seems sane to copy that. [23:01:18] Maybe the docs are outdated? [23:02:24] Krinkle: i was actually just looking at the python and it has both options, either 'verified' which does +2/-2 or non-verified, with is 0, -1 [23:02:37] so was going to switch to +1/-1 and run the verified option [23:30:40] legoktm: Want to do another npm push on skins this time? [23:31:07] James_F: yeah sure, let me do the CI change now [23:32:09] (03PS1) 10Legoktm: Configure npm for CologneBlue,Modern,MonoBook,Vector [integration/config] - 10https://gerrit.wikimedia.org/r/221001 [23:32:27] (03CR) 10Jforrester: [C: 031] Configure npm for CologneBlue,Modern,MonoBook,Vector [integration/config] - 10https://gerrit.wikimedia.org/r/221001 (owner: 10Legoktm) [23:34:21] 10Deployment-Systems, 6Labs, 10wikitech.wikimedia.org, 5Patch-For-Review: Merge as many configuration hacks in wikitech.php configuration file as possible into InitialiseSettings.php - https://phabricator.wikimedia.org/T75939#1403089 (10Krenair) (Re-did the above in https://gerrit.wikimedia.org/r/#/c/22084... [23:35:25] (03PS2) 10Legoktm: Configure npm for CologneBlue,Modern,MonoBook,Vector [integration/config] - 10https://gerrit.wikimedia.org/r/221001 [23:35:35] (03CR) 10Legoktm: [C: 032] Configure npm for CologneBlue,Modern,MonoBook,Vector [integration/config] - 10https://gerrit.wikimedia.org/r/221001 (owner: 10Legoktm) [23:36:29] legoktm: Pushed? [23:36:35] not yet [23:36:41] I'll !log when that happens [23:36:57] Kk. [23:37:25] (03Merged) 10jenkins-bot: Configure npm for CologneBlue,Modern,MonoBook,Vector [integration/config] - 10https://gerrit.wikimedia.org/r/221001 (owner: 10Legoktm) [23:38:09] !log deploying https://gerrit.wikimedia.org/r/221001 [23:38:14] Logged the message, Master [23:38:27] James_F: ^ done [23:39:22] legoktm: And done. [23:40:33] woot [23:44:47] 10Deployment-Systems, 6Labs, 10wikitech.wikimedia.org, 5Patch-For-Review: Merge as many configuration hacks in wikitech.php configuration file as possible into InitialiseSettings.php - https://phabricator.wikimedia.org/T75939#1403128 (10Krenair) Only other thing that stands out as needing to go is $wgOpenS... [23:45:01] 10Deployment-Systems, 6Labs, 10wikitech.wikimedia.org: Merge as many configuration hacks in wikitech.php configuration file as possible into InitialiseSettings.php - https://phabricator.wikimedia.org/T75939#1403129 (10Krenair) [23:54:41] (03CR) 10Ori.livneh: [C: 032] "Thanks for jumping on this so quickly." [tools/scap] - 10https://gerrit.wikimedia.org/r/220941 (https://phabricator.wikimedia.org/T103886) (owner: 10BryanDavis) [23:55:01] (03Merged) 10jenkins-bot: Add an hhvm-graceful-all command [tools/scap] - 10https://gerrit.wikimedia.org/r/220941 (https://phabricator.wikimedia.org/T103886) (owner: 10BryanDavis)