[00:11:56] <shinken-wm>	 RECOVERY - Free space - all mounts on integration-slave-trusty-1012 is OK All targets OK
[00:23:16] <Luke081515>	 greg-g: Should I create a phab task for that beta issue?
[01:01:16] <wikibugs>	 10Beta-Cluster, 6Collaboration-Team: Decide what to do with ee_prototypewiki in beta - https://phabricator.wikimedia.org/T107397#1493875 (10Krenair) 3NEW
[01:03:40] <wikibugs>	 10Beta-Cluster, 6Collaboration-Team: Decide what to do with ee_prototypewiki in beta - https://phabricator.wikimedia.org/T107397#1493892 (10Krenair)
[01:05:52] <grrrit-wm>	 (03PS3) 10Jforrester: Run update.php with --skip-external-dependencies [integration/jenkins] - 10https://gerrit.wikimedia.org/r/187933 (https://phabricator.wikimedia.org/T88211) (owner: 10Legoktm)
[01:06:05] <grrrit-wm>	 (03CR) 10Jforrester: Run update.php with --skip-external-dependencies (031 comment) [integration/jenkins] - 10https://gerrit.wikimedia.org/r/187933 (https://phabricator.wikimedia.org/T88211) (owner: 10Legoktm)
[01:06:19] <grrrit-wm>	 (03PS4) 10Jforrester: Run update.php with --skip-external-dependencies [integration/jenkins] - 10https://gerrit.wikimedia.org/r/187933 (https://phabricator.wikimedia.org/T88211) (owner: 10Legoktm)
[01:06:31] <James_F>	 legoktm: Feel like merging ^^^ to fix this issue?
[01:06:49] <grrrit-wm>	 (03CR) 10Jforrester: "PS4 is a rebase." [integration/jenkins] - 10https://gerrit.wikimedia.org/r/187933 (https://phabricator.wikimedia.org/T88211) (owner: 10Legoktm)
[01:07:01] <legoktm>	 no, I should abandon that
[01:07:20] <James_F>	 legoktm: You think? :-(
[01:07:42] <James_F>	 legoktm: What's the alternative?
[01:07:47] <legoktm>	 fixing it properly :)
[01:08:06] <James_F>	 Making gerrit and jenkins CI do multi-commit merges?
[01:08:11] <James_F>	 That seems… ambitious.
[01:08:21] <James_F>	 And also making everyone wait another six months is not great.
[01:08:33] <legoktm>	 no, using composer for non-wmf branches, and vendor for wmf/
[01:09:15] <James_F>	 So Beta Cluster would be running composer despite being like-production?
[01:09:39] <James_F>	 That seems workable, if a little concerning.
[01:09:47] <legoktm>	 no, but that's where it gets sticky
[01:09:53] <James_F>	 Yeah.
[01:09:54] <legoktm>	 icky*?
[01:10:18] <James_F>	 Can we merge that for the 0–300 days whilst the 'minor' icky issues get resolved, at least?
[01:10:31] <James_F>	 We can even pre-write the revert if you wish.
[01:10:53] <James_F>	 But right now we break CI at least once a week, which is not cool.
[01:11:09] <legoktm>	 right
[01:11:20] <James_F>	 Compromise? :-)
[01:11:57] <legoktm>	 I'll look at it after I figure out why javascript is terrible.
[01:12:06] <James_F>	 Something with which I could help?
[01:12:12] <James_F>	 The OOUI patch?
[01:13:00] <legoktm>	 see -editing
[01:17:56] <shinken-wm>	 PROBLEM - Puppet failure on deployment-restbase01 is CRITICAL 100.00% of data above the critical threshold [0.0]
[01:24:36] <grrrit-wm>	 (03CR) 10JanZerebecki: [C: 032] Run update.php with --skip-external-dependencies [integration/jenkins] - 10https://gerrit.wikimedia.org/r/187933 (https://phabricator.wikimedia.org/T88211) (owner: 10Legoktm)
[01:24:44] <legoktm>	 okay then :P
[01:25:14] <James_F>	 Ha.
[01:25:19] <James_F>	 jzerebecki: :-)
[01:25:37] <grrrit-wm>	 (03Merged) 10jenkins-bot: Run update.php with --skip-external-dependencies [integration/jenkins] - 10https://gerrit.wikimedia.org/r/187933 (https://phabricator.wikimedia.org/T88211) (owner: 10Legoktm)
[01:25:47] <James_F>	 OMG OMG OMG. :-)
[01:28:53] <grrrit-wm>	 (03CR) 1020after4: [C: 031] Add service deploy via scap [tools/scap] - 10https://gerrit.wikimedia.org/r/224374 (owner: 10Thcipriani)
[01:32:21] <James_F>	 legoktm: You going to push that (or is it auto-pushed)?
[01:32:32] <legoktm>	 auto
[01:32:35] <jzerebecki>	 James_F: you need to wait 30min for a puppet run
[01:32:39] <James_F>	 Magic.
[01:32:47] <James_F>	 OK, well, no /vendor push expected for a week.
[01:32:56] <James_F>	 I guess we can close as 'resolved' and re-open if it doesn't work.
[01:33:23] <jzerebecki>	 James_F: this should make your live easier https://www.mediawiki.org/wiki/Requests_for_comment/Streamlining_Composer_usage
[01:34:51] <James_F>	 jzerebecki: Yes, eventually.
[01:35:07] <James_F>	 jzerebecki: But the force-merge issue has been a problem since January. :-)
[01:35:26] <jzerebecki>	 yes :(
[01:35:31] <wikibugs>	 10Continuous-Integration-Infrastructure, 10Librarization, 10MediaWiki-Vendor: Unable to update libraries in MediaWiki core and vendor due to version mismatch and circular dependencies - https://phabricator.wikimedia.org/T88211#1493939 (10Jdforrester-WMF) 5Open>3Resolved Thanks all.
[01:36:19] <James_F>	 So… in another six months, I look forward to not breaking all devs' CI for fifteen minutes (up from a half hour) whilst Jenkins thrashes.
[01:37:55] <jzerebecki>	 ambitious time schedule ;)
[01:39:57] * James_F grins.
[01:40:00] <James_F>	 Thanks, anyway.
[01:40:26] <James_F>	 (Until I get the equivalent of WordPress's 'click here to install this extension' we're failing. ;-))
[02:12:00] <wikibugs>	 10Deployment-Systems, 10MediaWiki-extensions-LocalisationUpdate, 7I18n: l10nupdate fails since 2015-07-14 - https://phabricator.wikimedia.org/T106460#1493980 (10Krenair) Still happening...
[02:20:32] <wikibugs>	 10Deployment-Systems, 10MediaWiki-extensions-LocalisationUpdate, 7I18n: l10nupdate fails since 2015-07-14 - https://phabricator.wikimedia.org/T106460#1493984 (10Krenair) >>! In T106460#1469737, @Legoktm wrote: > Did someone just run it manually? >  > [19:37:46] <logmsgbot> !log LocalisationUpdate completed (...
[02:32:18] <wikibugs>	 10Beta-Cluster, 10Pywikibot-OAuth: Set up a Pywikibot OAuth test client on the Beta cluster - https://phabricator.wikimedia.org/T104764#1493988 (10VcamX) @hashar, it looks like the OAuth client lacks the two permissions about watch list: https://travis-ci.org/VcamX/pywikibot-core/jobs/73185512#L741 https://tra...
[03:55:32] <wikibugs>	 10Deployment-Systems, 10MediaWiki-extensions-LocalisationUpdate, 7I18n: l10nupdate fails since 2015-07-14 - https://phabricator.wikimedia.org/T106460#1494015 (10mmodell) @krenair: so it's not really failing?
[04:00:04] <wikibugs>	 10Deployment-Systems, 10MediaWiki-extensions-LocalisationUpdate, 7I18n: l10nupdate fails since 2015-07-14 - https://phabricator.wikimedia.org/T106460#1494016 (10Krenair) No idea. If it is really failing, then it's also retrying successfully.
[04:09:26] <wikibugs>	 10Deployment-Systems, 10MediaWiki-extensions-LocalisationUpdate, 7I18n: l10nupdate fails since 2015-07-14 - https://phabricator.wikimedia.org/T106460#1494021 (10Krenair) I don't know what causes it to run twice though.
[04:22:16] <wikibugs>	 10Beta-Cluster: [testwiki] Cannot create a new page - "Cannot read property 'appendChild' of null TypeError" - https://phabricator.wikimedia.org/T107361#1494031 (10Krenair)
[05:03:30] <shinken-wm>	 PROBLEM - Free space - all mounts on deployment-videoscaler01 is CRITICAL deployment-prep.deployment-videoscaler01.diskspace._var.byte_percentfree (<40.00%)
[06:58:28] <shinken-wm>	 RECOVERY - Free space - all mounts on deployment-videoscaler01 is OK All targets OK
[08:29:40] <wikibugs>	 5Continuous-Integration-Isolation, 6operations, 7Nodepool: Bump our Nodepool Debian package to 0.1.1 - https://phabricator.wikimedia.org/T107266#1494222 (10hashar)
[08:29:43] <wikibugs>	 5Continuous-Integration-Isolation, 6operations, 7Nodepool, 5Patch-For-Review: Bump our Nodepool package to 0.1.0 - https://phabricator.wikimedia.org/T104971#1494220 (10hashar) 5Open>3Resolved I forgot to got any Nodepool package uploaded, so when the server got reinstalled puppet complained.  Andrew ki...
[09:08:11] <wikibugs>	 10Beta-Cluster: [testwiki] Cannot create a new page - "Cannot read property 'appendChild' of null TypeError" - https://phabricator.wikimedia.org/T107361#1494253 (10hashar) **TL;DR: the beta cluster test wiki had a MediaWiki:Common.js importer from production de.wiki which was fairly outdated.  Ccing @Nemo_bis wh...
[09:08:21] <wikibugs>	 10Beta-Cluster: [testwiki] Cannot create a new page - "Cannot read property 'appendChild' of null TypeError" - https://phabricator.wikimedia.org/T107361#1494255 (10hashar) 5Open>3Resolved a:3hashar
[09:10:36] <wikibugs>	 10Beta-Cluster, 6Collaboration-Team: Decide what to do with ee_prototypewiki in beta - https://phabricator.wikimedia.org/T107397#1494259 (10hashar) Good catch! That is a leftover from more than 3 years ago. I think we should remove it from the beta cluster.
[09:13:22] <hashar_>	 !log integration: upgrading Zuul package on Precise/Trusty instances ( https://phabricator.wikimedia.org/T106499 )
[09:13:27] <qa-morebots>	 Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL, Master
[09:17:32] <hashar>	 !log apt-get upgrade on all Trusty slaves
[09:17:37] <qa-morebots>	 Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL, Master
[09:17:53] <wikibugs>	 10Continuous-Integration-Infrastructure, 6operations: Upload new Zuul .deb package on apt.wikimedia.org for precise-wikimedia and trusty-wikimedia - https://phabricator.wikimedia.org/T106499#1494261 (10hashar) Upgraded on all CI slaves.  Thank you very much!
[10:17:45] <mobrovac>	 hashar: 'round?
[12:07:17] <shinken-wm>	 PROBLEM - Puppet failure on integration-slave-jessie-1001 is CRITICAL 100.00% of data above the critical threshold [0.0]
[12:54:13] <shinken-wm>	 PROBLEM - Host deployment-mediawiki01 is DOWN: PING CRITICAL - Packet loss = 93%, RTA = 2608.92 ms
[12:54:23] <shinken-wm>	 RECOVERY - Host deployment-mediawiki01 is UPING OK - Packet loss = 16%, RTA = 3.71 ms
[14:36:27] <wmf-insecte>	 Project browsertests-MobileFrontend-SmokeTests-linux-chrome-sauce build #210: FAILURE in 8 min 25 sec: https://integration.wikimedia.org/ci/job/browsertests-MobileFrontend-SmokeTests-linux-chrome-sauce/210/
[14:43:44] <andrewbogott>	 ostriches: can you create your bits instance now?
[14:44:53] <ostriches>	 Lemme retry
[14:46:02] <ostriches>	 Created, we'll see how it spawns
[14:58:16] <ostriches>	 andrewbogott: success!
[14:58:30] <andrewbogott>	 cool, thanks for checking.
[14:58:39] <ostriches>	 And thanks for the quick fix
[15:05:54] <wikibugs>	 10Beta-Cluster, 10Traffic, 6operations, 5Patch-For-Review: Upgrade beta-cluster caches to jessie - https://phabricator.wikimedia.org/T98758#1494796 (10demon) Got instances of `deployment-cache-*04` running jessie, all succeeding with puppet (minus TLS stuff, which I'm skipping for now to prevent the eterna...
[15:06:31] <ostriches>	 hashar_: For consistency, all of the new jessie caches are named *04
[15:06:38] <ostriches>	 So it's easier to spot them in the instance list
[15:07:33] <hashar_>	 ostriches: great! have you finished the migration already? 
[15:07:56] <ostriches>	 I finished creating the instances and putting their puppet manifests in place. Making the puppet/mw-config changes today, I hope
[15:18:41] <wmf-insecte>	 Yippee, build fixed!
[15:18:41] <wmf-insecte>	 Project browsertests-CentralNotice-en.wikipedia.beta.wmflabs.org-os_x_10.9-chrome-sauce build #133: FIXED in 40 sec: https://integration.wikimedia.org/ci/job/browsertests-CentralNotice-en.wikipedia.beta.wmflabs.org-os_x_10.9-chrome-sauce/133/
[15:27:45] <greg-g>	 Luke081515|away: yeah, if you haven't already
[15:29:00] <wmf-insecte>	 Yippee, build fixed!
[15:29:01] <wmf-insecte>	 Project browsertests-Math-en.wikipedia.beta.wmflabs.org-linux-chrome-sauce build #610: FIXED in 59 sec: https://integration.wikimedia.org/ci/job/browsertests-Math-en.wikipedia.beta.wmflabs.org-linux-chrome-sauce/610/
[15:39:26] <gwicke>	 thcipriani: you around?
[15:39:34] <thcipriani>	 gwicke: yup
[15:39:38] <thcipriani>	 what's up?
[15:40:29] <gwicke>	 hey, I rebased https://gerrit.wikimedia.org/r/#/c/219253/ and was wondering if you are still testing trebuchet in production
[15:42:10] <gwicke>	 we had old code start up earlier today after adding new nodes, which prompted me to push for this again
[15:42:24] <thcipriani>	 I saw that this morning. Since the repo_config has moved into hiera I don't see a problem with it: if we want to use trebuchet for testing purposes we can config via hiera
[15:43:14] <thcipriani>	 I'll +1
[15:43:22] <gwicke>	 okay, cool
[15:43:26] <gwicke>	 thanks!
[15:43:29] <thcipriani>	 yup
[15:58:31] <wikibugs>	 6Release-Engineering, 10Continuous-Integration-Config, 3Mobile-App-Sprint-62-Android-Summer-Breeze, 3Wikipedia-Android-App: Create jenkins slave instance dedicated to Android runs - https://phabricator.wikimedia.org/T107336#1494958 (10hashar) @thcipriani created https://integration.wikimedia.org/ci/compute...
[16:11:37] <wikibugs>	 6Release-Engineering, 10Continuous-Integration-Config, 3Mobile-App-Sprint-62-Android-Summer-Breeze, 3Wikipedia-Android-App: Create jenkins slave instance dedicated to Android runs - https://phabricator.wikimedia.org/T107336#1494980 (10hashar) I ran the job on the new slave at https://integration.wikimedia....
[16:17:40] <thcipriani>	 hashar_: so it seems like new integration slaves shouldn't be jessie until https://phabricator.wikimedia.org/T94836 is resolved?
[16:22:14] <wikibugs>	 10Deployment-Systems, 10MediaWiki-extensions-LocalisationUpdate, 7I18n: l10nupdate fails since 2015-07-14 - https://phabricator.wikimedia.org/T106460#1495006 (10mmodell) It should be running once for each deployed branch, which is currently 2 branches from Tuesday afternoon through Thursday afternoon, and 1...
[16:22:48] <hashar_>	 thcipriani: more or less
[16:22:55] <hashar_>	 thcipriani: I followed up by email and on a couple tasks
[16:23:15] <hashar_>	 thcipriani: to workaround  mediawiki::packages not being installed, I went with  a dedicated role  "light"
[16:23:23] <hashar_>	 which only includes a subset of what the other slaves have installed 
[16:23:44] <hashar_>	 I sent a bunch of description.  In short, the android sdks dependencies need to be factored out to a new contint::packages::android
[16:24:06] <hashar_>	 then we can get a new role for the android emulator such as   role::ci::slave::labs::android
[16:24:16] <hashar_>	 which would include contint::packages::android and the basic stuff required
[16:27:12] <thcipriani>	 hashar_: hmm, is adding new puppet roles the Right Thing™? We could always just make a dedicated trusty slave in the interim, get the jessie ci-slave stuff worked out, then rebuild the android slave as jessie once that's resolved.
[16:35:44] <hashar_>	 thcipriani: yeah that is another way to solve it
[16:35:46] <hashar_>	 properly easier
[16:35:53] <hashar_>	 so get a new trusty labs slave just like the other
[16:36:03] <hashar_>	 but when pooling it it would only have AndroidEmulator
[16:36:13] <hashar_>	 sorry to have mislead you in building a Jessie one :/
[16:36:26] <hashar_>	 the test job is tied to AndroidEmulator label already, so it will adjust automatically
[16:36:30] <hashar_>	 I am off gotta rush back home
[16:36:35] <thcipriani>	 hashar_: you didn't mislead me, I made a bad assumption :)
[16:36:51] <hashar_>	 na I am sure I tricked you into building a Jessie machine :D :-D
[16:36:56] * hashar_ is evil
[16:37:07] <hashar_>	 in the end +1 on Trusty
[16:37:10] <thcipriani>	 well, I have no doubt about your evil-ness :) I'll try adding a trusty slave
[16:37:14] <hashar_>	 hehe
[16:37:33] <hashar_>	 riding bicycle now, gotta close the laptop
[16:37:34] <wikibugs>	 6Release-Engineering, 10MediaWiki-Maintenance-scripts, 10MediaWiki-Redirects, 5Patch-For-Review: namespaceDupes not handling deleted namespace redirects as desired - https://phabricator.wikimedia.org/T91401#1495029 (10demon) Anything still looking out of place?
[16:47:19] <wikibugs>	 6Release-Engineering, 10MediaWiki-Maintenance-scripts, 10MediaWiki-Redirects, 5Patch-For-Review: namespaceDupes not handling deleted namespace redirects as desired - https://phabricator.wikimedia.org/T91401#1495061 (10FcoLeonSaudanha) @demon I think not, feel free to close this task
[17:04:31] <shinken-wm>	 PROBLEM - Free space - all mounts on deployment-videoscaler01 is CRITICAL deployment-prep.deployment-videoscaler01.diskspace._var.byte_percentfree (<50.00%)
[17:05:22] <grrrit-wm>	 (03CR) 10Chad: "I can't seem to find the wide discussion about bundling it on mediawiki-l you seem to be referring to. And I /am/ on the list and have sea" [tools/release] - 10https://gerrit.wikimedia.org/r/221059 (https://phabricator.wikimedia.org/T74420) (owner: 10Nemo bis)
[17:09:50] <ostriches>	 !log cleaned up /var space on deployment-videoscaler01
[17:09:55] <qa-morebots>	 Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL, Master
[17:19:32] <shinken-wm>	 RECOVERY - Free space - all mounts on deployment-videoscaler01 is OK All targets OK
[17:22:54] <wikibugs>	 6Release-Engineering, 10Continuous-Integration-Config, 3Mobile-App-Sprint-62-Android-Summer-Breeze, 3Wikipedia-Android-App: Create jenkins slave instance dedicated to Android runs - https://phabricator.wikimedia.org/T107336#1495164 (10Niedzielski) I'm not an expert but it kind of looks like we have the 32b...
[17:59:01] <wmf-insecte>	 Yippee, build fixed!
[17:59:01] <wmf-insecte>	 Project browsertests-Math-en.wikipedia.beta.wmflabs.org-linux-firefox-sauce build #616: FIXED in 59 sec: https://integration.wikimedia.org/ci/job/browsertests-Math-en.wikipedia.beta.wmflabs.org-linux-firefox-sauce/616/
[18:22:57] <wikibugs>	 10Deployment-Systems, 10MediaWiki-extensions-LocalisationUpdate, 7I18n: l10nupdate fails since 2015-07-14 - https://phabricator.wikimedia.org/T106460#1495486 (10greg) 16:17 <     bd808> ori: that l10n.php stuff that Krenair was trying to debug last night is whatever voodoo you did to build the LCStoreStaticA...
[18:30:56] <wmf-insecte>	 Yippee, build fixed!
[18:30:56] <wmf-insecte>	 Project browsertests-CentralNotice-en.wikipedia.beta.wmflabs.org-linux-firefox-sauce build #394: FIXED in 54 sec: https://integration.wikimedia.org/ci/job/browsertests-CentralNotice-en.wikipedia.beta.wmflabs.org-linux-firefox-sauce/394/
[18:36:38] <wikibugs>	 10Deployment-Systems, 10MediaWiki-extensions-LocalisationUpdate, 7I18n: l10nupdate fails and runs twice since 2015-07-14 - https://phabricator.wikimedia.org/T106460#1495534 (10greg)
[18:36:57] <wikibugs>	 10Deployment-Systems, 10MediaWiki-extensions-LocalisationUpdate, 7I18n: l10nupdate fails and runs twice since 2015-07-14 - https://phabricator.wikimedia.org/T106460#1495538 (10Krenair) <Krenair> ori, are you running l10nupdate from your crontab on tin? <ori> ....no <ori> [tin:/srv/mediawiki-staging] $ cronta...
[18:46:20] <grrrit-wm>	 (03PS12) 10Paladox: Update interwiki tests [integration/config] - 10https://gerrit.wikimedia.org/r/225313 
[18:47:55] <grrrit-wm>	 (03PS7) 10Paladox: Update ConfirmAccount tests [integration/config] - 10https://gerrit.wikimedia.org/r/225311 
[18:48:51] <grrrit-wm>	 (03PS5) 10Paladox: Update ShoutWikiAds tests [integration/config] - 10https://gerrit.wikimedia.org/r/225298 
[18:49:19] <grrrit-wm>	 (03PS9) 10Paladox: Update BreadCrumbs tests [integration/config] - 10https://gerrit.wikimedia.org/r/225291 
[18:50:11] <grrrit-wm>	 (03PS9) 10Paladox: Update farmer tests [integration/config] - 10https://gerrit.wikimedia.org/r/225042 
[18:51:52] <grrrit-wm>	 (03PS14) 10Paladox: Update SyntaxHighlight_GeSHi tests [integration/config] - 10https://gerrit.wikimedia.org/r/225035 
[18:52:14] <grrrit-wm>	 (03PS10) 10Paladox: Update tests in vector extension [integration/config] - 10https://gerrit.wikimedia.org/r/225029 
[18:53:43] <wmf-insecte>	 Yippee, build fixed!
[18:53:43] <wmf-insecte>	 Project browsertests-CentralNotice-en.wikipedia.beta.wmflabs.org-linux-chrome-sauce build #395: FIXED in 41 sec: https://integration.wikimedia.org/ci/job/browsertests-CentralNotice-en.wikipedia.beta.wmflabs.org-linux-chrome-sauce/395/
[18:58:19] <grrrit-wm>	 (03PS7) 10Paladox: Update HitCounters tests [integration/config] - 10https://gerrit.wikimedia.org/r/227438 
[19:01:25] <grrrit-wm>	 (03PS2) 10Nemo bis: Bundle HitCounters extension [tools/release] - 10https://gerrit.wikimedia.org/r/221059 (https://phabricator.wikimedia.org/T74420) 
[19:01:40] <grrrit-wm>	 (03CR) 10Nemo bis: "I added the links easier to find." [tools/release] - 10https://gerrit.wikimedia.org/r/221059 (https://phabricator.wikimedia.org/T74420) (owner: 10Nemo bis)
[19:06:14] <grrrit-wm>	 (03CR) 10JanZerebecki: [C: 04-1] "For repositories like this that should not receive a commit unless someone resurrects them, I'd prefer one job that does nothing but alway" [integration/config] - 10https://gerrit.wikimedia.org/r/225029 (owner: 10Paladox)
[19:10:29] <wikibugs>	 10Deployment-Systems, 10MediaWiki-extensions-LocalisationUpdate, 7I18n: l10nupdate fails and runs twice since 2015-07-14 - https://phabricator.wikimedia.org/T106460#1495730 (10Krenair) I still wonder whether it's being run from a place other than l10nupdate's crontab though. The line there is: `0 2 * * * /us...
[19:12:49] <grrrit-wm>	 (03CR) 10Paladox: "Ok. Should I change it to mw-check for now until the repo starts being used. Then we can change it to what ever tests are needed for the r" [integration/config] - 10https://gerrit.wikimedia.org/r/225029 (owner: 10Paladox)
[19:14:42] <grrrit-wm>	 (03PS13) 10Paladox: Add jenkins test for BoilerPlate [integration/config] - 10https://gerrit.wikimedia.org/r/226680 
[19:16:00] <grrrit-wm>	 (03PS5) 10Paladox: Update Blueprint tests [integration/config] - 10https://gerrit.wikimedia.org/r/226542 
[19:20:06] <grrrit-wm>	 (03PS5) 10Paladox: Update BlueSky tests [integration/config] - 10https://gerrit.wikimedia.org/r/226635 
[19:20:30] <wikibugs>	 10Deployment-Systems, 10MediaWiki-extensions-LocalisationUpdate, 7I18n: l10nupdate fails and runs twice since 2015-07-14 - https://phabricator.wikimedia.org/T106460#1495751 (10Krenair) It's because mira is trying to run l10nupdate and failing.
[19:25:56] <wikibugs>	 6Release-Engineering, 10MediaWiki-Maintenance-scripts, 10MediaWiki-Redirects, 5Patch-For-Review: namespaceDupes not handling deleted namespace redirects as desired - https://phabricator.wikimedia.org/T91401#1495762 (10greg) 5Open>3Resolved :)
[19:27:10] <wikibugs>	 10Deployment-Systems, 10MediaWiki-extensions-LocalisationUpdate, 7I18n: l10nupdate fails and runs twice since 2015-07-14 - https://phabricator.wikimedia.org/T106460#1495772 (10Krenair) (Mira fails all mwscript calls, because on deployment servers that reads from mediawiki-staging, which isn't getting updated...
[19:28:39] <greg-g>	 I with there was a way to award tokens to comments instead of just tasks as a whole (cc Krenair ) :)
[19:28:50] <Krenair>	 :)
[19:31:54] <grrrit-wm>	 (03CR) 10JanZerebecki: "No add a new job named fail-archived-repositories that always fails and use that in the check-only pipeline for this repository." [integration/config] - 10https://gerrit.wikimedia.org/r/225029 (owner: 10Paladox)
[19:37:05] <grrrit-wm>	 (03CR) 10Paladox: "Ok how do I do that." [integration/config] - 10https://gerrit.wikimedia.org/r/225029 (owner: 10Paladox)
[19:41:27] <ebernhardson>	 If i update a composer.json dependency in a submodule (the Elastica extension) do i need to do anything special to make sure vendor is appropriatly updated in prod for the train deployment?
[19:47:20] <wikibugs>	 6Release-Engineering, 3Team-Practices-This-Week: Write up experiences from the RelEng workshop to share with team - https://phabricator.wikimedia.org/T101570#1495800 (10KLans_WMF)
[19:49:51] <grrrit-wm>	 (03CR) 10JanZerebecki: "Documentation is at: https://www.mediawiki.org/wiki/Continuous_integration/Jenkins_job_builder" [integration/config] - 10https://gerrit.wikimedia.org/r/225029 (owner: 10Paladox)
[19:51:37] <jzerebecki>	 ebernhardson: depends, is that dependency currently deployed via vendor? then yes, you need to manually update vendor.
[19:53:48] <ebernhardson>	 jzerebecki: yes it is deployed via vendor
[19:55:33] <wikibugs>	 6Release-Engineering, 10MediaWiki-Maintenance-scripts, 10MediaWiki-Redirects, 5Patch-For-Review: namespaceDupes not handling deleted namespace redirects as desired - https://phabricator.wikimedia.org/T91401#1495844 (10He7d3r) Does this mean that if in the future a wiki deletes a custom namespace the proble...
[20:01:03] <jzerebecki>	 ebernhardson: the process is basicall run composer with the vendor repo in place (with the right branches) to update it, commit the changes, get someone to review them line by line
[20:04:55] <grrrit-wm>	 (03PS1) 10Paladox: Add new job fail-archived-repositories [integration/config] - 10https://gerrit.wikimedia.org/r/228130 
[20:05:19] <grrrit-wm>	 (03PS2) 10Paladox: Add new job fail-archived-repositories [integration/config] - 10https://gerrit.wikimedia.org/r/228130 
[20:05:57] <grrrit-wm>	 (03CR) 10Paladox: "I am doing a follow for vector. It should be easy to review." [integration/config] - 10https://gerrit.wikimedia.org/r/228130 (owner: 10Paladox)
[20:08:14] <wikibugs>	 10Deployment-Systems: Setup l10nupdate alerts to remove l10nupdate from !log'ing - https://phabricator.wikimedia.org/T107480#1495899 (10greg) 3NEW
[20:11:01] <grrrit-wm>	 (03PS1) 10BryanDavis: Send $USER and $HOSTNAME with !log messages [tools/scap] - 10https://gerrit.wikimedia.org/r/228131 (https://phabricator.wikimedia.org/T106460) 
[20:11:06] <grrrit-wm>	 (03PS1) 10Paladox: Update tests in vector extension [integration/config] - 10https://gerrit.wikimedia.org/r/228133 
[20:11:07] <grrrit-wm>	 (03CR) 10JanZerebecki: [C: 031 V: 04-1] "Looks good but would break CI for that repo if the depended on patch is not merged first." [integration/config] - 10https://gerrit.wikimedia.org/r/225291 (owner: 10Paladox)
[20:12:20] <grrrit-wm>	 (03CR) 10Paladox: "Ok I will upload a patch with the basic mw-check for now. Since this patch requires looking at the other one too." [integration/config] - 10https://gerrit.wikimedia.org/r/225291 (owner: 10Paladox)
[20:12:42] <grrrit-wm>	 (03PS2) 10Paladox: Update tests in vector extension [integration/config] - 10https://gerrit.wikimedia.org/r/228133 
[20:13:18] <grrrit-wm>	 (03CR) 10Paladox: "Please see https://gerrit.wikimedia.org/r/#/c/228133/ for vector." [integration/config] - 10https://gerrit.wikimedia.org/r/228130 (owner: 10Paladox)
[20:17:08] <grrrit-wm>	 (03CR) 10BryanDavis: "Follow up to I1d7cccdcd32cb539ca2b730e34fa9b4d451d21fc that does something similar for l10nupdate logging." [tools/scap] - 10https://gerrit.wikimedia.org/r/228131 (https://phabricator.wikimedia.org/T106460) (owner: 10BryanDavis)
[20:18:01] <grrrit-wm>	 (03PS1) 10Paladox: Update BreadCrumbs tests [integration/config] - 10https://gerrit.wikimedia.org/r/228136 
[20:18:22] <grrrit-wm>	 (03PS2) 10Paladox: Update BreadCrumbs tests [integration/config] - 10https://gerrit.wikimedia.org/r/228136 
[20:18:49] <grrrit-wm>	 (03CR) 10Greg Grossmeier: [C: 031] Send $USER and $HOSTNAME with !log messages [tools/scap] - 10https://gerrit.wikimedia.org/r/228131 (https://phabricator.wikimedia.org/T106460) (owner: 10BryanDavis)
[20:21:42] <wikibugs>	 10Deployment-Systems: Setup l10nupdate alerts to remove l10nupdate from !log'ing - https://phabricator.wikimedia.org/T107480#1495967 (10greg)
[20:23:08] <grrrit-wm>	 (03CR) 10Paladox: "@JanZerebecki please merge. I approved the patch that is required by this." [integration/config] - 10https://gerrit.wikimedia.org/r/225042 (owner: 10Paladox)
[20:23:22] <grrrit-wm>	 (03PS10) 10Paladox: Update farmer tests [integration/config] - 10https://gerrit.wikimedia.org/r/225042 
[20:23:34] <grrrit-wm>	 (03PS16) 10Paladox: Update theme tests [integration/config] - 10https://gerrit.wikimedia.org/r/224838 
[20:26:04] <wikibugs>	 10Deployment-Systems, 10MediaWiki-extensions-LocalisationUpdate, 7I18n, 5Patch-For-Review: l10nupdate fails and runs twice since 2015-07-14 - https://phabricator.wikimedia.org/T106460#1495978 (10Krenair) a:3Krenair
[20:26:59] <shinken-wm>	 PROBLEM - Puppet failure on integration-slave-trusty-1017 is CRITICAL 50.00% of data above the critical threshold [0.0]
[20:32:05] <grrrit-wm>	 (03CR) 10Paladox: [C: 031] Add new job fail-archived-repositories [integration/config] - 10https://gerrit.wikimedia.org/r/228130 (owner: 10Paladox)
[20:42:26] <grrrit-wm>	 (03CR) 10JanZerebecki: [C: 04-1] "recheck" (033 comments) [integration/config] - 10https://gerrit.wikimedia.org/r/228130 (owner: 10Paladox)
[20:42:52] <grrrit-wm>	 (03CR) 10JanZerebecki: "recheck" [integration/config] - 10https://gerrit.wikimedia.org/r/228130 (owner: 10Paladox)
[20:44:30] <grrrit-wm>	 (03CR) 10jenkins-bot: [V: 04-1] Add new job fail-archived-repositories [integration/config] - 10https://gerrit.wikimedia.org/r/228130 (owner: 10Paladox)
[20:47:18] <grrrit-wm>	 (03CR) 10JanZerebecki: "https://www.mediawiki.org/wiki/Extension:BreadCrumbs says unmaintained. Does this extension actually still work?" [integration/config] - 10https://gerrit.wikimedia.org/r/225291 (owner: 10Paladox)
[20:56:11] <grrrit-wm>	 (03CR) 10JanZerebecki: [V: 04-1] "Waiting for dependency." [integration/config] - 10https://gerrit.wikimedia.org/r/224838 (owner: 10Paladox)
[20:56:17] <grrrit-wm>	 (03CR) 10Paladox: "Not sure but it has json files which are not tested. Also it is still receiving translation updates." [integration/config] - 10https://gerrit.wikimedia.org/r/225291 (owner: 10Paladox)
[20:57:14] <grrrit-wm>	 (03CR) 10Paladox: "Acording too https://wikiapiary.com/wiki/Extension:BreadCrumbs this it is still used by lots of wikis including newer version mediawiki on" [integration/config] - 10https://gerrit.wikimedia.org/r/225291 (owner: 10Paladox)
[20:59:08] <grrrit-wm>	 (03PS3) 10Paladox: Add new job fail-archived-repositories [integration/config] - 10https://gerrit.wikimedia.org/r/228130 
[21:16:37] <grrrit-wm>	 (03CR) 10Chad: "Ah, I saw those threads; just 2 threads wondering about hit counting...not an actual talk about bundling. And no discussion on mw.org eith" [tools/release] - 10https://gerrit.wikimedia.org/r/221059 (https://phabricator.wikimedia.org/T74420) (owner: 10Nemo bis)
[21:20:08] <wikibugs>	 10Beta-Cluster: Beta Cluster: API action=edit works not - https://phabricator.wikimedia.org/T107497#1496218 (10Luke081515) 3NEW
[21:20:37] <wikibugs>	 10Beta-Cluster: Redis error on Flow maintenance script on testwiki on Beta Cluster - https://phabricator.wikimedia.org/T107498#1496226 (10Mattflaschen) 3NEW
[21:30:28] <wikibugs>	 6Release-Engineering, 10MediaWiki-Maintenance-scripts, 10MediaWiki-Redirects, 5Patch-For-Review: namespaceDupes not handling deleted namespace redirects as desired - https://phabricator.wikimedia.org/T91401#1496321 (10demon) >>! In T91401#1495844, @He7d3r wrote: > Does this mean that if in the future a wik...
[21:31:31] <wikibugs>	 10Beta-Cluster: Beta Cluster: API action=edit works not - https://phabricator.wikimedia.org/T107497#1496336 (10Luke081515)
[21:34:59] <wikibugs>	 10Beta-Cluster: Beta Cluster: API action=edit doesn't work - https://phabricator.wikimedia.org/T107497#1496355 (10Luke081515)
[21:39:33] <wikibugs>	 10Beta-Cluster: Redis error on Flow maintenance script on testwiki on Beta Cluster - https://phabricator.wikimedia.org/T107498#1496390 (10Mattflaschen) a:3Mattflaschen
[21:40:22] <grrrit-wm>	 (03PS1) 10Legoktm: Whitelist happy5214 (Alexander Jones) [integration/config] - 10https://gerrit.wikimedia.org/r/228155 
[21:40:55] <Krenair>	 Luke081515, any error when you try action=edit?
[21:40:57] <grrrit-wm>	 (03CR) 10Legoktm: [C: 032] Whitelist happy5214 (Alexander Jones) [integration/config] - 10https://gerrit.wikimedia.org/r/228155 (owner: 10Legoktm)
[21:41:22] <Luke081515>	 only when I try it with api
[21:45:28] <shinken-wm>	 PROBLEM - Free space - all mounts on deployment-videoscaler01 is CRITICAL deployment-prep.deployment-videoscaler01.diskspace._var.byte_percentfree (<30.00%)
[21:47:52] <grrrit-wm>	 (03Merged) 10jenkins-bot: Whitelist happy5214 (Alexander Jones) [integration/config] - 10https://gerrit.wikimedia.org/r/228155 (owner: 10Legoktm)
[21:48:09] <legoktm>	 !log deploying https://gerrit.wikimedia.org/r/228155
[21:48:14] <qa-morebots>	 Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL, Master
[21:51:19] <legoktm>	 twentyafterfour, ostriches: https://phabricator.wikimedia.org/diffusion/ is not updating for any repositories besides the iOS Wikipedia app.
[21:56:22] <twentyafterfour>	 legoktm: I'll look into it
[21:56:40] <legoktm>	 thanks
[21:57:14] <ostriches>	 Had a feeling that might happen if we sent all requests through the proxy :p
[21:58:34] <ostriches>	 Although, 2 days seems longer than that.
[21:58:35] <ostriches>	 Hmm
[22:12:23] <grrrit-wm>	 (03PS4) 10JanZerebecki: Add new job fail-archived-repositories [integration/config] - 10https://gerrit.wikimedia.org/r/228130 (owner: 10Paladox)
[22:15:30] <grrrit-wm>	 (03CR) 10JanZerebecki: "No none of those usages are current versions of Mediawiki, not even LTS. I was wondering if we should archive this extension instead." [integration/config] - 10https://gerrit.wikimedia.org/r/225291 (owner: 10Paladox)
[22:18:11] <wikibugs>	 10Deployment-Systems: Setup l10nupdate alerts to remove l10nupdate from !log'ing - https://phabricator.wikimedia.org/T107480#1496860 (10mmodell) We should probably get some input from #ops on this one.
[22:19:01] <grrrit-wm>	 (03CR) 10Paladox: [C: 031] Add new job fail-archived-repositories [integration/config] - 10https://gerrit.wikimedia.org/r/228130 (owner: 10Paladox)
[22:19:52] <wikibugs>	 10Beta-Cluster, 5MW-1.26-release, 5Patch-For-Review, 5WMF-deploy-2015-08-04_(1.26wmf17): Redis error on Flow maintenance script on testwiki on Beta Cluster - https://phabricator.wikimedia.org/T107498#1496880 (10Mattflaschen)
[22:20:13] <grrrit-wm>	 (03CR) 10Paladox: "It shows mediawiki 1.23 which is currently a lts release. and mediawiki 1.24." [integration/config] - 10https://gerrit.wikimedia.org/r/225291 (owner: 10Paladox)
[22:20:43] <grrrit-wm>	 (03CR) 10Paladox: "Yes I think we should create a job for unused extensions and archive them." [integration/config] - 10https://gerrit.wikimedia.org/r/225291 (owner: 10Paladox)
[22:20:45] <grrrit-wm>	 (03CR) 10JanZerebecki: [C: 032] Add new job fail-archived-repositories [integration/config] - 10https://gerrit.wikimedia.org/r/228130 (owner: 10Paladox)
[22:21:07] <grrrit-wm>	 (03CR) 10Paladox: "Thanks." [integration/config] - 10https://gerrit.wikimedia.org/r/228130 (owner: 10Paladox)
[22:21:16] <grrrit-wm>	 (03CR) 10JanZerebecki: "Updated Jenkins job: https://integration.wikimedia.org/ci/job/fail-archived-repositories/" [integration/config] - 10https://gerrit.wikimedia.org/r/228130 (owner: 10Paladox)
[22:22:27] <grrrit-wm>	 (03PS3) 10Paladox: Update tests in vector extension [integration/config] - 10https://gerrit.wikimedia.org/r/228133 
[22:22:40] <grrrit-wm>	 (03CR) 10Paladox: [C: 031] Update tests in vector extension [integration/config] - 10https://gerrit.wikimedia.org/r/228133 (owner: 10Paladox)
[22:22:48] <grrrit-wm>	 (03Merged) 10jenkins-bot: Add new job fail-archived-repositories [integration/config] - 10https://gerrit.wikimedia.org/r/228130 (owner: 10Paladox)
[22:23:13] <grrrit-wm>	 (03CR) 10Paladox: "Ok." [integration/config] - 10https://gerrit.wikimedia.org/r/228130 (owner: 10Paladox)
[22:24:03] <grrrit-wm>	 (03PS4) 10Paladox: Update tests in vector extension [integration/config] - 10https://gerrit.wikimedia.org/r/228133 
[22:25:15] <wikibugs>	 10Deployment-Systems: Setup l10nupdate alerts to remove l10nupdate from !log'ing - https://phabricator.wikimedia.org/T107480#1496901 (10Legoktm) I think we should keep it !log'ing. We log all MediaWiki code deploys through scap, and l10nupdate shouldn't be an exception.
[22:26:06] <grrrit-wm>	 (03PS11) 10Paladox: Update farmer tests [integration/config] - 10https://gerrit.wikimedia.org/r/225042 
[22:30:05] <wikibugs>	 10Deployment-Systems: Setup l10nupdate alerts to remove l10nupdate from !log'ing - https://phabricator.wikimedia.org/T107480#1496919 (10greg) Ok, repurposing this task for whether or not we should remove it from !log'ing.  I still think alerting (more than just a !log) is needed for the l10nupdate, though, since...
[22:30:41] <wikibugs>	 10Deployment-Systems: Remove (?) l10nupdate from !log'ing - https://phabricator.wikimedia.org/T107480#1496922 (10greg)
[22:31:37] <wikibugs>	 10Deployment-Systems: Setup alerts for l10nupdate - https://phabricator.wikimedia.org/T107515#1496925 (10greg) 3NEW
[22:32:14] <wikibugs>	 10Deployment-Systems: Remove (?) l10nupdate from !log'ing - https://phabricator.wikimedia.org/T107480#1495899 (10greg)
[22:33:45] <grrrit-wm>	 (03CR) 10JanZerebecki: "I misread that, right, it show usages on legacy and LTS." [integration/config] - 10https://gerrit.wikimedia.org/r/225291 (owner: 10Paladox)
[22:37:02] <grrrit-wm>	 (03CR) 10JanZerebecki: "recheck" [integration/config] - 10https://gerrit.wikimedia.org/r/228133 (owner: 10Paladox)
[22:39:00] <grrrit-wm>	 (03CR) 10jenkins-bot: [V: 04-1] Update tests in vector extension [integration/config] - 10https://gerrit.wikimedia.org/r/228133 (owner: 10Paladox)
[22:46:21] <wmf-insecte>	 Project browsertests-Flow-en.wikipedia.beta.wmflabs.org-linux-firefox-sauce build #750: FAILURE in 35 min: https://integration.wikimedia.org/ci/job/browsertests-Flow-en.wikipedia.beta.wmflabs.org-linux-firefox-sauce/750/
[22:59:22] <grrrit-wm>	 (03CR) 10JanZerebecki: [C: 032] Update farmer tests [integration/config] - 10https://gerrit.wikimedia.org/r/225042 (owner: 10Paladox)
[22:59:54] <wmf-insecte>	 Yippee, build fixed!
[22:59:54] <wmf-insecte>	 Project browsertests-CentralNotice-en.wikipedia.beta.wmflabs.org-windows_7-firefox-sauce build #128: FIXED in 52 sec: https://integration.wikimedia.org/ci/job/browsertests-CentralNotice-en.wikipedia.beta.wmflabs.org-windows_7-firefox-sauce/128/
[23:10:59] <grrrit-wm>	 (03CR) 10Paladox: "Seems to fail test not sure why." [integration/config] - 10https://gerrit.wikimedia.org/r/228133 (owner: 10Paladox)
[23:14:59] <grrrit-wm>	 (03Merged) 10jenkins-bot: Update farmer tests [integration/config] - 10https://gerrit.wikimedia.org/r/225042 (owner: 10Paladox)
[23:17:22] <grrrit-wm>	 (03PS5) 10Paladox: Update tests in vector extension [integration/config] - 10https://gerrit.wikimedia.org/r/228133 
[23:17:33] <grrrit-wm>	 (03PS6) 10Paladox: Update tests in vector extension [integration/config] - 10https://gerrit.wikimedia.org/r/228133 
[23:21:57] <grrrit-wm>	 (03CR) 10Paladox: "Yes. So until mediawiki 1.23 is discontinued next year we need to run tests. Probley we can like empty the repo and urge users to upgrade " [integration/config] - 10https://gerrit.wikimedia.org/r/225291 (owner: 10Paladox)
[23:22:01] <grrrit-wm>	 (03PS10) 10Paladox: Update BreadCrumbs tests [integration/config] - 10https://gerrit.wikimedia.org/r/225291 
[23:31:45] <shinken-wm>	 PROBLEM - Puppet failure on deployment-cache-text02 is CRITICAL 100.00% of data above the critical threshold [0.0]
[23:39:07] <greg-g>	 ori and bd.808 are looking into beta breakage in -dev
[23:40:00] <bd808>	 there is some redis bit that is still wacky apparently
[23:40:34] <bd808>	 but not sure what. matt flaschen says sessions but I can log in and out
[23:41:21] <greg-g>	 is there a task?
[23:41:28] <greg-g>	 I can make one if not
[23:42:27] <greg-g>	 found it: https://phabricator.wikimedia.org/T107498
[23:44:46] <ori>	 matt_flaschen: as a temporary measure, I'll push a wmf-config change to unblock you
[23:44:54] <ori>	 and then I'll see what bd808 thinks re: long-term solutions
[23:45:02] <matt_flaschen>	 We're pondering whether PHP maint scripts should work on deployment-bastion, since there is no terbium for Beta Cluster.
[23:45:03] <ori>	 give me a moment
[23:45:06] <matt_flaschen>	 Or we could make a deployment-terbium.
[23:45:16] <matt_flaschen>	 ori, not urgent, mainly for QA testing on Beta.
[23:45:17] <bd808>	 they shoudl work there
[23:45:33] <bd808>	 we just need to set it up like ori did for tin
[23:45:45] <bd808>	 probably missing a role or something?
[23:45:53] <matt_flaschen>	 FYI, people are saying scripts shouldn't work on tin.
[23:46:26] <matt_flaschen>	 Oh, I see you already saw that task.
[23:47:04] <bd808>	 matt_flaschen: if you ssh to deployment-mediawiki01 then `sudo -u www-data php /srv/mediawiki/multiversion/MWScript.php` is the equivalent of mwscript
[23:47:31] <matt_flaschen>	 Okay, thanks.
[23:47:40] <ori>	 matt_flaschen: does that resolve the issue from your perspective
[23:48:16] <matt_flaschen>	 ori, not really, we would like mwscript on deployment-bastion to work.
[23:48:34] <matt_flaschen>	 I was only trying to get to the app server shell to see if it was also broken there.
[23:48:51] <wikibugs>	 10Beta-Cluster, 5MW-1.26-release, 5Patch-For-Review, 5WMF-deploy-2015-08-04_(1.26wmf17): Redis error on Flow maintenance script on testwiki on Beta Cluster - https://phabricator.wikimedia.org/T107498#1497333 (10bd808) ``` $ sudo -u www-data php /srv/mediawiki/multiversion/MWScript.php extensions/Flow/maint...
[23:49:43] <bd808>	 ori: maybe I just need to upgrade nutcracker on deployment-bastion to the version that can do redis auth?
[23:50:40] <bd808>	 !log upgraded nutcracker to 0.4.1-1+wm2~precise1 on deployment-bastion
[23:50:44] <qa-morebots>	 Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL, Master
[23:50:50] <Krenair>	 matt_flaschen, who's saying that? we rely on mwscript for certain things that need to run from tin
[23:51:07] <bd808>	 matt_flaschen: can you try something that needs redis from deployment-bastion now?
[23:51:40] <bd808>	 I think it was probably just the stale version of nutcracker
[23:51:42] <ori>	 oh wow, was that it?
[23:51:58] <bd808>	 it had 0.3.0+dfsg-1~precise1
[23:52:12] <bd808>	 which didn't do the redis auth right?
[23:52:13] <matt_flaschen>	 Krenair, I re-checked the bug a couple minutes ago, and it looks like it's resolved that it should work on tin: https://phabricator.wikimedia.org/T103198 .  But not actually fixed yet.
[23:52:51] <bd808>	 I think it's fixed
[23:52:57] <matt_flaschen>	 No, sorry.
[23:52:59] <bd808>	 on deployment-bastion
[23:53:03] <matt_flaschen>	 ObjectCache::getMainStashInstance()->get( 'foo' );
[23:53:46] <bd808>	 hmmm.
[23:53:49] <ori>	 hang on
[23:53:58] <matt_flaschen>	 There's another bug, BTW, that I should go ahead and fix in RedisConnectionPool.
[23:53:59] <bd808>	 missing stuff from /etc/nutcracker/nutcracker.yml
[23:54:33] <bd808>	 mc-unix and session-redis sections aren't there
[23:55:18] <matt_flaschen>	 I mean RedisBagOStuff
[23:55:27] <ori>	 matt_flaschen: can you try again?
[23:55:59] <wikibugs>	 10Beta-Cluster, 5MW-1.26-release, 5Patch-For-Review, 5WMF-deploy-2015-08-04_(1.26wmf17): Redis error on Flow maintenance script on testwiki on Beta Cluster - https://phabricator.wikimedia.org/T107498#1497340 (10bd808) /etc/nutcracker/nutcracker.yml on deployment-bastion is missing config sections. It has...
[23:55:59] <matt_flaschen>	 Works. :)
[23:56:03] <matt_flaschen>	 Thank you.
[23:56:29] <ori>	 bd808, thanks dude, for both yesterday and today.
[23:57:02] <bd808>	 fix your agent/keys :)
[23:57:04] <bd808>	 and yw
[23:57:27] <wikibugs>	 10Beta-Cluster, 5MW-1.26-release, 5Patch-For-Review, 5WMF-deploy-2015-08-04_(1.26wmf17): Redis error on Flow maintenance script on testwiki on Beta Cluster - https://phabricator.wikimedia.org/T107498#1497342 (10Mattflaschen) 5Open>3Resolved a:5Mattflaschen>3bd808
[23:58:07] <wikibugs>	 10Beta-Cluster, 5MW-1.26-release, 5Patch-For-Review, 5WMF-deploy-2015-08-04_(1.26wmf17): Redis error on Flow maintenance script on testwiki on Beta Cluster - https://phabricator.wikimedia.org/T107498#1497348 (10ori) This should work now, because I made CommonSettings.php once again consult `$sessionRedis`...