[00:00:41] Analytics, Labs, Patch-For-Review: Kill all unnecessary NFS usage in the analytics project - https://phabricator.wikimedia.org/T128804#2086918 (yuvipanda) Open>Resolved All usage has been deemed unnecessary! It is gone now! \o/ [00:02:49] (PS2) BryanDavis: Add initial oozie job for ApiAction [analytics/refinery] - https://gerrit.wikimedia.org/r/273557 (https://phabricator.wikimedia.org/T108618) [00:04:35] Analytics, Operations, hardware-requests, Patch-For-Review: AQS replacement nodes - https://phabricator.wikimedia.org/T124947#2086933 (RobH) a:RobH>JAllemandou Please note we don't want to use non-supported SSDs in production. As such, we don't want to purchase more of the Samsung SSDs. We... [00:05:04] Analytics, Operations, hardware-requests, Patch-For-Review: eqiad: (3)AQS replacement nodes - https://phabricator.wikimedia.org/T124947#1970805 (RobH) [00:05:11] Analytics, Operations, hardware-requests, Patch-For-Review: eqiad: (3) AQS replacement nodes - https://phabricator.wikimedia.org/T124947#1970805 (RobH) [00:06:21] (CR) BryanDavis: "Completely untested, but I tried to make things more generic as suggested by Ottomata." [analytics/refinery] - https://gerrit.wikimedia.org/r/273557 (https://phabricator.wikimedia.org/T108618) (owner: BryanDavis) [00:07:03] ottomata, joal: ^ new patch set that tries to make a proper bundle [00:10:43] * yuvipanda waves awaaaaaaaaaay [01:23:05] (CR) Nuria: [C: 2 V: 2] "self-merging removal of debug code" [analytics/dashiki] - https://gerrit.wikimedia.org/r/274811 (owner: Nuria) [01:40:17] (CR) Ottomata: [C: 1] "Looking good!" (3 comments) [analytics/refinery] - https://gerrit.wikimedia.org/r/273557 (https://phabricator.wikimedia.org/T108618) (owner: BryanDavis) [02:48:23] Analytics-Kanban: Parse User-Agent strings with OS like "Windows 7" correctly into the user agent map {hawk} - https://phabricator.wikimedia.org/T127324#2039833 (madhuvishy) Microsoft claims that the right User agent string for Windows 7 is something like "Mozilla/5.0 (compatible; MSIE 10.0; Windows NT 6.1; T... [10:37:33] I've been working on enabled host-based firewall rules for the eventlog* hosts (most of the systems in prod have that already). if anyone familiar with the architecture has some time I'd appreciate an additional review of https://gerrit.wikimedia.org/r/#/c/274715/ [10:48:08] Analytics, Operations, hardware-requests, Patch-For-Review: eqiad: (3) AQS replacement nodes - https://phabricator.wikimedia.org/T124947#2088046 (JAllemandou) @Eevans : is 64GB memory good (for 2x 6 cores CPU0, or is it better to ask for 128 ? @RobH : 8T useful (after RAID 10) per machine gives u... [10:48:32] Analytics, Operations, hardware-requests, Patch-For-Review: eqiad: (3) AQS replacement nodes - https://phabricator.wikimedia.org/T124947#2088047 (JAllemandou) a:JAllemandou>RobH [10:55:40] Analytics-Tech-community-metrics, Developer-Relations, DevRel-March-2016, Patch-For-Review, developer-notice: Check whether it is true that we have lost 40% of (Git) code contributors in the past 12 months - https://phabricator.wikimedia.org/T103292#2088059 (Aklapper) @ori: "There are cases wher... [10:59:00] Analytics-Tech-community-metrics, DevRel-March-2016: gerrit_review_queue.html: List of Repositories has not been updated recently - https://phabricator.wikimedia.org/T128170#2088063 (Aklapper) http://korma.wmflabs.org/browser/data_sources.html now shows "Updated on" 2016-03-02/-03 for Git and Gerrit so I... [11:52:56] Analytics-Kanban, Operations, Traffic, Patch-For-Review: varnishkafka integration with Varnish 4 for analytics - https://phabricator.wikimedia.org/T124278#2088214 (elukey) @Ottomata and @faidon: thanks a lot for all the info! >For this, my own recommendation would be to either add JSON & librdkaf... [11:59:31] Analytics-Kanban, Operations, Traffic, Patch-For-Review: varnishkafka integration with Varnish 4 for analytics - https://phabricator.wikimedia.org/T124278#2088220 (BBlack) >>! In T124278#2088214, @elukey wrote: > but we had to import a lot of .c files into varnishkafka's source. An alternative p... [14:46:28] Analytics-Kanban, Operations, Traffic, Patch-For-Review: varnishkafka integration with Varnish 4 for analytics - https://phabricator.wikimedia.org/T124278#2088466 (Ottomata) I think we have control over the varnishkafka license, so if we go that route and need to change it, we can. [14:49:29] ottomata: I'm starting to do the deploy (just copying files and stuff) [14:50:07] ok! [14:50:10] milimetric: copying files? [14:50:32] the limn*ones? [14:50:34] on stat1003? [14:50:34] yes, to /srv/reportupdater/output [14:50:44] everything in /a/limn-public-data [14:50:44] perfect [14:50:48] ok [14:50:51] cool [14:50:58] then we can make symlinks? [14:51:06] oh... hm, I don't have permission to make that dir [14:51:17] hmm, milimetric [14:51:25] the output doesn't have to be in the job repo, does it? [14:51:28] it currently is, right? [14:51:32] but that is not necessary? [14:51:51] in the job _repo_? [14:52:05] uh, job cloned repo [14:52:12] /srv/limn-mobile-data/mobile [14:52:17] it's not in that directory, no [14:52:20] no? [14:52:21] OH [14:52:22] right [14:52:22] nm [14:52:28] riiight [14:52:28] sorry [14:52:29] go tit [14:52:31] right now, the /srv/limn-mobile-data/mobile just has config [14:52:41] outputs to /a/limn-public-data/metrics/something-something [14:53:12] mobile/.reportupdater.history is ok that that is saved in the query path? [14:53:58] yeah, though I'm not sure if I should copy those to where the new jobs are going to be cloned [14:54:00] I don't think so [14:56:20] hmmm [14:56:27] not sure either! [14:56:29] yep, it's not necessary [14:56:32] milimetric: batcave? [14:56:37] yeah, omw [15:00:36] ottomata, milimetric: o/ [15:00:45] hey elukey [15:11:44] yoyo [15:12:52] ottomata: I am changing the parsing functions atm, today I was able to print from VSM nicely :) [15:13:00] nice! [15:13:05] segfaults and gdb and tears [15:13:19] heheheh [15:13:50] if you have time next week I'd really like to have a chat with you about VUT and *.c inclusion [15:14:32] https://dpaste.de/16aO#L --> this is the snippet [15:28:51] (CR) Milimetric: [C: 2 V: 2] Migrate the reports to the standalone reportupdater [analytics/limn-edit-data] - https://gerrit.wikimedia.org/r/274031 (https://phabricator.wikimedia.org/T128375) (owner: Mforns) [15:29:11] (CR) Milimetric: [C: 2 V: 2] Migrate the reports to use standalone reportupdater. [analytics/limn-language-data] - https://gerrit.wikimedia.org/r/274032 (https://phabricator.wikimedia.org/T128375) (owner: Mforns) [15:29:27] (CR) Milimetric: [C: 2 V: 2] Migrate the reports to use standalone reportupdater. [analytics/limn-ee-data] - https://gerrit.wikimedia.org/r/274034 (https://phabricator.wikimedia.org/T128375) (owner: Mforns) [15:29:36] (CR) Milimetric: [C: 2 V: 2] Migrate the reports to use standalone reportupdater. [analytics/limn-flow-data] - https://gerrit.wikimedia.org/r/274035 (https://phabricator.wikimedia.org/T128375) (owner: Mforns) [15:29:50] (CR) Milimetric: [C: 2 V: 2] Migrate the reports to use standalone reportupdater. [analytics/limn-multimedia-data] - https://gerrit.wikimedia.org/r/274037 (https://phabricator.wikimedia.org/T128375) (owner: Mforns) [15:30:02] (CR) Milimetric: [C: 2 V: 2] Migrate the reports to use standalone reportupdater. [analytics/limn-extdist-data] - https://gerrit.wikimedia.org/r/274039 (https://phabricator.wikimedia.org/T128375) (owner: Mforns) [15:30:18] (CR) Milimetric: [C: 2 V: 2] Migrate the reports to use standalone reportupdater. [analytics/limn-mobile-data] - https://gerrit.wikimedia.org/r/274038 (https://phabricator.wikimedia.org/T128375) (owner: Mforns) [15:42:13] brb for the standup, going to visit my grandmother! [15:49:10] (PS1) Milimetric: Create output folder if nonexistent [analytics/reportupdater] - https://gerrit.wikimedia.org/r/274967 [15:49:23] (CR) Milimetric: [C: 2 V: 2] Create output folder if nonexistent [analytics/reportupdater] - https://gerrit.wikimedia.org/r/274967 (owner: Milimetric) [16:17:53] Analytics-Kanban: dashiki should report metrics to piwiki in production - https://phabricator.wikimedia.org/T128866#2088649 (Nuria) [16:28:25] a-team: my update since i'm in a meeting: deploying reportupdater with Andrew [16:29:39] Analytics-EventLogging, Analytics-Kanban, Patch-For-Review, WMF-deploy-2016-03-08_(1.27.0-wmf.16), and 2 others: EventLogging needs to be ready for codfw failover - https://phabricator.wikimedia.org/T127209#2088690 (Ottomata) Hm, @ori, I was just testing this on MW vagrant with https://gerrit.wikim... [16:30:17] a-team: standddupppp [16:31:56] cannot get in [16:32:26] Analytics-EventLogging, Analytics-Kanban, Patch-For-Review, WMF-deploy-2016-03-08_(1.27.0-wmf.16), and 2 others: EventLogging needs to be ready for codfw failover - https://phabricator.wikimedia.org/T127209#2088706 (Ottomata) Ah, I see it was removed in https://gerrit.wikimedia.org/r/#/c/273008/1/i... [16:33:07] Analytics-Kanban: Add regexps that match the bots that follow the User-Agent policy {hawk} - https://phabricator.wikimedia.org/T125731#1996003 (madhuvishy) a:madhuvishy [16:34:21] Analytics-Cluster, Analytics-Kanban, Patch-For-Review: Enable purging of old jobs and coordinators in oozie - https://phabricator.wikimedia.org/T127988#2088710 (Ottomata) a:Ottomata [16:50:45] (PS3) Ottomata: Add destination overwriting capacity to camus [analytics/camus] - https://gerrit.wikimedia.org/r/274736 (https://phabricator.wikimedia.org/T128611) (owner: Joal) [16:52:36] Ironholds: around? Do you have an opinion on https://phabricator.wikimedia.org/T127324? [16:53:17] also do you know what the latest uap-java jar version is and where I can find the jar? [17:03:29] Analytics, Research-and-Data, Research-management: Draft announcement for wikistats transition plan - https://phabricator.wikimedia.org/T128870#2088783 (DarTar) [17:11:10] Analytics-Kanban, Research-and-Data, Patch-For-Review: Remove Client IP from Eventlogging capsule {mole} - https://phabricator.wikimedia.org/T128407#2088831 (leila) @madhuvishy FYI, our survey tracked in T125946 is scheduled to stop on Monday, 2016-03-07 in the 16:00-17:00 PST SWAT Deploy time slot. [17:11:43] Analytics-EventLogging, Analytics-Kanban, Patch-For-Review, WMF-deploy-2016-03-08_(1.27.0-wmf.16), and 2 others: EventLogging needs to be ready for codfw failover - https://phabricator.wikimedia.org/T127209#2088833 (Ottomata) https://gerrit.wikimedia.org/r/#/c/274986/ [17:23:39] debian-jessie.vagrantup.com 1457112150000000 [01/Jan/1970:00:00:00 +0000] - ::1 -/- - GET [17:24:00] ---^ first wrong and ugly ouput after parsing etc.. from varnish-kafka 4 :) [17:24:20] nice! [17:35:42] and also: [17:35:43] {"hostname":"cp1052.eqiad.wmnet","sequence":1457112857000000,"dt":"1970-01-01T00:00:00","time_firstbyte":0.0,"ip":"-","cache_status":"-","http_status":"-","response_size":0,"http_method":"GET\u0000","uri_host":"-","uri_path":"/\u0000","uri_query":"","content_type":"-","referer":"-","x_forwarded_for":"-","user_agent":"-","accept_language":"-","x_analytics":"-","range":"-","x_cache":"-" [17:35:49] \o/ [17:36:18] probably all these - are defaults because things need to be tweaked [17:36:26] buuuuut I call it a day :) [17:40:33] a-team: logging off! Talk with you on Monday! good weekend :) [17:40:42] have a nice weekend [17:48:59] elukey: looking gooood [17:49:02] laters [18:18:53] Analytics, Pageviews-API: Wikimedia pageviews API blocked by ad blockers - https://phabricator.wikimedia.org/T126947#2027714 (Niharika) Interestingly, AdBlock only has a problem with https://tools.wmflabs.org/pageviews/ but not with http://tools.wmflabs.org/pageviews-test/ (running the exact same thing)... [18:27:31] Analytics, Pageviews-API: Wikimedia pageviews API blocked by ad blockers - https://phabricator.wikimedia.org/T126947#2089172 (MusikAnimal) I believe that might only be true with AdBlock Plus. The behaviour I'm seeing on Safari OSX with uBlock: * http://tools.wmflabs.org/pageviews-test loads, but the API... [18:47:55] Analytics-Kanban, Wikipedia-Android-App-Backlog, Mobile-App-Android-Sprint-77-Iridium: Add x-analytics header for page view and preview requests - https://phabricator.wikimedia.org/T128887#2089309 (bearND) [18:48:36] Analytics-Kanban, Wikipedia-Android-App-Backlog: Count requests to RESTBase from the Android app - https://phabricator.wikimedia.org/T128612#2080435 (bearND) a:bearND>Milimetric [18:49:30] Analytics-Kanban, Wikipedia-Android-App-Backlog: Count requests to RESTBase from the Android app - https://phabricator.wikimedia.org/T128612#2080435 (bearND) @Dbrant and @MBinder_WMF I've created a subtask for the Android specific work. [18:51:32] Analytics-Kanban, Wikipedia-Android-App-Backlog, Mobile-App-Android-Sprint-77-Iridium: Add x-analytics header for page view and preview requests - https://phabricator.wikimedia.org/T128887#2089350 (bearND) https://gerrit.wikimedia.org/r/#/c/274645/ has already been merged (before I split this off into... [18:54:07] Analytics-Kanban, Wikipedia-Android-App-Backlog, Mobile-App-Android-Sprint-77-Iridium: Add x-analytics header for page view and preview requests - https://phabricator.wikimedia.org/T128887#2089373 (MBinder_WMF) @bearND nice, thanks. We should estimate this before the prioritization part of our meeting... [19:01:48] Analytics, Beta-Cluster-Infrastructure, Services, scap, and 3 others: Set up AQS in Beta - https://phabricator.wikimedia.org/T116206#2089461 (mmodell) [19:01:54] Analytics-EventLogging, scap, Scap3 (scap3-adoption): Move EventLogging service to scap3 - https://phabricator.wikimedia.org/T118772#2089465 (mmodell) [19:04:08] Analytics-EventLogging, scap, Scap3 (scap3-adoption): Move EventLogging service to scap3 - https://phabricator.wikimedia.org/T118772#2089473 (Ottomata) It would be best to let us fix the upstart vs systemd stuff first. Currently eventlogging deployment takes a manually global sudo pip install step,... [19:07:24] milimetric: any luck? [19:20:55] (CR) Ottomata: [C: 2 V: 2] Add destination overwriting capacity to camus [analytics/camus] - https://gerrit.wikimedia.org/r/274736 (https://phabricator.wikimedia.org/T128611) (owner: Joal) [19:26:36] I was just finishing lunch. I found the problem, ottomata, but I don't know how to fix it. Basically, it seems subprocess.Popen is not giving us a proper stdout when calling hive like this... I tricked it with a super bizarre combination of Popen and check_output, but I don't understand how to fix it properly [19:36:41] milimetric: what's the issue exactly? I've dealt with this before [19:37:14] subprocess can buffer streams when you don't want it to and cause deadlocks [19:37:30] if you point me at the buggy source and describe the problem I may be able to suggest a fix [19:38:01] hm... thanks ori, this is a repo that didn't get mirrored to github so I'm not sure how to help you browse to it [19:38:18] which repo? [19:38:26] analytics/reportupdater [19:38:36] in reportupdater/executor.py [19:38:44] line 157: [19:38:45] process = subprocess.Popen(parameters, stdout=subprocess.PIPE) [19:39:12] doing that and then later calling: [19:39:13] tsv_reader = csv.reader(process.stdout, delimiter='\t') [19:39:22] seems to not really work for this Hive script we're executing [19:39:26] (but works for other scripts) [19:40:43] ok milimetric so if it is a hive specifc thing [19:41:09] do you think we can just do the stat1003 t hing anyway? [19:41:11] no, I don't think it's Hive specific, I think it's a bad way to call Popen [19:41:16] milimetric: tsv_reader = csv.reader(iter(process.stdout.readline, b''), delimiter='\t') [19:41:17] we can, actually, yea [19:41:26] try that [19:41:28] I'll try that, ori, thx [19:41:42] ottomata: let's do 1003 first, batcave [19:41:44] ok [19:42:10] milimetric: for reference: you ran into https://bugs.python.org/issue3907 , and the fix is from http://stackoverflow.com/a/17698359/582542 [20:05:04] milimetric: https://gerrit.wikimedia.org/r/#/c/275038/ [20:08:25] milimetric: (let me know if it works!) [20:31:08] ori: sorry I was in a bunch of meetings. I pasted what you said in and tried once but it still didn't work... very odd. I'll try more in another hour when this next meeting's over [20:34:32] (CR) Ottomata: "OOPS! This was merged on the wrong brnach (master). Fixing, will submit against wmf branch." [analytics/camus] - https://gerrit.wikimedia.org/r/274736 (https://phabricator.wikimedia.org/T128611) (owner: Joal) [20:34:52] (PS1) Ottomata: Revert "Add destination overwriting capacity to camus" [analytics/camus] - https://gerrit.wikimedia.org/r/275046 [20:35:05] (CR) Ottomata: [C: 2 V: 2] Revert "Add destination overwriting capacity to camus" [analytics/camus] - https://gerrit.wikimedia.org/r/275046 (owner: Ottomata) [20:35:57] (PS1) Ottomata: Add destination overwriting capacity to camus [analytics/camus] (wmf) - https://gerrit.wikimedia.org/r/275047 (https://phabricator.wikimedia.org/T128611) [20:36:16] (PS2) Ottomata: Add destination overwriting capacity to camus [analytics/camus] (wmf) - https://gerrit.wikimedia.org/r/275047 (https://phabricator.wikimedia.org/T128611) [20:36:43] (CR) Ottomata: [C: 2 V: 2] Add destination overwriting capacity to camus [analytics/camus] (wmf) - https://gerrit.wikimedia.org/r/275047 (https://phabricator.wikimedia.org/T128611) (owner: Ottomata) [20:36:56] (CR) Ottomata: "Done here: https://gerrit.wikimedia.org/r/#/c/275047" [analytics/camus] - https://gerrit.wikimedia.org/r/275046 (owner: Ottomata) [20:37:11] (CR) Ottomata: "Re committed on wmf branch here: https://gerrit.wikimedia.org/r/#/c/275047" [analytics/camus] - https://gerrit.wikimedia.org/r/274736 (https://phabricator.wikimedia.org/T128611) (owner: Joal) [20:40:17] (PS1) Ottomata: Update to version wmf7 for tag and release [analytics/camus] (wmf) - https://gerrit.wikimedia.org/r/275048 [20:42:20] (Abandoned) Ottomata: Update to version wmf7 for tag and release [analytics/camus] (wmf) - https://gerrit.wikimedia.org/r/275048 (owner: Ottomata) [20:51:12] ok back! let's kill this bug, eh? [21:02:20] (CR) Ottomata: [C: 2 V: 2] Improve webrequest oozie jobs emails [analytics/refinery] - https://gerrit.wikimedia.org/r/274691 (owner: Joal) [21:03:16] (CR) Ottomata: [C: 2 V: 2] Improve aqs, browser & restbase oozie error emails [analytics/refinery] - https://gerrit.wikimedia.org/r/274698 (owner: Joal) [21:04:11] (CR) Ottomata: [C: 2 V: 2] Improve pagecounts oozie error emails [analytics/refinery] - https://gerrit.wikimedia.org/r/274700 (owner: Joal) [21:05:20] (CR) Ottomata: [C: 2] Improve pageview & projectview oozie error emails [analytics/refinery] - https://gerrit.wikimedia.org/r/274693 (owner: Joal) [21:05:26] (CR) Ottomata: [V: 2] Improve pageview & projectview oozie error emails [analytics/refinery] - https://gerrit.wikimedia.org/r/274693 (owner: Joal) [21:06:18] (CR) Ottomata: [C: 2 V: 2] Improve mobile_apps oozie error emails [analytics/refinery] - https://gerrit.wikimedia.org/r/274706 (owner: Joal) [21:06:54] (CR) Ottomata: [C: 2 V: 2] Improve mediacounts oozie error emails [analytics/refinery] - https://gerrit.wikimedia.org/r/274707 (owner: Joal) [21:08:26] (CR) Ottomata: [C: 2 V: 2] Add information to oozie error emails [analytics/refinery] - https://gerrit.wikimedia.org/r/274666 (owner: Joal) [21:08:53] (PS2) Ottomata: Improve last_access_uniques oozie error emails [analytics/refinery] - https://gerrit.wikimedia.org/r/274710 (owner: Joal) [21:09:00] (CR) Ottomata: [C: 2 V: 2] Improve last_access_uniques oozie error emails [analytics/refinery] - https://gerrit.wikimedia.org/r/274710 (owner: Joal) [21:09:31] (PS2) Ottomata: Add error emails to cassandra loading oozie jobs [analytics/refinery] - https://gerrit.wikimedia.org/r/274714 (owner: Joal) [21:09:37] (CR) Ottomata: [C: 2 V: 2] Add error emails to cassandra loading oozie jobs [analytics/refinery] - https://gerrit.wikimedia.org/r/274714 (owner: Joal) [21:10:01] (PS2) Ottomata: Improve webrequest oozie jobs emails [analytics/refinery] - https://gerrit.wikimedia.org/r/274691 (owner: Joal) [21:10:08] (CR) Ottomata: [V: 2] Improve webrequest oozie jobs emails [analytics/refinery] - https://gerrit.wikimedia.org/r/274691 (owner: Joal) [21:10:14] (PS2) Ottomata: Improve aqs, browser & restbase oozie error emails [analytics/refinery] - https://gerrit.wikimedia.org/r/274698 (owner: Joal) [21:10:21] (CR) Ottomata: [V: 2] Improve aqs, browser & restbase oozie error emails [analytics/refinery] - https://gerrit.wikimedia.org/r/274698 (owner: Joal) [21:10:28] (PS2) Ottomata: Improve pagecounts oozie error emails [analytics/refinery] - https://gerrit.wikimedia.org/r/274700 (owner: Joal) [21:10:34] (CR) Ottomata: [V: 2] Improve pagecounts oozie error emails [analytics/refinery] - https://gerrit.wikimedia.org/r/274700 (owner: Joal) [21:10:42] (PS3) Ottomata: Improve pageview & projectview oozie error emails [analytics/refinery] - https://gerrit.wikimedia.org/r/274693 (owner: Joal) [21:10:49] (CR) Ottomata: [V: 2] Improve pageview & projectview oozie error emails [analytics/refinery] - https://gerrit.wikimedia.org/r/274693 (owner: Joal) [21:11:12] (PS4) Ottomata: Improve pageview & projectview oozie error emails [analytics/refinery] - https://gerrit.wikimedia.org/r/274693 (owner: Joal) [21:11:18] (CR) Ottomata: [V: 2] Improve pageview & projectview oozie error emails [analytics/refinery] - https://gerrit.wikimedia.org/r/274693 (owner: Joal) [21:54:14] ori: I'm out of meetings and tried a couple things but still stuck [21:54:31] I can use basically any version of Popen from my own script and it works [21:54:36] (with the fix you sent or not) [21:54:52] but when I run the cron as it was set up, that's when Popen's output seems to magically vanish [21:55:28] it might be how it's run? "python ...command... >> log-file.log 2>&1" [21:55:39] I never understood that magical 2>&1 thing [22:01:06] Analytics, Operations, hardware-requests, Patch-For-Review: eqiad: (3) AQS replacement nodes - https://phabricator.wikimedia.org/T124947#2090071 (RobH) Agreed, we expect systems to typically last for three years. I'll move ahead on getting a quote to give you at least 8TB usable space after raid1... [22:01:15] milimetric: i think it means pipe stderr to stdout [22:01:42] madhuvishy: yeah, but does it also mean "steal all things that are piping to/from other processes"? 'cause that's what it seems to be doing [22:02:12] ah I'm not sure what happens [22:02:16] in that case [22:02:34] I'm pretty stuck on this, if you have time to brain-bounce I'd appreciate it :) [22:04:44] milimetric: just eating lunch, and i have no idea what you're working on :) but sure - 10 minutes? [22:05:05] anytime, I'm around tonight - no rush [22:05:20] okay [22:06:47] laters a-team [22:06:49] ! [22:06:53] o/ [22:21:50] milimetric: batcave? [22:22:00] omw [22:47:11] Analytics-Tech-community-metrics, DevRel-March-2016: gerrit_review_queue.html: List of Repositories has not been updated recently - https://phabricator.wikimedia.org/T128170#2090242 (Lcanasdiaz) This is clearly a bug in our side. It seems that the blacklist is not being correctly updated in our servers. S... [23:15:40] (PS2) EBernhardson: Update camus to support reading avro schemas from an avro protocol [analytics/refinery/source] - https://gerrit.wikimedia.org/r/274307 (https://phabricator.wikimedia.org/T128530) [23:16:48] * ebernhardson still mixed tabs and space... [23:18:16] (PS3) EBernhardson: Update camus to support reading avro schemas from an avro protocol [analytics/refinery/source] - https://gerrit.wikimedia.org/r/274307 (https://phabricator.wikimedia.org/T128530) [23:31:26] madhuvishy: it ran in 1 minute that way :) [23:31:40] go figure... [23:32:39] oh nice! [23:40:21] (PS1) Milimetric: Hack to give stats user access to hive on stat1002 [analytics/reportupdater-queries] - https://gerrit.wikimedia.org/r/275132 [23:40:33] (CR) Milimetric: [C: 2 V: 2] Hack to give stats user access to hive on stat1002 [analytics/reportupdater-queries] - https://gerrit.wikimedia.org/r/275132 (owner: Milimetric) [23:46:52] Analytics, Pageviews-API: Pageviews data for most recent day is missing when given one date range but not for other date ranges - https://phabricator.wikimedia.org/T128925#2090404 (MusikAnimal) [23:55:09] milimetric: you can probably run as sudo -u hdfs or something when it's deployed [23:55:33] sorry not sudo -u [23:55:35] but the stats user wouldn't have the rights to sudo [23:55:40] just -n hdfs [23:55:43] oh i see [23:55:45] ok, i'll do that [23:55:55] right now git/vim is totally screwing with me with line endings [23:55:57] sigh [23:56:06] but i don't know if you have the rights to do that if you don't have sudo for hdfs [23:56:14] i had some bizarre setting when I helped Erik with his windows-only repo [23:56:18] aaah [23:56:22] and now I can't get rid of CRLF [23:56:28] :/ [23:56:43] i don't have sudo for hdfs, right, but that wouldn't matter - it's that stats doesn't have it [23:57:51] yup [23:58:09] ya we'd have to work around that somehow. ottomata knows better