[03:45:55] (PS1) Milimetric: Clarify title [analytics/reportcard/data] - https://gerrit.wikimedia.org/r/131653 [03:47:46] (CR) Milimetric: [C: 2 V: 2] Clarify title [analytics/reportcard/data] - https://gerrit.wikimedia.org/r/131653 (owner: Milimetric) [07:54:52] (CR) Ottomata: "This patch addresses everything except for name of 'webrequest_role' and the possible change to partition_spec." (20 comments) [analytics/kraken] - https://gerrit.wikimedia.org/r/131208 (owner: Ottomata) [07:55:08] (PS3) Ottomata: Adding oozie files to control addition and deletion of webrequest table partitions [analytics/kraken] - https://gerrit.wikimedia.org/r/131208 [08:33:54] (CR) Milimetric: Rewrite null rows (1 comment) [analytics/limn-mobile-data] - https://gerrit.wikimedia.org/r/131547 (owner: Jdlrobson) [09:04:30] heh, I'd better get that camus delete stuff up soon! we are using 140/180TB HDFS space :p [09:04:33] sorry [09:04:37] 'oozie delete stuff' [09:31:02] (PS1) Gilles: Filter browser cache hits [analytics/multimedia] - https://gerrit.wikimedia.org/r/131673 [15:42:23] (CR) Milimetric: Rewrite null rows (1 comment) [analytics/limn-mobile-data] - https://gerrit.wikimedia.org/r/131547 (owner: Jdlrobson) [17:04:31] (CR) MarkTraceur: [C: 2 V: 2] Filter browser cache hits [analytics/multimedia] - https://gerrit.wikimedia.org/r/131673 (owner: Gilles) [17:12:39] good morning world [17:12:57] good evening! [17:12:58] :) [17:13:01] missin ya over here! [17:15:09] dinna time soon, laters! [17:20:31] take care! [17:34:51] Hm, my queries are taking...lots of time [17:40:17] marktraceur, what queries and where? [17:41:12] Action counts for MMV on stat1003 [17:41:29] We have perf data for yesterday but no action counts since May 1 [17:41:39] * marktraceur checks what got merged that day [17:41:58] Err [17:42:02] That's because springle [17:42:17] (probably) [17:42:20] he wrote a p-kill script that was...a wee bit broad [17:42:35] Oh, would that cause ongoing problems? [17:42:58] I'm still seeing long-running queries [17:43:02] hurm [17:43:08] what's the query? [17:43:11] More long-running than I would expect [17:43:14] Lemme get you the file [17:43:19] and the slave? [17:43:22] just s1? [17:43:27] Just s1, yeah [17:43:39] http://git.wikimedia.org/blob/analytics%2Fmultimedia.git/f4629a9d1d7205ed8f67e7930d96f45b63b76b53/actions%2Fglobal.sql Ironholds [17:43:52] oh good lord [17:44:25] Ironholds: http://patcheswelco.me/ [17:44:27] well, if I had to hazard a guess [17:44:41] I knew that would come in handy. :P [17:44:51] it would be that you are running all 3 of your project's big queries, simultaneously, on one machine] [17:44:57] Well, yeah [17:45:02] in all three cases, PROCESSLIST has it sending the data back, so... [17:45:05] Ironholds: They were never really that big though [17:45:18] And only the actions count is slow [17:45:34] hrm [17:45:57] welp, see if it clears up in the next 30 minutes? [17:46:12] geoperf finishes really fast and perf finishes...as quickly as can be expected [17:46:16] Will do [17:46:34] and my suggestion for query improvements would be 'stop doing everything in MySQL' ;p [17:46:54] Ironholds: What would you prefer we do? [17:46:57] R? [17:47:05] use R or Python, sure [17:47:11] Grmbl [17:47:24] Also, what's with the big CASE WHEN? Why not just select date, action, count(*), group by date,action? [17:47:43] to handle actions that don't appear? [17:47:54] * marktraceur looks for milimetric, who wrote the query [17:47:55] or, might not appear? [17:47:56] I don't know [17:48:06] I think they're all eating. Eh, no big deal. [17:48:07] I guess that would make sense [17:48:12] hey halfak :) [17:48:45] Hey Ironholds. Just walking through some stuff w/ Toby DarTar and lzia. [17:48:47] What's up? [17:49:06] eh, nothing major. Arguing with hive being slow. [17:49:32] Oh! Yeah. They left for food. We don't get to eat due to ED presentation prep. [17:49:54] otto was just demoing some things. I don't think we left any queries running. [17:49:55] remember to emphasise that we're adorable-looking. [17:49:59] EDs like adorable people. [17:50:07] And we're pretty adorable. [17:50:14] :) [17:52:46] * halfak makes an adorable face.  [17:52:51] * halfak goes back to review work.  [21:07:16] halfak, you're halfbak! [21:07:37] Hey dude. I'm just doing some last minute Growth stuff before I hit the hay. [21:08:45] Are you in North Carolina right now? [21:08:56] I am not [21:09:07] I am actually no longer going to NC [21:09:39] I looked at my mental state and decided that basically spending 5 days with people, in and out, would turn me into the burnt-out husk I'm already on my way to becoming. So I'm going to take Thursday and Friday and plug my eyeballs into a computer game for that period. [21:09:45] assuming Toby approves my personal days. [21:09:56] :( But but.. You should be in Switzerland. [21:10:12] The mountains had therapeutic qualities [21:10:15] \*have [21:12:36] but people. they also have people. [21:12:46] and y'realise I haven't got to play a computer game in...eight months, right? [21:12:57] Oh man. You're due. [21:13:05] totally [21:13:10] I missed Rome II. I missed it. [21:13:22] Played any Kerbal Space Program? [21:14:33] nope; my old housemate recommends it [21:16:13] I do too. I get a lot out of that game. Lots of fun to play around with space travel -- and think about it in terms of orbits.