[00:00:59] (PS7) Nuria: Mobile apps oozie jobs [analytics/refinery] - https://gerrit.wikimedia.org/r/181017 [01:04:54] (CR) OliverKeyes: [C: -1] Mobile apps oozie jobs (3 comments) [analytics/refinery] - https://gerrit.wikimedia.org/r/181017 (owner: Nuria) [01:04:59] nuria, thanks for the patch! :D [01:05:10] darnit, otto has gone to bed [02:01:03] (PS8) Nuria: Mobile apps oozie jobs [analytics/refinery] - https://gerrit.wikimedia.org/r/181017 [02:02:50] (CR) Nuria: Mobile apps oozie jobs (3 comments) [analytics/refinery] - https://gerrit.wikimedia.org/r/181017 (owner: Nuria) [03:03:48] (PS9) Nuria: Mobile apps oozie jobs [analytics/refinery] - https://gerrit.wikimedia.org/r/181017 [08:00:22] (CR) OliverKeyes: Mobile apps oozie jobs (3 comments) [analytics/refinery] - https://gerrit.wikimedia.org/r/181017 (owner: Nuria) [14:33:59] (CR) Ottomata: Mobile apps oozie jobs (7 comments) [analytics/refinery] - https://gerrit.wikimedia.org/r/181017 (owner: Nuria) [14:34:03] hiii nuria! [14:59:49] ottomata: hi now [15:50:40] (PS1) Milimetric: Fix install script [analytics/wikimetrics] - https://gerrit.wikimedia.org/r/182187 [15:51:51] (CR) Milimetric: [C: 2] Fix install script [analytics/wikimetrics] - https://gerrit.wikimedia.org/r/182187 (owner: Milimetric) [15:52:00] (Merged) jenkins-bot: Fix install script [analytics/wikimetrics] - https://gerrit.wikimedia.org/r/182187 (owner: Milimetric) [15:52:43] (CR) Milimetric: "self merging, simple script change that helps prevent pip problems" [analytics/wikimetrics] - https://gerrit.wikimedia.org/r/182187 (owner: Milimetric) [15:59:57] (CR) Nuria: "Great, one less thing to worry about." [analytics/wikimetrics] - https://gerrit.wikimedia.org/r/182187 (owner: Milimetric) [16:12:03] (CR) Milimetric: "I added 3 comments that explain the problem with the test you didn't write. This is actually great, the test succeeded in pointing out a " (3 comments) [analytics/wikimetrics] - https://gerrit.wikimedia.org/r/181770 (owner: Fhocutt) [16:13:01] (CR) Nuria: Mobile apps oozie jobs (2 comments) [analytics/refinery] - https://gerrit.wikimedia.org/r/181017 (owner: Nuria) [16:43:36] morning [16:44:41] morning Ironholds [16:45:06] I just got upset that IRC didn't auto-complete "morning" - I need to get some food :) [16:45:09] hahah [17:02:11] (PS2) Mforns: Add annotations to graphs [analytics/dashiki] - https://gerrit.wikimedia.org/r/181591 [17:03:13] (CR) Mforns: [C: -1] "Pushed code structure changes." [analytics/dashiki] - https://gerrit.wikimedia.org/r/181591 (owner: Mforns) [17:37:46] MediaWiki-Vagrant, Analytics: role::hadoop will not provision on Ubuntu 14.04 (MediaWiki-Vagrant default) - https://phabricator.wikimedia.org/T70302#949041 (bd808) Should we remove the analytics, hadoop, hive, hue, and oozie roles until somebody ports the required packages to Trusty or is there another work a... [17:45:46] MediaWiki-Vagrant, Analytics: role::hadoop will not provision on Ubuntu 14.04 (MediaWiki-Vagrant default) - https://phabricator.wikimedia.org/T70302#949063 (Ottomata) This is a chicken/egg problem I'm currently stuck in. CDH 5.2 is now available for Trusty. I have mostly upgraded production nodes to Trusty.... [17:56:09] MediaWiki-Vagrant, Analytics: role::hadoop will not provision on Ubuntu 14.04 (MediaWiki-Vagrant default) - https://phabricator.wikimedia.org/T70302#949085 (bd808) Open>stalled [17:56:23] MediaWiki-Vagrant, Analytics: role::hadoop will not provision on Ubuntu 14.04 (MediaWiki-Vagrant default) - https://phabricator.wikimedia.org/T70302#727771 (bd808) a:Ottomata [18:00:12] ottomata: looked at e-mail actions the e-mail action executor does not send attachments: https://oozie.apache.org/docs/3.1.3-incubating/core/apidocs/org/apache/oozie/action/email/EmailActionExecutor.html [18:00:41] it only sends a string body so file will need to be "catted" and sent as part of the body [18:00:59] ottomata: wait, let me see vs 4.0 of the executor [18:01:55] ottomata: same [18:03:04] ottomata: i think e-mail is made to send error/success msgs but i *think* we should be able to cat a file into a variable...lemme seee [18:04:40] yeah, nuria, pretty much, how big is the data you want to send? [18:04:52] ottomata: nothing, two lines [19:01:27] Wikimedia-Logstash, Analytics-Engineering, operations: Convert Hadoop-Logstash logging to use Redis to address failures - https://phabricator.wikimedia.org/T85015#949167 (Gage) Enabled stack trace filtering which should avoid this problem until we move to Redis: https://gerrit.wikimedia.org/r/#/c/182208/ [19:04:13] Wikimedia-Logstash, Analytics-Engineering, operations: Convert Hadoop-Logstash logging to use Redis to address failures - https://phabricator.wikimedia.org/T85015#949172 (Nuria) Please let us know when this is deployed so we can test whether errors get propagated to logstash as they should. Thank you. [19:05:56] ottomata: ok, got the changes to cat file and send it as body of e-mail but ..... where does the sh script in question go? [19:06:06] Wikimedia-Logstash, Analytics-Engineering, operations: Convert Hadoop-Logstash logging to use Redis to address failures - https://phabricator.wikimedia.org/T85015#949176 (Gage) p:Triage>Normal [19:06:43] ottomata: If i put it where workflow.xml is I still get a permision denied error [19:07:22] ottomata: wait... maybe file needs 777? [19:17:07] nuria: yeah try that? [19:17:08] not sure [19:17:11] that sounds like the right place [19:18:09] dear god, Java. Why do you need so many build frameworks [19:18:13] * Ironholds is seriously regretting this decision [19:21:29] ottomata: still error Cannot run program "cat_file.sh" (in directory "/var/lib/hadoop/data/b/yarn/local/usercache/nuria/appcache/application_1415917009743_58303/container_1415917009743_58303_01_000002"): error=13, Permission denied [19:23:05] maybe you need to invoke bash and pass it? [19:23:09] bash cat_file.sh? [19:30:55] (PS3) Mforns: Add annotations to graphs [analytics/dashiki] - https://gerrit.wikimedia.org/r/181591 [19:31:29] ottomata: don't think so cause there is a shell task [19:31:40] (CR) Mforns: [C: -1] "Modified tests to adapt to structure change." [analytics/dashiki] - https://gerrit.wikimedia.org/r/181591 (owner: Mforns) [19:43:31] holy shit, beautiful D3 [19:47:20] ottomata: but i see although sh file has 777 the -put command is not preserving permits, lemme fix that [20:03:18] nuria: how do people get added to that security group that gives them access to the db credentials on stat1003? [20:03:19] is that puppet? [20:03:55] milimetric: there are two things 1) ssh 2) access to db [20:04:07] ssh is already good [20:04:12] access to db is via the research user [20:04:15] ssh is via RT ( and toby aproves it) [20:04:17] whose credentials are in some file in /etc/ [20:04:29] db access is via belonging to a group [20:04:37] that otto can do [20:04:46] so I just send him an email? [20:05:11] seems like a crappy process for him, but ok [20:05:11] I think if it's none on our team it might need to go through RT [20:08:21] milimetric: I think if the user in question is not from our team request might ned to go through RT [20:08:30] Phabricator! [20:08:32] Ops have switched [20:09:24] right [21:28:54] milimetric, thanks! I'll take a look later this afternoon. [21:29:12] cool, np [21:34:33] nuria, yt? [21:34:46] mforns: yesss [21:35:25] you said to filter the annotations by date, the graph component could output the dates [21:35:33] how does that work [21:35:34] ? [21:36:45] mforns: I though we were doing that in another changeset per milimetric request [21:36:51] oh [21:37:12] ok [22:51:56] (CR) Nuria: "Regarding UX I think font size for annotations plus the space they take should be a bit smaller." [analytics/dashiki] - https://gerrit.wikimedia.org/r/181591 (owner: Mforns) [23:17:59] (CR) Milimetric: Add annotations to graphs (1 comment) [analytics/dashiki] - https://gerrit.wikimedia.org/r/181591 (owner: Mforns)