[00:06:45] <drdee>	 ottomata, updated khadoop
[00:06:49] <ottomata>	 cool, danke
[03:03:29] <average_drifter>	 drdee: I still have problems with many titles
[03:03:31] <average_drifter>	 drdee:  you there ?
[03:03:37] <drdee>	 yo
[03:03:39] <average_drifter>	 drdee: I mean, some of them just don't have titles
[03:03:42] <drdee>	 which domains?
[03:03:46] <average_drifter>	 let me give some examples
[03:03:58] <average_drifter>	 http://nl.wikipedia.org/w/api.php?format=json&action=opensearch&search=bu&namespace=0&suggest=
[03:04:24] <average_drifter>	 ok so -o should output 5 fields
[03:04:28] <average_drifter>	 the last field is the title
[03:04:34] <average_drifter>	 what should I output if it doesn't have a title ?
[03:04:56] <drdee>	 but that url does not have /wiki/
[03:05:10] <drdee>	 so you can skip it
[03:05:26] <average_drifter>	 alright
[03:05:27] <drdee>	 we only count urls that contain either /wiki/ or index.php=
[04:02:19] <average_drifter>	 drdee: within ~40 of the same output as filter
[04:02:44] <drdee>	 in total?
[04:04:23] <average_drifter>	 drdee: yea
[04:04:53] <drdee>	 and those 40, can you share those on a gist?
[04:05:21] <average_drifter>	 yes
[04:05:25] <average_drifter>	 but first, I need to mention
[04:05:29] <average_drifter>	 this is a comparison between
[04:05:38] <average_drifter>	 ./udp-filter -o -t    and    filter
[04:05:51] <drdee>	 that's fine
[04:07:07] <average_drifter>	 I'll gist these up
[14:51:36] <milimetric>	 good morning!
[14:52:43] <ottomata>	 mornign!
[14:52:50] <ottomata>	 drdee is gonna have a babyyyyy!
[14:53:02] <ottomata>	 hey, what did the mommy bullet say to the daddy bullet?
[14:53:40] <drdee>	 dunno
[14:55:36] <ottomata>	 "We're gonna have a BB!"
[14:58:13] <milimetric>	 wait it's official?
[14:58:32] <milimetric>	 no, can't be
[14:58:35] <milimetric>	 he wouldn't be on IRC!
[15:03:48] <ottomata>	 no laughter?
[15:04:02] <ottomata>	 cmoooonnnnnn good joake!
[15:04:57] <drdee>	 :D
[15:05:17] <drdee>	 i am tapering off soon
[15:05:23] <drdee>	 busting out some final emails
[15:05:32] <drdee>	 try to join scrum bot no promises
[15:09:11] <milimetric>	 lol ottomata, BB
[15:09:12] <milimetric>	 :)
[15:09:50] <ottomata>	 hehehe
[15:43:11] <drdee>	 average_drifter:around?
[15:53:57] <ottomata>	 q for him too, and maybe you drdee
[15:54:04] <ottomata>	 i've got the change to udp-fitler for field delimiter
[15:54:12] <ottomata>	 should I jsut commit it and let you guys deal with changelog and debianizing?
[15:57:09] <drdee>	 yeah just push it
[16:06:29] <ottomata>	 ok pushed
[16:06:34] <ottomata>	 oops, i shoulda git-reviewed it
[16:06:37] <ottomata>	 i just pusheed
[16:07:28] <ottomata>	 https://gerrit.wikimedia.org/r/gitweb?p=analytics/udp-filters.git;a=commitdiff;h=67dcf53f0ee4214e24f75528ecee6ba37e0e58ca
[17:59:13] <milimetric>	 https://plus.google.com/hangouts/_/2e8127ccf7baae1df74153f25553c443bd351e90
[18:01:00] <milimetric>	 ottomata, erosen, average_drifter ^^
[18:28:15] <dschoon>	 Analyst syncup is https://plus.google.com/hangouts/_/33bb08418c094ead3577050db709b808c2007e86
[18:28:57] <dschoon>	 in case anyone (like, say, erosen) would like to alleviate the crushing loneliness
[18:31:37] <erosen>	 yeah
[18:32:22] <dschoon>	 or not!
[18:32:31] <dschoon>	 oh, i forgot to hit "join"
[19:06:07] <ottomata>	 ok, actually going to post office now
[19:07:21] <ottomata>	 oops just kidding
[19:07:28] <ottomata>	 have to wait 30 minutes til pie is done
[19:37:24] <average_drifter>	 hey
[19:37:33] <average_drifter>	 I fell alseep and forgot to review
[19:37:35] <average_drifter>	 doing now
[19:39:28] <ottomata>	 i committed the —field-delimiter change to udp-filter
[19:39:32] <ottomata>	 you should pull and check that one out
[19:43:17] <ottomata>	 afk for a few mins, going to post office (for real this time)
[19:47:40] <dschoon>	 ottomata, i did a bit more reading and updated http://www.mediawiki.org/wiki/Analytics/Kraken/JMX_Monitoring
[19:48:06] <dschoon>	 basically i think we should just go with graphite or ganglia. graphite seems shinier, mostly for the query API
[20:08:51] <average_drifter>	 ottomata: hello
[20:08:53] <average_drifter>	 ottomata: https://gist.github.com/7fa3c3eb24ceca675ffa
[20:09:28] <average_drifter>	 drdee: https://gerrit.wikimedia.org/r/#/c/33403/
[20:09:34] <average_drifter>	 drdee: https://gerrit.wikimedia.org/r/#/c/33407/
[20:09:55] <average_drifter>	 ottomata: fixed bugs, please have a look at the output
[20:11:01] <average_drifter>	 ok, these are the outputs
[20:11:10] <average_drifter>	 http://garage-coding.com/filters_output_fixing_bugs.zip
[20:11:27] <average_drifter>	 ottomata , drdee   the input file was the one we used yesterday
[20:21:33] <milimetric>	 average_drifter, drdee's having a baby
[20:21:50] <milimetric>	 so he probably won't get to review
[20:24:37] <average_drifter>	 :)
[20:43:15] <ottomata>	 ok soo waaa?
[20:44:07] <ottomata>	 average_drifter, that's cool, i'm not going to get into reviewing any of the filter/collector webstats stuff
[20:44:11] <ottomata>	 as you know way more about it than I do
[20:44:23] <ottomata>	 should I just merge those?
[20:45:14] <average_drifter>	 ottomata: you can yes, tests are passing
[20:45:20] <ottomata>	 cool
[20:45:46] <ottomata>	 jenkinsbot doesn't like this one though
[20:45:47] <ottomata>	 https://gerrit.wikimedia.org/r/#/c/33407/
[20:46:15] <average_drifter>	 it doesn't like it because our ticket to operations in gerrit is not finished
[20:46:25] <average_drifter>	 ottomata: can you help me make the final changes for the ops please ?
[20:46:47] <average_drifter>	 ottomata: I don't know in what role I should put the package installations for openssl
[20:46:51] <average_drifter>	 actually libssl-dev
[20:46:56] <average_drifter>	 well, both
[20:47:28] <ottomata>	 oh
[20:47:28] <ottomata>	 hm
[20:47:34] <average_drifter>	 if we do that, then we'll have libanon built, libcidr files and then we can do continous integration for udp-filters as well
[20:47:38] <ottomata>	 yeah, what's the link to that change again?
[20:47:48] <average_drifter>	 and jenkins bot will not complain anymore
[20:47:50] <average_drifter>	 moment
[20:47:53] <average_drifter>	 lookin for it
[20:49:03] <average_drifter>	 ottomata: https://gerrit.wikimedia.org/r/#/c/32192/
[20:51:12] <ottomata>	 ok, mind if I just create a new commit to do this?
[20:52:49] <average_drifter>	 ottomata: no problem
[20:56:07] <ottomata>	 um so
[20:56:11] <ottomata>	 are you sure this is the problem?
[20:56:19] <ottomata>	 openssl and libssl-dev are both currently installed on gallium
[20:56:45] <ottomata>	 average_drifter^
[20:57:15] <average_drifter>	 are they ?
[20:57:16] <average_drifter>	 hmm
[20:57:22] <average_drifter>	 let me check another libanon build
[20:57:56] <average_drifter>	 20:57:44 ./configure: line 11393: syntax error near unexpected token `OPENSSL,'
[20:57:59] <average_drifter>	 20:57:44 ./configure: line 11393: `PKG_CHECK_MODULES(OPENSSL, openssl)'
[20:58:02] <average_drifter>	 https://integration.mediawiki.org/ci/job/libanon/20/console
[20:58:19] <average_drifter>	 I don't know why that happens
[20:59:20] <ottomata>	 that says syntax error though, right?
[20:59:27] <ottomata>	 hmmm
[21:00:15] <average_drifter>	 well libanon builds without problems on my machine
[21:00:26] <average_drifter>	 and I don't know why that's happening there
[21:00:45] <average_drifter>	 not having access to gallium, I can't figure out the problem
[21:03:53] <ottomata>	 can we trigger a build now?
[21:04:17] <ottomata>	 want to try it
[21:04:22] <ottomata>	 average_drifter^
[21:04:30] <average_drifter>	 ottomata: yea
[21:04:38] <ottomata>	 how do we do that?
[21:04:43] <average_drifter>	 https://integration.mediawiki.org/ci/job/libanon/
[21:04:46] <average_drifter>	 just hit build now
[21:06:10] <ottomata>	 yeah?
[21:06:11] <ottomata>	 can I see it?
[21:06:47] <average_drifter>	 the result ?
[21:06:58] <ottomata>	 yeah, don't see the build running
[21:07:05] <average_drifter>	 did you press "build now ?
[21:07:21] <ottomata>	 oh ha, thought you did...
[21:07:22] <ottomata>	 uhhh
[21:07:28] <ottomata>	 dno't see that link
[21:08:15] <ottomata>	 ah, got it
[21:08:16] <ottomata>	 had to log in
[21:08:18] <average_drifter>	 :)
[21:12:11] <ottomata>	 https://gerrit.wikimedia.org/r/#/c/33466/
[21:12:13] <ottomata>	 :)
[21:13:19] <average_drifter>	 looking
[21:13:43] <average_drifter>	 sweeet :) looks good
[21:16:19] <average_drifter>	 that looks good, so pkg-config was missing
[21:16:24] <average_drifter>	 and pcpa
[21:16:26] <average_drifter>	 pcap
[21:16:33] <ottomata>	 yup
[21:16:57] <ottomata>	 so, both of your udp-filter changes are merged now
[21:17:51] <average_drifter>	 thanks !
[21:18:00] <average_drifter>	 ottomata: how can I make libanon be part of analytics on jenkins ?
[21:18:04] <average_drifter>	 ottomata: currently they're not
[21:18:06] <average_drifter>	 ottomata: https://integration.mediawiki.org/ci/job/libanon/
[21:20:30] <ottomata>	 hmm, i have never used jenkins before!
[21:21:16] <ottomata>	 so i unnooooo
[21:38:13] <average_drifter>	 ottomata: buildbot ?
[21:38:36] <ottomata>	 buildbot?
[21:38:49] <ottomata>	 i haven't used CI before, honestly
[21:38:55] <average_drifter>	 oh ok :)
[21:57:31] <louisdang>	 hey ottomata, I was able to rewrite my own github kraken repo's history using the command dschoon gave and a force push, but I don't have a push access to the wmf-analytics repo.
[21:57:47] <dschoon>	 *nod*
[21:58:03] <dschoon>	 github is git in most respects, so all the tools basically work.
[21:58:29] <dschoon>	 the thing is, `git push --force` will cause a huge mess for everybody who pulls afterward
[21:58:46] <ottomata>	 i'm ok with recloning kraken
[21:58:49] <dschoon>	 yeah.
[21:59:06] <dschoon>	 i recommend that FIRST, everybody try cloning louisdang's fork
[21:59:12] <ottomata>	 hmm ok
[21:59:15] <dschoon>	 make sure that works, still builds/whatever
[21:59:18] <dschoon>	 do it clean
[21:59:57] <ottomata>	 cloned no prob
[22:01:01] <dschoon>	 once everybody signs off, then ottomata you:
[22:01:15] <dschoon>	 git remote add wmfa git@github.com:wmf-analytics/kraken.git to your fresh clone
[22:01:49] <dschoon>	 and finally, after triple-checking that everyone knows: `git push --force wmfa --all`
[22:01:51] <dschoon>	 i believe
[22:02:02] <dschoon>	 you may want to test this with a dummy repo first :)
[22:02:04] <dschoon>	 brb meeting
[22:03:51] <louisdang>	 ottomata, I haven't merged your latest commit yet
[22:05:22] <ottomata>	 ok, i'm not doing anything atm
[22:57:56] <erosen>	 ottomata: what was that library you made for processing generic csv?
[22:57:59] <erosen>	 files
[23:11:54] <ottomata>	 bwerrrrrrr
[23:11:58] <ottomata>	 pipeline
[23:12:34] <ottomata>	 https://gerrit.wikimedia.org/r/#/admin/projects/analytics/reportcard/old-pipeline
[23:30:13] <erosen>	 danke