[01:29:52] new release for udp-filters 0.3.20 available http://stat1.wikimedia.org/spetrea/releases/udp-filters/ [01:30:05] ottomata: ^^ [01:30:09] drdee: ^^ [01:30:20] dschoon: ^^ [01:30:49] yay [01:32:08] awesome, ty! [01:32:15] is this both lucid and precise? [01:33:29] yes [01:33:47] great job! [01:34:16] thanks :) [01:34:20] congrats! [01:34:32] I'm waiting now for stat1 to finish the new mobile reports [01:34:55] cool [01:34:59] ping me when they are ready [01:35:03] ok [03:06:25] brb food [10:41:24] do we know what % of visitors have cookies disabled? [14:30:07] good question ori-l [15:45:03] drdee: hi [15:45:07] morning [15:45:13] new mobile page view report? [15:45:26] not yet, writing code to split GET params [15:45:32] will have one soon [15:48:24] ottomata: whenever you have a spare cycle, wanna help me set up ldap for our redmine instance? [18:37:26] drdee: did you pay for the Github repo? [18:38:52] drdee: Someone paid for a Bronze plan this morning [18:39:15] 01/29/2013 04:38AM PST [18:39:40] yes i did [18:40:31] drdee: I thought that the plan was to decommission wmf-analytics [18:40:58] drdee: and use Wikimedia Incubator and Wikimedia [18:41:07] we just came up with a list of repos to transition to wikimedia [18:41:17] that was yesterday [18:41:29] so i will do that once i have admin rights on wikimedia [18:41:47] drdee: if you give me the list I can move them [18:42:00] ok [18:43:42] dschoon: http://www.timezoneconverter.com/cgi-bin/tzc.tzc [18:47:33] ottomata: ping [18:47:36] hi [18:47:46] kraken is now https://github.com/wikimedia/kraken [18:47:57] cool! [18:49:40] preilly: i was looking for http://www.timeanddate.com/worldclock/fixedtime.html?p1=224&iso=20130212T12&ah=2 [18:49:43] ty tho [18:50:03] so will wmf-analytics be closed down ? :( [18:50:12] and we move ti github.com/wikimedia ? [18:50:15] *to [18:50:48] well it's good that we know it's happening now so we can make all the changes. like changing remotes and stuff [18:51:47] yes average_drifter: preilly is moving the list of repo's as discussed yesterday [18:52:02] so please reclone /update configs [18:52:46] ok [18:52:47] drdee or ottomata: can you check on the existence of any zero-orange-congo* files on oxygen? [18:53:11] (also, can you advise on where to request access?) [18:53:24] do you have RT access? [18:53:29] ya [18:53:32] just make a ticket? [18:53:32] ok [18:53:42] i'll look at it [18:53:46] make a ticket, CC me, CT, and andrew and robla [18:53:57] and ask for access and give motivation [18:54:10] Kraken, dClass, reportcard, puppet-kafka, puppet-jmxtrans, puppet-cdh4, puppet-storm and sqoopy are all moved to https://github.com/wikimedia now [18:54:13] under general ops-requests [18:54:20] yes [18:54:22] ty preilly! [18:54:22] i think there is [18:54:25] thanks [18:54:26] an access-requests queue [18:54:39] tis true [18:54:39] i'll do it htere [18:54:39] oh, erosen [18:54:40] congo [18:54:46] ya? [18:54:46] that was one of the recently requested ones, right? [18:54:49] ish [18:54:53] like a couple of weeks ago [18:54:57] yeah [18:54:58] 4 new filters [18:54:59] yeah [18:55:02] i had to turn them off [18:55:03] oxygen couldn't handle it [18:55:11] we were/are waiting to get X-CS working [18:55:15] gotcha [18:55:17] but I couldn't run X-CS on oxygen either [18:55:23] so I was trying to get them into kraken for you [18:55:26] but something was broke [18:55:31] and I have been consumed since [18:55:51] no worries [18:55:56] i just need to know what to tell amit [18:55:59] Does kraken-puppet need to be private? [18:56:07] it can die [18:56:09] its not being used [18:56:16] it doesn't need to be private [18:57:02] Can the rest of these: https://github.com/wmf-analytics [18:57:14] Be moved to: Wikimedia Incubator [18:57:30] is incubator a different github org? [18:57:48] ottomata: yes [18:58:04] cool, sure don't see why not, as long as you don't mind more repo mess in incubator [18:58:10] can we create/fork repos at will there? [18:58:21] ottomata: yes create/fork at will is fine [18:58:30] cool, then yeah do it [18:58:39] oh, maybe not libcidr [18:58:45] i want to maintain that one in gerrit [18:58:49] and do the gerrit -> github sync [18:58:52] Can any of these: https://github.com/wmf-analytics be deleted? [18:58:58] oh for sure [18:59:05] lemme make a list [18:59:06] wait [18:59:17] * preilly — waiting [18:59:21] haha [18:59:22] please don't delete any repo's [18:59:28] just move them to incubator [18:59:48] drdee: why do you need operations-puppet ? [19:00:09] that needs to be integrated with the real operations puppet [19:00:19] drdee: ah okay [19:00:23] kraken-bak can be deleted [19:00:25] preilly, that is a branch of the gerrit opeartions/puppet repo, and it needs to be merged back in [19:00:26] yeah [19:00:36] can we be added to the wikimedia incubator or to wikimedia organizations ? [19:00:44] or both [19:00:57] hm, actually, preilly, the only one I know that you should delete is hue [19:01:00] average_drifter: are you a contractor or staff? [19:01:03] its a fork of cloudera's hue [19:01:05] contractor [19:01:06] because I made a patch [19:01:11] but they don't use github for patches [19:01:15] preilly: contractor, yes [19:01:38] the rest have changes that would be good to keep around [19:02:05] average_drifter: so you can have access for sure [19:02:10] ottomata: Okay cool [19:02:22] preilly: milimetric should also have push priviliges [19:02:25] he is staff [19:03:09] preilly: so, can you add me to those organizations ? https://github.com/wsdookadr <== this is my github account [19:03:38] average_drifter: you're added [19:03:52] thanks preilly [19:03:52] drdee: milimetric is added too [19:04:01] awesome! [19:04:17] drdee: see https://github.com/organizations/wikimedia [19:04:49] ok [19:05:23] thanks [19:11:44] hm, ottomata: is an06 really the only kafka broker we have running? [19:11:50] or am i grepping for the wrong thing? [19:11:55] no [19:11:58] kafka brokers are an21 and22 [19:12:00] an22 [19:12:04] an06 is one of 5 producers [19:12:21] ahh. [19:12:31] it has kafka.Kafka running, though. [19:12:49] i see an06, an21, an22 [19:12:50] well pooopdy doo! [19:13:35] >:( [19:13:40] how do I make an angry face? [19:13:49] ha, this is a reason why reprovisioning these will be nice [19:14:11] thanks preilly! [19:14:53] oh phew, dschoon, it isn't part of the main kafka cluster though [19:14:59] it doesn't know about the main zks [19:15:04] weird that it's up. [19:15:46] probably was left up from some past local testing of it [19:27:46] need food back in a bit [19:31:06] drdee , preilly what about https://github.com/wmf-analytics/fast-field-parser-xs ? [19:31:10] what do we do with this one ? [19:31:22] you tell us :) [19:31:23] it's one of the main components for the new mobile pageview reports [19:31:41] can we move it to github.com/wikimedia ? [19:36:06] average_drifter: Repository moved to wikimedia/fast-field-parser-xs [19:42:24] ok, thanks [19:43:40] https://github.com/wikimedia-incubator now has all of the other repos moved [19:44:06] https://github.com/wmf-analytics is now decommissioned [19:44:32] ok, may I be added to wikimedia-incubator also please ? [19:48:09] average_drifter: done [19:51:04] thanks [20:06:40] Just an FYI [20:07:04] Andrew has admin access to https://github.com/wikimedia-incubator as he is in operations [20:07:20] So if you need anything created in that organization you can ping him as well [20:12:51] ah, thanks preilly [20:13:00] ottomata: you're welcome [20:13:26] ottomata: if at all possible I'd like you to be a choke point for repo admin stuff [20:14:05] sure [20:20:10] ottomata: also I'm talking to Magnus Edenhill about librdkafka [20:20:29] ottomata: [20:20:33] oh! [20:20:40] nice [20:20:42] preilly told me about this earlier. i think it's a fantastic idea. [20:20:49] ottomata: He gave these estimates [20:20:50] we'd love to do it, but it's a matter of time and priorities. [20:20:58] - kafka 0.8 support: 16 hours [20:20:59] - zookeeper producer support: 12 hours [20:20:59] - varnish log kafka plugin: ~10 hours [20:21:22] that's for him to do them? [20:21:23] If it takes less than that I wont charge for the remaining hours. And I was planning on doing kafka 0.8 spport anyway, maybe just not this soon, so that'll be pro-bono. [20:21:32] ottomata: that's for him to do them [20:21:38] ottomata: as a contractor [20:21:41] nice [20:21:51] very cool [20:23:49] I'm just waiting to hear his rates [20:23:57] * preilly hopes they're low [22:05:23] ottomata, drdee, milimetric I got JMX stats working in Riemann: http://riemann.analytics.wikimedia.org/ [22:05:39] there are now several tabs, the jvm one has a bunch of kafka stats for the brokers. [22:06:05] note that the http proxy is off, so i think milimetric is screwed to play around [22:06:12] brb lunch [22:06:21] cool [22:06:48] ok it works now dschoon [22:06:50] (reminder: you need to add "riemann.analytics.wikimedia.org riemann-ws.analytics.wikimedia.org graphite.analytics.wikimedia.org" to /etc/hosts file) [22:07:20] ottomata: apparently an01 is out of disk on / ? [22:07:37] yes that's me [22:07:56] verifying no packet loss with mobile pageviews [22:08:06] drdee [22:08:07] use /a [22:08:13] i did [22:08:46] oh ha [22:13:09] ? [22:13:38] guess I didn't realize it would fill it up [22:13:43] i can delete some of my stuff I think [22:15:34] back [22:22:35] i pushed my jruby client to https://github.com/dsc/riemann-jmx [22:22:54] but the install steps are awful, because the jruby in apt is old [22:23:16] so i'll probably fork jmxtrans and add riemann support [22:28:07] dschoon, isn't it better to either push riemann-jmx to wikimedia or wikimedia-incubator? [22:28:20] sure. [22:28:24] i'll do it later. [22:32:21] ok status report! because i'm about to sign off, need a nap or something [22:32:32] i pushed puppet-kafka to gerrit puppet for review [22:32:42] but, i realized that it uses a kafka .deb [22:32:42] so [22:32:50] i created operations/debs/kafka [22:32:58] from wikimedia-incubator/kafka-debian [22:33:05] i'm attempting to use it to rebuild a kafka .deb [22:33:11] and then will put that in wikimedia apt [22:33:23] i would build it on my precise labs instance [22:33:26] but labs is offline atm [22:33:35] tried to build it on an01 for a sec [22:33:44] but kept hitting little walls [22:33:51] so i'm going to start there again tomorrow [22:34:48] okidoki [22:38:04] drdee [22:38:08] shoudl I work on tabs thought? [22:38:10] though? [22:38:22] this whole merge and review process will take a while [22:38:52] i would just submit some more patches and then while we are waiting for review work on tabs [22:39:05] but i fully realize that this might be postponed to monday [22:39:12] we wil see tomorrow what is feasible timeline [22:41:04] ok [23:01:07] ottomata , drdee have you seen this thing called rerun ? [23:01:07] http://vimeo.com/54831977# [23:01:18] listening to it on the background [23:06:27] preilly: [23:06:28] ERROR: Permission to wikimedia/fast-field-parser-xs.git denied to wsdookadr. [23:06:31] fatal: The remote end hung up unexpectedly [23:07:24] preilly: I can't push into the repository I'm working on [23:07:30] preilly: what do I do ? [23:09:07] preilly: ping [23:13:06] nevermind, I've forked it