[01:08:51] bb in 1h [01:10:49] ok [14:29:45] morning [14:32:28] morning [14:34:27] morning [16:28:47] millimetric, brain bounce w me for a second about the internal hadoop urls? [16:28:51] (chat is fine [16:28:53] ) [16:46:19] yo yo yo [16:52:32] morning milimetric, ottomata [16:52:39] morning drdee [16:52:51] i slept for 10 hours straight :D [16:53:05] the advantage of not being home ;) [18:01:11] i see no drdee. [18:01:29] !log where does this go? [18:01:31] Logged the message, Master [18:01:39] damnit, analytics-logbot, you're not helping. [18:02:19] hiiiiii [18:02:25] it says in the chat [18:02:27] sorry [18:02:29] in the topic [18:02:35] https://www.mediawiki.org/wiki/Analytics/Server_Admin_Log [18:03:02] y'all tryna hangout [18:03:02] ? [18:03:03] https://plus.google.com/hangouts/_/2e8127ccf7baae1df74153f25553c443bd351e90 [18:21:41] erosen: [18:21:41] http://hue.analytics.wikimedia.org/filebrowser/view/var/log/hadoop-yarn/apps/erosen?file_filter=any [18:21:57] danke [18:27:28] !analytics-logbot [18:27:33] !help [18:31:15] drdee: Hi [18:31:22] hey average_drifter! [18:41:51] erosen, drdee: can't make it to the hangout today [18:42:00] k [18:42:03] say hi to everybody [18:43:53] aw, I was looking forward to your perspective DarTar, you should crash the end of our standup sometime and we can catch up. [18:45:17] milimetric: will do, gotta run - ttyl folks [19:13:09] drdee,dschoon: can I haz link to slides for meeting? [19:13:20] https://docs.google.com/a/wikimedia.org/presentation/d/1EutD_z6Koyv71JY8qM1AovTxJDGSWGkE9bikXHji0k4/edit [19:14:05] danke [19:33:39] where could we find source code for geoiplogtag [19:33:43] ? [19:34:17] is Mark Bergsma reachable ? [19:34:22] let me search, you guys move on [19:34:29] ok [19:35:36] http://svn.mediawiki.org/viewvc/mediawiki/trunk/tools/geoiplogtag/geoiplogtag.c?view=markup [19:36:39] average_drifter ^^ [19:36:54] openeed [19:37:00] it seems we have a code called -P [19:37:01] region code [19:37:01] it's very simple [19:37:07] which we don't know anything about [19:37:17] so maybe that's an old version of the maxmind db [19:38:34] could it be Pacific? [19:39:27] user@garage:/tmp$ gcc geoiplogtag.c -lGeoIP [19:39:27] user@garage:/tmp$ ./a.out [19:39:27] ^C [19:39:27] user@garage:/tmp$ echo "188.40.40.40" | ./a.out [19:39:27] 188.40.40.40 DE [19:39:47] hey ottomata [19:39:51] just fyi: http://permalink.gmane.org/gmane.comp.web.varnish.misc/864 [19:40:10] varnish truncates log fields at 256 chars [19:40:22] i'm about to write up an e-mail requesting the patch is applied [19:40:46] drdee: can you ask Mark if that supports IPv6 ? [19:40:50] we noticed requests were getting truncated :/ [19:41:06] s/requests/query strings [19:41:09] ori-l: arrrggghhhhhhhh :( [19:41:33] average_drifter: geoiplogtag does not support ip6 [19:42:10] i'll add you guys to the RT ticket [19:42:16] ty! [19:47:15] oh that is bad [19:56:54] ori-l,i am not sure if you are right regarding the varnish url limit, i just found a url of size 280 from bits (assuming that bits is serviced by varnish) [19:57:26] found where? [19:57:49] in a sampled log file [20:01:26] let me check more carefully [20:04:12] ottomata: http://dpaste.de/SSShI/ [20:04:28] i hand-removed the IP, in case you're wondering what xx.xx.xx.xx is [20:05:38] in case you need more good news [20:05:48] fixing it will require rebuilding all of varnish [20:06:43] not just varnishlog / varnishncsa [20:06:44] merry xmas [20:06:44] :/ [20:07:36] nice! [20:13:06] drdee: IPv6 is not supported by maxmind [20:13:24] drdee / ottomata: notice that the request path + query string are exactly 255 chars [20:13:26] yes [20:13:32] "/en.wikipedia.org/load.php?debug=false&lang=en&modules=ext.UserBuckets%2CmarkAsHelpful%7Cext.UserBuckets.AccountCreationUserBucket%7Cext.articleFeedback.startup%7Cext.articleFeedbackv5.startup%7Cext.gadget.teahouse%7Cjquery.autoEllipsis%2CcheckboxShiftCli".length === 255 [20:17:22] drdee / ottomata: https://rt.wikimedia.org/Ticket/Display.html?id=4094 [21:29:33] cool, danke [21:53:44] hm [21:53:48] oop, wrong chat [21:59:51] drdee: answer to your question => AQ,FX,GF,TK,A1,A2,BL,MF,XX,-P [22:00:12] once any of the region codes in the list above appears, World counts them but Global South and North do not count those [22:00:24] so that's where differences come from [22:01:02] all of those are treated as "unknowns" but only EU, AP, AN appear in the table as being unknown [22:02:15] EU is classified as Global North [22:02:29] AP is classified as Global South [22:02:41] AN is also Global South [22:05:49] so for example [22:06:02] let's say I just put in the logs 2 entries with region code "AQ" [22:06:04] then [22:06:09] world_total = 2 [22:06:09] global_north = 0 [22:06:09] global_south = 0 [22:06:29] so map AQ,FX,GF,TK,A1,A2,BL,MF,XX,-P to 'unknown' [22:06:35] that would solve it, right? [22:07:29] I think so yes [22:09:32] AQ is Antarctica btw [22:13:46] MF is an island in the middle of the sea http://en.wikipedia.org/wiki/Collectivity_of_Saint_Martin [22:15:15] it's all unknown, it's all marginal stuff [22:15:24] ok [22:16:24] drdee: ok, so one last time I need to check, you agree that World - North - South - Unknown = 0 [22:16:33] this equation should hold for any possible scenario [22:16:34] right ? [22:16:35] yes [22:16:39] ok great [22:48:12] analytics-logbot, tell me about yourself. [22:48:13] I am a logbot running on bots-analytics. [22:48:13] Messages are logged to www.mediawiki.org/wiki/Analytics/Server_Admin_Log. [22:48:13] To log a message, type !log . [22:48:53] analytics-logbot: who are you sir ? [22:48:53] I am a logbot running on bots-analytics. [22:48:53] Messages are logged to www.mediawiki.org/wiki/Analytics/Server_Admin_Log. [22:48:53] To log a message, type !log . [22:49:21] !log !log [22:49:28] !log test123 [22:49:34] !log "test123" [22:49:36] Logged the message, Master [22:49:39] Logged the message, Master [22:49:41] Logged the message, Master [22:49:45] oh looks like I'm a master [22:50:20] drdee: just talked with Erik, we found a solution where to insert all those codes in a RegionCodes.csv file. they will be mapped to XX, then the test will pass [22:50:26] drdee: I'll get back with a gerrit link :) [22:52:12] I look forward to the day that the bot is used to log something other than 'test' [22:55:38] andrewbogott: can the bot be told to send a message to someone when they come up online ? [22:55:49] nope, not that fancy. [22:56:18] Or, at least, /that/ bot is strictly a logbot. I don't know what wm-bot's deal is. [22:56:31] wm-bot, what's your deal? [22:56:39] Hm, how rude [23:21:32] dschoon: got a sec for a node question? [23:21:42] erosen: nope, meeting in 10 [23:21:46] k [23:27:08] hmmm [23:27:20] hangout yes no? [23:28:08] yes [23:28:10] https://plus.google.com/hangouts/_/322a23cbc2dc33491a7826c439c2aa12335141f3?authuser=0&hl=en [23:28:13] I just started that [23:28:29] drdee ^^ jump in when you guys get set up [23:28:57] i am not allowed to join that hangout! [23:29:30] what the [23:30:10] ? [23:30:15] dunno! [23:30:48] got it! [23:34:25] in the process! [23:34:28] of? [23:34:41] we're on the hangout above (https://plus.google.com/hangouts/_/322a23cbc2dc33491a7826c439c2aa12335141f3?authuser=0&hl=en) [23:36:15] working on stuff [23:38:53] http://etherpad.wmflabs.org/pad/p/analytics-quarterly-review