[01:01:30] Analytics / Wikimetrics: add endpoint to show invalid users as html page - https://bugzilla.wikimedia.org/60628 (Marcel Ruiz Forns) ASSI>PATC [09:18:00] (CR) QChris: [C: -1] Add UAParserUDF from kraken (21 comments) [analytics/refinery/source] - https://gerrit.wikimedia.org/r/166142 (owner: Ottomata) [10:19:02] Analytics / General/Unknown: Kafka broker analytics1021 not receiving messages every now and then - https://bugzilla.wikimedia.org/69667#c14 (christian) Happened again on 2014-10-13 around 13:37:31. [10:51:35] !log Ran kafka leader re-elections, since analytics1021 got kicked out of being partition leader {{bug|69667}}. [11:12:46] Analytics / Refinery: Raw webrequest partitions that were not marked successful - https://bugzilla.wikimedia.org/70085 (christian) [11:12:49] Analytics / Refinery: Several raw webrequest partitions now marked successful between 2014-10-13T13:xx:xx and 2014-10-13T22:xx:xx - https://bugzilla.wikimedia.org/72028 (christian) NEW p:Unprio s:normal a:None Between 2014-10-13T13:xx:xx and 2014-10-13T22:xx:xx several partitions, were not... [11:52:32] !log Marked webrequest partitions for 2014-10-13T13:xx:xx good {{bug|72028}} [12:06:31] hi everyone! [13:02:44] Heya mforns :-) [13:11:43] Yeeeee haaa! [13:11:45] morning :) [13:15:29] Heya milimetric [13:15:58] hi! [13:16:14] qchris: I'm curious what you think of our playing with cubes [13:16:49] I find it interesting. [13:17:06] That would certainly help users to look at the data. [13:17:11] So i am all for it. [13:17:12] when you say "playing with cubes" I can't help but imagine you idly flipping a holocron between your fingers [13:17:12] JFYI [13:17:24] (http://starwars.wikia.com/wiki/Holocron ) [13:17:42] Ironholds: Holocron .... aren't we talking about plain d6? [13:18:20] milimetric: But I have not been involved in discussions about where we want to take this, so I don't really know. [13:18:23] qchris, you I like. [13:18:30] SWRPG D6 was actually how I got on to IRC! [13:18:38] and then WOTC made it D20 and ruined everything :( [13:18:48] Hahahahaha [13:18:57] but yes. Oliver, aged ten, was on undernet playing SWRPG with some random friends from the internet. [13:19:01] I was a really weird kid. [13:20:30] qchris: those discussions haven't happened yet :) [13:21:47] Oh. Hey ... more discussions :-D [13:43:00] Analytics / Wikimetrics: JSON reports printing user names incorrectly if they have non ascii chars - https://bugzilla.wikimedia.org/64555#c3 (Marcel Ruiz Forns) NEW>PATC This issue has been solved together with 60628. Adding an HTML page (instead of JSON) for invalid user lists renders non-ascii... [13:46:14] (CR) Milimetric: Add a timerange validator (3 comments) [analytics/wikimetrics] - https://gerrit.wikimedia.org/r/166157 (https://bugzilla.wikimedia.org/70714) (owner: Bmansurov) [14:01:10] hm i can't join the hangout, i just get a wobbling green asterisk. restarting browser.. [14:10:16] Analytics / Refinery: Several raw webrequest partitions now marked successful between 2014-10-13T13:xx:xx and 2014-10-13T22:xx:xx - https://bugzilla.wikimedia.org/72028#c1 (christian) For 2014-10-13T13:xx:xx it affected all caches with the only exception of cp1056.eqiad.wmnet (bits) cp1057.eqiad.wm... [15:49:26] Folks, I'm having lunch and will be back in 1 hour [15:57:01] qchris: show all your comments in UDF, will try to take care of all of them today. need to review udf 'theory' a liitle bit as i have not looked at this code since May [16:24:51] nuria_: No need to take care of them if you're not going to work on the patch. It only sounded that you want to work on it. [16:25:34] qchris_away : i do want to leave it as good as it can be though [16:25:50] Cool :-) [17:06:02] (CR) Nuria: [C: 1] "Looks good, just one small nit. Tested on vagrant and things work well." (1 comment) [analytics/wikimetrics] - https://gerrit.wikimedia.org/r/166150 (owner: Mforns) [17:06:57] is bugzilla out for everyone? [17:07:11] saying: "Can't connect to the database. [17:07:11] Error: Unknown MySQL server host 'db1001.eqiad.wmnet' (111)" [17:08:14] ah no, working now [17:08:17] nevermind [17:10:45] Analytics / Wikimetrics: Integrate wikimetrics with mediawiki-utilities - https://bugzilla.wikimedia.org/63203#c2 (nuria) Given that mediawiki utilities uses plain SQL and we are set to use alembic I do not see how this 'integration' could happen. Are we sure we want to keep this bug open? [17:16:00] Analytics / Wikimetrics: Cannot validate a new cohort - https://bugzilla.wikimedia.org/71099#c3 (nuria) UNCO>RESO/FIX I am resolving this bug as lab issues were solved a day after the bug was filed. [17:21:17] Analytics / Wikimetrics: Feature Request: Cannot edit or delete cohorts - https://bugzilla.wikimedia.org/67664 (nuria) [17:24:00] Analytics / Wikimetrics: Cors on wikimetrics. - https://bugzilla.wikimedia.org/67825#c3 (nuria) NEW>RESO/FIX Apache headers are working w/o manual intervention. [17:33:54] (PS3) Mforns: Render invalid cohort members as html [analytics/wikimetrics] - https://gerrit.wikimedia.org/r/166150 [17:35:19] mforns_ : you patch looked great, did you choose another bug to work on? [17:35:27] not yet [17:35:47] do you have something in mind? [17:35:48] mforns_: i just went through teh list and cleaned up a bit as there were several that were already fixed [17:36:03] yes, and some others were duplicates [17:36:03] mforns_: take a look at this one: https://bugzilla.wikimedia.org/show_bug.cgi?id=64294 [17:36:16] ok, perfect [17:36:42] it does not have to do with the application per se but on how db migrations are handled , alembic is pretty amazing [17:36:59] ok [17:37:17] Analytics / Wikimetrics: Alembic upgrade head should not try to access testing DB when running in production - https://bugzilla.wikimedia.org/64294 (Marcel Ruiz Forns) NEW>ASSI a:Marcel Ruiz Forns [17:38:42] mforms_: it might be that changes are actually done but we should verify that is the case [17:38:51] sorry mforns_ [17:39:04] xD, that's ok [17:45:38] (CR) Milimetric: "just two nitpicks Marcel, everything looks good." (2 comments) [analytics/wikimetrics] - https://gerrit.wikimedia.org/r/166150 (owner: Mforns) [17:51:16] Analytics / General/Unknown: Kafka broker analytics1021 not receiving messages every now and then - https://bugzilla.wikimedia.org/69667#c15 (Toby Negrin) Hi Christian - would you say that the fix did not solve this problem? thanks, -Toby [17:51:50] holaaaa YuviPanda [17:51:55] yo! [17:53:24] nuria_: good... evening? morning? [17:53:50] YuviPanda: I am in the west coast now so morning [17:53:54] oh, showcase not happening today? [17:54:07] DarTar: no, no sprint last week [17:54:15] ah ok [17:54:24] hi all, btw :) [17:54:29] nuria_: aaah, good :) morning! [17:54:29] DarTar: lemme see if i can cancel it [17:54:49] nuria_: looks like somebody did already [17:55:20] YuviPanda: question [17:55:26] if you have 5 mins [17:55:34] nuria_: sure [17:56:06] YuviPanda: what did you use to stream cvs results in quarry, cause i would like to add something similar to wikimetrics cvs reports [17:56:17] nuria_: ah, a small snippet of python code! [17:56:30] which combines a neat little duck typing trick + generators to do it [17:56:30] YuviPanda: no library? [17:56:31] let me find it [17:56:36] k [17:56:37] nuria_: nope, just the unicodecsv library [17:57:18] nuria_: https://github.com/wikimedia/analytics-quarry-web/blob/master/quarry/web/output.py#L15-L33 [17:57:47] nuria_: I 'fake' a writer object, and pass it to unicodecsv.writer, and then use that to stream output... [17:58:22] YuviPanda: ahahaam [17:58:53] reader.get_rows returns a generator, so I never load the full thing into memory. [17:59:42] but ... YuviPanda who is executing the buffering (i.e. calling respond() repeatedily?) [17:59:50] nuria_: flask! [18:00:04] nuria_: http://flask.pocoo.org/docs/0.10/patterns/streaming/ [18:00:08] YuviPanda: ohhhhhh [18:00:26] nuria_: that code snipet too generates CSV, but generating CSV with concatenation sounds like a terrible idea... [18:00:45] boy flask is so handy... [18:01:04] ok, thanks YuviPanda for the pointers, will start working on this today/tomorrow [18:01:10] nuria_: :D yw! [18:10:31] Analytics / General/Unknown: Requests for 'undefined' page increasing on wikipedias - https://bugzilla.wikimedia.org/66352#c26 (Toby Negrin) We've decided that as a team, we've done what we can do on this. I've let Mark B. know and he's in agreement. Christian has written a fix which we will deploy th... [18:22:00] Analytics / Refinery: Make webrequest partition validation handle races between time and sequence numbers - https://bugzilla.wikimedia.org/69615#c10 (Toby Negrin) This looks like something we should resource. Christian, how does this line up with the other things that you are working on in severity? [18:24:21] (PS4) Mforns: Render invalid cohort members as html [analytics/wikimetrics] - https://gerrit.wikimedia.org/r/166150 (https://bugzilla.wikimedia.org/60628) [18:29:42] (CR) Milimetric: [C: 2] Render invalid cohort members as html [analytics/wikimetrics] - https://gerrit.wikimedia.org/r/166150 (https://bugzilla.wikimedia.org/60628) (owner: Mforns) [18:43:36] jgage: Today at standup, you asked today about the esams bits issue for kafka/varnishkafka [18:43:46] Looks like it's happening right now again [18:43:49] http://ganglia.wikimedia.org/latest/graph.php?r=4hr&z=xlarge&hreg[]=%28amssq|cp%29.%2B&mreg[]=kafka.varnishkafka\.kafka_drerr.per_second>ype=line&title=kafka.varnishkafka\.kafka_drerr.per_second&aggregate=1 [18:44:18] So if you want to look at esams machines to check stats ... now would be a good time. [18:57:15] Analytics / Wikimetrics: Integrate wikimetrics with mediawiki-utilities - https://bugzilla.wikimedia.org/63203#c3 (Dan Andreescu) wikimetrics is using sqlalchemy, and that's a bit of a mismatch with mediawiki utilities. I don't think that's too big of a deal, we could integrate the tools if it's a goo... [19:13:11] thanks qchris, taking a look now.. [19:13:17] Awesome! [19:58:51] (PS1) Kaldari: Fixing new active editor query to account for NULL useragents [analytics/limn-mobile-data] - https://gerrit.wikimedia.org/r/166632 [19:59:19] (CR) Kaldari: [C: 2] Fixing new active editor query to account for NULL useragents [analytics/limn-mobile-data] - https://gerrit.wikimedia.org/r/166632 (owner: Kaldari) [19:59:21] (CR) Milimetric: [C: 2] Fixing new active editor query to account for NULL useragents [analytics/limn-mobile-data] - https://gerrit.wikimedia.org/r/166632 (owner: Kaldari) [19:59:25] (Merged) jenkins-bot: Fixing new active editor query to account for NULL useragents [analytics/limn-mobile-data] - https://gerrit.wikimedia.org/r/166632 (owner: Kaldari) [20:10:30] Analytics / Wikimetrics: Alembic upgrade head should not try to access testing DB when running in production - https://bugzilla.wikimedia.org/64294#c1 (Marcel Ruiz Forns) ASSI>PATC This is already working. See stdout when executing 'alembic upgrade HEAD' in these 2 cases: 1) When 'DEBUG = True'... [20:14:17] Analytics / Wikimetrics: Alembic upgrade head should not try to access testing DB when running in production - https://bugzilla.wikimedia.org/64294 (Marcel Ruiz Forns) PATC>RESO/FIX [20:15:08] sweet :) [20:15:22] mforns_: thanks for verifying - we are really bad at keeping a clean backlog [20:15:28] it's all because of that awful lazy scrum master [20:15:30] :] [20:15:33] xD [20:17:23] i have only seen people from spain use xD, which fascinates me. [20:17:33] really? [20:17:35] yeah [20:17:39] xD [20:17:41] hee [20:19:42] and this? ¬¬ [20:19:49] or ¬¬U [20:20:31] i don't even understand what that is! [20:21:24] hm :U for surprise [20:22:18] looking to the side with low eyes, with or without sweat drop [20:22:32] it's kind of a manga emoticon [20:23:00] never seen it outside spain also :] [20:23:12] hah neat [20:34:16] Analytics / Wikimetrics: Alembic upgrade head should not try to access testing DB when running in production - https://bugzilla.wikimedia.org/64294#c2 (nuria) The catch is that alembic should not be reading ./wikimetrics/config/db_config.yaml but rather /etc/wikimetrics/db_config.yaml unless this secon... [20:34:33] Analytics / Wikimetrics: Alembic upgrade head should not try to access testing DB when running in production - https://bugzilla.wikimedia.org/64294 (nuria) RESO/FIX>REOP [20:35:38] oh I see... [20:41:15] Analytics / Wikimetrics: Feature Request: Cannot edit or delete cohorts - https://bugzilla.wikimedia.org/67664#c1 (Dan Andreescu) Hi Rahmanuddin, Adding users to a cohort is not something that we want to support, and that's on purpose. Cohorts should stay as fixed as possible so that ongoing analysis... [20:45:37] mforns_ : sorry, i reopened the bug. it should have explained more clearly that alembic needs to look at config in /etc/wikimetrics [20:45:46] my mistake [20:46:09] I've seen it, no I'm sorry, didn't get it [20:46:23] I'll fix it now [21:10:45] jgage: Now that the errors are gone again for today ... any idea what's going on with the esams caches? [22:27:38] jgage: ^ [22:31:11] it's an interesting mystery. traffic goes up, varnish spawns more workers and uses more ram.. but enough seems to remain available.. yet varnishkafka then starts having errors delivering to kafka. haven't found the root cause yet but it seems like we may be hitting a perf threshold for that 4-node varnish cache, and varnishkafka is suffering as a result. [22:34:36] Yup. [22:34:54] network graphs don't have mesas so i don't think it's contention at the nic. wishing i had java vm/gc, cpu freq, cpu temp [22:35:04] +stats [22:35:23] No java around I guess ;-) [22:35:46] i suppose that makes life easier :) [22:36:02] * jgage has been standing too close to hadoop [22:36:18] :-D [22:42:23] Analytics / General/Unknown: Kafka broker analytics1021 not receiving messages every now and then - https://bugzilla.wikimedia.org/69667#c16 (christian) (In reply to Toby Negrin from comment #15) > would you say that the fix did not solve this problem? If you are refering to the change from comment 13...