[06:11:53] 10Analytics, 06Labs, 10Pageviews-API, 10wikitech.wikimedia.org: wikitech.wikimedia.org missing from pageviews API - https://phabricator.wikimedia.org/T153821#2892095 (10Krinkle) [06:20:21] 10Analytics-Tech-community-metrics, 06Developer-Relations: Who are the top 50 independent contributors and what do they need from the WMF? - https://phabricator.wikimedia.org/T85600#2892127 (10Aklapper) [06:20:23] 10Analytics-Tech-community-metrics, 06Developer-Relations (Oct-Dec-2016): Fix incorrect mailing list activity of AKlapper (=Phabricator) in Technical Community Metrics user data - https://phabricator.wikimedia.org/T132907#2892125 (10Aklapper) 05Resolved>03Open Reopening as it's still an issue in Kibana. h... [06:20:32] 10Analytics-Tech-community-metrics: Fix incorrect mailing list activity of AKlapper (=Phabricator) in Technical Community Metrics user data - https://phabricator.wikimedia.org/T132907#2892128 (10Aklapper) [10:27:49] 10Analytics, 06Labs, 10Pageviews-API, 10wikitech.wikimedia.org: wikitech.wikimedia.org missing from pageviews API - https://phabricator.wikimedia.org/T153821#2892095 (10Krenair) {T102178} [11:14:01] 10Analytics, 10LDAP-Access-Requests, 15User-Elukey: Add Francisco Dans to the wmf LDAP group - https://phabricator.wikimedia.org/T153847#2892980 (10elukey) [11:14:32] 06Analytics-Kanban, 10LDAP-Access-Requests, 15User-Elukey: Add Francisco Dans to the wmf LDAP group - https://phabricator.wikimedia.org/T153847#2892980 (10elukey) [11:29:49] joal: o/ [11:30:05] random question about the leap second of the 31st (http://www.datastax.com/dev/blog/preparing-for-the-leap-second-2017) [11:31:05] would it be wise (if we don't adopt in ops a solution like Google's smear second) to stop the oozie bundles on the 31st? [11:31:23] * joal hides in a timestable dimension [11:31:29] ahhaha [11:31:36] not sure if I am over paranoid or not [11:31:47] probably everything will be fine [11:32:37] elukey: in my mind we will 'just' double the amount of stuff gathered for that second (since it will actually last 2) [11:33:20] oh yes theoretically nothing should be weird [11:33:28] practically I don't know :D [11:33:32] elukey: but, since it is managed at linux system level (I think, right?), oozie and others will just be late / on time depending on your view point [11:34:40] the post you pasted mentions a bugfix in kernel [11:34:46] well the OS will give you the time that is in sync with NTP, so it might happen that "writes" to dbs or cassandra or whatever happening at the leap second moment might get confused [11:36:09] it is not the kernel that worries me, but the apps on top of it :D [11:36:22] hm ... supposedly from the post, the last second of 2016 will last 2 secs [11:37:12] We don't do anything during last-second of hours specifically, son I'm not too much afraid [11:37:26] maybe I'm wrong not to be [11:38:47] sure, let's think about it during the day and see if anything comes up before standup :) [11:39:37] I have no idea why people have chosen the last second of the year to do this [11:40:02] elukey: to be sure that if everything breaks, all olps will be drunk ;-P [12:29:51] * elukey lunch! [13:19:43] awesome (long) read: http://www.nytimes.com/2016/12/14/magazine/the-great-ai-awakening.html [14:01:27] halfak: Hi ! [14:02:07] hey1 [14:02:14] Just connecting now [14:02:27] Ah, sorry, take your time :) [14:04:06] 06Analytics-Kanban, 06Reading-Web-Backlog: mobile-safari has very few internally-referred pageviews - https://phabricator.wikimedia.org/T148780#2893395 (10mforns) @JKatzWMF Mmmm, the only thing I can think of is changing to the typo'd version of "origin-when-crossorigin" (without -). In my short understandin... [14:06:37] hey team :] [14:08:22] mforns o/ [14:08:31] hey fdans :] [14:24:14] halfak: o/ - qq, there is a mongo db on stat1003 IIRC.. from what I remember puppet was indicating that you needed it, so I am wondering if we could nuke it or not [14:25:22] # Aaron Halfaker (halfak) wants MongoDB for his project. [14:25:41] but it is always down for some reason, so I think it is not really used [14:27:53] nuke it! [14:28:11] \o/ [14:29:22] 10Analytics, 06Operations, 10Traffic: A/B Testing solid framework - https://phabricator.wikimedia.org/T135762#2893426 (10Jan_Dittrich) Is that testing framework also planned to work with central notice/banners, or is that a separate infrastructure? [15:03:46] halfak: nuked! [15:04:31] \o/ [15:17:54] lunch! [15:26:58] elukey: need to miss ops sync, will be back for standup (hopefully) [15:45:28] ack! [15:45:31] just created https://wikitech.wikimedia.org/wiki/Analytics/Varnishkafka [15:53:43] 06Analytics-Kanban, 15User-Elukey: Valgrind tutorial for periodical mem usage reviews - https://phabricator.wikimedia.org/T147438#2692888 (10elukey) [15:54:15] 06Analytics-Kanban: Varnishkafka testing framework - https://phabricator.wikimedia.org/T147432#2893658 (10elukey) Created the page https://wikitech.wikimedia.org/wiki/Analytics/Varnishkafka to reference this ticket and useful data about Varnishkafka. [15:55:35] \o/ --^ [15:56:27] hey all [15:56:58] Hi milimetric [15:57:00] unexpected dr. appointment this morning, sorry was out [15:57:11] np milimetric, everything all right? [15:57:24] i see the new druid thing, just verifying, it's called "mediawiki-history-beta" yes? [15:57:29] yes, everything's fine, sorry [15:57:30] :) [15:57:41] great milimetric :) [15:57:59] correct milimetric, we can update pivot (alreday played with superset a bit [16:03:08] (03CR) 10Mforns: "Awesome change :] Kudos" (033 comments) [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/327237 (https://phabricator.wikimedia.org/T120131) (owner: 10Fdans) [16:08:30] good article, worth reading: http://www.nytimes.com/2016/12/14/magazine/the-great-ai-awakening.html [16:08:50] milimetric: we share some sources ;) [16:12:34] joal: patch updated, take a look [16:12:40] sure milimetric [16:13:20] (03PS4) 10Nuria: Standardized UDF naming [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/327237 (https://phabricator.wikimedia.org/T120131) (owner: 10Fdans) [16:16:44] elukey: you can merge milimetric patch :) [16:17:06] * elukey proceeds [16:17:11] Thanks elukey [16:17:19] I think a restart is needed after that, right? [16:17:26] should be handled by puppet [16:17:29] awesome [16:17:55] \o/ [16:24:04] 06Analytics-Kanban, 06Operations, 06Reading-Web-Backlog, 10Traffic: mobile-safari has very few internally-referred pageviews - https://phabricator.wikimedia.org/T148780#2893736 (10mforns) [16:31:48] elukey: updates posted [16:33:20] milimetric: ahahahha I was asking about a line not a poem, but super good! :) [16:33:37] thanks for the long description [16:38:26] #007Could not load config from '/etc/pivot/config.yaml': incomplete explicit mapping pair; a key node is missed at line 74, column 175: [16:38:56] hm [16:39:15] that is description: Mediawiki history [16:39:30] ah yeah, it might need to be in quotes [16:39:37] you wanna try it and I'll make a patch? [16:40:02] ok I just fixed it with "todo" [16:40:34] elukey: do you want to see if quotes work around it? [16:40:37] or that's what you did? [16:41:29] milimetric: added the quotes but it looks horrible :D [16:43:23] ew, you're right :) I'll work on it and we can send an update, will you be here tomorrow elukey ? [16:43:58] yep [16:44:05] but it is really weird [16:44:17] so at col 175 there was a ':' [16:44:21] I removed it [16:44:25] but still got truncated [16:44:32] (also removed the quotes) [16:45:20] there must be some char that makes pivot upset [16:47:51] I am going to add one slice at the time until it breaks [16:48:15] it might be the http link [16:50:08] joal, fdans, milimetric, sorry my connection is flapping [16:50:32] (if that is a word) [16:51:09] milimetric: yeah it is the link [16:51:22] also it doesn't show more than two very short lines.. [16:52:53] (03CR) 10Fdans: Standardized UDF naming (031 comment) [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/327237 (https://phabricator.wikimedia.org/T120131) (owner: 10Fdans) [16:55:01] ok merging your path [16:55:03] *patch [16:58:32] milimetric: done! [16:58:55] elukey: currently reading on pivot config for cubes - will provide a new patch in minutes [17:04:52] 10Analytics-Tech-community-metrics, 06Developer-Relations (Oct-Dec-2016): "Backlog" widget on "Gerrit-Backlog" seems to miss some older open changesets - https://phabricator.wikimedia.org/T146893#2893820 (10Aklapper) [17:05:28] 10Analytics-Tech-community-metrics, 06Developer-Relations (Oct-Dec-2016): "Backlog" widget on "Gerrit-Backlog" seems to miss some older open changesets - https://phabricator.wikimedia.org/T146893#2673934 (10Aklapper) 05Open>03Resolved Confirming that https://wikimedia.biterg.io/app/kibana#/dashboard/Gerrit... [17:19:51] joal: your config triggered something super weird :D [17:20:05] Arf :( [17:20:23] what happens elukey :) [17:20:44] Dec 21 17:20:15 thorium pivot[133603]: Error: can not find defaultSortMeasure 'events' in data cube 'mediawiki-history-beta' [17:21:50] elukey: :( [17:21:56] elukey: I don't undestand [17:23:39] joal: is there a sort measure called events? [17:23:43] (03CR) 10Mforns: Standardized UDF naming (031 comment) [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/327237 (https://phabricator.wikimedia.org/T120131) (owner: 10Fdans) [17:23:45] I commented it and it works now [17:23:56] elukey: there is a metric called events [17:26:09] maybe the sort part is something that it doesn't like [17:26:43] joal: is it needed on can we comment it? [17:27:03] elukey: Let's comment it - it doesn't make sense though [17:27:15] maybe we are hitting a bug [17:27:27] elukey: completely possible [17:28:01] another weird thing: we select events as the default measure, but pivot shows us 2 [17:28:30] I can see only events for mw beta [17:28:31] no? [17:28:39] (I mean, in the main page after I click) [17:28:55] hm elukey - batcave? [17:29:14] sure [17:29:16] https://hangouts.google.com/hangouts/_/wikimedia.org/a-batcave-2 [17:29:19] elukey: --^ [17:29:30] milimetric, fdans, is the meeting in the cave or in the room specified in the calendar event? you know? [17:34:30] ashgrigas, hi! I invited you to the batcave [17:34:51] mforns sorry [17:34:57] thought we were using Nuria's link [17:34:59] one second [17:58:25] going afk people! byeee [17:58:34] bye elukey ! [18:10:21] sorry ashgrigas, milimetric and fdans_, my connection is dropping again [18:18:59] leaving for today a-team, see y'all tomorrow [18:46:02] yurik: I love that weather bar chart [18:46:10] thanks :) [18:46:17] yurik: I still am going to try and come down for the wiki thing, is it over? [18:46:29] it doesn't start until 5 i think [18:46:32] or even later [18:46:42] i plan to go to cafe to work a bit first, and then go there [18:46:46] want to come by? [18:46:59] oh 7-9, I've gotta clean a lot but then I'll try and swing by [18:47:08] I've family coming later, may have to miss this one [18:47:41] bummer :( [19:11:06] fdans: still around? need help? [19:11:38] milimetric still in the meeting, but for now I can carry on until tomorrow I think [19:13:03] fdans: ok, i'm not around tomorrow, but I'll try to answer email if you need help [19:13:22] also of course marcel or others are just as good at navigating that code [19:14:32] milimetric sure, the only thing i'm a bit dubious about right now is getting country data, but I can figure that out [19:27:30] fdans: on the path we were going, you can hack getCategorizedMetrics, and insert the config that would match the "Test World Map" metric, that way dashiki would pull that fake data we uploaded the other day [19:27:43] but you can totally just fake the data too, and we can hook it up later [19:27:54] awesome [19:29:42] btw, that Test World Map metric should get pulled in by the default debugging version of metrics-by-project, from this config: https://meta.wikimedia.org/w/index.php?title=Dashiki:DefaultDashboard [21:54:13] 10Analytics, 10Phabricator: Get rid of Pageview-API -> Analytics auto-tagging - https://phabricator.wikimedia.org/T146042#2894767 (10Aklapper) a:05ggellerman>03None [23:47:28] 10Analytics-Dashiki, 06Analytics-Kanban: Add Map component to dashiki layout - https://phabricator.wikimedia.org/T153921#2895069 (10Nuria) [23:48:26] 06Analytics-Kanban: Wikistats 2.0. Edit Reports: Setting up a pipeline to source Historical Edit Data - https://phabricator.wikimedia.org/T130256#2895088 (10Nuria) [23:48:50] 06Analytics-Kanban: Wikistats 2.0. Edit Reports: Setting up a pipeline to source Historical Edit Data - https://phabricator.wikimedia.org/T130256#2131074 (10Nuria) [23:49:52] 06Analytics-Kanban: Replacing standard edit metrics in dashiki with data from new edit data depot - https://phabricator.wikimedia.org/T143924#2895113 (10Nuria) [23:49:54] 06Analytics-Kanban: Create 1-off tsv files that dashiki would source with standard metrics from datalake - https://phabricator.wikimedia.org/T152034#2895112 (10Nuria) 05Open>03Resolved [23:52:43] 10Analytics, 06Research-and-Data: Coordinate with research to vet metrics calculated from edit data lake - https://phabricator.wikimedia.org/T153923#2895122 (10Nuria) [23:53:44] 06Analytics-Kanban: Replacing standard edit metrics in dashiki with data from new edit data depot - https://phabricator.wikimedia.org/T143924#2583423 (10Nuria) [23:53:47] 10Analytics, 06Research-and-Data: Coordinate with research to vet metrics calculated from edit data lake - https://phabricator.wikimedia.org/T153923#2895122 (10Nuria) [23:55:24] 10Analytics, 06Research-and-Data: Coordinate with research to vet metrics calculated from edit data lake - https://phabricator.wikimedia.org/T153923#2895139 (10Nuria) [23:55:26] 06Analytics-Kanban: Productionize Edit History Reconstruction and Extraction - https://phabricator.wikimedia.org/T152035#2895138 (10Nuria) [23:57:36] 06Analytics-Kanban: Productionize Edit History Reconstruction and Extraction - https://phabricator.wikimedia.org/T152035#2895143 (10Nuria) [23:57:38] 06Analytics-Kanban: Replacing standard edit metrics in dashiki with data from new edit data depot - https://phabricator.wikimedia.org/T143924#2895142 (10Nuria) [23:58:26] 10Analytics: Load storage (druid? clickhouse?) with calculated edit metrics data and serve under an external endpoint - https://phabricator.wikimedia.org/T146490#2895147 (10Nuria) [23:58:28] 06Analytics-Kanban: Replacing standard edit metrics in dashiki with data from new edit data depot - https://phabricator.wikimedia.org/T143924#2583423 (10Nuria)