[06:16:46] PROBLEM - Varnishkafka log producer on cp4019 is CRITICAL: PROCS CRITICAL: 3 processes with args /usr/bin/varnishkafka -S /etc/varnishkafka/webrequest.conf [06:17:46] RECOVERY - Varnishkafka log producer on cp4019 is OK: PROCS OK: 1 process with args /usr/bin/varnishkafka -S /etc/varnishkafka/webrequest.conf [08:34:39] hello team! [08:34:50] I am feeling a bit better but still recovering.. [08:35:14] so I'll be available for pings but not fully working :( [09:07:38] the vk alarm is a bit weird, I can't find any issue on the host. There was a vk reload happening at that time.. The alarm complained about 3 processes running instead of only one on a maps cache host [11:21:24] (03PS1) 10Addshore: Disable temrs_by_language in cron [analytics/wmde/scripts] - 10https://gerrit.wikimedia.org/r/330656 (https://phabricator.wikimedia.org/T154601) [11:21:35] (03PS1) 10Addshore: Disable temrs_by_language in cron [analytics/wmde/scripts] - 10https://gerrit.wikimedia.org/r/330657 (https://phabricator.wikimedia.org/T154601) [11:21:41] (03CR) 10Addshore: [V: 032 C: 032] Disable temrs_by_language in cron [analytics/wmde/scripts] - 10https://gerrit.wikimedia.org/r/330657 (https://phabricator.wikimedia.org/T154601) (owner: 10Addshore) [11:21:45] (03CR) 10Addshore: [V: 032 C: 032] Disable temrs_by_language in cron [analytics/wmde/scripts] - 10https://gerrit.wikimedia.org/r/330656 (https://phabricator.wikimedia.org/T154601) (owner: 10Addshore) [11:21:53] (03Merged) 10jenkins-bot: Disable temrs_by_language in cron [analytics/wmde/scripts] - 10https://gerrit.wikimedia.org/r/330657 (https://phabricator.wikimedia.org/T154601) (owner: 10Addshore) [11:33:26] 10Analytics-Tech-community-metrics, 06Developer-Relations (Jan-Mar-2017): Deployment of Maniphest panel - https://phabricator.wikimedia.org/T138002#2386415 (10sduenas) @Aklapper we are getting HTTP 503 Errors - Service unavailable. I've been testing our tool and we get this error from time to time, not after... [12:54:38] 06Analytics-Kanban, 06Operations, 15User-Elukey: Yarn node manager JVM memory leaks - https://phabricator.wikimedia.org/T153951#2919345 (10elukey) >>! In T153951#2917859, @Nuria wrote: > Also here: https://issues.apache.org/jira/browse/HADOOP-11105 regarding class: org.apache.hadoop.metrics2.impl.MetricsSyst... [13:09:20] milimetric, mforns: I had the same sqoop error -- looks like the sql cnage actually last longer than until jan 3 [14:29:11] 10Analytics-Tech-community-metrics, 06Developer-Relations (Jan-Mar-2017): Deployment of Maniphest panel - https://phabricator.wikimedia.org/T138002#2919475 (10Aklapper) >>! In T138002#2919209, @sduenas wrote: > @Aklapper we are getting HTTP 503 Errors - Service unavailable. > Are we overloading the server? We... [16:14:15] 06Analytics-Kanban, 10EventBus, 10Wikimedia-Stream, 07Documentation: EventStreams documentation - https://phabricator.wikimedia.org/T153117#2870252 (10Nuria) Let's create a quickstart guide for current users of RCstream to migrate. Ideally we would include an example of "old" way versus new way for python... [16:15:46] 10Analytics-Cluster, 06Analytics-Kanban: Update wikitech Kafka documentation - https://phabricator.wikimedia.org/T150277#2919707 (10Ottomata) [16:29:58] 10Analytics, 10EventBus, 10Wikimedia-Stream, 10service-template-node, 06Services (watching): Tests for swagger spec stream routes in EventStreams - https://phabricator.wikimedia.org/T150439#2919732 (10Nuria) Some links regarding service template execution: https://github.com/wikimedia/service-template-n... [16:31:22] 10Analytics, 10EventBus, 10Wikimedia-Stream, 10service-template-node, 06Services (watching): Tests for swagger spec stream routes in EventStreams - https://phabricator.wikimedia.org/T150439#2919738 (10Nuria) our fork: https://gerrit.wikimedia.org/r/#/admin/projects/mediawiki/services/eventstreams [16:44:36] 06Analytics-Kanban, 10EventBus, 10Wikimedia-Stream, 13Patch-For-Review: Set charset=utf-8 in Content-Type response header from sse.js client - https://phabricator.wikimedia.org/T154328#2907516 (10Nuria) a:05Ottomata>03mforns [16:44:54] 06Analytics-Kanban, 10EventBus, 10Wikimedia-Stream, 13Patch-For-Review: Set charset=utf-8 in Content-Type response header from sse.js client - https://phabricator.wikimedia.org/T154328#2907516 (10Nuria) We will be adding a bit more testing to this fix. [17:35:54] ottomata: yt? [17:36:45] ottomata: how can i know what version of cdh we are on? [17:40:02] hadoop version [17:40:05] Hadoop 2.6.0-cdh5.5.2 [17:45:58] 06Analytics-Kanban, 06Operations, 15User-Elukey: Yarn node manager JVM memory leaks - https://phabricator.wikimedia.org/T153951#2920026 (10Nuria) Ok, fix for https://issues.apache.org/jira/browse/YARN-5482 is also in the same method: unregisterSource, that is why memory seems to leak from the MetricsSystemI... [17:46:40] ottomata: ok, i think i figured out why it seem to leak from the place that was fixed [17:48:09] ottomata: because the fix for 2.7 is in the same method, the 1st fix (for 2.6) doesn't actually fix the whole memory issue, just part of it [17:48:27] ottomata: updated ticket and i think things make sense now [17:50:40] wow good catch nuria, thanks for spotting that [17:51:01] joal: holaaa [17:51:21] Heyaaaa :) [17:51:28] nuria: how is ti going? [17:52:03] joal: thi is my week on loneliness seems like as everyone is dropping by day by day but good, i get to have time to do work [17:52:13] :) [17:52:41] I'll be here until the end of the week, but only for a small time in my evening [17:53:10] nuria: you probably haven't seen that, but jaime fix for analytics DB prevents us from sqooping correctly :( [17:53:33] I sent him a n email for some more details / confiramtions and we'll need to discuss that with milimetric [17:54:32] joal: the ulimits by user? [17:54:38] yes [17:55:08] joal: ok, did you open a ticket? [17:55:22] I didn't, sent an email to confirm before doing so [17:55:46] joal: he doesn't read e-mail much i think a phab ticket will be better [17:55:57] nuria: ok, doing ! [17:56:01] nuria: thanks for the tip [17:57:01] joal: should have a somewhat high priority but maybe we can raise it after next week (unless we plan on scooping the coming week) [17:57:32] nuria: our plan with milimetric ws to sqoop early this week to provide full 2016 dataset uptodate before presentation [17:57:43] joal: then priority should be high [17:57:55] nuria: not really a huge deal, a dataset exists, but would be great to have updated data [17:58:12] joal: right, understood [18:01:51] 06Analytics-Kanban, 10DBA: Sqoop doesn't run anymore - Seem related to a DB change (analytics store) - https://phabricator.wikimedia.org/T154685#2920146 (10JAllemandou) [18:02:05] 06Analytics-Kanban, 10DBA: Sqoop doesn't run anymore - Seem related to a DB change (analytics store) - https://phabricator.wikimedia.org/T154685#2920158 (10JAllemandou) p:05Triage>03High [18:02:09] nuria: --^ [18:02:21] joal: yessir [18:03:34] 06Analytics-Kanban, 10DBA: Sqoop doesn't run anymore - Seem related to a DB change (analytics store) - https://phabricator.wikimedia.org/T154685#2920171 (10Nuria) Ping @jcrespo mmmm.. I guess i was totally wrong about letting the user limits on place as it seems like they are preventing us from running regula... [18:05:24] Thanks for the ping to jaime nuria :) [18:05:33] gone again for babycare, will pass by later ;) [18:06:29] 10Analytics, 06Research-and-Data: Hash IPs on webrequest table - https://phabricator.wikimedia.org/T150545#2920184 (10Nuria) @Jsalsman: I will try to answer your question concisely but please do not derail this ticket to a 1 to 1 conversation. An example of why do we need a 60 day retention: for us to be able... [18:33:24] nice nuria! [18:33:51] (bug fix notice) [18:37:42] 10Analytics, 10Analytics-Wikistats, 06Editing-Analysis: Update active editor metrics to use consensus definition - https://phabricator.wikimedia.org/T153702#2920313 (10Milimetric) >>! In T153702#2896230, @ezachte wrote: > @Millimetric I'm not sure but I believe we said any change in the definition will alway... [19:13:28] 06Analytics-Kanban, 10DBA: Sqoop doesn't run anymore - Seem related to a DB change (analytics store) - https://phabricator.wikimedia.org/T154685#2920470 (10jcrespo) I have eliminated the limits (I have actually set them to print, rather than kill), but I may have to put them back again for wikidata-related que... [19:23:00] nuria: yt? [19:25:05] ottomata: yessir [19:25:32] i'm not totally sure what I would write beyond showing examples of how to use eventstreams [19:25:43] https://wikitech.wikimedia.org/wiki/Draft:EventStreams#Client_Examples [19:25:53] this is RCstream doc [19:25:54] https://wikitech.wikimedia.org/wiki/RCStream [19:26:22] * nuria looking [19:30:00] ottomata: Ithink we could make that RCstream wiki point to the new docs but without mentioning event stream, just make it recent-changes specific , i would archive the current documentation under that wiki, i think if you moved it to RCStrem/deprecated and tag with with {archive} it will not get index by google [19:30:37] ottomata: so i do not think we need to write more rather organize docs such it is easy to find the supported way and it is clear that the legacy way is deprecated [19:32:20] ottomata: but feel free to disagree [19:34:44] ah, yeah, i think we will edit the RCStream page a bunch [19:34:49] noting that it is deprecated, etc. [19:34:51] 06Analytics-Kanban: Kill limn1 - https://phabricator.wikimedia.org/T146308#2920599 (10Milimetric) @Nemo_bis: do you have specific examples of dashboards that are used in conversation but not migrated? I'd like to make sure the migration is complete, and that we only delete dashboards that are no longer used. [19:34:53] and point at EventSTreams [19:35:03] not sure if we really need to archive it for a while [19:35:09] until we are ready to turn off RCStream completely [19:37:07] 06Analytics-Kanban, 07Easy, 03Google-Code-In-2016, 13Patch-For-Review: Add monthly request stats per article title to pageview api - https://phabricator.wikimedia.org/T139934#2920628 (10Milimetric) @Phantom42, we've been on break and I wasn't able to merge the other supporting changes to get this deployed.... [19:41:43] ottomata: ok, i think rather than very generic our docs should list "how to migrate your code to use new recent-chnages feed" s we can answer with a link any question that users might have rather than having to elaborate on e-mail [19:43:01] hehe, nuria changed header name [19:43:01] https://wikitech.wikimedia.org/wiki/Draft:EventStreams#Client_Examples_With_RecentChanges_Feed [19:43:12] ottomata: jajaj nice [19:43:33] 06Analytics-Kanban, 10Community-Wikimetrics, 13Patch-For-Review: Story: WikimetricsUser reports pages edited by cohort {kudu} [13 pts] - https://phabricator.wikimedia.org/T75072#2920665 (10Milimetric) I believe this metric is missing from the general UI because it was only ever requested as a part of the "gl... [19:45:39] 10Analytics, 06Operations, 06Reading-Web-Backlog, 10Traffic: mobile-safari has very few internally-referred pageviews - https://phabricator.wikimedia.org/T148780#2920678 (10BBlack) It's not really my feature, I just happened to write the very short config patch to turn it on, because nobody else had at the... [20:19:44] 10Analytics, 06Operations, 06Reading-Web-Backlog, 10Traffic: mobile-safari has very few internally-referred pageviews - https://phabricator.wikimedia.org/T148780#2920833 (10Nuria) @JKatzWMF Looks like we already discussed on whether to support the missspelled version (ahem... one of them) and consensus wa... [20:20:06] 10Analytics, 06Operations, 06Reading-Web-Backlog, 10Traffic: mobile-safari has very few internally-referred pageviews - https://phabricator.wikimedia.org/T148780#2920834 (10Nuria) 05Open>03Resolved [20:25:39] 10Analytics, 06Operations, 06Reading-Web-Backlog, 10Traffic: mobile-safari has very few internally-referred pageviews - https://phabricator.wikimedia.org/T148780#2920852 (10Nuria) Documented issue in https://wikitech.wikimedia.org/wiki/Analytics/Data/Pageview_hourly#Changes_and_known_problems_since_2015-06-16 [20:40:13] 10Analytics-Cluster, 06Analytics-Kanban: Update wikitech Kafka documentation - https://phabricator.wikimedia.org/T150277#2780405 (10Ottomata) Updated https://wikitech.wikimedia.org/wiki/Kafka and moved it out of Analytics/Cluster sub page. [20:55:00] ottomata: yt? [20:59:38] guessnot [21:00:34] ja nuriahere [21:00:35] sorry [21:01:42] nuria: sorry, ja whats up? [21:01:56] ottomata: i am looking at tests on evenstreams depot [21:02:32] ottomata: the part that it doesn't work is this one, right? https://github.com/wikimedia/service-template-node/blob/master/test/features/app/spec.js#L269 [21:02:55] ottomata: that hangs indefinately [21:02:59] ottomata: right? [21:03:12] correct [21:03:17] return preq(testCase.request) [21:03:19] *indefinitely [21:03:20] will not resolve [21:03:31] ottomata: k, got it [21:04:49] 10Analytics, 06Operations, 06Reading-Web-Backlog, 10Traffic: mobile-safari has very few internally-referred pageviews - https://phabricator.wikimedia.org/T148780#2920920 (10JKatzWMF) >>! In T148780#2920833, @Nuria wrote: > > Either way there is no perfect solution but we rather not revisit a decision alre... [21:06:10] ottomata: ok, added a missing ";" so jshint runs clean: https://gerrit.wikimedia.org/r/#/c/330726/ [21:06:29] ottomata: will look at understanding better the testing scenario [21:14:20] coool [21:14:22] thanks nuria! [21:15:56] 10Analytics, 06Operations, 06Reading-Web-Backlog, 10Traffic: mobile-safari has very few internally-referred pageviews - https://phabricator.wikimedia.org/T148780#2920974 (10Nuria) @JKatzWMF: sounds good, as I said on our end there are no changes needed to process the header either way. I just closed ticket... [21:19:42] hi, is reportcard.wmflabs.org still maintained? [21:20:10] dennyvrandecic: no, it is not. we are planning on migrating it this coming quarter [21:20:44] what's the replacement? [21:22:24] there is a limn1 instance in labs, is that used? it has a short life either way FYI as it's precise and that is dying [21:22:25] https://phabricator.wikimedia.org/T143349 [21:22:40] maybe someone from here could comment on that task in terse form? [21:23:29] nuria: is there a way to figure out the stats from reportcard - or a subset of it - right now? [21:23:48] dennyvrandecic: for pageviews you can take a look here: https://analytics.wikimedia.org/dashboards/vital-signs/#projects=eswiki,itwiki,enwiki,jawiki,dewiki,ruwiki,frwiki/metrics=Pageviews [21:23:58] thanks! [21:25:07] dennyvrandecic: for edits data is on the way, snapshot is here but this is WIP and might be moved/deleted/updated w/o notice, we are hoping to have a full fledge ui to substitute wikistats by next quarter [21:25:26] dennyvrandecic: https://analytics.wikimedia.org/dashboards/standard-metrics/#projects=eswiki,itwiki,enwiki,jawiki,dewiki,ruwiki,frwiki/metrics=(Beta)%20Monthly%20New%20Editors [21:25:47] the replace includes both reportcard.wm.o and stats.wm.o? [21:26:16] chasemp: the limn1 instance is on its way out: https://phabricator.wikimedia.org/T146308 [21:26:41] chasemp: the only remaining thing on it is the reportcard as you can see on that ticket,m everything else has been migrated [21:26:59] nuria: ok cool, I will referene that and let it be for now, no hurry to me just the big deadline [21:27:07] thank you [21:27:11] dennyvrandecic: we might do away with reportcard entirely, it only exists cause wikistats had too much data to parse at a glimpse [21:27:28] sweet, sounds smart [21:27:32] thank you! [21:33:16] ottomata: but the idea with the spec (if it were to work) is that it shoudl run w/o any kafka instance correct/ [21:33:39] it would have been nice to keep the services up until the new ones are there, though :( [21:33:51] dennyvrandecic: waht services? [21:34:04] dennyvrandecic: pageview data is available and so is edit data [21:34:13] dennyvrandecic: are you missing anything else? [21:34:16] like how many active editors are there in the different projects right now [21:34:30] maybe i just can't find that number [21:34:39] dennyvrandecic: https://analytics.wikimedia.org/dashboards/standard-metrics/#projects=eswiki,itwiki,enwiki,jawiki,dewiki,ruwiki,frwiki/metrics=(Beta)%20Monthly%20Surviving%20New%20Editors [21:34:58] no, that's not that - that's the surviving new editors [21:35:24] just plain active editors, as we used to count them - 5 edits or more per month [21:36:35] basically this: https://meta.wikimedia.org/wiki/Research:Rolling_active_editor not https://meta.wikimedia.org/wiki/Research:Surviving_new_editor [21:37:26] dennyvrandecic: there are 3 definitions of that metric to date (i think) , the std metrics are here: https://meta.wikimedia.org/wiki/Research:Standard_metrics#Daily_unique_registered_editors [21:38:03] dennyvrandecic: and I think that metric is calculated daily: https://analytics.wikimedia.org/dashboards/standard-metrics/#projects=eswiki,itwiki,enwiki,jawiki,dewiki,ruwiki,frwiki/metrics=(Beta)%20Daily%20Unique%20Registered%20Editors [21:38:38] dennyvrandecic: but not disputing that there are other ways to count those, as of recent i think research was trying to come to an agreement on the three definitions that exist [21:39:51] not sure I understand - the wiki doesn't reflect any question on the defintion of active editor [21:39:55] https://meta.wikimedia.org/wiki/Research:Active_editor [21:40:26] https://www.mediawiki.org/wiki/Analytics/Metric_definitions#Active_editor [21:41:32] dennyvrandecic: sorry i do not have a better answer but at this time i think there are several definitions of active editor, one of those was used by reportcard [21:44:01] dennyvrandecic: https://phabricator.wikimedia.org/T151507 [21:44:20] thanks! [21:46:29] dennyvrandecic: the traditional active editor metric is available only on wikistats right now, it hasn't been migrated yet [21:47:04] the definition is indeed in flux, but mostly settled. Once it's settled we'll recompute everything and make the new numbers available in the new wikistats (prototypes of that are due by the end of this quarter) [21:47:19] but wikistats onlyhas data until october [21:47:46] but yes, for now, active editor numbers are on wikistats: https://stats.wikimedia.org/EN/TablesWikipediansEditsGt5.htm [21:48:00] dennyvrandecic: yes, updating that has slowed as we're working on the replacement [21:48:14] ok, but it will be eventually updated until the replacement is there? [21:48:34] dennyvrandecic: though, note that usually wikistats is behind by 2 months, so considering the winter break it's not actually "late" [21:48:55] (it's usually behind by 2 months because of the way that pipeline works (hence the reason we are updating it)) [21:49:11] I believe it will still be updated, but that's entirely up to Erik Zachte [21:49:12] ah, I thought it was around usually a month late [21:49:28] ok, thanks [21:49:49] yeah, i know, the pipeline relies on the dumps and takes a while :) i tried to run it myself a few times [21:49:54] no, because it takes a month to compute the data which is then posted the next month, so usually 2-ish, though yeah, for a couple of days it looks like it's only a month behind [21:50:09] right [21:50:36] kk, understood :) i'm just impatient, sorry [21:50:45] looking forward to the new analytics page [22:15:38] ottomata: howdy! can you please point me to the setup script that establishes defaults for beeline (https://wikitech.wikimedia.org/wiki/Analytics/Cluster/Beeline#Defaults)? for some reason it doesn't run for me and so I can't use beeline :\ ("No current connection") [22:26:57] (03CR) 10Mforns: Add mediawiki history spark jobs to refinery-job (0310 comments) [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/325312 (https://phabricator.wikimedia.org/T141548) (owner: 10Joal) [22:54:10] 10Analytics: Adding top counts for wiki projects (ex: WikiProject:Medicine) to pageview API - https://phabricator.wikimedia.org/T141010#2484223 (10kaldari) FYI, on English Wikipedia at least, it is possible to query what pages belong to a WikiProject via the PageAssessments API (or directly from the page_assessm... [22:55:22] 10Analytics, 10Edit-Review-Improvements-ReviewStream, 10EventBus, 06Collaboration-Team-Triage (Collab-Team-Q3-Jan-Mar-2017), and 3 others: Add fields needed by ERI to mediawiki.revision-create - https://phabricator.wikimedia.org/T145164#2921601 (10jmatazzoni) [22:55:33] 10Analytics, 10ChangeProp, 10Edit-Review-Improvements-ReviewStream, 10EventBus, and 4 others: Set up the foundation for the ReviewStream feed - https://phabricator.wikimedia.org/T143743#2921603 (10jmatazzoni) [23:38:32] 10Analytics, 10ChangeProp, 10Citoid, 10ContentTranslation-CXserver, and 11 others: Node 6 upgrade planning - https://phabricator.wikimedia.org/T149331#2921703 (10bearND) Should also add the new trending-edits service.