[00:53:58] 10Analytics-Data-Quality, 10WMDE-Analytics-Engineering, 10User-GoranSMilovanovic: Please review: new WMDE public data set on stat1005 - https://phabricator.wikimedia.org/T187606#4000234 (10GoranSMilovanovic) #analytics-data-quality Please please could anyone do this 5 minutes review for us so that we can syn... [01:08:18] 10Analytics, 10TCB-Team, 10Two-Column-Edit-Conflict-Merge, 10WMDE-Analytics-Engineering, and 5 others: How often are new editors involved in edit conflicts - https://phabricator.wikimedia.org/T182008#4000243 (10GoranSMilovanovic) @Lea_WMDE The [[ https://docs.google.com/document/d/18KcSTdAmjqm5WiIoZSpFU4dT... [01:52:14] 10Analytics, 10Analytics-Data-Quality, 10WMDE-Analytics-Engineering, 10User-GoranSMilovanovic: Please review: new WMDE public data set on stat1005 - https://phabricator.wikimedia.org/T187606#4000287 (10GoranSMilovanovic) [02:33:25] 10Analytics-Data-Quality, 10Analytics-Kanban, 10WMDE-Analytics-Engineering, 10User-GoranSMilovanovic: Please review: new WMDE public data set on stat1005 - https://phabricator.wikimedia.org/T187606#4000304 (10Nuria) a:03Nuria [07:23:46] 10Analytics, 10Contributors-Analysis: Use native timestamp types in Data Lake edit data (needs Hive 1.2) - https://phabricator.wikimedia.org/T161150#4000408 (10Neil_P._Quinn_WMF) The latest CDH version is [5.14](https://www.cloudera.com/documentation/enterprise/release-notes/topics/cdh_vd_cdh_package_tarball_5... [08:29:11] Hi team [08:31:18] o/ [08:33:27] elukey: new kafka topic moves today? [08:39:53] joal: ? [09:00:34] 10Analytics, 10TCB-Team, 10Two-Column-Edit-Conflict-Merge, 10WMDE-Analytics-Engineering, and 5 others: How often are new editors involved in edit conflicts - https://phabricator.wikimedia.org/T182008#4000480 (10Lea_WMDE) @GoranSMilovanovic cool, thanks! Could you also add a "0 edits" column to the A table? [09:02:35] * elukey lost Joseph [09:02:52] elukey: was reading emials :) [09:03:17] elukey: I was wondering about eventlogging kafka topics to be moved to jumbo for instance? [09:03:29] ah! [09:03:44] We'll keep going when Andrew is back [09:03:51] atm only cache misc has been ported [09:03:59] err webrequest misc [09:04:17] I believe that the next one will be webrequest upload [09:04:48] because it is a high traffic one, but from the (kafka) consumer pov not that used [09:05:05] for webrequest_text and EL it might be a little bit trickier [09:05:19] also it will be good to observe TLS varnishkafka latencies with upload [09:05:31] elukey: sounds greqt [09:05:31] I don't expect anything weird happening but better be super careful :) [09:06:14] elukey: from a camus/hadoop perspective, I assume that when you switch, you also start camus jobs from jumbo ? [09:07:59] joal: yep exactly what Andrew did! [09:08:27] for webrequest_misc we had only to create the topic + acls + partitions etc.. and update vk [09:08:30] that's it [09:08:40] it will be the same for upload but for text it is tricky [09:09:51] elukey: I'm trying to think of why it's different for text [09:11:00] joal: consumers mostly, like fundraising, ops 503s from oxygen, etc.. nothing major but it requires a bit of coordination [09:19:39] elukey: of course makes sense [09:28:45] (03CR) 10Mforns: [C: 031] "LGTM overall! Left a couple minor to very minor comments." (037 comments) [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/413633 (https://phabricator.wikimedia.org/T186602) (owner: 10Ottomata) [09:37:24] (03CR) 10Joal: "One super minimal nit - Good to merge after." (031 comment) [analytics/refinery] - 10https://gerrit.wikimedia.org/r/408848 (https://phabricator.wikimedia.org/T184759) (owner: 10Milimetric) [09:37:49] joal: we have two new hosts! kafkamon1001/2001, forgot to tell you :) [09:37:56] they'll run for the moment only burrow [09:40:05] elukey: cool, what are the plan for them? [09:41:06] those are ganeti vms, for the moment only monitoring [09:41:30] but I now on krypton (that runs misc websites) we don't have anything left [09:41:33] that is great [09:43:42] (03CR) 10Joal: "Super nice. One thing though: Given we add more and more jobs using refine, would now be the good time to use a properties file to pass pa" [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/413633 (https://phabricator.wikimedia.org/T186602) (owner: 10Ottomata) [09:44:07] ok sounds great :) [09:46:07] so now https://grafana.wikimedia.org/dashboard/db/kafka-consumer-lag shows main-eqiad/codfw/analytics [09:46:34] mmm probably it is worth to add jumbo as well [09:46:59] 10Analytics, 10TCB-Team, 10Two-Column-Edit-Conflict-Merge, 10WMDE-Analytics-Engineering, and 5 others: How often are new editors involved in edit conflicts - https://phabricator.wikimedia.org/T182008#4000607 (10GoranSMilovanovic) @Lea_WMDE I guess you mean "add a row for 0 edits". [[ https://docs.google.co... [09:52:44] (03CR) 10Joal: "Another idea after having read the patch for cu_changes productionization." (031 comment) [analytics/refinery] - 10https://gerrit.wikimedia.org/r/408848 (https://phabricator.wikimedia.org/T184759) (owner: 10Milimetric) [10:03:26] (03CR) 10Joal: "Some ideas inline." (034 comments) [analytics/refinery] - 10https://gerrit.wikimedia.org/r/413265 (owner: 10Milimetric) [11:31:03] * elukey lunch + errand! (brb in ~2h) [11:55:20] 10Analytics-Tech-community-metrics, 10Bugzilla-Migration, 10Phabricator, 10DevRel-November-2015: Closed tickets in Bugzilla migrated without closing event? - https://phabricator.wikimedia.org/T107254#4000910 (10Aklapper) For the records, the [[ https://phabricator.wikimedia.org/phame/post/view/85/phabricat... [12:32:01] 10Analytics-Kanban, 10Research, 10User-Elukey: Phase out and replace analytics-store (multisource) - https://phabricator.wikimedia.org/T172410#4001008 (10Addshore) >>! In T172410#3508852, @jcrespo wrote: > **I do not want to phase out anything**. We can keep using eventlogging and have a mediawiki database c... [12:32:19] 10Analytics-Kanban, 10Research, 10WMDE-Analytics-Engineering, 10User-Addshore, 10User-Elukey: Phase out and replace analytics-store (multisource) - https://phabricator.wikimedia.org/T172410#4001009 (10Addshore) [13:18:32] (03PS1) 10Addshore: Update location of all.dblist in scripts [analytics/wmde/scripts] - 10https://gerrit.wikimedia.org/r/414655 [13:18:48] (03PS1) 10Addshore: Update location of all.dblist in scripts [analytics/wmde/scripts] - 10https://gerrit.wikimedia.org/r/414656 [13:18:53] (03CR) 10Addshore: [C: 032] Update location of all.dblist in scripts [analytics/wmde/scripts] - 10https://gerrit.wikimedia.org/r/414655 (owner: 10Addshore) [13:18:56] (03CR) 10Addshore: [C: 032] Update location of all.dblist in scripts [analytics/wmde/scripts] - 10https://gerrit.wikimedia.org/r/414656 (owner: 10Addshore) [13:19:01] (03Merged) 10jenkins-bot: Update location of all.dblist in scripts [analytics/wmde/scripts] - 10https://gerrit.wikimedia.org/r/414655 (owner: 10Addshore) [13:19:05] (03Merged) 10jenkins-bot: Update location of all.dblist in scripts [analytics/wmde/scripts] - 10https://gerrit.wikimedia.org/r/414656 (owner: 10Addshore) [13:24:52] (03PS1) 10Addshore: Create WikimediaDbList class and getter [analytics/wmde/scripts] - 10https://gerrit.wikimedia.org/r/414658 [13:26:24] (03PS1) 10Addshore: Create WikimediaDbList class and getter [analytics/wmde/scripts] - 10https://gerrit.wikimedia.org/r/414659 [13:26:27] (03CR) 10Addshore: [C: 032] Create WikimediaDbList class and getter [analytics/wmde/scripts] - 10https://gerrit.wikimedia.org/r/414659 (owner: 10Addshore) [13:26:31] (03CR) 10Addshore: [C: 032] Create WikimediaDbList class and getter [analytics/wmde/scripts] - 10https://gerrit.wikimedia.org/r/414658 (owner: 10Addshore) [13:26:36] (03Merged) 10jenkins-bot: Create WikimediaDbList class and getter [analytics/wmde/scripts] - 10https://gerrit.wikimedia.org/r/414659 (owner: 10Addshore) [13:26:43] (03Merged) 10jenkins-bot: Create WikimediaDbList class and getter [analytics/wmde/scripts] - 10https://gerrit.wikimedia.org/r/414658 (owner: 10Addshore) [13:28:51] (03PS1) 10Addshore: Actually check dblist text element [analytics/wmde/scripts] - 10https://gerrit.wikimedia.org/r/414660 [13:29:09] (03PS1) 10Addshore: Actually check dblist text element [analytics/wmde/scripts] - 10https://gerrit.wikimedia.org/r/414661 [13:29:12] (03CR) 10Addshore: [C: 032] Actually check dblist text element [analytics/wmde/scripts] - 10https://gerrit.wikimedia.org/r/414661 (owner: 10Addshore) [13:29:14] (03CR) 10Addshore: [C: 032] Actually check dblist text element [analytics/wmde/scripts] - 10https://gerrit.wikimedia.org/r/414660 (owner: 10Addshore) [13:29:20] (03Merged) 10jenkins-bot: Actually check dblist text element [analytics/wmde/scripts] - 10https://gerrit.wikimedia.org/r/414661 (owner: 10Addshore) [13:29:22] (03Merged) 10jenkins-bot: Actually check dblist text element [analytics/wmde/scripts] - 10https://gerrit.wikimedia.org/r/414660 (owner: 10Addshore) [13:29:24] spam over [13:29:25] [= [13:31:50] addshore: thanks for the feedback for dbstore1002 [13:32:45] elukey: no problem :) If you need a list of the tables that I use gimmie a poke [13:33:07] they include things like user_properties to track beta feature usage [13:34:00] (03PS1) 10Addshore: Add visualeditor-visualdiffpage to BF tracking [analytics/wmde/scripts] - 10https://gerrit.wikimedia.org/r/414662 [13:34:16] (03CR) 10Addshore: [C: 032] Add visualeditor-visualdiffpage to BF tracking [analytics/wmde/scripts] - 10https://gerrit.wikimedia.org/r/414662 (owner: 10Addshore) [13:34:21] (03PS1) 10Addshore: Add visualeditor-visualdiffpage to BF tracking [analytics/wmde/scripts] - 10https://gerrit.wikimedia.org/r/414663 [13:34:25] (03CR) 10Addshore: [C: 032] Add visualeditor-visualdiffpage to BF tracking [analytics/wmde/scripts] - 10https://gerrit.wikimedia.org/r/414663 (owner: 10Addshore) [13:34:27] (03Merged) 10jenkins-bot: Add visualeditor-visualdiffpage to BF tracking [analytics/wmde/scripts] - 10https://gerrit.wikimedia.org/r/414662 (owner: 10Addshore) [13:34:33] (03Merged) 10jenkins-bot: Add visualeditor-visualdiffpage to BF tracking [analytics/wmde/scripts] - 10https://gerrit.wikimedia.org/r/414663 (owner: 10Addshore) [13:34:57] last spam, I promise ;) [13:45:30] HaeB: Hi! I'd like to get your opinion about T172410, long time has passed :) [13:45:31] T172410: Phase out and replace analytics-store (multisource) - https://phabricator.wikimedia.org/T172410 [13:45:41] (whenever you have time) [13:48:57] 10Analytics-Kanban, 10ChangeProp, 10EventBus, 10Patch-For-Review, and 2 others: Export burrow metrics to prometheus - https://phabricator.wikimedia.org/T180442#4001170 (10elukey) We have now main-eqiad/codfw and analytics monitored, but jumbo is not supported yet since as far as I can see Burrow 0.1 doesn'... [13:49:09] of course Jumbo is currently not supported by Burrow 0.1 [13:49:22] since the __consumer topics happened afterwards :D [14:23:13] 10Analytics, 10Research, 10WMDE-Analytics-Engineering, 10User-Addshore: dbstore1002 (analytics store) enwiki lag due to blocking query - https://phabricator.wikimedia.org/T175790#4001267 (10jcrespo) p:05Triage>03Unbreak! This query is right now blocking enwiki replication: ``` Id: 31132883... [14:24:33] 10Analytics-Kanban, 10Research, 10WMDE-Analytics-Engineering, 10User-Addshore, 10User-Elukey: Phase out and replace analytics-store (multisource) - https://phabricator.wikimedia.org/T172410#4001276 (10Tbayer) (To clarify: Since the August 2017 discussion above, the `log` database with the EventLogging ta... [14:24:43] elukey: thanks, replied there [14:25:18] 10Analytics, 10Research, 10WMDE-Analytics-Engineering, 10User-Addshore: dbstore1002 (analytics store) enwiki lag due to blocking query - https://phabricator.wikimedia.org/T175790#4001279 (10Addshore) This is the same script as in previous comments (just running at a different time) due to a failed run via... [14:26:13] 10Analytics, 10Research, 10WMDE-Analytics-Engineering, 10User-Addshore: dbstore1002 (analytics store) enwiki lag due to blocking query - https://phabricator.wikimedia.org/T175790#4001282 (10jcrespo) Over 1700 seconds and going. ``` Seconds_Behind_Master: 1746 ``` This is because the origin table is not Inn... [14:27:09] 10Analytics, 10Research, 10WMDE-Analytics-Engineering, 10User-Addshore: dbstore1002 (analytics store) enwiki lag due to blocking query - https://phabricator.wikimedia.org/T175790#4001301 (10Addshore) > one select to memory and one insert from memory, so replication is unaffected. Can do [14:27:55] 10Analytics-Kanban, 10Research, 10WMDE-Analytics-Engineering, 10User-Addshore, 10User-Elukey: Phase out and replace analytics-store (multisource) - https://phabricator.wikimedia.org/T172410#4001305 (10elukey) >>! In T172410#4001276, @Tbayer wrote: > (To clarify: Since the August 2017 discussion above, th... [14:28:11] HaeB: super, thanks a lot! Anybody else that you'd think we could ping for this task? [14:29:19] 10Analytics, 10Research, 10WMDE-Analytics-Engineering, 10User-Addshore: dbstore1002 (analytics store) enwiki lag due to blocking query - https://phabricator.wikimedia.org/T175790#4001318 (10jcrespo) You say here T172410#4001008 change to innodb/multi-instance will not affect you, but I am not 100% sure thi... [14:31:07] 10Analytics, 10Research, 10WMDE-Analytics-Engineering, 10User-Addshore: dbstore1002 (analytics store) enwiki lag due to blocking query - https://phabricator.wikimedia.org/T175790#4001333 (10Addshore) >>! In T175790#4001318, @jcrespo wrote: > You say here T172410#4001008 change to innodb/multi-instance will... [14:31:37] elukey: the other data analytics from Audiences might want to take a quick look too - bearloga, chelsyx and neilpquinn [14:34:25] I'll add them to the task :) [14:37:31] 10Analytics-Kanban, 10Research, 10WMDE-Analytics-Engineering, 10User-Addshore, 10User-Elukey: Phase out and replace analytics-store (multisource) - https://phabricator.wikimedia.org/T172410#4001345 (10elukey) @mpopov @chelsyx @Neil_P._Quinn_WMF - Hi! Any thoughts about the refresh of dbstore1002? [14:59:29] 10Analytics, 10Research, 10WMDE-Analytics-Engineering, 10User-Addshore: dbstore1002 (analytics store) enwiki lag due to blocking query - https://phabricator.wikimedia.org/T175790#4001426 (10jcrespo) 05stalled>03Open p:05Unbreak!>03Normal a:03Addshore It recovered: [15:06] PROBLEM - Ma... [15:01:53] mforns,milimetric o/ [15:02:00] hey elukey [15:02:05] hello :) [15:02:21] how was your weekend [15:02:46] it was great, all the time spent building Ikea furniture [15:02:55] and I managed not to destroy most of them [15:02:58] :D [15:03:18] how about you? All good? [15:05:16] hey elukey and milimetric :] [15:05:22] :) [15:05:43] whenever you have time I'd need to brain bounce with you about the future of eventloggingctl on systemd :) [15:05:53] we were looking at houses pretty seriously this weekend [15:06:00] and teaching baby how to eat by herself [15:06:06] she's really good at carrots! [15:06:30] :D [15:06:52] I love Ikea, like magic in a box, are you furnishing a new place? [15:07:21] hehe, me too [15:07:22] yep! We have been renovating my granma's house [15:10:57] cool :) My favorite Ikea thing is this thing: http://www.ikea.com/us/en/catalog/products/60075295/ [15:11:20] discovered it on our honeymoon in France and we use it for everything, but you gotta have a really sturdy thing to screw it into [15:17:21] mforns: I'm going to revert this if that's okay with you [15:17:21] https://github.com/wikimedia/analytics-wikistats2/blob/master/src/components/TopicExplorer.vue#L103-L105 [15:17:55] hey fdans [15:17:57] Vue.nextTick calls the function too soon for the searchResults to show up [15:18:09] so the topic explorer is broken [15:18:45] fdans, I see [15:19:18] * elukey brb [15:19:40] fdans, the searchResults component has a method called hover or similar, that tells you if the mouse is inside the results or not. [15:20:02] this way you can determine if the blur click was inside the results or outside [15:20:20] and act accordingly, no need to use setTimeout [15:21:00] if the click is outside, then close [15:21:15] if the click is inside, update the choice and only then close [15:22:21] I think it's a bit better this way, but we can discuss with milimetric if you disagree? [15:23:05] I'm not convinced about selecting a search result from the topic selector using the blur event [15:23:15] seems a bit unnecessary [15:24:09] while i see nothing wrong with the previous approach of timeouting the close function, which was simple and it worked [15:24:17] (mforns) [15:24:49] fdans, wait I might be confused [15:24:53] batcave? [15:25:10] yeaaa [15:25:14] mforns: omw [15:25:14] omw [15:36:54] (03PS1) 10Fdans: Fix topic explorer not switching view to metrics [analytics/wikistats2] - 10https://gerrit.wikimedia.org/r/414690 (https://phabricator.wikimedia.org/T188190) [15:36:58] mforns ˆ [15:37:57] (03CR) 10Mforns: [V: 032 C: 032] Fix topic explorer not switching view to metrics [analytics/wikistats2] - 10https://gerrit.wikimedia.org/r/414690 (https://phabricator.wikimedia.org/T188190) (owner: 10Fdans) [15:43:03] (03PS1) 10Fdans: Release 2.1.10 [analytics/wikistats2] - 10https://gerrit.wikimedia.org/r/414691 [15:44:16] (03CR) 10Fdans: [V: 032 C: 032] Release 2.1.10 [analytics/wikistats2] - 10https://gerrit.wikimedia.org/r/414691 (owner: 10Fdans) [15:46:41] (03PS1) 10Fdans: Release 2.1.10 [analytics/wikistats2] (release) - 10https://gerrit.wikimedia.org/r/414693 [15:47:13] (03CR) 10Fdans: [V: 032 C: 032] Release 2.1.10 [analytics/wikistats2] (release) - 10https://gerrit.wikimedia.org/r/414693 (owner: 10Fdans) [15:51:40] joal: let's talk about the sqoop script when you're back? [15:55:07] I'm here milimetric :) [15:55:29] This I'll qctuqlly be there qll qfternoon (except tomorrow) [15:55:47] oh right you're in Paris [15:55:49] Again ... This week, I'll be online all afternoon [15:55:49] doh, sorry [15:55:51] np [15:55:55] early batcave? [15:56:02] OMW ! [16:00:26] ping mforns [16:00:32] standuppp [16:26:29] 10Analytics-Kanban, 10Operations, 10Ops-Access-Requests, 10Patch-For-Review: Add Tilman to analytics-admins - https://phabricator.wikimedia.org/T178802#4001844 (10elukey) @HaeB Hi! Do you still need these perms or can we roll them back? [16:26:39] 10Analytics, 10Analytics-Wikistats: Active Editors metric for all projects - https://phabricator.wikimedia.org/T188265#4001846 (10Nuria) [16:34:28] 10Analytics-Kanban: Some metrics don't work in the topic selector - https://phabricator.wikimedia.org/T188268#4001892 (10fdans) [16:46:51] Fighting with internet [16:46:56] Will be on soon [16:47:45] ping joal [16:53:12] 10Analytics, 10Analytics-Wikistats: The alert message about adblocker is not fully shown on smaller screens - https://phabricator.wikimedia.org/T188208#4002014 (10fdans) [16:53:16] 10Analytics: Make the Wikistats 2 UI responsive - https://phabricator.wikimedia.org/T186812#4002013 (10fdans) [16:53:34] 10Analytics-Kanban: Create canary site for wikistats on labs - https://phabricator.wikimedia.org/T188273#4002016 (10Nuria) [16:53:36] 10Analytics-Kanban, 10Analytics-Wikistats: The alert message about adblocker is not fully shown on smaller screens - https://phabricator.wikimedia.org/T188208#3999726 (10fdans) [16:54:19] 10Analytics, 10Analytics-Kanban: Provide active editor metric for "all-projects"? - https://phabricator.wikimedia.org/T188194#4002027 (10fdans) 05Open>03Invalid [16:57:18] 10Analytics: Jupyter Notebooks TLC 2018-2019 - https://phabricator.wikimedia.org/T188275#4002059 (10Nuria) [16:58:17] 10Analytics: Functionality to share & view SWAP notebooks - https://phabricator.wikimedia.org/T156934#4002078 (10fdans) [16:58:19] 10Analytics: Jupyter Notebooks TLC 2018-2019 - https://phabricator.wikimedia.org/T188275#4002077 (10fdans) [16:59:18] 10Analytics-Kanban: Jupyter Notebooks TLC 2018-2019 - https://phabricator.wikimedia.org/T188275#4002059 (10fdans) [17:01:33] 10Analytics, 10Analytics-EventLogging, 10TimedMediaHandler, 10Wikimedia-Video: Record and report metrics for audio and video playback - https://phabricator.wikimedia.org/T108522#1522707 (10fdans) @brion let us know whenever you want to talk about doing this! [17:06:31] 10Analytics: Replace all hover actions with touch-compatible UI - https://phabricator.wikimedia.org/T188277#4002130 (10fdans) [17:07:44] 10Analytics-Kanban, 10Analytics-Wikistats: Make the Wikistats 2 UI responsive - https://phabricator.wikimedia.org/T186812#4002149 (10fdans) [17:17:49] 10Analytics-Kanban: Measure DNT usage across geographies and wikis - https://phabricator.wikimedia.org/T187376#4002203 (10fdans) [17:19:44] 10Analytics-Kanban: Private geo wiki data in new analytics stack - https://phabricator.wikimedia.org/T176996#4002216 (10fdans) [17:20:54] 10Analytics, 10Analytics-Wikistats: wikistats UI: mobile responsivness for most used pages based on piwik data - https://phabricator.wikimedia.org/T176143#4002220 (10fdans) 05Open>03declined [17:23:26] 10Analytics, 10Analytics-Wikistats: Wikistats Beta: How about historic data - https://phabricator.wikimedia.org/T186124#4002236 (10fdans) [17:23:35] 10Analytics, 10Analytics-Wikistats: Wikistats Beta: How about historic data - https://phabricator.wikimedia.org/T186124#3934379 (10fdans) [17:24:03] 10Analytics, 10Analytics-Wikistats: Wikistats Beta Localization on the UI - https://phabricator.wikimedia.org/T186122#4002238 (10fdans) [17:24:46] 10Analytics, 10Analytics-Wikistats: Remaining reports. - https://phabricator.wikimedia.org/T186121#4002244 (10fdans) [17:25:18] 10Analytics-Kanban: Replace all hover actions with touch-compatible UI - https://phabricator.wikimedia.org/T188277#4002260 (10fdans) [17:29:04] hey milimetric - sqoop in da cave? [17:37:00] mforns: since you have ops duty can you take care of this: https://phabricator.wikimedia.org/T187104 [17:37:08] nura sure [17:37:37] also, elukey I don't think there is any action item with Refine errors... [17:37:50] mforns: ping bearloga when done please [17:37:52] the data is incompatible for refinement for some hours [17:37:56] nuria_, ok [17:40:10] mforns: why is it incompatible? Shouldn't those events comply with a schema? [17:45:44] elukey, yes, https://meta.wikimedia.org/wiki/Schema:SaveTiming [17:46:18] but for some reason, some events come with the field savetiming in a string value... [17:46:35] hmmm, maybe you're right, there have been no changes to that schema since 2015 [17:46:43] 2016 [17:46:51] mmmm [17:47:08] yeah I checked today as well, it was weird [17:47:27] I thought a change in schema at first [17:51:10] 10Analytics, 10InteractionTimeline, 10Anti-Harassment (AHT Sprint 15): Measure how many unique people visit the Timeline - https://phabricator.wikimedia.org/T187374#4002429 (10dbarratt) @TBolliger so is this done? [17:52:31] elukey, there is an email from andrew on Jan 25 on an identical error [17:52:46] ctrl+F for savetiming [17:52:55] it is a bug, it seems [17:53:10] but hadn't happened again since then [17:53:15] 10Analytics, 10InteractionTimeline, 10Anti-Harassment (AHT Sprint 15): Measure how many unique people visit the Timeline - https://phabricator.wikimedia.org/T187374#4002437 (10TBolliger) 05Open>03Resolved 👍 [17:58:49] 10Analytics-Data-Quality, 10Analytics-Kanban, 10WMDE-Analytics-Engineering, 10User-GoranSMilovanovic: Please review: new WMDE public data set on stat1005 - https://phabricator.wikimedia.org/T187606#4002482 (10Nuria) a:05Nuria>03mforns [17:59:04] mforns: also (since you have ops week) can you take care of this requests from WMDE? https://phabricator.wikimedia.org/T187606 [18:00:29] a-team: you have now sudo -u yarn capabilities on all the Hadoop nodes [18:05:02] elukey: I feel drunk with powerrrr [18:06:13] nuria_, will do [18:16:54] elukey, don't worry about the saveTiming task, I can look at it these week, it doesn't seem a super pressing thing [18:25:04] sure sure [18:28:05] 10Analytics, 10InteractionTimeline, 10Anti-Harassment (AHT Sprint 15): Measure how many unique people visit the Timeline - https://phabricator.wikimedia.org/T187374#4002696 (10Nuria) @dbarratt Yes, data is in piwik for the last couple of days [18:30:14] fdans: do you wnat to hear the issue with japanese? [18:30:32] Many thanks elukey :) [18:36:55] * elukey off! [18:39:41] nuria_: yeah, batcave? [18:39:56] fdans: sure, give me two mins [18:41:05] fdans: on baticueva [18:44:14] 10Analytics-Cluster, 10Analytics-Kanban, 10Operations, 10ops-eqiad: rack/setup/install analytics107[0-7] - https://phabricator.wikimedia.org/T188294#4002756 (10RobH) p:05Triage>03Normal [18:44:41] ottomata[m] or elukey: we've got the new hadoop nodes onsite in eqiad [18:44:46] https://phabricator.wikimedia.org/T188294 [18:44:59] can these be stretch or should they be jessie like other worker nodes? [18:45:26] also who should we assign to for followup post os install? =] [19:03:51] 10Analytics-Kanban, 10Research, 10WMDE-Analytics-Engineering, 10User-Addshore, 10User-Elukey: Phase out and replace analytics-store (multisource) - https://phabricator.wikimedia.org/T172410#4002880 (10mpopov) I never do cross-wiki joins, so no objections from me either. [19:06:18] 10Analytics-Cluster, 10Analytics-Kanban, 10Operations, 10ops-eqiad: rack/setup/install analytics107[0-7] - https://phabricator.wikimedia.org/T188294#4002884 (10elukey) > OS Version: Existing hadoop worker nodes use Jessie. Can these new hosts be stretch? We still haven't tested Hadoop packages on stretch... [19:06:19] robh: please assign follow ups to elukey , i am guessing that same OS that rest of nodes is easiest so patches can be applied to all cluster at once doing rolling re-starts [19:06:34] 10Analytics-Cluster, 10Analytics-Kanban, 10Operations, 10ops-eqiad, 10User-Elukey: rack/setup/install analytics107[0-7] - https://phabricator.wikimedia.org/T188294#4002886 (10elukey) [19:06:34] cool, thx! [19:06:41] robh: ah wait [19:06:47] robh: see reply of elukey in ticket [19:06:56] robh: he wanted to test with new OS, my bad [19:07:51] too slow to answer sorry! [19:08:27] 10Analytics-Cluster, 10Analytics-Kanban, 10Operations, 10ops-eqiad, 10User-Elukey: rack/setup/install analytics107[0-7] - https://phabricator.wikimedia.org/T188294#4002892 (10RobH) [19:08:53] yeah, updated use stretch and assign to elukey for service implementation [19:20:36] Yay ! New hadoop nodes \o/ [19:25:24] 10Analytics-Kanban, 10MW-1.31-release-notes (WMF-deploy-2018-02-27 (1.31.0-wmf.23)), 10Patch-For-Review: Record and aggregate page previews - https://phabricator.wikimedia.org/T186728#4002989 (10Jdlrobson) All done our end @Ottomata and @Nuria The funnel is disabled by default. When enabled https://meta.wiki... [20:14:40] 10Analytics-Kanban, 10MW-1.31-release-notes (WMF-deploy-2018-02-27 (1.31.0-wmf.23)), 10Patch-For-Review: Record and aggregate page previews - https://phabricator.wikimedia.org/T186728#4003205 (10Nuria) >The funnel is disabled by default via $wgPopupsVirtualPageViews. When enabled https://meta.wikimedia.org/w... [20:22:16] 10Analytics-Kanban, 10MW-1.31-release-notes (WMF-deploy-2018-02-27 (1.31.0-wmf.23)), 10Patch-For-Review: Record and aggregate page previews - https://phabricator.wikimedia.org/T186728#4003266 (10Jdlrobson) Yup sorry! Desktop. > Once that is done we ill get hits for all wikis in which the feature is enabled... [20:24:20] 10Analytics-Kanban, 10MW-1.31-release-notes (WMF-deploy-2018-02-27 (1.31.0-wmf.23)), 10Patch-For-Review: Record and aggregate page previews - https://phabricator.wikimedia.org/T186728#4003274 (10Nuria) Sounds good , let's test correctness in beta cluster and after we can enable it in prod for one wiki and se... [20:26:09] 10Analytics, 10Analytics-EventLogging, 10Performance-Team: Make webperf eventlogging consumers use eventlogging on Kafka - https://phabricator.wikimedia.org/T110903#4003301 (10Imarlier) [20:26:49] 10Analytics-Kanban: Write agreggation job for eventlogging page preview data - https://phabricator.wikimedia.org/T188310#4003315 (10Nuria) p:05Triage>03Normal [20:30:32] 10Analytics-Kanban, 10Research, 10WMDE-Analytics-Engineering, 10User-Addshore, 10User-Elukey: Phase out and replace analytics-store (multisource) - https://phabricator.wikimedia.org/T172410#3497641 (10bmansurov) Just wanted to share our use case of querying multiple databases. As part of analyzing the us... [20:41:56] 10Analytics-Kanban, 10Analytics-Wikistats, 10Patch-For-Review: Fix issues with localization of number formatting - https://phabricator.wikimedia.org/T187010#4003457 (10Nuria) {F14039474} {F14039477} {F14039503} This is how the site will look with units localized in japanese/russian and italian. [20:43:39] (03PS8) 10Nuria: Fix issues with numer formatting [analytics/wikistats2] - 10https://gerrit.wikimedia.org/r/409714 (https://phabricator.wikimedia.org/T187010) [20:43:45] (03CR) 10jerkins-bot: [V: 04-1] Fix issues with numer formatting [analytics/wikistats2] - 10https://gerrit.wikimedia.org/r/409714 (https://phabricator.wikimedia.org/T187010) (owner: 10Nuria) [20:50:35] 10Analytics-Kanban, 10Research, 10WMDE-Analytics-Engineering, 10User-Addshore, 10User-Elukey: Phase out and replace analytics-store (multisource) - https://phabricator.wikimedia.org/T172410#4003480 (10chelsyx) No objection from me, since I never do cross-wiki joins on Mysql. Plus, sqoop works great so far. [23:11:51] (03PS9) 10Nuria: Fix issues with numer formatting [analytics/wikistats2] - 10https://gerrit.wikimedia.org/r/409714 (https://phabricator.wikimedia.org/T187010) [23:42:54] milimetric, mforns[m] , fdans: do please take a look at patch https://gerrit.wikimedia.org/r/#/c/409714/ i think is ready to merge but it would not hurt to test it in some other browser with a different browser language setting (I have tested chrome with Spanish, Russian , Italian and Japanese and FF with italian) [23:43:58] 10Analytics-Kanban, 10Analytics-Wikistats, 10Patch-For-Review: Question explorer: you cannot select a question - https://phabricator.wikimedia.org/T188190#4004226 (10Nuria) [23:48:06] 10Analytics-Kanban, 10Analytics-Wikistats, 10Patch-For-Review: Question explorer: you cannot select a question - https://phabricator.wikimedia.org/T188190#4004262 (10Nuria) mmm... I think this might not be fixed all the way, try to select "how many times are articles viewed?" [23:59:21] 10Analytics-Kanban, 10Analytics-Wikistats, 10Patch-For-Review: Question explorer: you cannot select a question - https://phabricator.wikimedia.org/T188190#4004348 (10fdans) @Nuria yep, different issue! Tracking at https://phabricator.wikimedia.org/T188268