[00:13:59] (03PS1) 10Zhuyifei1999: Revert recent changes regarding maximum time / size of query results [analytics/quarry/web] - 10https://gerrit.wikimedia.org/r/427036 (https://phabricator.wikimedia.org/T188564) [00:14:40] (03CR) 10Zhuyifei1999: [C: 032] Revert recent changes regarding maximum time / size of query results [analytics/quarry/web] - 10https://gerrit.wikimedia.org/r/427036 (https://phabricator.wikimedia.org/T188564) (owner: 10Zhuyifei1999) [00:14:57] (03Merged) 10jenkins-bot: Revert recent changes regarding maximum time / size of query results [analytics/quarry/web] - 10https://gerrit.wikimedia.org/r/427036 (https://phabricator.wikimedia.org/T188564) (owner: 10Zhuyifei1999) [00:15:34] (03CR) 10Zhuyifei1999: "Why not something like 'untitled' or 'untitled query'?" [analytics/quarry/web] - 10https://gerrit.wikimedia.org/r/427025 (owner: 10Framawiki) [00:18:29] (03CR) 10Zhuyifei1999: [C: 032] Verify user before updating meta query informations [analytics/quarry/web] - 10https://gerrit.wikimedia.org/r/427024 (owner: 10Framawiki) [00:18:47] (03Merged) 10jenkins-bot: Verify user before updating meta query informations [analytics/quarry/web] - 10https://gerrit.wikimedia.org/r/427024 (owner: 10Framawiki) [00:24:15] (03PS3) 10Zhuyifei1999: Add export to HTML [analytics/quarry/web] - 10https://gerrit.wikimedia.org/r/427020 (https://phabricator.wikimedia.org/T117644) (owner: 10Framawiki) [00:25:20] (03CR) 10Zhuyifei1999: "Do you think it would make sense to remove that '?download=true' from wikitable?" [analytics/quarry/web] - 10https://gerrit.wikimedia.org/r/427020 (https://phabricator.wikimedia.org/T117644) (owner: 10Framawiki) [00:26:25] (03CR) 10Zhuyifei1999: Add export to HTML (031 comment) [analytics/quarry/web] - 10https://gerrit.wikimedia.org/r/427020 (https://phabricator.wikimedia.org/T117644) (owner: 10Framawiki) [00:33:01] (03CR) 10Zhuyifei1999: Add export to HTML (032 comments) [analytics/quarry/web] - 10https://gerrit.wikimedia.org/r/427020 (https://phabricator.wikimedia.org/T117644) (owner: 10Framawiki) [00:38:06] ottomata: Hello [00:38:33] ottomata: Do you happen to know if we have R installed on all workers in the cluster? [00:39:28] ottomata: to put it in a nutshell: "java.io.IOException: Cannot run program "Rscript": error=2, No such file or directory" upon running a test Generalized Linear Model from SparkR [02:53:08] (03PS1) 10Nuria: Friendly Titles for Wikistats2 Pages [analytics/wikistats2] - 10https://gerrit.wikimedia.org/r/427042 (https://phabricator.wikimedia.org/T182718) [02:53:09] (03PS2) 10Nuria: Friendly Titles for Wikistats2 Pages [analytics/wikistats2] - 10https://gerrit.wikimedia.org/r/427042 (https://phabricator.wikimedia.org/T182718) [02:54:02] (03PS13) 10Nuria: Identify new search engines as such [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/423336 (https://phabricator.wikimedia.org/T191714) (owner: 10Jonas Kress (WMDE)) [02:58:15] 10Analytics-Kanban, 10Analytics-Wikistats, 10Patch-For-Review: friendly HTML titles for Wikistats 2.0 - https://phabricator.wikimedia.org/T182718#3832561 (10Nuria) [02:58:47] 10Analytics-Kanban, 10Google-Summer-of-Code (2018): [Analytics] Improvements to Wikistats2 front-end - https://phabricator.wikimedia.org/T189210#4135116 (10Nuria) [02:58:54] 10Analytics-Kanban, 10Analytics-Wikistats, 10Easy, 10Patch-For-Review: [Wikistats2] The detail page for tops and maps metrics does not indicate time range - https://phabricator.wikimedia.org/T182990#4135115 (10Nuria) 05Open>03Resolved [03:00:30] 10Analytics-Kanban, 10Google-Summer-of-Code (2018): [Analytics] Improvements to Wikistats2 front-end - https://phabricator.wikimedia.org/T189210#4035243 (10Nuria) [03:00:30] 10Analytics-Kanban, 10Analytics-Wikistats, 10Patch-For-Review: Limit pan in Wikistats2 maps - https://phabricator.wikimedia.org/T189195#4135118 (10Nuria) 05Open>03Resolved [03:00:32] 10Analytics, 10Analytics-Kanban, 10Analytics-Wikistats, 10Patch-For-Review: Wikistats2 GraphPanel computeds and watchers do not update as expected when using table-chart. - https://phabricator.wikimedia.org/T191661#4135120 (10Nuria) 05Open>03Resolved [03:00:34] 10Analytics-Kanban, 10Google-Summer-of-Code (2018): [Analytics] Improvements to Wikistats2 front-end - https://phabricator.wikimedia.org/T189210#4035243 (10Nuria) [03:00:36] 10Analytics-Kanban, 10Analytics-Wikistats: Wikistats Beta - https://phabricator.wikimedia.org/T186120#4135123 (10Nuria) [03:00:38] 10Analytics-Kanban, 10Analytics-Wikistats, 10Patch-For-Review: Wikistat Beta: expand topic explorer by default - https://phabricator.wikimedia.org/T186335#4135121 (10Nuria) 05Open>03Resolved [03:00:53] 10Analytics-Kanban, 10Patch-For-Review: Execute mediawiki history scoping jobs in the 5th of the month - https://phabricator.wikimedia.org/T191645#4135124 (10Nuria) 05Open>03Resolved [03:01:07] 10Analytics, 10Analytics-Kanban, 10Patch-For-Review: [EL sanitization] Modify mysql purging script to read from the new YAML whitelist - https://phabricator.wikimedia.org/T189692#4135126 (10Nuria) 05Open>03Resolved [03:01:28] 10Analytics, 10Analytics-Kanban, 10Patch-For-Review, 10User-Elukey: Add trash folder to hadoop - https://phabricator.wikimedia.org/T189051#4135127 (10Nuria) 05Open>03Resolved [03:02:37] 10Analytics-Kanban, 10Patch-For-Review: Create refinery-spark package - https://phabricator.wikimedia.org/T188025#4135128 (10Nuria) 05Open>03Resolved [03:02:47] 10Analytics-Kanban, 10Patch-For-Review: Refresh SWAP notebook hardware - https://phabricator.wikimedia.org/T183145#4135129 (10Nuria) 05Open>03Resolved [03:46:17] (03CR) 10VolkerE: [C: 04-1] Fix accessibility/markup issues (033 comments) [analytics/wikistats2] - 10https://gerrit.wikimedia.org/r/425925 (https://phabricator.wikimedia.org/T185533) (owner: 10Sturmkrahe) [04:22:01] (03PS14) 10Nuria: Identify new search engines as such [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/423336 (https://phabricator.wikimedia.org/T191714) (owner: 10Jonas Kress (WMDE)) [06:47:50] (03CR) 10VolkerE: "Looks mostly good, a few nitpicks & recommendations." (035 comments) [analytics/wikistats2] - 10https://gerrit.wikimedia.org/r/426848 (https://phabricator.wikimedia.org/T185533) (owner: 10Mrcornacchio) [07:30:02] (03PS1) 10Joal: Make stats gathering optional in mediawiki-history [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/427067 [07:36:41] * elukey waves to Jonas_WMDE [07:36:45] argh sorry :) [07:36:51] * elukey waves to joal [07:36:52] :) [09:16:32] 10Analytics, 10Analytics-Data-Quality, 10Analytics-Kanban, 10New-Readers, and 5 others: Proxies information gone from Zero portal - https://phabricator.wikimedia.org/T187014#4135465 (10ema) Here's pageview hourly after deploying the changes above: {F17025595} US going down, upwards trend for India and Nig... [09:40:41] a-team: Marko is enabling keep alives between aqs and rb [09:59:50] (03CR) 10Ladsgroup: Track number of constraint definition snaks over time (032 comments) [analytics/wmde/scripts] - 10https://gerrit.wikimedia.org/r/425872 (https://phabricator.wikimedia.org/T191891) (owner: 10Ladsgroup) [09:59:56] (03PS3) 10Ladsgroup: Track number of constraint definition snaks over time [analytics/wmde/scripts] - 10https://gerrit.wikimedia.org/r/425872 (https://phabricator.wikimedia.org/T191891) [10:24:12] (03CR) 10Lucas Werkmeister (WMDE): "This comment from Phabricator is still open, I think:" (031 comment) [analytics/wmde/scripts] - 10https://gerrit.wikimedia.org/r/425872 (https://phabricator.wikimedia.org/T191891) (owner: 10Ladsgroup) [10:27:47] * elukey lunch + errand [10:33:41] 10Analytics, 10WMDE-Analytics-Engineering: SparkR on Spark 2.3.0 - Cannot run program "Rscript" - https://phabricator.wikimedia.org/T192348#4135629 (10GoranSMilovanovic) [10:36:47] 10Analytics, 10WMDE-Analytics-Engineering: SparkR on Spark 2.3.0 - Cannot run program "Rscript" - https://phabricator.wikimedia.org/T192348#4135645 (10GoranSMilovanovic) [10:37:50] 10Analytics, 10WMDE-Analytics-Engineering: SparkR on Spark 2.3.0 - Cannot run program "Rscript" - https://phabricator.wikimedia.org/T192348#4135629 (10GoranSMilovanovic) [10:41:30] (03PS4) 10Ladsgroup: Track number of constraint definition snaks over time [analytics/wmde/scripts] - 10https://gerrit.wikimedia.org/r/425872 (https://phabricator.wikimedia.org/T191891) [10:53:24] (03CR) 10Lucas Werkmeister (WMDE): [C: 031] "We should be able to prettify the Grafana chart with a bunch of targets like" [analytics/wmde/scripts] - 10https://gerrit.wikimedia.org/r/425872 (https://phabricator.wikimedia.org/T191891) (owner: 10Ladsgroup) [10:59:04] hey teaaam [11:14:22] (03CR) 10Mforns: Changed 'NaN' to an appropriate message in metrics % change over the selected time range (031 comment) [analytics/wikistats2] - 10https://gerrit.wikimedia.org/r/425747 (https://phabricator.wikimedia.org/T192028) (owner: 10Sahil505) [11:17:13] 10Analytics, 10Analytics-Wikistats: Improve scoping of CSS - https://phabricator.wikimedia.org/T190915#4135703 (10mforns) [11:17:15] 10Analytics-Kanban, 10Google-Summer-of-Code (2018): [Analytics] Improvements to Wikistats2 front-end - https://phabricator.wikimedia.org/T189210#4135702 (10mforns) [11:17:55] 10Analytics, 10Analytics-Wikistats: Improve scoping of CSS - https://phabricator.wikimedia.org/T190915#4087497 (10mforns) Ok, added it to GSoC project T189210. Moving to mentoring column in backlog. [11:34:10] (03CR) 10Sahil505: ">" (031 comment) [analytics/wikistats2] - 10https://gerrit.wikimedia.org/r/425747 (https://phabricator.wikimedia.org/T192028) (owner: 10Sahil505) [11:43:21] (03CR) 10Joal: "Still one nit" (031 comment) [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/423336 (https://phabricator.wikimedia.org/T191714) (owner: 10Jonas Kress (WMDE)) [11:54:56] (03PS3) 10Sahil505: Changed 'NaN' and 'Infinite' to an appropriate message in metrics % change over the selected time range [analytics/wikistats2] - 10https://gerrit.wikimedia.org/r/425747 (https://phabricator.wikimedia.org/T192028) [11:59:35] (03CR) 10Mforns: Changed 'NaN' and 'Infinite' to an appropriate message in metrics % change over the selected time range (031 comment) [analytics/wikistats2] - 10https://gerrit.wikimedia.org/r/425747 (https://phabricator.wikimedia.org/T192028) (owner: 10Sahil505) [12:07:16] (03PS4) 10Sahil505: Changed 'NaN' and 'Infinite' to an appropriate message in metrics % change over the selected time range [analytics/wikistats2] - 10https://gerrit.wikimedia.org/r/425747 (https://phabricator.wikimedia.org/T192028) [12:10:43] (03CR) 10Mforns: Changed 'NaN' and 'Infinite' to an appropriate message in metrics % change over the selected time range (031 comment) [analytics/wikistats2] - 10https://gerrit.wikimedia.org/r/425747 (https://phabricator.wikimedia.org/T192028) (owner: 10Sahil505) [12:13:24] mforns: o/ [12:13:31] hey elukey :] [12:14:16] (03PS5) 10Sahil505: Changed 'NaN' and 'Infinite' to an appropriate message in metrics % change over the selected time range [analytics/wikistats2] - 10https://gerrit.wikimedia.org/r/425747 (https://phabricator.wikimedia.org/T192028) [12:15:14] Hi mforns - Are you somewhere nearby? [12:15:22] joal, yes! [12:15:32] Hey ! [12:15:47] helloooo [12:16:02] mforns: Do you mind a brainstorm on how to generate those druid queries for checking datasource validity? [12:17:12] joal, not at all! but... I'm in the middle of the page preview rollout to 25%, have to be looking at logs and grafana... [12:17:25] it just launched 5 mins ago [12:17:35] but in a while, hopefully I ping you! [12:17:41] Wow ok - I thought it was planned for about 4pm [12:17:54] mforns: I'll ba having a look at graph with you :) [12:18:04] mforns: nothing urgent, so it can wai [12:18:15] ok :] [12:20:08] 10Analytics, 10Analytics-Kanban, 10Analytics-Wikistats, 10Patch-For-Review: Change 'NaN' & 'Infinite' to something more helpful in metrics % change over the selected time range - https://phabricator.wikimedia.org/T192028#4135821 (10sahil505) [13:16:00] (03CR) 10Sahil505: Changed 'NaN' and 'Infinite' to an appropriate message in metrics % change over the selected time range (031 comment) [analytics/wikistats2] - 10https://gerrit.wikimedia.org/r/425747 (https://phabricator.wikimedia.org/T192028) (owner: 10Sahil505) [13:27:03] ottomata: o/ [13:27:16] just upgraded zookeeper on main-codfw to 3.4.9, all good! [13:27:26] nothing on fire for the moment [13:27:29] and kafka seems happy [13:29:23] yeehaw [13:34:47] will let it boil for one day and then I'll upgrade main-eqiad [13:35:05] Moritz helped me creating a new jessie-wikimedia component [13:35:14] so forcing zookeeper to 3.4.9 via hiera does all the magic [13:43:05] nice [13:44:56] 10Analytics, 10EventBus, 10MediaWiki-JobQueue, 10Services (next): Transfer wikitech jobs to Kafka queue - https://phabricator.wikimedia.org/T192361#4136017 (10Pchelolo) p:05Triage>03Normal [14:00:20] 10Analytics, 10EventBus, 10MediaWiki-JobQueue, 10Services (doing): The .meta.domain is incorrect in EventBus when other wiki is used - https://phabricator.wikimedia.org/T192363#4136055 (10Pchelolo) p:05Triage>03Normal [14:18:38] * elukey brb, coffee [14:36:17] (03PS3) 10EBernhardson: Drop hive partitions before checking hdfs paths [analytics/refinery] - 10https://gerrit.wikimedia.org/r/419953 [14:36:56] nuria_, yt? fdans and I are in the batcave, if you want to comment on the rollout meeting [14:37:43] (03CR) 10EBernhardson: "Thats a much better solution! I've updated the script and tested it out, looks to work a charm." [analytics/refinery] - 10https://gerrit.wikimedia.org/r/419953 (owner: 10EBernhardson) [14:38:26] (03CR) 10Ottomata: [V: 032 C: 032] "Thanks!" [analytics/refinery] - 10https://gerrit.wikimedia.org/r/419953 (owner: 10EBernhardson) [14:41:06] 10Analytics-Tech-community-metrics: Using an author_name filter on Gerrit, I get a different author listed (original author_name is only mentioned in the commit message) - https://phabricator.wikimedia.org/T192366#4136180 (10Aklapper) [14:41:28] 10Analytics-Tech-community-metrics: Using an author_name filter on Gerrit, I get a different author listed (original author_name is only mentioned in the commit message) - https://phabricator.wikimedia.org/T192366#4136180 (10Aklapper) [14:44:30] mforns: yes, give me a sec [14:48:29] 10Analytics, 10EventBus, 10MediaWiki-JobQueue, 10Services (doing): The .meta.domain is incorrect in EventBus when other wiki is used - https://phabricator.wikimedia.org/T192363#4136204 (10mobrovac) [15:03:12] 10Analytics-Kanban: Check that pagecounts-ez cron is ok - https://phabricator.wikimedia.org/T192110#4128266 (10Milimetric) [15:15:12] 10Analytics, 10Analytics-Kanban: Upgrade Kafka on main cluster with security features - https://phabricator.wikimedia.org/T167039#3315367 (10Ottomata) a:03Ottomata [15:32:40] milimetric, wanna bc-2 to see the phabricator script? [15:34:17] mforns: 1.5 minutes [15:34:42] xD ok, will be there sharp [15:57:47] (03PS1) 10EBernhardson: Remove reference to undefined `internal` var [analytics/refinery] - 10https://gerrit.wikimedia.org/r/427158 [16:01:20] (03CR) 10Ottomata: [V: 032 C: 032] Remove reference to undefined `internal` var [analytics/refinery] - 10https://gerrit.wikimedia.org/r/427158 (owner: 10EBernhardson) [16:02:39] 10Analytics-Kanban, 10MW-1.31-release-notes (WMF-deploy-2018-02-27 (1.31.0-wmf.23)), 10Patch-For-Review: Record and aggregate page previews - https://phabricator.wikimedia.org/T186728#4136617 (10Jdlrobson) @mforns the underscores are riding the train. Should be live thursday [16:06:50] 10Analytics-Kanban, 10MW-1.31-release-notes (WMF-deploy-2018-02-27 (1.31.0-wmf.23)), 10Patch-For-Review: Record and aggregate page previews - https://phabricator.wikimedia.org/T186728#4136629 (10mforns) @Jdlrobson thanks a lot! Aggregation of VirtualPageViews into wmf.virtualpageview_hourly is tested and in... [16:17:06] 10Analytics, 10WMDE-Analytics-Engineering, 10Patch-For-Review: SparkR on Spark 2.3.0 - Cannot run program "Rscript" - https://phabricator.wikimedia.org/T192348#4136659 (10GoranSMilovanovic) @Ottomata Andrew, seems like we have R on workers, thank you. However, any operation, for example: ``` head(filter(d... [16:38:08] (03CR) 10Mforns: Changed 'NaN' and 'Infinite' to an appropriate message in metrics % change over the selected time range (032 comments) [analytics/wikistats2] - 10https://gerrit.wikimedia.org/r/425747 (https://phabricator.wikimedia.org/T192028) (owner: 10Sahil505) [16:38:29] 10Analytics, 10WMDE-Analytics-Engineering, 10Patch-For-Review: SparkR on Spark 2.3.0 - Cannot run program "Rscript" - https://phabricator.wikimedia.org/T192348#4136729 (10GoranSMilovanovic) @Ottomata Fixed with the arguments to `sparkR.session()` and the preceding `Sys.setenv()` R call as in the following:... [16:39:54] 10Analytics, 10WMDE-Analytics-Engineering, 10Patch-For-Review: SparkR on Spark 2.3.0 - Cannot run program "Rscript" - https://phabricator.wikimedia.org/T192348#4136733 (10GoranSMilovanovic) 05Open>03Resolved a:03GoranSMilovanovic [16:51:51] mforns, fdans : mistery solved with previews [16:52:02] you can reda backscroll on ops channel [16:52:05] oh, what was it? [16:52:09] ok [16:52:18] mforns: their config was not what they thought it was [16:52:27] mforns: they were using a/b testing config rollout [16:52:41] mforns: where 10% means two groups [16:52:48] 5% on 5% off [16:53:25] cc fdans [16:53:48] mforns, fdans we are having one more meeting if you want to attend (totally optional) just an FYI [16:54:39] aaaaaaah, but then aren't we deploying page previews to 100%? or just 50%? [16:54:42] nuria_, ^ [16:58:12] mforns: unless you do 0% with how they have setup the code you cannot deploy to 100% [16:59:00] 10Analytics, 10WMDE-Analytics-Engineering, 10Patch-For-Review: SparkR on Spark 2.3.0 - Cannot run program "Rscript" - https://phabricator.wikimedia.org/T192348#4136784 (10Ottomata) STill working on this, am having versioning problems on different nodes... [17:01:20] He folks. I need to skip the analytics hangout today to cram for paper writing. [17:01:29] joal, ottomata ^ [17:01:30] FYI [17:01:44] good luck halfak - We're in there :) [17:01:52] halfak: hello nonetheless :) [17:02:35] * elukey off! [17:03:00] o/ [17:03:30] 10Analytics, 10MediaWiki-Vagrant, 10Services (watching): Vagrant's /var/log/daemon.log filling up with kafka errors - https://phabricator.wikimedia.org/T187102#4136801 (10Pchelolo) [17:04:53] 10Analytics, 10WMDE-Analytics-Engineering, 10Patch-For-Review: SparkR on Spark 2.3.0 - Cannot run program "Rscript" - https://phabricator.wikimedia.org/T192348#4136806 (10GoranSMilovanovic) 05Resolved>03Open [17:20:54] 10Analytics: Piwik to measure traffic for new wikimedia foundation site - https://phabricator.wikimedia.org/T188419#4136838 (10Nuria) Update on conversation. Given that this new foundation site is a third party hosted on wordpress. site our proposal is to check whether these wordpress plugins for stats do work... [17:21:03] 10Analytics: Measure traffic for new wikimedia foundation site - https://phabricator.wikimedia.org/T188419#4136840 (10Nuria) [17:25:35] mforns, fdans : now we are seeing what I would have expected earlier: https://grafana-admin.wikimedia.org/dashboard/db/restbase?panelId=15&fullscreen&orgId=1&from=1523895148889&to=now&refresh=1m [17:26:57] nuria_: it shows up a bit as well on EL [17:27:07] joal: ya, now the fun part starts [17:27:33] nuria_: I'll be around checking for some time [17:27:47] fdans: I changed title to "Wikistats 2 - Statistics for bm.wikipedia.org - Unique Devices" but i gather I should remove the "2" eh? [17:54:31] 10Analytics, 10WMDE-Analytics-Engineering, 10Patch-For-Review: SparkR on Spark 2.3.0 - Cannot run program "Rscript" - https://phabricator.wikimedia.org/T192348#4137047 (10Ottomata) Ok! Got it. Should be good now. [17:55:11] 10Analytics-Kanban, 10WMDE-Analytics-Engineering, 10Patch-For-Review: SparkR on Spark 2.3.0 - Cannot run program "Rscript" - https://phabricator.wikimedia.org/T192348#4137049 (10Ottomata) p:05Triage>03Normal a:05GoranSMilovanovic>03Ottomata [17:55:23] 10Analytics-Kanban, 10WMDE-Analytics-Engineering, 10Patch-For-Review: SparkR on Spark 2.3.0 - Cannot run program "Rscript" - https://phabricator.wikimedia.org/T192348#4135629 (10Ottomata) [18:00:05] 10Analytics, 10Analytics-Kanban: Switch to --new.consumer for main -> analytics MirrorMaker - https://phabricator.wikimedia.org/T192387#4137076 (10Ottomata) p:05Triage>03Normal [18:05:36] 10Analytics-Kanban, 10WMDE-Analytics-Engineering, 10Patch-For-Review: SparkR on Spark 2.3.0 - Cannot run program "Rscript" - https://phabricator.wikimedia.org/T192348#4137121 (10GoranSMilovanovic) - Elementary tests with {SparkR} conducted: works. - In the following hours I will be testing MLlib procedur... [18:06:28] nuria_: The shape of the EL graph is really weird [18:06:41] joal: sorry on meetinhg , can look in abit [18:06:50] np nuria_ - When you have time [18:09:22] 10Analytics, 10Easy: Productionize job for Global Innovation Index from Hadoop Geowiki data - https://phabricator.wikimedia.org/T190535#4137129 (10Milimetric) [18:12:42] (03CR) 10Mforns: [C: 031] "LVGTM!" (031 comment) [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/427067 (owner: 10Joal) [18:28:04] 10Analytics-Kanban, 10Patch-For-Review: Add defaults section to WhitelistSanitization.scala - https://phabricator.wikimedia.org/T190202#4137250 (10mforns) I need another +1 for this task. @JAllemandou / @Nuria can you have a look, please? Or alternatively, I can merge it :] [18:28:57] joal: back, looking at grphs now [18:29:00] *graphs [18:30:22] joal: what do you find is strange? [18:33:09] joal: do you mean why it looks so jagged in the last half hour or so? https://grafana.wikimedia.org/dashboard/db/eventlogging-schema?var-schema=VirtualPageView&orgId=1 [18:35:49] joal: I think it makes sense with rollout , follows restbase pretty well (we will always se emore traffic on restbase end) [18:36:11] joal: but we would not know for sure until we have let it bake for a bit [18:36:45] joal: let's talk on batcave about referrer if you have a sec [18:39:43] nuria_: OMW ! [18:42:03] (03PS1) 10Joal: Add PartitionedDataFrame to spark Refine job [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/427187 [18:42:17] ottomata: --^ if you wanna have a look [18:45:58] (03CR) 10Joal: [C: 032] Identify new search engines as such (031 comment) [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/423336 (https://phabricator.wikimedia.org/T191714) (owner: 10Jonas Kress (WMDE)) [18:47:42] (03PS3) 10Mforns: Add defaults section to WhitelistSanitization [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/420795 (https://phabricator.wikimedia.org/T190202) [18:52:09] Hi HaeB - My wonder was about the jagged shape indeed [18:52:51] HaeB: Could be related to cache invalidation or other things, I'm gonna wait for the thing to have baked a bit before asking for more :) [18:53:09] (03Merged) 10jenkins-bot: Identify new search engines as such [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/423336 (https://phabricator.wikimedia.org/T191714) (owner: 10Jonas Kress (WMDE)) [18:54:23] (03PS5) 10Mforns: Add job and query for page previews aggregation [analytics/refinery] - 10https://gerrit.wikimedia.org/r/425281 (https://phabricator.wikimedia.org/T186728) [18:57:30] (03CR) 10jerkins-bot: [V: 04-1] Add defaults section to WhitelistSanitization [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/420795 (https://phabricator.wikimedia.org/T190202) (owner: 10Mforns) [19:18:06] (03PS4) 10Mforns: Add defaults section to WhitelistSanitization [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/420795 (https://phabricator.wikimedia.org/T190202) [19:19:35] (03PS6) 10Sahil505: Changed 'NaN' and 'Infinite' to an appropriate message in metrics % change over the selected time range [analytics/wikistats2] - 10https://gerrit.wikimedia.org/r/425747 (https://phabricator.wikimedia.org/T192028) [19:21:03] (03CR) 10Sahil505: "Please review :-]" (032 comments) [analytics/wikistats2] - 10https://gerrit.wikimedia.org/r/425747 (https://phabricator.wikimedia.org/T192028) (owner: 10Sahil505) [19:24:34] joal: do you want to come to Wiki Workshop next week? [19:24:56] I know it's far from your place and all. but just saying. It would be nice and relevant to have you there. ;) [19:30:49] 10Analytics, 10EventBus, 10MediaWiki-JobQueue, 10Services (next): Transfer wikitech jobs to Kafka queue - https://phabricator.wikimedia.org/T192361#4137451 (10Krinkle) [19:31:53] (03CR) 10Mforns: [V: 032 C: 032] "Great fix!" [analytics/wikistats2] - 10https://gerrit.wikimedia.org/r/425747 (https://phabricator.wikimedia.org/T192028) (owner: 10Sahil505) [19:57:48] For my opsie people - Super interesting read on networking - https://cilium.io/blog/2018/04/17/why-is-the-kernel-community-replacing-iptables/ [19:58:33] Ok team - Gone for tonight [19:58:43] byeee [19:58:49] me too leaving! [19:59:04] And gentle reminder, tomorrow is kids day, I'll be on and off until standup, then on for a while :) [20:35:04] 10Analytics, 10EventBus, 10MediaWiki-JobQueue, 10Services (doing): LocalGlobalUserPageCacheUpdateJob always fails - https://phabricator.wikimedia.org/T192405#4137620 (10Pchelolo) [20:49:30] 10Analytics, 10Analytics-Wikistats: Hide "Load more rows..." once all the data is visible in Table Chart - https://phabricator.wikimedia.org/T192407#4137657 (10sahil505) [21:01:03] 10Analytics, 10Analytics-Wikistats: Hide "Load more rows..." once all the data is visible in Table Chart - https://phabricator.wikimedia.org/T192407#4137689 (10Nuria) Indeed, I tested this and completely missed this case, please be so kind to fix it. [21:06:17] milimetric: yt? need help with geowiki veting? [21:07:46] I’m on my way to tutoring now, but no I’m ok [21:12:16] 10Analytics, 10Analytics-Data-Quality, 10Analytics-Kanban, 10New-Readers, and 5 others: Proxies information gone from Zero portal - https://phabricator.wikimedia.org/T187014#4137700 (10Nuria) {F17046846} Indeed things look like they are coming back, Nigeria pageviews are present again and US traffic is qu... [21:15:11] 10Analytics, 10Analytics-Data-Quality, 10Analytics-Kanban, 10New-Readers, and 5 others: Proxies information gone from Zero portal. Opera mini pageviews geolocating to wrong country - https://phabricator.wikimedia.org/T187014#4137702 (10Nuria) [21:15:47] 10Analytics, 10Analytics-Data-Quality, 10Analytics-Kanban, 10New-Readers, and 5 others: Proxies information gone from Zero portal. Opera mini pageviews geolocating to wrong country - https://phabricator.wikimedia.org/T187014#3961955 (10Nuria) Solving ticket. Added note to: https://wikitech.wikimedia.org/wi... [21:15:55] 10Analytics, 10Analytics-Data-Quality, 10Analytics-Kanban, 10New-Readers, and 5 others: Proxies information gone from Zero portal. Opera mini pageviews geolocating to wrong country - https://phabricator.wikimedia.org/T187014#4137704 (10Nuria) Solving ticket. Added note to: https://wikitech.wikimedia.org/wi... [21:16:40] 10Analytics, 10Analytics-Data-Quality, 10Analytics-Kanban, 10New-Readers, and 5 others: Proxies information gone from Zero portal. Opera mini pageviews geolocating to wrong country - https://phabricator.wikimedia.org/T187014#3961955 (10Nuria) 05Open>03Resolved [21:24:10] 10Analytics-Kanban: Meta-statistics on MediaWiki history reconstruction process - https://phabricator.wikimedia.org/T155507#4137723 (10Nuria) 05Open>03Resolved [21:24:51] 10Analytics: Unlock Spark with Oozie - https://phabricator.wikimedia.org/T159961#4137725 (10Nuria) [21:24:54] 10Analytics-Kanban, 10Patch-For-Review: Spark 2 as cluster default (working with oozie) - https://phabricator.wikimedia.org/T159962#4137724 (10Nuria) 05Open>03Resolved [21:26:02] 10Analytics-Kanban, 10Operations, 10Patch-For-Review: Review changes to /etc/java-8-openjdk/security/java.security in Kafka from u162 update - https://phabricator.wikimedia.org/T190400#4137727 (10Nuria) 05Open>03Resolved [21:31:17] (03CR) 10Nuria: [C: 031] Add job and query for page previews aggregation (031 comment) [analytics/refinery] - 10https://gerrit.wikimedia.org/r/425281 (https://phabricator.wikimedia.org/T186728) (owner: 10Mforns) [21:36:17] (03CR) 10Nuria: [C: 031] "Looks good, do we also need changes on python version?" [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/420795 (https://phabricator.wikimedia.org/T190202) (owner: 10Mforns) [22:20:50] 10Analytics, 10Analytics-Data-Quality, 10Analytics-Kanban, 10New-Readers, and 5 others: Proxies information gone from Zero portal. Opera mini pageviews geolocating to wrong country - https://phabricator.wikimedia.org/T187014#3961964 (10atgo) Thank you! [22:30:55] 10Analytics, 10Analytics-Data-Quality, 10Analytics-Kanban, 10New-Readers, and 5 others: Proxies information gone from Zero portal. Opera mini pageviews geolocating to wrong country - https://phabricator.wikimedia.org/T187014#4137843 (10DFoy) Thanks everyone, great to see this working again! [23:35:48] 10Analytics, 10Google-Summer-of-Code: When cursor is out of graph overlay should not display - https://phabricator.wikimedia.org/T192416#4137990 (10Nuria) [23:36:28] 10Analytics, 10Google-Summer-of-Code: When cursor is out of graph overlay should not display - https://phabricator.wikimedia.org/T192416#4138003 (10Nuria) {F17054773} Overlay with point values keeps on displaying even when cursor is no longer on top of graph. It should disappear. [23:36:40] 10Analytics, 10Analytics-Wikistats, 10Google-Summer-of-Code: When cursor is out of graph overlay should not display - https://phabricator.wikimedia.org/T192416#4138004 (10Nuria) [23:48:02] 10Analytics, 10Analytics-Data-Quality, 10Analytics-Kanban, 10New-Readers, and 5 others: Proxies information gone from Zero portal. Opera mini pageviews geolocating to wrong country - https://phabricator.wikimedia.org/T187014#4138028 (10Tbayer) Great, thanks everyone! But do we now know what caused the corr... [23:49:48] 10Analytics, 10Analytics-Data-Quality, 10Analytics-Kanban, 10New-Readers, and 5 others: Proxies information gone from Zero portal. Opera mini pageviews geolocating to wrong country - https://phabricator.wikimedia.org/T187014#4138030 (10Nuria) The proxy list for zero was emptied and that must have included...