[04:54:04] (03PS4) 10Amitjoki: Fix the confusing display of radio buttons [analytics/wikistats2] - 10https://gerrit.wikimedia.org/r/422407 (https://phabricator.wikimedia.org/T183185) [04:55:30] (03CR) 10Amitjoki: "> Uploaded patch set 4: Commit message was updated." [analytics/wikistats2] - 10https://gerrit.wikimedia.org/r/422407 (https://phabricator.wikimedia.org/T183185) (owner: 10Amitjoki) [05:23:10] 10Analytics: Varnishkafka does not play well with varnish 5.2 - https://phabricator.wikimedia.org/T177647#4093693 (10elukey) Yeah, we upgraded to 5.1.3 but 5.2 is completely different: https://varnish-cache.org/docs/5.2/whats-new/changes-5.2.html#vsm-vsc-api-changes There are some changes in the way the shared... [06:10:14] 10Analytics, 10Analytics-Wikistats, 10Easy: [Wikistats2] The detail page for tops and maps metrics does not indicate time range - https://phabricator.wikimedia.org/T182990#3840528 (10Amitjoki) @mforns where can I get the duration for the MapChart? The month attribute seems to be same for all the countries: `... [07:07:15] hello people! [07:07:30] so this morning I am working on https://gerrit.wikimedia.org/r/#/c/423000/ for a couple of hours (I think) [07:07:51] it is a big refactoring of the hadoop jmx code in puppet, that should simplify a lot our dependencies etc.. [07:08:01] I should have done it from day one of course [07:08:07] buuut didn't think about it :) [07:08:14] so I am currently testing it on an1030 [07:08:50] and if good, I am going to roll it out everywhere.. this will need to restart the daemons to make sure that everything works fine, I'll do it veeery slowly [07:12:38] worked super fine on an1030 [07:39:35] currently restarting all yarn node managers [08:20:35] 10Analytics, 10Patch-For-Review, 10User-Elukey: Add the prometheus jmx exporter to all the Zookeeper daemons - https://phabricator.wikimedia.org/T177460#4093766 (10elukey) Better one: ``` --- lowercaseOutputLabelNames: true lowercaseOutputName: false whitelistObjectNames: - 'org.apache.ZooKeeperService:*'... [08:26:40] !log stopped camus to drain the cluster - prep for easy restart of analytics1003's jvm daemons [08:26:42] Logged the message at https://www.mediawiki.org/wiki/Analytics/Server_Admin_Log [08:38:32] rolling restart of the hdfs datanodes in progress [08:38:37] 1 every 120 seconds [08:58:58] Heya elukey - So far so good on the clusteR? [08:59:55] joal: o/ - all good! [08:59:59] Yay :) [09:00:11] elukey: Interestingly enough, my spark job didn't fail ! [09:00:27] elukey: I think U have (finally) found the solution [09:01:12] 10Analytics, 10Analytics-Kanban, 10Analytics-Wikistats, 10Google-Summer-of-Code (2018): GSoC Proposal 2018 : [Analytics] Improvements to Wikistats2 front-end - https://phabricator.wikimedia.org/T189964#4093789 (10sahil505) [09:03:39] joal: nice! [09:03:49] is it mw-history or another one? [09:03:57] elukey: mw-history [09:04:01] other ones don't fail [09:06:02] joal: do you want me to stop? I am doing the datanodes now, one every 2 mins [09:06:16] elukey: no no - It's actaully very interesting :) [09:07:11] elukey: The fact that nodemanagers restart didn't kill the job let us know that, for super important/long prod jobs, we shouldn't use dynamic partitioning (therefore we don't rely on the ShuffleManager coupled to yarn) [09:08:03] 10Analytics, 10Analytics-Kanban, 10Wikidata, 10Patch-For-Review, 10Wikidata-Ministry-Of-Magic: Add Wikidata website extract oozie job - https://phabricator.wikimedia.org/T191022#4093790 (10Jonas) @Nuria yes I would like to have *.wikidata.org. If wdqs_extract is being removed it should definitely be in... [09:08:03] joal: ouch I completely forgot about that and didn't ask you first! Sorry :( [09:08:24] elukey: no problemo - It was an interesting test :D [09:08:47] elukey: I run jobs for perfomance optimisation - nothing problematic in having one failing (which did n'ot happen) [09:10:04] okok :) [09:10:09] so next steps for today [09:10:21] 1) restart an1003's daemons for openjdk upgrades [09:10:41] 2) enable the brand new prometheus exporter for zookeeper on one of the druid clusters [09:11:02] will let it boil for some days and the roll it out everywhere in case all is ok [09:20:16] (03CR) 10Jonas Kress (WMDE): "Would removing ip and referer columns allow keeping data for longer period?" [analytics/refinery] - 10https://gerrit.wikimedia.org/r/422930 (owner: 10Jonas Kress (WMDE)) [09:31:06] restarted oozie [09:44:15] restarted hive server+metastore [09:44:45] !log re-enable camus [09:44:47] Logged the message at https://www.mediawiki.org/wiki/Analytics/Server_Admin_Log [09:48:02] 10Analytics-Kanban, 10Patch-For-Review: Checklist for geowiki pipeline - https://phabricator.wikimedia.org/T190409#4093828 (10JAllemandou) @Milimetric : I have modifed https://wikitech.wikimedia.org/wiki/Analytics/Systems/Druid#Delete_segments_from_deep_storage for better understanding of the issue you encount... [10:00:36] (03CR) 10Joal: [C: 031] "One minimal nit in commit message - Code looks good !" (031 comment) [analytics/refinery] - 10https://gerrit.wikimedia.org/r/423019 (https://phabricator.wikimedia.org/T190409) (owner: 10Milimetric) [10:06:36] (03CR) 10Fdans: [C: 031] "I couldn't replicate the original bug in master, but I tested this change and it looks good, just one suggestion." (031 comment) [analytics/wikistats2] - 10https://gerrit.wikimedia.org/r/423051 (https://phabricator.wikimedia.org/T191097) (owner: 10Nuria) [10:08:46] 10Analytics, 10EventBus, 10Pywikibot-core, 10Wikimedia-Stream, 10Upstream: EventStreams fails due to Bad Gateway for url: https://stream.wikimedia.org/v2/stream/recentchange - https://phabricator.wikimedia.org/T191108#4093882 (10Xqt) p:05High>03Triage Looks like an upstream issue [10:14:03] 10Analytics-Kanban, 10Contributors-Analysis, 10Patch-For-Review: Provide cumulative edit count in Data Lake edit data - https://phabricator.wikimedia.org/T161147#4093943 (10Neil_P._Quinn_WMF) p:05High>03Triage [10:14:24] 10Analytics-Kanban, 10Contributors-Analysis, 10Patch-For-Review: Provide cumulative edit count in Data Lake edit data - https://phabricator.wikimedia.org/T161147#3122928 (10Neil_P._Quinn_WMF) a:05Neil_P._Quinn_WMF>03None [10:20:14] (03PS1) 10Amitjoki: Add time period for maps and tops metrics [analytics/wikistats2] - 10https://gerrit.wikimedia.org/r/423144 (https://phabricator.wikimedia.org/T182990) [10:22:50] 10Analytics-Kanban, 10Contributors-Analysis, 10Patch-For-Review: Re-enable the edit analysis dashboard - https://phabricator.wikimedia.org/T126058#4094052 (10Neil_P._Quinn_WMF) p:05High>03Triage [10:23:04] 10Analytics-Kanban, 10Contributors-Analysis, 10Patch-For-Review: Re-enable the edit analysis dashboard - https://phabricator.wikimedia.org/T126058#2003512 (10Neil_P._Quinn_WMF) a:05mforns>03Neil_P._Quinn_WMF [10:24:14] 10Analytics, 10Analytics-Wikistats, 10Easy, 10Patch-For-Review: [Wikistats2] The detail page for tops and maps metrics does not indicate time range - https://phabricator.wikimedia.org/T182990#4094058 (10sahil505) @Amitjoki I admire your enthusiasm, but whenever you take a task please share it in comments o... [10:26:24] 10Analytics, 10EventBus, 10Pywikibot-core, 10Wikimedia-Stream, 10Upstream: EventStreams fails due to Bad Gateway for url: https://stream.wikimedia.org/v2/stream/recentchange - https://phabricator.wikimedia.org/T191108#4094087 (10Xqt) 05Open>03Resolved a:03Xqt Working again. Thanks. [10:30:56] 10Analytics-Kanban, 10Contributors-Analysis, 10Patch-For-Review: Queries for the edit analysis dashboard failing since December 2015 [5 pts] - https://phabricator.wikimedia.org/T124383#4094143 (10Neil_P._Quinn_WMF) p:05High>03Triage [10:33:00] 10Analytics, 10Analytics-EventLogging, 10Analytics-Kanban, 10Contributors-Analysis, and 6 others: Managing size of page-create and revision-create tables in storage. Aggregation? - https://phabricator.wikimedia.org/T169898#4094170 (10Neil_P._Quinn_WMF) p:05High>03Triage [10:34:08] joal: https://grafana.wikimedia.org/dashboard/db/zookeeper-prometheus [10:34:09] 10Analytics-Kanban, 10Contributors-Analysis, 10Documentation: Remove outdated docs regarding dashboard info - https://phabricator.wikimedia.org/T137883#4094189 (10Neil_P._Quinn_WMF) p:05Normal>03Triage [10:34:11] \o/ [10:34:17] for the moment only druid-analytics [10:34:20] 10Analytics-Kanban, 10Contributors-Analysis, 10Patch-For-Review: editor-engagement dashboard on edit-analysis stopped updating on ~ 2017-02-21 - https://phabricator.wikimedia.org/T160807#4094192 (10Neil_P._Quinn_WMF) p:05Normal>03Triage [10:34:33] 10Analytics, 10Analytics-EventLogging, 10Analytics-Kanban, 10Community-Tech, and 6 others: Record an event every time a new content namespace page is created - https://phabricator.wikimedia.org/T150369#4094195 (10Neil_P._Quinn_WMF) p:05Normal>03Triage [10:34:45] elukey: U haz dazboard! [10:35:04] thanks a mil for that elukey :) [10:35:06] 10Analytics-EventLogging, 10Analytics-Kanban, 10Contributors-Analysis, 10DBA, and 4 others: Drop tables with bad data: mediawiki_page_create_1 mediawiki_revision_create_1 - https://phabricator.wikimedia.org/T169781#4094201 (10Neil_P._Quinn_WMF) p:05Normal>03Triage [10:35:25] 10Analytics, 10Analytics-Dashiki, 10Contributors-Analysis, 10VisualEditor, 10User-Ryasmeen: Improve the edit analysis dashboard {lion} - https://phabricator.wikimedia.org/T104261#4094204 (10Neil_P._Quinn_WMF) a:05Neil_P._Quinn_WMF>03Milimetric [10:35:29] 10Analytics, 10Patch-For-Review, 10User-Elukey: Add the prometheus jmx exporter to all the Zookeeper daemons - https://phabricator.wikimedia.org/T177460#4094205 (10elukey) Created https://grafana.wikimedia.org/dashboard/db/zookeeper-prometheus, for the moment only displaying the druid-analytics cluster. Next... [10:35:37] 10Analytics, 10Analytics-Dashiki, 10Contributors-Analysis, 10VisualEditor, 10User-Ryasmeen: Improve the edit analysis dashboard {lion} - https://phabricator.wikimedia.org/T104261#1412040 (10Neil_P._Quinn_WMF) p:05Normal>03Triage [10:36:21] joal: so I'll let it boil for the upcoming weekend, and if everything looks good next week I'll deploy to all [10:36:35] Super great [10:37:02] elukey: With you joining the tema, we've gone from almost no-java-oriented dashboard to everything-has-a-dashboard [10:37:09] elukey: <3 <3 <3 [10:37:13] \o/ [10:37:15] :) [10:38:18] 10Analytics, 10Contributors-Analysis: Improve performance of graphs visualizing the sessions metric - https://phabricator.wikimedia.org/T130864#4094229 (10Neil_P._Quinn_WMF) p:05Normal>03Triage [10:38:21] 10Analytics, 10Analytics-EventLogging, 10Community-Tech, 10Contributors-Analysis, and 3 others: Visualize page create events for all wikis - https://phabricator.wikimedia.org/T170850#4094226 (10Neil_P._Quinn_WMF) p:05Normal>03Triage [10:38:55] going to lunch! [11:14:08] (03PS1) 10Jonas Kress (WMDE): Add recent changes mobile edits [analytics/wmde/scripts] - 10https://gerrit.wikimedia.org/r/423145 [11:16:27] (03CR) 10Jonas Kress (WMDE): "I could not verify that this tag exists in the API response, but I see it in the recent changes:" [analytics/wmde/scripts] - 10https://gerrit.wikimedia.org/r/423145 (owner: 10Jonas Kress (WMDE)) [11:17:03] (03PS2) 10Jonas Kress (WMDE): Add recent changes mobile edits [analytics/wmde/scripts] - 10https://gerrit.wikimedia.org/r/423145 [11:21:08] (03PS3) 10Jonas Kress (WMDE): Add recent changes mobile edits [analytics/wmde/scripts] - 10https://gerrit.wikimedia.org/r/423145 (https://phabricator.wikimedia.org/T191111) [11:55:06] 10Analytics, 10Analytics-Kanban, 10Analytics-Wikistats: Scroll should not bounce horizontally when swiping left/right - https://phabricator.wikimedia.org/T190959#4089108 (10fdans) a:03fdans [11:55:18] (03PS1) 10Fdans: Prevent screen from bouncing horizontally when swiping left/right [analytics/wikistats2] - 10https://gerrit.wikimedia.org/r/423150 (https://phabricator.wikimedia.org/T190959) [11:56:22] milimetric: boy did I take a long time to come up with that [12:49:53] 10Analytics, 10Analytics-Wikistats: Improve scoping of CSS - https://phabricator.wikimedia.org/T190915#4094397 (10sahil505) Hey all, this task would be really interesting. @fdans - I had a quick question, any reason why we didn't opt for pre-processors (SASS/SCSS or LESS) to handle dynamic values and variable... [13:09:04] joal: o/ - whenever you have time I'd like to chat with you about the hdfs trash [13:28:18] 18/03/30 13:28:03 INFO fs.TrashPolicyDefault: Moved: 'hdfs://analytics-hadoop-labs/user/elukey/.sparkStaging' to trash at: hdfs://analytics-hadoop-labs/user/elukey/.Trash/Current/user/elukey/.sparkStaging [13:28:22] \o/ [13:31:12] 10Analytics, 10Analytics-Kanban, 10Patch-For-Review, 10User-Elukey: Add trash folder to hadoop - https://phabricator.wikimedia.org/T189051#4094442 (10elukey) Tested the two values that I've set in the above patch in labs: ``` elukey@hadoop-master-1:~$ hdfs dfs -rm -r -f /user/elukey/.sparkStaging Picked u... [13:31:13] so it works with two parameters [13:31:34] 1) set how frequent a trash "checkpoint" is made, namely a copy of the trash dir [13:31:47] 2) set how old a checkpoint must be before cleaning it up [13:32:07] so in our case, we could do something like: checkpoint every day, delete after X days [13:32:42] everything that is in the trash but not in a checkpoint stays in the "current" trash [13:33:13] 10Analytics, 10EventBus, 10Pywikibot-core, 10Wikimedia-Stream, 10Upstream: EventStreams fails due to Bad Gateway for url: https://stream.wikimedia.org/v2/stream/recentchange - https://phabricator.wikimedia.org/T191108#4094443 (10Xqt) 05Resolved>03Open Again the same problem as described above. [13:35:32] PROBLEM - Number of banner_activity realtime events received by Druid over a 30 minutes period on einsteinium is CRITICAL: CRITICAL - scalar(sum(sum_over_time(druid_realtime_ingest_events_processed_count{cluster=druid_analytics, instance=druid.*:8000, datasource=banner_activity_minutely}[30m]))): 0.0 = 0.0 https://grafana.wikimedia.org/dashboard/db/prometheus-druid?refresh=1m&panelId=41&fullscreen&orgId=1 [13:36:41] mmmm [13:36:55] 10Analytics, 10EventBus, 10Pywikibot-core, 10Wikimedia-Stream, 10Upstream: EventStreams fails due to Bad Gateway for url: https://stream.wikimedia.org/v2/stream/recentchange - https://phabricator.wikimedia.org/T191108#4094448 (10Xqt) a:05Xqt>03None [13:37:38] something is not right - https://grafana.wikimedia.org/dashboard/db/prometheus-druid?refresh=1m&panelId=41&fullscreen&orgId=1 [13:38:50] this could be related to the zookeeper restarts [13:38:54] but they were a long time ago [13:39:01] real time indexers failed [13:40:17] ERROR io.druid.indexing.overlord.TaskQueue: Failed to persist status for task: [13:41:53] !log restart overlord+middlemanager on druid1001 after failures in real time indexing (overlord leader) [13:41:54] Logged the message at https://www.mediawiki.org/wiki/Analytics/Server_Admin_Log [13:48:08] !log restart overlord+middlemanager on druid100[23] to avoid consistency issues [13:48:10] Logged the message at https://www.mediawiki.org/wiki/Analytics/Server_Admin_Log [13:48:38] last time this was the trick [13:48:48] not sure if the overlord's zookeeper client is weird [14:00:18] * elukey is waiting for the next banner impression data [14:02:26] seems to be working [14:04:41] RECOVERY - Number of banner_activity realtime events received by Druid over a 30 minutes period on einsteinium is OK: OK - scalar(sum(sum_over_time(druid_realtime_ingest_events_processed_count{cluster=druid_analytics, instance=druid.*:8000, datasource=banner_activity_minutely}[30m]))) within thresholds https://grafana.wikimedia.org/dashboard/db/prometheus-druid?refresh=1m&panelId=41&fullscreen&orgId=1 [14:51:26] 10Analytics, 10Analytics-Wikistats, 10Easy, 10Patch-For-Review: [Wikistats2] The detail page for tops and maps metrics does not indicate time range - https://phabricator.wikimedia.org/T182990#4094506 (10Amitjoki) @sahil505 don't know. I thought claiming task was akin to issues "Assigned" in Github. Usually... [14:52:15] 10Analytics, 10Analytics-Cluster: Requesting account expiration extension - https://phabricator.wikimedia.org/T183291#4094507 (10Jdcc-berkman) I haven't been able to secure the developer time yet for this. It's unlikely I'll have anything to show for at least two months, during which time I won't need access.... [15:12:15] fdans,joal - do you guys want to do standup? [15:12:27] ah wait Nuria will join too, forgot about it [15:16:28] elukey: we can do early standup [15:16:38] i think joal might not be able to join though [15:18:07] (03CR) 10Nuria: [C: 04-1] ">Would removing ip and referer columns allow keeping data for longer period?" [analytics/refinery] - 10https://gerrit.wikimedia.org/r/422930 (owner: 10Jonas Kress (WMDE)) [15:19:38] nuria_: fine to me, but not sure if the rest of team EU agrees.. let's see if they are available, otherwise I don't have any issue to wait for standup [15:19:50] elukey: k [15:19:50] buuut if you have time we can discuss EL alarms :) [15:22:17] 10Analytics, 10Analytics-Kanban, 10Patch-For-Review, 10User-Elukey: Add trash folder to hadoop - https://phabricator.wikimedia.org/T189051#4094535 (10Nuria) Let's talk these values with team, I was thinking trash should persist several days but that drops we do on a cron (retention) should delete skipping... [15:23:51] nuria_: didn't get --^ [15:24:12] so we can configure days of retention, after those hdfs will automatically clean up for us [15:24:31] like 1 checkpoint for each day, and then a retention of 7 days for each checkpoint [15:29:30] (03CR) 10Nuria: [C: 04-1] "Please see also comments on patch." (033 comments) [analytics/wikistats2] - 10https://gerrit.wikimedia.org/r/423144 (https://phabricator.wikimedia.org/T182990) (owner: 10Amitjoki) [15:30:52] 10Analytics, 10Analytics-Wikistats, 10Easy, 10Patch-For-Review: [Wikistats2] The detail page for tops and maps metrics does not indicate time range - https://phabricator.wikimedia.org/T182990#4094548 (10Nuria) @Amitjoki I think you need to rework your patch a bit, please take a look at code on dashboard th... [15:34:45] 10Analytics, 10Analytics-Kanban, 10Patch-For-Review, 10User-Elukey: Add the prometheus jmx exporter to all the Zookeeper daemons - https://phabricator.wikimedia.org/T177460#4094551 (10elukey) [15:39:10] Hey folks [15:39:27] Here from now if you wanna a not-so-early standup [15:41:17] a-team --^ [15:44:19] hi joal, do you want to take a look at this and see why I can't add a world-map slice? https://superset.wikimedia.org/superset/dashboard/9 [15:44:39] Hi milimetric - Sure ! doing now [15:45:08] at this point let's wait 15 mins :) [15:45:17] elukey: :-P [15:46:47] fdans: do you have that patch loaded somewhere? [15:46:58] I mean like the canary? [15:52:42] (03PS2) 10Milimetric: Repair successfuly sqooped cu_changes [analytics/refinery] - 10https://gerrit.wikimedia.org/r/423019 (https://phabricator.wikimedia.org/T190409) [15:53:08] (03CR) 10Milimetric: [C: 031] Repair successfuly sqooped cu_changes (031 comment) [analytics/refinery] - 10https://gerrit.wikimedia.org/r/423019 (https://phabricator.wikimedia.org/T190409) (owner: 10Milimetric) [15:53:22] milimetric: done [15:54:57] (03CR) 10Joal: [C: 031] "Thanks !!" [analytics/refinery] - 10https://gerrit.wikimedia.org/r/423019 (https://phabricator.wikimedia.org/T190409) (owner: 10Milimetric) [15:55:22] joal: how in the world... [15:56:23] ok, I'll try it myself sometime to see what I missed... maybe the filters weren't set up to match the filter slice? [15:56:53] (03CR) 10Amitjoki: ">" (033 comments) [analytics/wikistats2] - 10https://gerrit.wikimedia.org/r/423144 (https://phabricator.wikimedia.org/T182990) (owner: 10Amitjoki) [15:57:08] milimetric: Added the trick for country borders as well [15:57:19] milimetric: looks awesome with new layout ! [15:57:56] oh sweet, thanks [16:01:09] (03CR) 10Amitjoki: "> >" (033 comments) [analytics/wikistats2] - 10https://gerrit.wikimedia.org/r/423144 (https://phabricator.wikimedia.org/T182990) (owner: 10Amitjoki) [16:04:20] 10Analytics-Kanban, 10Patch-For-Review: Checklist for geowiki pipeline - https://phabricator.wikimedia.org/T190409#4094563 (10Milimetric) Thank you so much, awesome. [16:04:37] 10Analytics-Kanban, 10Patch-For-Review: Checklist for geowiki pipeline - https://phabricator.wikimedia.org/T190409#4094564 (10Milimetric) [16:11:49] milimetric: correct about the filters - Also, for the thing to display, I needed to enable (then disable) the bubbles [16:32:21] * elukey bbiab [16:34:01] 10Analytics, 10Analytics-Cluster: Requesting account expiration extension - https://phabricator.wikimedia.org/T183291#4094586 (10Nuria) We discourage access for collaborations that are not active, if think that you will be able to collaborate on this two months from now we can maintain access for a few more m... [16:35:12] 10Analytics-Kanban, 10Patch-For-Review: Checklist for geowiki pipeline - https://phabricator.wikimedia.org/T190409#4094587 (10Milimetric) [16:38:20] 10Analytics, 10Analytics-Wikistats, 10Easy, 10Patch-For-Review: [Wikistats2] The detail page for tops and maps metrics does not indicate time range - https://phabricator.wikimedia.org/T182990#4094589 (10sahil505) @Amitjoki No worries please go through with it. Although, I did take a look at your code and I... [16:54:06] (03PS4) 10Nuria: Fixing formatting of dates on time selector [analytics/wikistats2] - 10https://gerrit.wikimedia.org/r/423051 (https://phabricator.wikimedia.org/T191097) [17:00:17] a-team: new eventlogging alarms created [17:01:11] milimetric, joal: Looked at geowiki dashboard in superset.! [17:01:20] milimetric: are we going to include also level of activity? [17:01:47] * elukey off! [17:02:03] milimetric: ah sorry, i see it [17:03:18] milimetric: after we show it to asaf we should send an e-mail to neilpquinn et all [17:04:22] nuria_: I'll do that after I document it, so that people have a little more context, right now it's just a number [17:04:39] so once this task is done 100%: https://phabricator.wikimedia.org/T190409#4093002 [17:04:46] (03CR) 10Milimetric: [C: 032] Prevent screen from bouncing horizontally when swiping left/right [analytics/wikistats2] - 10https://gerrit.wikimedia.org/r/423150 (https://phabricator.wikimedia.org/T190959) (owner: 10Fdans) [17:05:06] (03CR) 10Milimetric: [C: 032] Prevent Wikimedia Statistics header from bolding in certain cases [analytics/wikistats2] - 10https://gerrit.wikimedia.org/r/422925 (https://phabricator.wikimedia.org/T187412) (owner: 10Fdans) [17:05:50] (03CR) 10Milimetric: [C: 032] Repair successfuly sqooped cu_changes [analytics/refinery] - 10https://gerrit.wikimedia.org/r/423019 (https://phabricator.wikimedia.org/T190409) (owner: 10Milimetric) [17:05:53] (03CR) 10Milimetric: [V: 032 C: 032] Repair successfuly sqooped cu_changes [analytics/refinery] - 10https://gerrit.wikimedia.org/r/423019 (https://phabricator.wikimedia.org/T190409) (owner: 10Milimetric) [17:06:12] (03PS2) 10Amitjoki: Add time period for maps and tops metrics [analytics/wikistats2] - 10https://gerrit.wikimedia.org/r/423144 (https://phabricator.wikimedia.org/T182990) [17:06:14] (03CR) 10Milimetric: [V: 032 C: 032] "self-merged this 'cause it already had a +1 for the code" [analytics/refinery] - 10https://gerrit.wikimedia.org/r/423019 (https://phabricator.wikimedia.org/T190409) (owner: 10Milimetric) [17:11:41] 10Analytics, 10Analytics-Wikistats, 10Easy, 10Patch-For-Review: [Wikistats2] The detail page for tops and maps metrics does not indicate time range - https://phabricator.wikimedia.org/T182990#4094636 (10Amitjoki) @sahil505 thanks for the information. I've reduced the code as per your @Nuria suggestions :] [17:38:57] 10Analytics, 10Analytics-Wikistats: Page views and Country name table columns overlapping in the Page Views By Country metric on Dashboard - https://phabricator.wikimedia.org/T191121#4094664 (10sahil505) [17:55:59] (03PS3) 10Nuria: Label map and top metrics with the month they belong to [analytics/wikistats2] - 10https://gerrit.wikimedia.org/r/423144 (https://phabricator.wikimedia.org/T182990) (owner: 10Amitjoki) [17:56:56] 10Analytics, 10Analytics-Wikistats, 10Easy, 10Patch-For-Review: [Wikistats2] The detail page for tops and maps metrics does not indicate time range - https://phabricator.wikimedia.org/T182990#4094709 (10Nuria) I have modified commit message and submitted a patch. Can you add a screenshot to this ticket wi... [17:57:25] 10Analytics, 10Analytics-Wikistats: Page views and Country name table columns overlapping in the Page Views By Country metric on Dashboard - https://phabricator.wikimedia.org/T191121#4094710 (10Nuria) Indeed! [18:09:41] o/ see yall later, I'm out for the weekend, back Monday, and then on vacation for a week [18:16:57] Bye milimetric ! [18:20:56] chelsyx: take a look at editor data per country per level of activity, this is still WIP but i think is mostly what you where talking about the other day: https://superset.wikimedia.org/superset/dashboard/9/?preselect_filters=%7B%7D [18:45:34] 10Analytics, 10Analytics-Wikistats, 10Easy, 10Patch-For-Review: [Wikistats2] The detail page for tops and maps metrics does not indicate time range - https://phabricator.wikimedia.org/T182990#4094727 (10Amitjoki) @Nuria thanks! Here is the screen recording https://drive.google.com/file/d/1obp9JGeBla1wPhoRe... [18:53:14] 10Analytics, 10Analytics-Wikistats, 10Easy, 10Patch-For-Review: [Wikistats2] The detail page for tops and maps metrics does not indicate time range - https://phabricator.wikimedia.org/T182990#4094728 (10Nuria) I see where is the confusion, the legend shoudl not be changed, it will not change per month rath... [19:05:53] 10Analytics, 10Analytics-Wikistats, 10Easy, 10Patch-For-Review: [Wikistats2] The detail page for tops and maps metrics does not indicate time range - https://phabricator.wikimedia.org/T182990#4094738 (10sahil505) @Amitjoki Maybe we can find a better placement for displaying the month in top metric table. D... [19:07:08] 10Analytics, 10Analytics-Wikistats: Page views and Country name table columns overlapping in the Page Views By Country metric on Dashboard - https://phabricator.wikimedia.org/T191121#4094739 (10sahil505) a:03sahil505 [19:09:41] (03PS26) 10Joal: Upgrade scala to 2.11.7 and Spark to 2.2.1 [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/348207 [19:09:44] (03PS10) 10Joal: Add by-wiki stats to MediawikiHistory job [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/415255 (https://phabricator.wikimedia.org/T155507) [19:09:46] (03PS9) 10Joal: Update mediawiki-history spark job for performance [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/419516 (https://phabricator.wikimedia.org/T189449) [19:11:45] 10Analytics, 10Analytics-Wikistats, 10Easy, 10Patch-For-Review: [Wikistats2] The detail page for tops and maps metrics does not indicate time range - https://phabricator.wikimedia.org/T182990#4094740 (10Nuria) {F16481179} [19:19:30] (03PS27) 10Joal: Upgrade scala to 2.11.7 and Spark to 2.2.1 [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/348207 [19:20:05] (03PS11) 10Joal: Add by-wiki stats to MediawikiHistory job [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/415255 (https://phabricator.wikimedia.org/T155507) [19:20:07] (03PS10) 10Joal: Update mediawiki-history spark job for performance [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/419516 (https://phabricator.wikimedia.org/T189449) [19:45:57] (03PS1) 10Sahil505: Solved overlapping issue in the Page Views By Country metric on Dashboard [analytics/wikistats2] - 10https://gerrit.wikimedia.org/r/423172 (https://phabricator.wikimedia.org/T191121) [19:48:03] nuria_: This looks great! I think what Jon want is something similar but for pageviews and unique devices, also UDdaily/UDmonthly [19:50:07] (03CR) 10Sahil505: "This bug can be taken care of in multiple ways, one is this which decreases the `.widget.list .label` width because it was overlapping wit" [analytics/wikistats2] - 10https://gerrit.wikimedia.org/r/423172 (https://phabricator.wikimedia.org/T191121) (owner: 10Sahil505) [20:08:17] (03PS11) 10Joal: Update mediawiki-history spark job for performance [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/419516 (https://phabricator.wikimedia.org/T189449) [20:10:37] (03PS1) 10Mrcornacchio: Fix stylelint errors and TopicExplorer placeholder contrast [analytics/wikistats2] - 10https://gerrit.wikimedia.org/r/423176 (https://phabricator.wikimedia.org/T185533) [20:23:03] (03Abandoned) 10Mrcornacchio: Change TopicExplorer placeholder contrast to WCAG AA compliance [analytics/wikistats2] - 10https://gerrit.wikimedia.org/r/419962 (https://phabricator.wikimedia.org/T185533) (owner: 10Mrcornacchio) [21:30:41] chelsyx: you can get that done with these now , no? https://superset.wikimedia.org/superset/dashboard/7/?preselect_filters=%7B%7D [21:31:04] chelsyx: modifying those slices, no? since data is in druid, you do not need to ingest it again [22:56:07] (03PS2) 10Nuria: Add wikidata tag [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/423064 (https://phabricator.wikimedia.org/T191022) [22:56:32] (03PS3) 10Nuria: Add wikidata tag to webrequest refine process [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/423064 (https://phabricator.wikimedia.org/T191022) [22:59:12] 10Analytics-Kanban, 10Analytics-Wikistats: When displaying a graph include metric total not only average - https://phabricator.wikimedia.org/T184139#4094902 (10Nuria) [23:00:35] 10Analytics-Kanban, 10Analytics-Wikistats: When displaying a graph include metric total not only average - https://phabricator.wikimedia.org/T184139#3873650 (10Nuria) >But do you think it should show both total and average in the additive metric cases? I think so, cause it is likely that users want a summary o... [23:08:21] 10Analytics-Kanban, 10Analytics-Wikistats: When displaying a graph include metric total not only average - https://phabricator.wikimedia.org/T184139#4094904 (10Nuria)