[00:11:01] 10Analytics-Kanban, 10Analytics-Wikistats: Wikistats 2.0: add filters on the "Top edited pages" view - https://phabricator.wikimedia.org/T205770 (10Nuria) Ssorry I was not more specific. Filters to be developed on UI will work for both metrics because the filters already exist at the API level, see for examp... [00:12:18] 10Analytics: Percentage range should be removed from"all" time range on wikistats UI - https://phabricator.wikimedia.org/T205809 (10Nuria) [07:18:44] hello people, physioteraphy done, now I need to go to the vet and then I'll be ready :) [07:21:19] Hi elukey - no worries :) [08:00:19] back :) [08:28:43] 10Analytics, 10Operations, 10ops-eqiad, 10Patch-For-Review: setup/install an-coord1001/wmf7621 - https://phabricator.wikimedia.org/T204970 (10ops-monitoring-bot) Script wmf-auto-reimage was launched by elukey on neodymium.eqiad.wmnet for hosts: ``` an-coord1001.eqiad.wmnet ``` The log can be found in `/var... [08:50:36] I am trying to install the os on an-coord1001 but it seems not collaborating :D [08:55:11] 10Analytics, 10Operations, 10ops-eqiad, 10Patch-For-Review: setup/install an-coord1001/wmf7621 - https://phabricator.wikimedia.org/T204970 (10ops-monitoring-bot) Completed auto-reimage of hosts: ``` ['an-coord1001.eqiad.wmnet'] ``` Of which those **FAILED**: ``` ['an-coord1001.eqiad.wmnet'] ``` [08:55:46] 10Analytics, 10Operations, 10ops-eqiad, 10Patch-For-Review: setup/install an-coord1001/wmf7621 - https://phabricator.wikimedia.org/T204970 (10elukey) So attempting to install the OS leads to: ``` iDRAC Settings: CBL0009: Backplane 1 connector A0 is not connected. CBL0009: Backplane 1 connector B0 is not c... [09:03:30] nope need to wait for Chris [10:54:24] 10Analytics, 10WMDE-Analytics-Engineering: /srv/published-datasets does not get published from stat1004 - https://phabricator.wikimedia.org/T205839 (10GoranSMilovanovic) [11:12:46] 10Analytics, 10WMDE-Analytics-Engineering: /srv/published-datasets does not get published from stat1004 - https://phabricator.wikimedia.org/T205839 (10elukey) Hi Goran, can you give us an example? On stat1004 I can see: ``` elukey@stat1004:~$ ls -l /srv/published-datasets/ total 12 drwxrwxr-x 2 smalyshev wiki... [11:32:46] 10Analytics, 10WMDE-Analytics-Engineering: /srv/published-datasets does not get published from stat1004 - https://phabricator.wikimedia.org/T205839 (10GoranSMilovanovic) @elukey Interesting. Because from https://analytics.wikimedia.org/datasets/ one does not see this directory (https://analytics.wikimedia.org/... [11:59:33] joal: we don't have values yet for september in top editors, is this normal? we might have to change stuff in the ui if that's the case [12:00:44] 10Analytics, 10WMDE-Analytics-Engineering: /srv/published-datasets does not get published from stat1004 - https://phabricator.wikimedia.org/T205839 (10elukey) So as far as I know this is the default directory listing that httpd/apache offers, namely you see the first level of directories under the directory th... [12:04:38] 10Analytics: Move users from stat1005 to stat1007 - https://phabricator.wikimedia.org/T205846 (10elukey) p:05Triage>03Normal [12:05:07] Hi fdans :) [12:05:33] fdans: september data will be indexed in druid around the 10th [12:06:22] joal: I seeee... this is later than the rest of the editing metrics right? :) [12:06:26] fdans: Sqoop starts the 5th and takes ~2 days, then mediawiki-history, then reduced --> best case the 8th [12:06:38] fdans: same [12:06:47] ah wait, no, we're showing august in the rest of editing metrics [12:07:11] there's a bit of date logic that we're not applying to the new endpoints [12:07:16] Ahhh [12:08:02] fdans: even if we try to streamline as much as we can, data will still not be present before the 3rd/4th best case [12:08:42] joal: yes yes totally :) I just need to locate what it is that dictates the amount of time to go back [12:08:51] (I did that iirc) [12:09:48] k :) [12:24:24] 10Analytics, 10WMDE-Analytics-Engineering: /srv/published-datasets does not get published from stat1004 - https://phabricator.wikimedia.org/T205839 (10GoranSMilovanovic) @elukey I have conducted a small experiment. - From **stat1005**: after running the data production code, `cp /home/goransm/RScripts/Wikidat... [12:25:27] 10Analytics, 10WMDE-Analytics-Engineering: /srv/published-datasets does not get published from stat1004 - https://phabricator.wikimedia.org/T205839 (10GoranSMilovanovic) @elukey Still experimenting to compare the mapping from stat1004 and stat1004 onto https://analytics.wikimedia.org/datasets/. [12:33:48] 10Analytics, 10WMDE-Analytics-Engineering: /srv/published-datasets does not get published from stat1004 - https://phabricator.wikimedia.org/T205839 (10elukey) Please also note that the data is not synced instantly, but there is a cron that runs every 15 mins. [12:43:10] 10Analytics, 10Analytics-Kanban: Wikistats UI: Top editors and top pages by edits are asking for data that is not yet available - https://phabricator.wikimedia.org/T205848 (10fdans) [12:43:47] 10Analytics, 10Analytics-Kanban: Wikistats UI: Top editors and top pages by edits are asking for data that is not yet available - https://phabricator.wikimedia.org/T205848 (10fdans) p:05Triage>03Unbreak! [12:51:59] (03PS1) 10Fdans: Add a property in some metrics to wait for available data [analytics/wikistats2] - 10https://gerrit.wikimedia.org/r/463743 (https://phabricator.wikimedia.org/T205848) [12:52:28] 10Analytics-Kanban, 10User-Elukey: Upgrade Analytics infrastructure to Debian Stretch - https://phabricator.wikimedia.org/T192642 (10elukey) [12:53:54] milimetric mforns nuria if any of yall are available I [12:54:08] I'd like to merge and deploy this asap: https://gerrit.wikimedia.org/r/#/c/analytics/wikistats2/+/463743/ [12:55:02] (03CR) 10jerkins-bot: [V: 04-1] Add a property in some metrics to wait for available data [analytics/wikistats2] - 10https://gerrit.wikimedia.org/r/463743 (https://phabricator.wikimedia.org/T205848) (owner: 10Fdans) [12:56:27] !log reverting to last version of wikistats [12:56:30] Logged the message at https://www.mediawiki.org/wiki/Analytics/Server_Admin_Log [12:57:33] (03PS1) 10Fdans: Revert "Release 2.4.1" due to problem with editing top metrics [analytics/wikistats2] - 10https://gerrit.wikimedia.org/r/463744 [12:57:42] (03CR) 10Fdans: [V: 032 C: 032] Revert "Release 2.4.1" due to problem with editing top metrics [analytics/wikistats2] - 10https://gerrit.wikimedia.org/r/463744 (owner: 10Fdans) [12:58:51] (03PS2) 10Fdans: Add a property in some metrics to wait for available data [analytics/wikistats2] - 10https://gerrit.wikimedia.org/r/463743 (https://phabricator.wikimedia.org/T205848) [13:03:48] mforns: helloooooo can you take a look at this? https://gerrit.wikimedia.org/r/463743 [13:03:58] fdans, hheeeeya [13:04:03] lookin [13:04:13] mforns: it's a hooooootfix [13:04:28] I reverted 2.4.1 some minutes ago [13:04:41] 10Analytics, 10Analytics-EventLogging, 10Analytics-Kanban, 10EventBus, and 3 others: Modern Event Platform (TEC2) - https://phabricator.wikimedia.org/T185233 (10phuedx) >>! In T185233#4626980, @Tgr wrote: > * Largish events (due to stack traces) - not huge but well over the current GET size limit. > * Even... [13:05:47] 10Analytics, 10WMDE-Analytics-Engineering: /srv/published-datasets does not get published from stat1004 - https://phabricator.wikimedia.org/T205839 (10GoranSMilovanovic) @elukey Done - it's probably the sync period that has caused the confusion. Thanks a lot! [13:05:52] 10Analytics, 10WMDE-Analytics-Engineering: /srv/published-datasets does not get published from stat1004 - https://phabricator.wikimedia.org/T205839 (10GoranSMilovanovic) 05Open>03Resolved a:03GoranSMilovanovic [13:09:26] fdans, oh so, the top editors metric will be removed from production? [13:09:41] mforns: right now it is removed from production [13:09:52] mforns: this change fixes them and we can redeploy [13:09:59] fdans, right, I had a cached version [13:10:19] fdans, what happens with availabilityBuffer=15? [13:10:36] it only updates the month at the day 15th of the next month? [13:11:11] it's the number of days the UI should wait before data becomes available [13:11:33] mforns: which until now wasn't a problem because we only had timeseries metrics [13:11:43] aha [13:12:09] so we could just ask for [20161001-20181001] and we would get all data that is available [13:12:16] mforns: but this is not ok with top metrics [13:12:29] aha [13:12:31] all top metrics we've had so far were pageviews, so we had the data pretty much immediately [13:12:36] I see [13:13:11] fdans, but does this mean that even when there's data, we'll have to wait 15 days to see the last month? [13:13:48] mforns: for that metric, yes [13:13:52] but we can adjust [13:13:53] I see [13:14:02] ok [13:14:16] i think it's a better approach than requesting several times to get last data available, which was the other option [13:15:44] (03CR) 10Mforns: "See 1 comment, I think it's a typo." (031 comment) [analytics/wikistats2] - 10https://gerrit.wikimedia.org/r/463743 (https://phabricator.wikimedia.org/T205848) (owner: 10Fdans) [13:16:18] understand [13:16:51] fdans, see I think there's a typo [13:17:15] fdans, but apart from that, I think we can merge to fix prod. [13:17:37] fdans, we can talk in Standup whether we need a better solution [13:17:44] no? [13:18:11] (03PS3) 10Fdans: Add a property in some metrics to wait for available data [analytics/wikistats2] - 10https://gerrit.wikimedia.org/r/463743 (https://phabricator.wikimedia.org/T205848) [13:18:24] (03CR) 10Fdans: Add a property in some metrics to wait for available data (031 comment) [analytics/wikistats2] - 10https://gerrit.wikimedia.org/r/463743 (https://phabricator.wikimedia.org/T205848) (owner: 10Fdans) [13:19:33] mforns: yep, I think the final solution goes more inline with defining relative time ranges per metric, but I think that should go bundled with redoing the timerange selector [13:19:34] fdans, I'm going to merge, you tested right? [13:19:44] mforns: yeah, just tested :) [13:19:49] thank you for the CR [13:19:49] k! [13:20:20] (03CR) 10Mforns: [V: 032 C: 032] "LGTM as a Hotfix!" [analytics/wikistats2] - 10https://gerrit.wikimedia.org/r/463743 (https://phabricator.wikimedia.org/T205848) (owner: 10Fdans) [13:21:11] no prob :] be back in a couple minutes [13:22:20] fdans: we can talk about long-term fixes when mforns is back, no need to wait for standup [13:22:39] (03PS1) 10Fdans: Release 2.4.2 [analytics/wikistats2] - 10https://gerrit.wikimedia.org/r/463754 [13:22:58] milimetric: meeting my wife for lunch now, will be back in about 45min [13:23:01] joal: what do you think about extending AQS to allow cohort-based queries, like the ones that wikimetrics uses but for limited cohorts [13:23:22] Hi milimetric [13:23:24] fdans: oh, that's fine, just saying if you have time before standup [13:23:31] (03CR) 10Fdans: [V: 032 C: 032] Release 2.4.2 [analytics/wikistats2] - 10https://gerrit.wikimedia.org/r/463754 (owner: 10Fdans) [13:23:34] milimetric: I really think this would be great :) [13:23:37] !!! [13:23:43] ok, let's chat about it? you got time? [13:23:48] I do :) [13:39:49] baaack [14:15:38] (03CR) 10Milimetric: [C: 032] Move pages-to-date to "content" frrom "contributing" category [analytics/wikistats2] - 10https://gerrit.wikimedia.org/r/463574 (owner: 10Nuria) [14:18:27] (03Merged) 10jenkins-bot: Move pages-to-date to "content" frrom "contributing" category [analytics/wikistats2] - 10https://gerrit.wikimedia.org/r/463574 (owner: 10Nuria) [14:48:11] 10Analytics, 10MediaWiki-API, 10Patch-For-Review, 10User-Addshore: Run ETL for wmf_raw.ActionApi into wmf.action_* aggregate tables - https://phabricator.wikimedia.org/T137321 (10Milimetric) p:05Normal>03Unbreak! [14:48:19] 10Analytics, 10MediaWiki-API, 10Patch-For-Review, 10User-Addshore: Run ETL for wmf_raw.ActionApi into wmf.action_* aggregate tables - https://phabricator.wikimedia.org/T137321 (10Milimetric) p:05Unbreak!>03Normal [14:54:23] 10Analytics, 10Contributors-Analysis, 10Product-Analytics: Streamline Superset signup and authentication - https://phabricator.wikimedia.org/T203132 (10Milimetric) hm, seems like maybe we could monkey patch the registration python to infer <>@wikimedia.org for email. Also kind of hacky [14:58:44] fdans: let's talk about the changeset you did for tops metrics after standup [15:00:29] fdans, mforns : I think we need a different strategy [15:00:44] standuuuup? [15:01:00] team, google 2FA! sorry... [15:53:54] 10Analytics, 10Analytics-EventLogging: Resurrect eventlogging_EventError logging to in logstash - https://phabricator.wikimedia.org/T205437 (10fdans) p:05Triage>03High [15:56:27] 10Analytics, 10Analytics-EventLogging: Increase number of partitions of eventlogging-client-side topic in Kafka jumbo-eqiad - https://phabricator.wikimedia.org/T205436 (10fdans) p:05Triage>03Normal [15:58:22] 10Analytics, 10Analytics-Kanban: Replace the Analytics Hadoop coordinator - Hive/Oozie/etc... (hardware refresh) - https://phabricator.wikimedia.org/T205509 (10fdans) [15:59:50] 10Analytics, 10Analytics-Kanban, 10Patch-For-Review: Wikistats UI: Top editors and top pages by edits are asking for data that is not yet available - https://phabricator.wikimedia.org/T205848 (10fdans) 05Open>03Resolved [16:00:22] 10Analytics, 10Analytics-Kanban: Ingest data into druid for readingDepth schema - https://phabricator.wikimedia.org/T205562 (10fdans) p:05Triage>03Normal [16:12:34] elukey: alert on piwik - Can we help? [16:12:45] 10Analytics, 10Analytics-Kanban: Add ability to bucketize integers as part of event ingestion - https://phabricator.wikimedia.org/T205641 (10fdans) p:05Triage>03Normal [16:13:18] 10Analytics, 10Analytics-Kanban: Change dashboard order in wikistats - https://phabricator.wikimedia.org/T205555 (10fdans) 05Open>03Resolved [16:13:38] 10Analytics, 10Analytics-Kanban: Change dashboard order in wikistats - https://phabricator.wikimedia.org/T205555 (10fdans) p:05Triage>03Normal [16:14:37] joal: nono it is matomo1001, new host [16:14:38] no issue [16:14:39] thanks :) [16:14:46] ah - ok :) [16:14:47] 10Analytics, 10Analytics-Kanban: Remove sessionId, pageId pairs from whitelist - https://phabricator.wikimedia.org/T205458 (10fdans) p:05Triage>03Normal [16:20:28] 10Analytics: Allow "scoped" EventLogging sanitization hashes - https://phabricator.wikimedia.org/T205331 (10fdans) p:05Triage>03Normal [16:23:21] 10Analytics: Percentage range should be removed from"all" time range on wikistats UI - https://phabricator.wikimedia.org/T205809 (10fdans) a:03Nuria [16:24:50] 10Analytics: Percentage range should be removed from"all" time range on wikistats UI - https://phabricator.wikimedia.org/T205809 (10fdans) p:05Triage>03High [16:26:45] 10Analytics, 10Analytics-Kanban: Add ability to filter "top contributors" metric for bot and editors - https://phabricator.wikimedia.org/T205725 (10fdans) [16:26:48] 10Analytics, 10Analytics-Wikistats: Wikistats 2.0: add filters on the "Top editors" view - https://phabricator.wikimedia.org/T205769 (10fdans) [16:27:14] 10Analytics, 10Analytics-Kanban: Add ability to filter top metrics - https://phabricator.wikimedia.org/T205725 (10fdans) [16:27:36] 10Analytics, 10Analytics-Kanban, 10Patch-For-Review: Move pages to date to "content" frrom "contributing" category on wikistats UI - https://phabricator.wikimedia.org/T205752 (10fdans) p:05Triage>03Normal [16:28:03] 10Analytics, 10Analytics-Kanban: Add ability to filter top metrics - https://phabricator.wikimedia.org/T205725 (10fdans) p:05Triage>03High [16:29:35] 10Analytics: Escape end-of-line or other special characters from pageview-dumps generation - https://phabricator.wikimedia.org/T205620 (10fdans) p:05Triage>03Normal [16:32:19] 10Analytics: Update datasets to have explicit timestamp for druid indexation facilitation - https://phabricator.wikimedia.org/T205617 (10fdans) p:05Triage>03High [16:32:32] 10Analytics, 10Analytics-Kanban: Update datasets to have explicit timestamp for druid indexation facilitation - https://phabricator.wikimedia.org/T205617 (10fdans) [16:44:31] 10Analytics, 10MediaWiki-Authentication-and-authorization, 10Core Platform Team Kanban (Watching / External): Clear site data on MediaWiki log out - https://phabricator.wikimedia.org/T179752 (10CCicalese_WMF) [16:51:52] 10Analytics, 10EventBus, 10WMF-JobQueue, 10Services (later), 10Wikimedia-Incident: ChangeProp logging KafkaConsumer is not connected - https://phabricator.wikimedia.org/T199444 (10Pchelolo) [17:02:03] joal: you wanted to talk? [17:02:34] joal: if you want, I can create that task, after I make lunch [17:02:35] lemme know [17:02:36] o/ [17:31:03] hey all, just wanted to give you a heads up that we're turning on the page issues a/b test today (https://phabricator.wikimedia.org/T200792). we're going up to 10% today and increasing to 20% by tomorrow morning (cc HaeB) [17:33:45] (i'm gonna start this with 2 swats today - 1 to 5% and then to 10%) [17:34:05] want to make sure the events per second is as expected and not seeing any errors [17:35:30] to add detail: the main impact on EL should be that the event rate for the PageIssues schema increases (to very roughly 0.2 * mobile pageviews rate * sample rate) [17:38:22] ..i.e. 2% of mobile pageviews today [17:38:38] Thanks for the heads up olliv, jdlrobson and HaeB :) We're going to monitor as well :) [17:39:16] milimetric: Let me know when you're done eating, we can discuss the taks if you want (but I think you understand it better than I do actually :) [17:46:56] Nettrom: Hello - Just a ping to let you know that blocks history should be queryable in mediawiki-history dataset :) [17:48:37] joal: ah, thanks! I'll make a note to not forget that, it will come in handy :) [17:49:11] Nettrom: for blocks only mediawiki_user_history is a lot smaller - For blocks + edits mediawiki-history :) [17:49:55] Nettrom: I guessed so from the email in the research list :) [17:52:04] joal: you guessed absolutely right, thanks for reaching out, I might've forgotten otherwise :) [17:55:48] nuria: the cronspam is from matomo1001, feel free to discard it sorry [17:56:08] * elukey off! [17:56:15] elukey: it totally says: matomo1001 [17:56:26] * nuria not reading [17:56:33] well that is [17:57:47] too many things cronspamming when first booted :( [17:57:58] but this might be a good canditate for a systemd timer! [17:58:01] * elukey adds to his notes [17:58:16] o/ [18:11:30] joal: ok, no worries, I'll add the task and cc you [18:24:29] So i'm seeing 15 events per second for 5% sampling rate for the PageIssues schema [18:24:42] 20% is the proposal so we can probably expect 60 events per second [18:25:15] little to no impact on the ReadingDepth schema traffic [18:25:22] cc HaeB [18:25:45] jdlrobson: barely noticeable in comparsion to high-traffic schemas [18:26:01] 10Analytics, 10Product-Analytics: Move page creation queries to Hive - https://phabricator.wikimedia.org/T205654 (10Niharika) [18:26:21] joal: yeh. Should I just jump from 5% to 20%? It feels safe to me. [18:26:28] i was gonna to 5 to 10 to 20 [18:27:11] jdlrobson: works for me :) [18:38:35] at 40 right now [18:49:58] 10Analytics, 10Analytics-EventLogging, 10Wikipedia-iOS-App-Backlog: MobileWikiAppiOSSearch validation errors adding noise to EventLogging error - https://phabricator.wikimedia.org/T205910 (10Jdlrobson) [18:51:03] kafkacat -C -b kafka-jumbo1001.eqiad.wmnet -t eventlogging_EventError | grep PageIssues running clean [18:51:16] and just under 60 events per second [18:51:17] w00t [19:12:03] 10Analytics-Kanban, 10Analytics-Wikistats: Top metrics. Implement failsafe mechanism for when current month computations are not available - https://phabricator.wikimedia.org/T205915 (10Nuria) [19:30:15] joal: did Marko ping you that your patch should be life (this time I'm pretty sure we did the right thing) [19:30:43] Hi Pchelolo - Yessir, patch went live on the friday :) [19:32:31] ok good. getting back from sick days and missing a lot of context [19:33:00] No prob Pchelolo - Hope you're better :) [19:33:10] oh so much better [19:33:13] thank you [19:33:22] :) [19:45:51] 10Analytics, 10EventBus, 10Product-Analytics, 10MW-1.32-notes (WMF-deploy-2018-08-21 (1.32.0-wmf.18)), and 2 others: Load change tags into the Analytics Data Lake on a daily basis - https://phabricator.wikimedia.org/T201062 (10Neil_P._Quinn_WMF) 05Open>03Resolved This data has been accumulating success... [19:51:15] 10Analytics, 10Analytics-Kanban: heirloom-mailx fails trying to send out email from SWAP notebook - https://phabricator.wikimedia.org/T168103 (10Tbayer) >>! In T168103#4610975, @Ottomata wrote: > Ah, sorry, I responded to hastily. The problem is from inside a Jupyter notebook. I'm a bit stumped at the moment... [21:55:13] 10Analytics, 10Analytics-EventLogging, 10Analytics-Kanban: Deprecation Information for EventLogging ResourceLoader modules - https://phabricator.wikimedia.org/T205744 (10Milimetric) [21:56:38] milimetric: I am going to deploy wikimetrics to get the fix for "pages to date" being on "contributing", let me know if you have any issues [21:57:41] wikistats? [21:57:41] :) [21:58:01] nuria: don't see any risk, go ahead [21:59:55] 10Analytics, 10Analytics-EventLogging, 10Analytics-Kanban: Deprecation Information for EventLogging ResourceLoader modules - https://phabricator.wikimedia.org/T205744 (10Milimetric) [22:04:37] (03PS1) 10Nuria: Wikistats release 2.4.3 [analytics/wikistats2] - 10https://gerrit.wikimedia.org/r/463859 [22:05:06] milimetric: Please see: https://gerrit.wikimedia.org/r/#/c/analytics/wikistats2/+/463859/ [22:06:10] (03CR) 10Milimetric: [C: 032] Wikistats release 2.4.3 [analytics/wikistats2] - 10https://gerrit.wikimedia.org/r/463859 (owner: 10Nuria) [22:10:41] (03Merged) 10jenkins-bot: Wikistats release 2.4.3 [analytics/wikistats2] - 10https://gerrit.wikimedia.org/r/463859 (owner: 10Nuria) [22:11:26] milimetric: i have added the anotations we had for pageviews in dashiki to wikistats: [22:11:40] https://meta.wikimedia.org/wiki/Config:Dashiki:Annotations/Wikistats/totalPageViews [22:14:34] milimetric: i think what we are missing on anotation requests is to add the parameter to the api that determines cache expires , makes sense? [22:16:54] nuria: yeah, that'd be good! maybe I should just use mediawiki-storage at this point [22:17:11] donno why I talked myself into not using it [22:17:16] milimetric: the cache thingy is supported by api itself [22:17:16] I'll make a task [22:17:21] I know, yea [22:17:27] you add it to the url (very nifty) [22:17:47] milimetric: let me remember how it went, cause otherwise, when will annotations take effect once entered? [22:18:31] 10Analytics, 10Analytics-Kanban: Add caching to wikistats 2 annotations request - https://phabricator.wikimedia.org/T205933 (10Milimetric) [22:18:37] 10Analytics, 10Analytics-Kanban: Add caching to wikistats 2 annotations request - https://phabricator.wikimedia.org/T205933 (10Milimetric) p:05Triage>03High [22:20:15] nuria: oh, they're being fetched but they don't have a date property: https://wikitech.wikimedia.org/wiki/Analytics/Systems/Dashiki/Configuration [22:21:32] milimetric: ah my fault, totally assumed format will be the same, one sec [22:23:15] nuria: the change I'm making to the Dashiki extension will link to that docs page, but it's not going to be live for a week or so [22:23:47] milimetric: ya, understood [22:24:01] perhaps I should've handled the start/end format too :( [22:24:09] (add a task if you think that's the case) [22:24:32] milimetric: does this look good: https://meta.wikimedia.org/wiki/Config:Dashiki:Annotations/Wikistats/totalPageViews [22:25:30] looks good yea, and it's working, just gotta look at all-time: https://stats.wikimedia.org/v2/#/all-projects/reading/total-page-views/normal|bar|All|~total [22:25:51] milimetric: i will add this example to docs [22:26:02] yeah, example would be useful [22:27:07] also, would be nice to extend the width, that first annotation from the left looks pretty bad [22:27:46] hm, there's also an error, I might look more into that tomorrow [22:29:02] milimetric: in the console? i do not see any [22:30:01] milimetric: just changed your doc page pointing to the page i just created [22:41:26] 10Analytics-Kanban, 10Analytics-Wikistats: Top metrics. Implement failsafe mechanism for when current month computations are not available - https://phabricator.wikimedia.org/T205915 (10Nuria) [22:41:44] 10Analytics-Kanban, 10Analytics-Wikistats: Top metrics. Implement failsafe mechanism for when current month computations are not available - https://phabricator.wikimedia.org/T205915 (10Nuria) [22:43:46] milimetric: just purged entry, pages-to-date change deployed: https://stats.wikimedia.org/v2/#/all-projects/content/pages-to-date/normal|line|All|~total [22:50:11] 10Analytics, 10Analytics-Kanban, 10Analytics-Wikistats, 10Patch-For-Review: Create report for "articles with most contributors" in Wikistats2 - https://phabricator.wikimedia.org/T204965 (10Nuria) 05Open>03Resolved [22:50:13] 10Analytics, 10Analytics-Kanban, 10Analytics-Wikistats, 10Patch-For-Review: Create reports in wikistats UI for "most prolific editors" (a.k.a "top contributors") - https://phabricator.wikimedia.org/T189882 (10Nuria) [22:52:52] 10Analytics, 10Analytics-Wikistats, 10Patch-For-Review: Wikistats 2.0: allow to view stats for all language versions (a.k.a. Project families) - https://phabricator.wikimedia.org/T188550 (10Nuria) [22:52:56] 10Analytics, 10Analytics-Kanban, 10Analytics-Wikistats, 10Patch-For-Review: Add project-families to AQS for additive-metrics - https://phabricator.wikimedia.org/T203258 (10Nuria) 05Open>03Resolved [22:54:31] 10Analytics-Kanban: Correct end point documentation about parameter specification on AQS api docs - https://phabricator.wikimedia.org/T203403 (10Nuria) 05Open>03Resolved [22:54:59] 10Analytics, 10Analytics-Wikistats: Beta Release: Wikistats: support annotations in graphs - https://phabricator.wikimedia.org/T178015 (10Nuria) [22:55:03] 10Analytics, 10Analytics-Kanban, 10Analytics-Wikistats, 10Patch-For-Review: Render annotations on all Wikistats charts - https://phabricator.wikimedia.org/T194705 (10Nuria) 05Open>03Resolved [22:59:38] 10Analytics, 10WMDE-Analytics-Engineering, 10Wikidata, 10User-Addshore: Investigate June Unique devices increase of 170% for wikidata - https://phabricator.wikimedia.org/T199517 (10Nuria) Added annotation for this event to wikidata unique devices data on wikistats: http://localhost:5000/dist/#/wikidata.org... [23:00:10] milimetric: look how nice : http://localhost:5000/dist/#/wikidata.org/reading/unique-devices/normal|line|All|~total [23:00:32] milimetric: bust cache to see annotations [23:07:55] :) yeah, I should mess with these more now that we have real examples [23:53:21] 10Analytics: Provide edit tags in the Data Lake edit data - https://phabricator.wikimedia.org/T161149 (10Neil_P._Quinn_WMF) [23:53:23] 10Analytics, 10Analytics-Cluster, 10Contributors-Analysis, 10Product-Analytics: Add change tag tables to monthly mediawiki_history sqoop - https://phabricator.wikimedia.org/T205940 (10Neil_P._Quinn_WMF) [23:56:24] 10Analytics, 10Analytics-Cluster, 10Contributors-Analysis, 10Product-Analytics: Add change tag tables to monthly mediawiki_history sqoop - https://phabricator.wikimedia.org/T205940 (10Nuria) a:05Neil_P._Quinn_WMF>03Milimetric [23:56:37] 10Analytics, 10Analytics-Cluster, 10Analytics-Kanban, 10Contributors-Analysis, 10Product-Analytics: Add change tag tables to monthly mediawiki_history sqoop - https://phabricator.wikimedia.org/T205940 (10Nuria) [23:56:45] 10Analytics, 10Analytics-EventLogging, 10EventBus, 10Core Platform Team Goals (Event Intake Service (TEC2)), and 2 others: Modern Event Platform: Stream Configuration Service - https://phabricator.wikimedia.org/T205319 (10CCicalese_WMF) [23:57:22] 10Analytics, 10Analytics-EventLogging, 10Analytics-Kanban, 10EventBus, and 3 others: Modern Event Platform (TEC2) - https://phabricator.wikimedia.org/T185233 (10CCicalese_WMF)