[01:24:09] 10Analytics, 10User-Elukey: Upgrade Druid to its latest upstream version (currently 0.17.1) - https://phabricator.wikimedia.org/T244482 (10Milimetric) [01:34:28] (03CR) 10Milimetric: [C: 03+1] "Looks like all the pieces are here, will merge when I hear that it's been tested (which will probably be after the next deploy)" [analytics/refinery] - 10https://gerrit.wikimedia.org/r/582638 (https://phabricator.wikimedia.org/T248289) (owner: 10Lex Nasser) [01:51:28] 10Analytics, 10Analytics-Kanban, 10Research: Proposed adjustment to wmf.wikidata_item_page_link to better handle page moves - https://phabricator.wikimedia.org/T249773 (10Milimetric) I've never seen an example like Jabuticaba, I'll have to look into that! I know there are lots of outliers where page titles... [03:26:52] 10Analytics: Unique devices, retrofit with bot detection code - https://phabricator.wikimedia.org/T250744 (10Nuria) [06:28:07] 10Analytics: Check home/HDFS leftovers of anomie - https://phabricator.wikimedia.org/T250167 (10elukey) @WDoranWMF Hi! Adding you to the task, would you be able to help? Otherwise, is there anybody else that I can contact? [06:30:19] 10Analytics, 10Analytics-Cluster: Hue doesn't show executor details - https://phabricator.wikimedia.org/T246724 (10elukey) ping @awight :) [06:50:50] gooood morning [06:50:57] I am checking the issue with banner impression monthly [06:51:09] after re-running all the failed jobs, February seems to be running [06:51:18] the others are missing various daily success flags [06:51:23] now March tells me [06:51:33] Missing hdfs://analytics-hadoop/wmf/data/wmf/banner_activity/daily/year=2020/month=5/day=19/_SUCCESS [06:51:48] that is very weird, May 19th? [06:52:28] in all the months, except february, there seems to be one day like that [06:53:30] ahh "Wait 79 days to sanitize data " [06:56:57] January is waiting for a lot of success flags [06:56:59] elukey@stat1004:~$ ls /mnt/hdfs/wmf/data/wmf/banner_activity/daily/year=2020/month=1 [06:57:02] day=22 day=23 day=24 day=25 day=26 day=27 day=28 day=29 day=30 day=31 [06:57:05] and it makes sense [07:07:08] 10Analytics, 10Performance-Team, 10Vue.js: Revise schema and performance dashboards for Vue.js search - https://phabricator.wikimedia.org/T250336 (10Peter) > @Peter, do you think the user journey adequately covers the baseline characterization? I am pinging my team to see who's interested and will reach out... [07:08:21] I am wondering what is the thing that removes the _SUCCESS flag from hdfs, if any [07:19:44] interesting, I checked the segments in druid and indeed 12/2019 and 01/2020 are still daily [07:20:57] so to unblock this mess, I'd temporarily create _SUCCESS flags on hdfs for 12/2019 and 01/2010 (the missing ones) [07:21:12] to allow oozie monthly to aggregate the segments in druid [08:47:35] * elukey afk for a bit [08:53:14] 10Analytics, 10WMDE-New-Editors-Banner-Campaigns (Banner campaign occasional editors 2020): User ID not in event data capsule - https://phabricator.wikimedia.org/T250782 (10kai.nissen) [09:08:12] (03PS1) 10Gilles: Retain broad context for CPU benchmark [analytics/refinery] - 10https://gerrit.wikimedia.org/r/591307 [10:08:10] 10Analytics, 10Performance-Team, 10Vue.js: Revise schema and performance dashboards for Vue.js search - https://phabricator.wikimedia.org/T250336 (10Gilles) @Niedzielski does it mean that vue.js + all the newly introduced JS will be downloaded for all article pageviews on those wikis that will get the experi... [10:10:35] 10Analytics, 10WMDE-New-Editors-Banner-Campaigns (Banner campaign occasional editors 2020): User ID not in event data capsule - https://phabricator.wikimedia.org/T250782 (10kai.nissen) [10:47:38] this issue with banner job is very weird - let's sync on that when you're back elukey [10:49:43] in a meeting but brb [11:06:53] joal: ok I am free! (if you are) [11:06:58] yes elukey [11:08:51] elukey: I don't understand how the flags where missing for so many folders :( [11:09:00] joal: bc? [11:09:04] sureelu [11:16:25] 10Analytics, 10Analytics-Cluster: Hue doesn't show executor details - https://phabricator.wikimedia.org/T246724 (10awight) Oops! Apologies, I must have dreamed that I replied earlier. This was a Spark job, submitted directly from the command line on stat1007 using `spark-submit`. I'm getting the sense that... [11:49:35] 10Analytics, 10Analytics-Cluster: Hue doesn't show executor details - https://phabricator.wikimedia.org/T246724 (10elukey) 05Open→03Resolved a:03elukey >>! In T246724#6074673, @awight wrote: > Oops! Apologies, I must have dreamed that I replied earlier. This was a Spark job, submitted directly from the... [11:51:54] !log manually add SUCCESS flags under /wmf/data/wmf/banner_activity/daily/year=2020/month=1 and /wmf/data/wmf/banner_activity/daily/year=2019/month=12 to unblock druid banner monthly indexations [11:51:57] Logged the message at https://www.mediawiki.org/wiki/Analytics/Server_Admin_Log [11:52:07] jobs are running now :) [11:52:21] \o/ thanks a lot elukey [11:55:40] 10Analytics: Check home/HDFS leftovers of anomie - https://phabricator.wikimedia.org/T250167 (10WDoranWMF) Hi @elukey, thanks for organising this. I think @AMooney is the right person to contact as his manager. [12:51:22] 10Analytics: We should get an alarm for partitions that have no data for topics that have data influx at all times, most of the mediawiki.* - https://phabricator.wikimedia.org/T250699 (10mforns) I think this would be a good use case for the data quality alarms. It would be super-easy to setup an alarm for a giv... [12:53:36] * elukey afk for a bit! [12:59:54] (03PS5) 10Amire80: Update the CX abuse filter statistics script for hive [analytics/reportupdater-queries] - 10https://gerrit.wikimedia.org/r/579022 (https://phabricator.wikimedia.org/T223958) [13:00:19] (03PS6) 10Amire80: Update the CX abuse filter statistics script for hive [analytics/reportupdater-queries] - 10https://gerrit.wikimedia.org/r/579022 (https://phabricator.wikimedia.org/T223958) [13:06:08] elukey: was thinking, given days off this week, and no rush, shall we do eventgate TLS next week monday? [13:20:10] mforns: o/ [13:20:29] oh nm just answered my own questiono [13:20:31] o/ anyway! [13:27:36] ottomata: +1, good morning :) [13:27:41] :) [13:27:45] mforns: i do have another question in case you are around! [13:30:26] 10Analytics, 10Analytics-Kanban, 10Patch-For-Review, 10User-Elukey: Repurpose db1108 as generic Analytics db replica - https://phabricator.wikimedia.org/T234826 (10elukey) 05Open→03Stalled I had a chat with my team, and after some discussion we created T250709 to figure out how hard it would be to load... [13:30:30] 10Analytics, 10Analytics-Kanban: Analytics Ops Technical Debt - https://phabricator.wikimedia.org/T240437 (10elukey) [13:30:31] 10Analytics-EventLogging, 10Analytics-Kanban: Sunset MySQL data store for eventlogging - https://phabricator.wikimedia.org/T159170 (10elukey) [13:34:15] 10Analytics: Check home/HDFS leftovers of anomie - https://phabricator.wikimedia.org/T250167 (10AMooney) Hi @elukey, Is there a folder someplace to store these files as a backup that I could access just in case, and then you could delete them? [13:36:49] 10Analytics, 10Operations, 10Traffic: Create replacement for Varnishkafka - https://phabricator.wikimedia.org/T237993 (10elukey) Me and Ema had several chats on IRC, reporting in here the summary: - the HTTP status `000` seems to be used for clients that have some trouble doing a HTTP request to ats-tls, wi... [13:37:27] 10Analytics, 10Operations: kafka-jumbo1003 /srv disk space usage over 90% - https://phabricator.wikimedia.org/T250347 (10elukey) 05Open→03Resolved [13:42:47] (03CR) 10Mforns: "+1 for the query :]" (032 comments) [analytics/reportupdater-queries] - 10https://gerrit.wikimedia.org/r/579022 (https://phabricator.wikimedia.org/T223958) (owner: 10Amire80) [13:46:59] 10Analytics: Check home/HDFS leftovers of anomie - https://phabricator.wikimedia.org/T250167 (10elukey) >>! In T250167#6074935, @AMooney wrote: > Hi @elukey, Is there a folder someplace to store these files as a backup that I could access just in case, and then you could delete them? Hi! We could back them up o... [13:52:22] 10Analytics: Decomission notebook hosts - https://phabricator.wikimedia.org/T249752 (10elukey) I had some thoughts about this, and here's my plan: * complete the work on stat1007, so all stat boxes will have jupyterhub. * add documentation about how to transfer files between stat and notebook hosts via rsync (a... [13:52:45] HUH! I think we can use EventLoggingSanitization with non EventLogging evnet data as is! [13:52:49] map types seem to be supported! [13:53:11] 10Analytics, 10Performance-Team, 10Vue.js: Revise schema and performance dashboards for Vue.js search - https://phabricator.wikimedia.org/T250336 (10Niedzielski) @Peter, sounds good {icon thumbs-up} @Gilles, yes, assuming that everything goes as planned, the new search feature will be deployed to at least a... [13:58:57] 10Analytics, 10Performance-Team, 10Vue.js: Revise schema and performance dashboards for Vue.js search - https://phabricator.wikimedia.org/T250336 (10Gilles) Not an issue, but I would advise testing the extra payload being loaded without it being used first, just to measure the impact of the extra weight on i... [13:59:57] ottomata: does it look good? https://wikitech.wikimedia.org/wiki/Analytics/Systems/Clients#Rsync_between_clients [14:00:14] 10Analytics: Check home/HDFS leftovers of anomie - https://phabricator.wikimedia.org/T250167 (10AMooney) Per, 'If those are of interest for you I can copy them to a host that you have access to @AMooney (or maybe to somebody in your team as well). ' Yes, that would be great @elukey [14:02:09] looks good elukey! just made a small edit to make the command a little more explicit [14:02:14] . could be anything! :) [14:02:39] ack thanks! [14:02:50] I am going to add a motd for notebook1003/4 suggesting to not use them [14:02:57] and adding a link to that rsync [14:04:06] 10Analytics: Check home/HDFS leftovers of anomie - https://phabricator.wikimedia.org/T250167 (10elukey) @AMooney super, can you tell me a host that you have ssh access to? Otherwise we can think about another way to share this, let me know what you prefer. [14:07:03] (03PS7) 10Amire80: Update the CX abuse filter statistics script for hive [analytics/reportupdater-queries] - 10https://gerrit.wikimedia.org/r/579022 (https://phabricator.wikimedia.org/T223958) [14:08:36] +1 [14:09:53] (03CR) 10Mforns: [C: 03+1] "Code looks good to me!" [analytics/wikistats2] - 10https://gerrit.wikimedia.org/r/589606 (https://phabricator.wikimedia.org/T246971) (owner: 10Fdans) [14:20:22] 10Analytics, 10Analytics-EventLogging, 10Analytics-Kanban, 10Better Use Of Data, and 5 others: Modern Event Platform: Schema Guidelines and Conventions - https://phabricator.wikimedia.org/T214093 (10Ottomata) Just had some more thoughts about annotations. In the examples above, we have annotations directl... [14:23:28] (03CR) 10Mforns: "Left a comment that I missed on the lag param. Otherwise LGTM!" (031 comment) [analytics/reportupdater-queries] - 10https://gerrit.wikimedia.org/r/579022 (https://phabricator.wikimedia.org/T223958) (owner: 10Amire80) [14:24:18] hey ottomata, sorry I missed your pings... [14:24:46] 10Analytics, 10Analytics-Kanban: [HiveToDruid] Add support for ingesting subfields of map columns - https://phabricator.wikimedia.org/T208589 (10Ottomata) a:05Ottomata→03None [14:25:28] ottomata: joal and I discussed yesterday about how to implement refine in airflow, and there's some things we thought to ask you [14:26:02] (03PS8) 10Amire80: Update the CX abuse filter statistics script for hive [analytics/reportupdater-queries] - 10https://gerrit.wikimedia.org/r/579022 (https://phabricator.wikimedia.org/T223958) [14:26:45] mforns: lets bc before standup and chat about stuff ya?! [14:26:51] yea! [14:27:13] !log add motd to notebook100[3,4] to alert about host deprecation (in favor of stat100x) [14:27:16] Logged the message at https://www.mediawiki.org/wiki/Analytics/Server_Admin_Log [14:28:26] in bc mforns [14:28:35] ottomata: omw [14:32:13] 10Analytics, 10Patch-For-Review: Decomission notebook hosts - https://phabricator.wikimedia.org/T249752 (10elukey) Updated: https://wikitech.wikimedia.org/wiki/SWAP#Access_and_infrastructure https://wikitech.wikimedia.org/wiki/Analytics/Systems/Clients#Rsync_between_clients [14:41:32] going afk now to bring my parent's cat to the vet, just sent e-scrum! hope to join retro but not sure if I'll be on time, sorry [14:41:48] hey was thinking of deploying after meetings today, no worries about the geoeditors job, I'll babysit it. And I'm around tomorrow and Thursday in case something goes wrong. [14:42:04] hope kitty feels ok, Luca, meow [14:46:34] joal: wanna join ottomata and I in the bc about airflow? [14:46:43] sure mforns! [14:57:34] (03CR) 10Nuria: [C: 04-1] Retain broad context for CPU benchmark (031 comment) [analytics/refinery] - 10https://gerrit.wikimedia.org/r/591307 (owner: 10Gilles) [14:59:15] 10Analytics, 10Analytics-Kanban, 10Patch-For-Review: Druid access for view on event.editeventattempt - https://phabricator.wikimedia.org/T249945 (10Nuria) @fdans i think a manual ingest might be needed to get the whole 90 days span [15:00:17] 10Analytics, 10Analytics-Kanban, 10Patch-For-Review: Druid access for view on event.editeventattempt - https://phabricator.wikimedia.org/T249945 (10fdans) Sounds good! Will do [15:21:25] 10Analytics: Check home/HDFS leftovers of anomie - https://phabricator.wikimedia.org/T250167 (10AMooney) Thanks @elukey, I am not sure of a host that I have ssh access to? How can I tell? [15:23:08] 10Analytics, 10Analytics-Kanban, 10Patch-For-Review: Druid access for view on event.editeventattempt - https://phabricator.wikimedia.org/T249945 (10Nuria) also ping to @dr0ptp4kt that you did not added webhost to whitelist, it should probably be there [15:27:25] (03CR) 10Krinkle: Retain broad context for CPU benchmark (031 comment) [analytics/refinery] - 10https://gerrit.wikimedia.org/r/591307 (owner: 10Gilles) [15:44:03] (03CR) 10Hashar: "recheck due to a deadlock in the CI infrastructure ( T250820 )" [analytics/refinery] - 10https://gerrit.wikimedia.org/r/591307 (owner: 10Gilles) [15:44:52] (03CR) 10Hashar: "recheck due to a deadlock in the CI infrastructure ( T250820 )" [analytics/reportupdater-queries] - 10https://gerrit.wikimedia.org/r/579022 (https://phabricator.wikimedia.org/T223958) (owner: 10Amire80) [15:51:49] 10Analytics, 10Analytics-Kanban, 10Patch-For-Review: High volume mediawiki analytics events camus import is lagging - https://phabricator.wikimedia.org/T233718 (10Nuria) @nettrom_WMF we are in the process of joining eventlogging and eventbus docs, we will add this event for now to the eventlogging dataset pa... [15:54:24] (03PS2) 10Gilles: Retain broad context for CPU benchmark [analytics/refinery] - 10https://gerrit.wikimedia.org/r/591307 [15:54:43] (03CR) 10Gilles: Retain broad context for CPU benchmark (031 comment) [analytics/refinery] - 10https://gerrit.wikimedia.org/r/591307 (owner: 10Gilles) [16:14:57] 10Analytics, 10Analytics-Kanban, 10Patch-For-Review: Druid access for view on event.editeventattempt - https://phabricator.wikimedia.org/T249945 (10dr0ptp4kt) @nuria I added //webhost// to `druid_load.pp` for this more narrow treatment - see https://gerrit.wikimedia.org/r/#/c/operations/puppet/+/587984/6..8/... [16:16:26] I am back people [16:21:02] (03Abandoned) 10Elukey: Test superset 0.36.0rc3 (release candidate) [analytics/superset/deploy] - 10https://gerrit.wikimedia.org/r/585733 (owner: 10Elukey) [16:26:01] elukey: wb [16:37:41] :) [16:59:45] nuria: thanks for the update on T233718 about where documentation will go, that sounds good to me and I won't boldly add stuff to the EventBus page on wikitech :) [16:59:46] T233718: High volume mediawiki analytics events camus import is lagging - https://phabricator.wikimedia.org/T233718 [17:53:04] 10Analytics: Release a public dataset about percentage of referrers in wikipedia traffic - https://phabricator.wikimedia.org/T250840 (10Nuria) [17:59:43] 10Analytics: We should get an alarm for partitions that have no data for topics that have data influx at all times, most of the mediawiki.* - https://phabricator.wikimedia.org/T250699 (10Nuria) Follow up from our discussion: - We will implement canary alarms for all streams in MEP, this reuires schemas per str... [18:02:30] 10Analytics: MEP: canary alarms so we know events are flowing through pipeline - https://phabricator.wikimedia.org/T250844 (10Nuria) [18:05:27] 10Analytics: Anomaly detection alarms for the edit event stream - https://phabricator.wikimedia.org/T250845 (10Nuria) [18:05:54] Nettrom: we are trying to document datasets for what they are (event-based) rather than the path they follow (eventbus), after this quarter we will have reworked docs a bit [18:07:07] 10Analytics, 10Analytics-Kanban, 10Patch-For-Review: High volume mediawiki analytics events camus import is lagging - https://phabricator.wikimedia.org/T233718 (10Nuria) to clarify the camus partition checker did alram here, we missed that there was some data loss as well in the mediaiwki topics as when this... [18:10:50] * elukey afk! [18:14:18] 10Analytics, 10Analytics-Kanban, 10Patch-For-Review: Druid access for view on event.editeventattempt - https://phabricator.wikimedia.org/T249945 (10Nuria) Ah, yes. I had missunderstood @kaladari's request. Ok, the only thing to do here is to run the reindexation since there is data available. [18:22:11] (03CR) 10Nuria: [C: 04-1] Retain broad context for CPU benchmark (031 comment) [analytics/refinery] - 10https://gerrit.wikimedia.org/r/591307 (owner: 10Gilles) [18:23:40] (03CR) 10Nuria: [C: 04-1] "A possible solution is to "hash" the device, the salt with which is hashed changes about every 90 days thus correlation is only possible o" [analytics/refinery] - 10https://gerrit.wikimedia.org/r/591307 (owner: 10Gilles) [18:26:49] 10Analytics: jmads requesting Kerberos password - https://phabricator.wikimedia.org/T250560 (10jmads) [18:32:19] (03CR) 10Nuria: [C: 03+2] "Merging, @milimetric, let's add this to the pageview whilelist" [analytics/refinery] - 10https://gerrit.wikimedia.org/r/591094 (owner: 10Urbanecm) [18:32:21] (03CR) 10Nuria: [V: 03+2 C: 03+2] Add new wiki [analytics/refinery] - 10https://gerrit.wikimedia.org/r/591094 (owner: 10Urbanecm) [19:36:15] (03CR) 10Milimetric: [C: 03+2] Add check for corrupted (empty) flag files [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/587270 (https://phabricator.wikimedia.org/T246706) (owner: 10Mforns) [19:47:41] foof, complicated train now and lots of stuff omitted from the deployment etherpad [19:47:46] fdans: sorry man, are you still working? [19:48:05] I could use a break in focus, but we can catch up tomorrow too [19:49:02] fdans: yep! still here if you wanna chat for a couple min [19:49:54] haha [19:49:57] to the bc fdans [19:51:32] (03PS1) 10Elukey: Release upstream version 0.36.0 [analytics/superset/deploy] - 10https://gerrit.wikimedia.org/r/591440 (https://phabricator.wikimedia.org/T249495) [19:51:43] (03CR) 10Milimetric: [C: 03+2] Add traffic entropy data quality stats in hourly resolution [analytics/refinery] - 10https://gerrit.wikimedia.org/r/587844 (https://phabricator.wikimedia.org/T249759) (owner: 10Mforns) [19:52:04] milimetric: let's talk tomorrow about what was missing on train etherpad [19:53:57] 10Analytics, 10Analytics-Kanban, 10Privacy Engineering, 10Product-Analytics, and 3 others: Identify pending analyses needing access to data older than 90 days - https://phabricator.wikimedia.org/T250857 (10nettrom_WMF) [20:03:16] 10Analytics, 10Analytics-Kanban, 10Privacy Engineering, 10Product-Analytics, and 3 others: Identify pending analyses needing access to data older than 90 days - https://phabricator.wikimedia.org/T250857 (10nettrom_WMF) [20:07:30] 10Analytics, 10Analytics-Kanban, 10Privacy Engineering, 10Product-Analytics, and 3 others: Drop data from Prefupdate schema that is older than 90 days - https://phabricator.wikimedia.org/T250049 (10nettrom_WMF) [20:11:33] mforns: thanks! [20:11:39] for T249759 :) [20:11:40] T249759: Add hourly resolution to data quality outage/censhorship alarms - https://phabricator.wikimedia.org/T249759 [20:19:19] nuria: the "check if merged" stuff wasn't merged, so I had to read up and merge that. And the jobs to restart section is not clearly linked to the patches, but some of that is understandable because it's Lex's [20:19:42] milimetric: ah i see [20:25:42] milimetric: do you need help with the train? [20:25:54] sukhe: np :] [20:25:58] (03PS1) 10Milimetric: Update changelog for v0.0.122 [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/591457 [20:26:33] np mforns, was just nervous for a second 'cause there were three unmerged changes with +1s [20:26:51] I didn't look too carefully, but none of them were too critical so I figure I'll merge and see what happens :) [20:26:57] milimetric: ok, let me know if you want to pair or anything else [20:27:06] thx, no worries [20:27:32] (03CR) 10Milimetric: [V: 03+2 C: 03+2] Update changelog for v0.0.122 [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/591457 (owner: 10Milimetric) [20:28:33] Starting build #40 for job analytics-refinery-maven-release-docker [20:28:45] also - fancy new build :) [20:28:47] nice jo [20:34:52] milimetric: for the emoji pageview definition the jar needs to be updated as well [20:35:37] nuria: yeah, I'm doing the build for 0.0.122 now (btw, we should increment that to like 0.1 at some point... I think we're ready :) [20:38:56] Project analytics-refinery-maven-release-docker build #40: 09SUCCESS in 10 min: https://integration.wikimedia.org/ci/job/analytics-refinery-maven-release-docker/40/ [20:45:20] Starting build #132 for job analytics-refinery-update-jars [20:45:29] Project analytics-refinery-update-jars build #132: 09SUCCESS in 11 sec: https://integration.wikimedia.org/ci/job/analytics-refinery-update-jars/132/ [21:13:32] 10Analytics, 10Analytics-Kanban, 10Research: Proposed adjustment to wmf.wikidata_item_page_link to better handle page moves - https://phabricator.wikimedia.org/T249773 (10Isaac) @Milimetric yeah, while doing the research around this task, I've come to super appreciate the `mediawiki_page_history` table given... [21:38:29] !log deployed twice because analytics1030 failed with "OSError {}" but seems ok after the second deploy [21:38:31] Logged the message at https://www.mediawiki.org/wiki/Analytics/Server_Admin_Log [21:43:15] oh nuria you meant the jar version on the bundle!!! Ugh, I did forget that, thank you :) [21:44:57] (03PS1) 10Milimetric: Update unicode handling in Pageview Definition [analytics/refinery] - 10https://gerrit.wikimedia.org/r/591493 (https://phabricator.wikimedia.org/T245468) [21:45:19] (03CR) 10Milimetric: [V: 03+2 C: 03+2] Update unicode handling in Pageview Definition [analytics/refinery] - 10https://gerrit.wikimedia.org/r/591493 (https://phabricator.wikimedia.org/T245468) (owner: 10Milimetric) [22:00:17] (03CR) 10Nuria: [C: 03+1] Update unicode handling in Pageview Definition [analytics/refinery] - 10https://gerrit.wikimedia.org/r/591493 (https://phabricator.wikimedia.org/T245468) (owner: 10Milimetric) [22:10:44] 10Analytics, 10Technical blog: Techblog: Change URL permalink style to better measure pageviews - https://phabricator.wikimedia.org/T248614 (10Krinkle) 05Open→03Declined [22:27:49] 10Analytics, 10Analytics-Kanban, 10Research: covid19 data preservation - https://phabricator.wikimedia.org/T248600 (10Isaac) Update: I have now pulled the data up to January 28th and will continue to build the dataset so that I stay ahead of the normal deletion process. I assume that restoring the deletion w... [23:00:19] !log forgot a small jar version update, finished deploying now [23:00:20] Logged the message at https://www.mediawiki.org/wiki/Analytics/Server_Admin_Log [23:17:04] !log restarted webrequest bundle, babysitting that first before going on [23:17:06] Logged the message at https://www.mediawiki.org/wiki/Analytics/Server_Admin_Log [23:57:19] 10Analytics, 10Analytics-Kanban, 10Pageviews-API, 10Patch-For-Review: Pageviews missing for titles with emojis since April 23, 2019 - https://phabricator.wikimedia.org/T245468 (10Nuria) Changes are deployed @lexnasser let's do another round of test to make sure all is good on webrequets table and to see...