[07:49:57] 10Analytics, 10Analytics-Kanban: Mediawiki History Release - 2019-04 snapshot - https://phabricator.wikimedia.org/T221824 (10JAllemandou) [07:53:59] 10Analytics, 10Analytics-Data-Quality, 10Analytics-Kanban, 10Product-Analytics, 10Patch-For-Review: Some registered users have null values for event_user_text and event_user_text_historical in mediawiki_history - https://phabricator.wikimedia.org/T218463 (10JAllemandou) [07:54:01] 10Analytics, 10Analytics-Kanban, 10Analytics-Wikistats, 10Patch-For-Review: Add user_is_bot_by to MediaWiki history - https://phabricator.wikimedia.org/T219177 (10JAllemandou) [07:54:03] 10Analytics, 10Analytics-Data-Quality, 10Analytics-Kanban, 10Product-Analytics: mediawiki_history datasets have null user_text for IP edits - https://phabricator.wikimedia.org/T206883 (10JAllemandou) [07:54:05] 10Analytics, 10Analytics-Kanban, 10Anti-Harassment, 10Product-Analytics: Add partial blocks to mediawiki history tables - https://phabricator.wikimedia.org/T211950 (10JAllemandou) [07:54:07] 10Analytics, 10Analytics-Kanban: Add caused_by_user_text to mediawiki_page_history - https://phabricator.wikimedia.org/T167608 (10JAllemandou) [07:54:09] 10Analytics-Kanban, 10Patch-For-Review: Coordinate work on minor changes for Edit Data Quality - https://phabricator.wikimedia.org/T213603 (10JAllemandou) [07:54:11] 10Analytics, 10Analytics-Kanban: Mediawiki History Release - 2019-04 snapshot - https://phabricator.wikimedia.org/T221824 (10JAllemandou) [07:54:13] 10Analytics, 10Analytics-Kanban, 10Patch-For-Review: Update wikimedia-history revision data with deleted field (and find it a new name?) - https://phabricator.wikimedia.org/T178587 (10JAllemandou) [07:54:15] 10Analytics, 10Analytics-Kanban: Provide edit tags in the Data Lake edit data - https://phabricator.wikimedia.org/T161149 (10JAllemandou) [08:01:38] 10Analytics, 10Analytics-Kanban: Mediawiki History Release - 2019-04 snapshot - https://phabricator.wikimedia.org/T221824 (10JAllemandou) [08:02:02] 10Analytics, 10Analytics-Kanban: Mediawiki History Release - 2019-04 snapshot - https://phabricator.wikimedia.org/T221824 (10JAllemandou) a:03JAllemandou [08:05:54] 10Analytics, 10Analytics-Kanban: Mediawiki-history release - WIP for future - https://phabricator.wikimedia.org/T221825 (10JAllemandou) [08:08:57] 10Analytics, 10Analytics-Data-Quality, 10Analytics-Kanban, 10Product-Analytics: Many small wikis missing from mediawiki_history dataset - https://phabricator.wikimedia.org/T220456 (10JAllemandou) [08:08:59] 10Analytics, 10Analytics-Kanban: Mediawiki History Release - 2019-04 snapshot - https://phabricator.wikimedia.org/T221824 (10JAllemandou) [08:13:43] 10Analytics, 10Analytics-Data-Quality, 10Analytics-Kanban, 10Product-Analytics: Many revision events in mediawiki_history have missing page and namespace information - https://phabricator.wikimedia.org/T221338 (10JAllemandou) a:03JAllemandou [08:14:41] 10Analytics, 10Analytics-Data-Quality, 10Analytics-Kanban, 10Product-Analytics: A few alterblocks events have event_timestamps from before 2001 - https://phabricator.wikimedia.org/T218824 (10JAllemandou) a:03JAllemandou [08:17:09] 10Analytics, 10Analytics-Data-Quality, 10Analytics-Kanban, 10Product-Analytics: Many revision events in mediawiki_history have missing page and namespace information - https://phabricator.wikimedia.org/T221338 (10JAllemandou) [08:17:11] 10Analytics, 10Analytics-Data-Quality, 10Analytics-Kanban, 10Product-Analytics: A few alterblocks events have event_timestamps from before 2001 - https://phabricator.wikimedia.org/T218824 (10JAllemandou) [08:17:13] 10Analytics, 10Analytics-Data-Quality, 10Analytics-Kanban, 10Product-Analytics: page_creation_timestamp not always correct in mediawiki_history - https://phabricator.wikimedia.org/T214490 (10JAllemandou) [08:17:15] 10Analytics, 10Analytics-Data-Quality, 10Analytics-Kanban, 10Product-Analytics: mediawiki_history missing page events - https://phabricator.wikimedia.org/T205594 (10JAllemandou) [08:17:17] 10Analytics, 10Anti-Harassment, 10Product-Analytics: Mediawiki history has no data on IP blocks - https://phabricator.wikimedia.org/T211627 (10JAllemandou) [08:17:19] 10Analytics, 10Analytics-Kanban: Mediawiki-history release - WIP for future - https://phabricator.wikimedia.org/T221825 (10JAllemandou) [08:17:21] 10Analytics, 10Analytics-Kanban, 10Patch-For-Review: Issues with page deleted dates on data lake - https://phabricator.wikimedia.org/T190434 (10JAllemandou) [08:18:58] 10Analytics, 10Product-Analytics: Identify imported revisions in mediawiki_history - https://phabricator.wikimedia.org/T221482 (10JAllemandou) [08:19:00] 10Analytics: Update mediawiki-history subgraph-partitioner so that it uses [page/user]_id in addition to title/text - https://phabricator.wikimedia.org/T218130 (10JAllemandou) [08:19:02] 10Analytics, 10Analytics-Kanban: Mediawiki-history release - WIP for future - https://phabricator.wikimedia.org/T221825 (10JAllemandou) [08:20:23] 10Analytics: Mediawiki-history release - Backlog - https://phabricator.wikimedia.org/T221828 (10JAllemandou) [08:22:19] 10Analytics, 10Product-Analytics: Identify imported revisions in mediawiki_history - https://phabricator.wikimedia.org/T221482 (10JAllemandou) [08:22:21] 10Analytics: Mediawiki-history release - Backlog - https://phabricator.wikimedia.org/T221828 (10JAllemandou) [08:23:34] 10Analytics: Improve mediawiki-user-history bot-by-name regex - https://phabricator.wikimedia.org/T221114 (10JAllemandou) [08:23:36] 10Analytics: Update mediawiki-history subgraph-partitioner so that it uses [page/user]_id in addition to title/text - https://phabricator.wikimedia.org/T218130 (10JAllemandou) [08:23:40] 10Analytics, 10Anti-Harassment, 10Product-Analytics: Mediawiki history has no data on IP blocks - https://phabricator.wikimedia.org/T211627 (10JAllemandou) [08:23:42] 10Analytics: Mediawiki-history release - Backlog - https://phabricator.wikimedia.org/T221828 (10JAllemandou) [08:23:57] 10Analytics, 10Product-Analytics: Identify imported revisions in mediawiki_history - https://phabricator.wikimedia.org/T221482 (10JAllemandou) [08:23:59] 10Analytics: Improve mediawiki-user-history bot-by-name regex - https://phabricator.wikimedia.org/T221114 (10JAllemandou) [08:24:02] 10Analytics: Update mediawiki-history subgraph-partitioner so that it uses [page/user]_id in addition to title/text - https://phabricator.wikimedia.org/T218130 (10JAllemandou) [08:24:04] 10Analytics, 10Anti-Harassment, 10Product-Analytics: Mediawiki history has no data on IP blocks - https://phabricator.wikimedia.org/T211627 (10JAllemandou) [08:24:06] 10Analytics, 10Analytics-Kanban: Mediawiki-history release - WIP for future - https://phabricator.wikimedia.org/T221825 (10JAllemandou) [08:24:18] Wow - sorry for the spam team :( [10:24:02] 10Analytics, 10Analytics-EventLogging, 10Analytics-Kanban, 10EventBus, and 3 others: Modern Event Platform: Deploy instance of EventGate service that produces events to kafka main - https://phabricator.wikimedia.org/T218346 (10akosiaris) >>! In T218346#5136013, @Ottomata wrote: > @fsero @akosiaris - moving... [12:12:02] 10Analytics, 10Analytics-EventLogging, 10Performance-Team: Upgrade python-kafka - https://phabricator.wikimedia.org/T221848 (10Gilles) [12:12:11] 10Analytics, 10Analytics-EventLogging, 10Performance-Team: Upgrade python-kafka - https://phabricator.wikimedia.org/T221848 (10Gilles) p:05Triage→03Normal a:05Gilles→03None [12:12:39] 10Analytics, 10Analytics-EventLogging, 10Operations, 10Performance-Team: Upgrade python-kafka - https://phabricator.wikimedia.org/T221848 (10Gilles) [12:20:57] 10Analytics, 10Analytics-EventLogging, 10Operations, 10Performance-Team: Upgrade python-kafka - https://phabricator.wikimedia.org/T221848 (10MoritzMuehlenhoff) We can probably simply backport https://github.com/dpkp/kafka-python/pull/1628/commits/f12d4978e06c191871e092c190c2a34977f0c8bd on top of our 1.4.3... [12:32:51] 10Analytics, 10Analytics-EventLogging, 10Operations, 10Performance-Team: Upgrade python-kafka - https://phabricator.wikimedia.org/T221848 (10Gilles) a:03Ottomata Why not just upgrade to a newer version? Surely it's not the only bugfix in the past year. I've packaged the latest stable (1.4.6) without iss... [13:51:30] (03PS12) 10Mforns: Add edit_hourly oozie job [analytics/refinery] - 10https://gerrit.wikimedia.org/r/501197 (https://phabricator.wikimedia.org/T220092) [13:53:11] (03CR) 10Mforns: "@Joseph and @Nuria, this is tested and ready :]" [analytics/refinery] - 10https://gerrit.wikimedia.org/r/501197 (https://phabricator.wikimedia.org/T220092) (owner: 10Mforns) [13:59:53] 10Analytics, 10Analytics-EventLogging, 10Analytics-Kanban, 10EventBus, and 3 others: Modern Event Platform: Deploy instance of EventGate service that produces events to kafka main - https://phabricator.wikimedia.org/T218346 (10Ottomata) > I 'd advise against having the namespace referenced in charts. I'm... [14:03:43] 10Analytics, 10Analytics-EventLogging, 10Analytics-Kanban, 10EventBus, and 3 others: Modern Event Platform: Deploy instance of EventGate service that produces events to kafka main - https://phabricator.wikimedia.org/T218346 (10Ottomata) Hm yeah it gets a little weird. Without using namespaces, wmf.release... [14:17:18] 10Analytics, 10Analytics-EventLogging, 10Analytics-Kanban, 10EventBus, and 4 others: Modern Event Platform: Deploy instance of EventGate service that produces events to kafka main - https://phabricator.wikimedia.org/T218346 (10Ottomata) [14:19:18] !log Restarted Turnilo to clear deleted datasource [14:19:34] Logged the message at https://www.mediawiki.org/wiki/Analytics/Server_Admin_Log [15:03:18] (03CR) 10Nuria: "I think this is good to go, dropping the .org from project column makes it match the" [analytics/refinery] - 10https://gerrit.wikimedia.org/r/501197 (https://phabricator.wikimedia.org/T220092) (owner: 10Mforns) [15:24:30] (03PS7) 10Mforns: Add oozie job to load edit_hourly to druid [analytics/refinery] - 10https://gerrit.wikimedia.org/r/501607 (https://phabricator.wikimedia.org/T211173) [15:25:50] (03CR) 10Mforns: "OK, @Joal and @Nuria, this is tested and ready for final review." [analytics/refinery] - 10https://gerrit.wikimedia.org/r/501607 (https://phabricator.wikimedia.org/T211173) (owner: 10Mforns) [15:26:29] 10Analytics, 10Product-Analytics: Add additional dimensions to edits_hourly in Turnilo and Superset - https://phabricator.wikimedia.org/T219323 (10mforns) [15:34:39] 10Analytics, 10Analytics-Kanban, 10Better Use Of Data, 10Product-Analytics: Add edit tags when available to edit_hourly dataset on turnilo - https://phabricator.wikimedia.org/T221866 (10Nuria) [15:36:19] 10Analytics, 10Analytics-EventLogging, 10Analytics-Kanban, 10EventBus, and 4 others: Modern Event Platform: Deploy instance of EventGate service that produces events to kafka main - https://phabricator.wikimedia.org/T218346 (10Ottomata) Hm, I think what I need is a values.yaml specified service name. Goin... [15:38:33] 10Analytics, 10Analytics-EventLogging, 10Analytics-Kanban, 10EventBus, and 4 others: Modern Event Platform: Deploy instance of EventGate service that produces events to kafka main - https://phabricator.wikimedia.org/T218346 (10Ottomata) Hm, if ^ works and it became a convention, we could make scap-helm aut... [15:42:15] https://usercontent.irccloud-cdn.com/file/dLcfNIxz/Screen%20Shot%202019-04-25%20at%205.41.51%20PM.png [15:52:50] a-team better use of data meeting overlaps with sstanadup [15:52:54] will miss, but i'll be there for grooming [15:53:40] 10Analytics, 10Analytics-EventLogging, 10Analytics-Kanban, 10EventBus, and 4 others: Modern Event Platform: Deploy instance of EventGate service that produces events to kafka main - https://phabricator.wikimedia.org/T218346 (10akosiaris) >>! In T218346#5137518, @Ottomata wrote: >> I 'd advise against havin... [16:01:09] 10Analytics, 10Analytics-EventLogging, 10Analytics-Kanban, 10EventBus, and 4 others: Modern Event Platform: Deploy instance of EventGate service that produces events to kafka main - https://phabricator.wikimedia.org/T218346 (10Ottomata) kubernetes_namespace might be right, but will `app` or `service` be?... [16:02:14] a-team: i have a mid tyerm plannimg meeting now at the same time than standup [16:02:30] i guess ottomata is also not there [16:02:37] i will also join for grooming [16:36:43] a-team: will make the later part of grooming [16:39:25] 10Analytics, 10Analytics-Kanban: Mediawiki History Release - 2019-04 snapshot - https://phabricator.wikimedia.org/T221824 (10fdans) p:05Triage→03High [16:39:32] 10Analytics: Mediawiki-history release - Backlog - https://phabricator.wikimedia.org/T221828 (10fdans) p:05Triage→03Normal [16:39:41] 10Analytics, 10Analytics-Kanban: Mediawiki-history release - WIP for future - https://phabricator.wikimedia.org/T221825 (10fdans) p:05Triage→03Normal [16:41:21] 10Analytics, 10Product-Analytics: Add additional dimensions to edits_hourly in Turnilo and Superset - https://phabricator.wikimedia.org/T219323 (10fdans) p:05Triage→03High [16:43:56] nuria: just finished groomed incoming and since we're only 3 people we've adjourned the meeting [16:44:14] fdans: ok, that is fine too [16:47:16] 10Analytics, 10Analytics-EventLogging, 10Analytics-Kanban, 10EventBus, and 4 others: Modern Event Platform: Deploy instance of EventGate service that produces events to kafka main - https://phabricator.wikimedia.org/T218346 (10akosiaris) >>! In T218346#5137946, @Ottomata wrote: > kubernetes_namespace might... [16:48:01] fdans: the vetting page is still under your user space: https://wikitech.wikimedia.org/wiki/User:Fdans/Vetting_data_lake_metrics_for_project_families [16:48:39] nuria: hmmm I'm pretty sure that's just the first version though [16:49:00] ah no wait [16:49:12] sorry nuria i thought you were talking bout the ops duty doc [16:49:30] nuria: yeah you're right, let's move it elsewhere? [16:49:31] fdans: ah i see, the vetting we also need to fisnish [16:50:39] fdans: we need to have an abstract session that concisely explains findings and after a details section, i think once we have common captions on images we are done [16:51:36] fdans: you can remove from talk pages things taht have been done: https://wikitech.wikimedia.org/wiki/User_talk:Fdans/Vetting_data_lake_metrics_for_project_families [16:51:59] fdans: It is almost there , let's try to finish this week [16:52:42] nuria: I'd say the heading of the article qualifies as an abstract [16:56:23] 10Analytics, 10Analytics-EventLogging, 10Analytics-Kanban, 10EventBus, and 4 others: Modern Event Platform: Deploy instance of EventGate service that produces events to kafka main - https://phabricator.wikimedia.org/T218346 (10Ottomata) > Alternatively you can use wmf.releasename, which has a default of .C... [16:57:32] 10Analytics, 10Event Metrics: Review category queries - https://phabricator.wikimedia.org/T206783 (10jmatazzoni) [17:03:00] 10Analytics, 10Analytics-Kanban, 10EventBus, 10Core Platform Team (Modern Event Platform (TEC2)), and 3 others: Schema Registry HTTP Service - https://phabricator.wikimedia.org/T219552 (10ayounsi) [17:03:06] 10Analytics-Kanban, 10EventBus, 10Operations, 10netops: Allow analytics VLAN to reach schema.svc.$site.wmnet - https://phabricator.wikimedia.org/T221690 (10ayounsi) 05Open→03Resolved I assumed you needed HTTPS and not HTTP based on T219552, but please reopen if it's wrong. [17:05:59] fdans: ok, ya header works as abstract [17:07:28] fdans: but it needs correction on table of "total article count" [17:07:32] 10Analytics-Kanban, 10EventBus, 10Operations, 10netops: Allow analytics VLAN to reach schema.svc.$site.wmnet - https://phabricator.wikimedia.org/T221690 (10Ottomata) HTTP is enough for now, thanks. If/when this gets exposed publicly we'll put it through the usual frontend nginx tls stuff there. Thank you! [17:07:39] fdans: let's correct that and move to main namespace [17:09:27] (03CR) 10Nuria: [C: 03+2] Add edit_hourly oozie job [analytics/refinery] - 10https://gerrit.wikimedia.org/r/501197 (https://phabricator.wikimedia.org/T220092) (owner: 10Mforns) [17:29:42] 10Analytics, 10Analytics-EventLogging, 10Analytics-Kanban, 10EventBus, and 4 others: Modern Event Platform: Deploy instance of EventGate service that produces events to kafka main - https://phabricator.wikimedia.org/T218346 (10Ottomata) > If I do set --namespace=eventgate-dev, I think EventGate can no long... [17:44:39] 10Analytics, 10Analytics-EventLogging, 10Analytics-Kanban, 10EventBus, and 4 others: Modern Event Platform: Deploy instance of EventGate service that produces events to kafka main - https://phabricator.wikimedia.org/T218346 (10Ottomata) Hm, is it possible to use `helm template` to check rendered templates... [18:02:16] 10Analytics, 10Analytics-EventLogging, 10Analytics-Kanban, 10EventBus, and 4 others: Modern Event Platform: Deploy instance of EventGate service that produces events to kafka main - https://phabricator.wikimedia.org/T218346 (10Ottomata) Hm, I think I do have to change _helpers.tpl. `wmf.releasename` is de... [18:17:15] 10Analytics, 10Product-Analytics, 10Growth-Team (Current Sprint), 10Patch-For-Review: Add HelpPanel schema to the EventLogging whitelist - https://phabricator.wikimedia.org/T220033 (10nettrom_WMF) 05Open→03Resolved I have verified that HelpPanel data is now being sanitized and stored correctly, so it's... [18:21:36] ottomata, hey, do you know anything about deployment-conf03.deployment-prep.eqiad.wmflabs ? [18:22:03] probably a little bit! luca might know more [18:22:04] what's up? [18:34:38] 10Analytics-Kanban, 10EventBus, 10Operations, 10netops: Allow analytics VLAN to reach schema.svc.$site.wmnet - https://phabricator.wikimedia.org/T221690 (10Ottomata) Hm, @ayounsi: `lang=shell [@stat1004:/home/otto] $ curl -Iv http://schema.svc.eqiad.wmnet:8190/repositories/ * Trying 10.2.2.43... [@stat... [18:35:36] 10Analytics-Kanban, 10EventBus, 10Operations, 10netops: Allow analytics VLAN to reach schema.svc.$site.wmnet - https://phabricator.wikimedia.org/T221690 (10Ottomata) Ah I think that might have been my fault. T219552 doesn't specify a port; that task description was made before service was implemented. P... [18:36:08] 10Analytics, 10Analytics-Kanban, 10EventBus, 10Core Platform Team (Modern Event Platform (TEC2)), and 3 others: Schema Registry HTTP Service - https://phabricator.wikimedia.org/T219552 (10Ottomata) [18:36:12] 10Analytics-Kanban, 10EventBus, 10Operations, 10netops: Allow analytics VLAN to reach schema.svc.$site.wmnet - https://phabricator.wikimedia.org/T221690 (10Ottomata) 05Resolved→03Open [19:00:34] ottomata, it seems to be unpuppetised, ancient and broken [19:02:11] root@deployment-conf03:/var/lib/etcd/ssl/certs# openssl x509 -in ca.pem -noout -text | grep Issuer: [19:02:12] Issuer: CN=Puppet CA: virt1000.wikimedia.org [19:02:16] host has not existed since like 2015 I think [19:02:34] but that does not appear to be an issue [19:02:39] this does appear to be an issue however: [19:02:40] root@deployment-conf03:/var/lib/etcd/ssl/certs# openssl x509 -in cert.pem -noout -text | grep Issuer: [19:02:40] Issuer: CN=Puppet CA: deployment-puppetmaster02.deployment-prep.eqiad.wmflabs [19:03:19] deployment-puppetmaster02 has not existed since May/June last year [19:03:28] but it's still trying to serve traffic using that cert and failing because of it [19:03:59] ok, then i don't know anything about it: p [19:04:07] either luca...or more likely someone dealingwith etcd. [19:06:23] This instance does not appear to have a role [19:06:39] I suspect anything actually using etcd in beta is talking to deployment-etcd-01 instead [19:08:58] elukey, ^ [19:10:06] if no one knows what might be using it I'd like to turn it off for a while to see if anything breaks - if anything visibly changes as a result of this it's probably already broken for trusting that old cert [19:10:35] Krenair: I'd try it, if it is that old and unpuppetized. [19:10:47] i'd say go ahead* [19:10:48] :() [19:10:52] is luca around today? [19:11:00] ya, but he's in euro time so he's off [19:11:02] 10Analytics, 10Product-Analytics: Add additional dimensions to edits_hourly in Turnilo and Superset - https://phabricator.wikimedia.org/T219323 (10mforns) [19:11:02] 10Analytics, 10Analytics-Kanban, 10Better Use Of Data, 10Product-Analytics, 10Patch-For-Review: "Edit" equivalent of pageviews daily available to use in Turnilo and Superset - https://phabricator.wikimedia.org/T211173 (10mforns) [19:11:07] oh actually [19:11:13] no he wasn't around today, i think its an italy bank holiday [19:11:46] will ask tomorrow [19:11:49] 10Analytics, 10Analytics-Kanban, 10Better Use Of Data, 10Product-Analytics: Add edit tags when available to edit_hourly dataset on turnilo - https://phabricator.wikimedia.org/T221866 (10mforns) @Nuria There is already one task (T219323) that Megan created which corresponds to the second iteration on that d... [19:12:02] 10Analytics, 10Analytics-Kanban, 10Better Use Of Data, 10Product-Analytics: Add edit tags when available to edit_hourly dataset on turnilo - https://phabricator.wikimedia.org/T221866 (10mforns) [19:12:06] 10Analytics, 10Product-Analytics: Add additional dimensions to edits_hourly in Turnilo and Superset - https://phabricator.wikimedia.org/T219323 (10mforns) [19:13:36] thanks ottomata [19:27:49] 10Analytics, 10Analytics-Kanban, 10Better Use Of Data, 10Product-Analytics, 10Patch-For-Review: "Edit" equivalent of pageviews daily available to use in Turnilo and Superset - https://phabricator.wikimedia.org/T211173 (10kzimmerman) @MNeisler @Neil_P._Quinn_WMF: wanted to check in with your thoughts on t... [19:40:15] 10Analytics, 10Analytics-EventLogging, 10Analytics-Kanban, 10MW-1.33-notes (1.33.0-wmf.6; 2018-11-27): Deprecation Information for EventLogging ResourceLoader modules - https://phabricator.wikimedia.org/T205744 (10D3r1ck01) [19:47:20] 10Analytics, 10Analytics-Data-Quality, 10Analytics-Kanban, 10Product-Analytics: mediawiki_history datasets have null user_text for IP edits - https://phabricator.wikimedia.org/T206883 (10Neil_P._Quinn_WMF) Thanks, @JAllemandou! 🎉 🎉 [19:50:35] 10Analytics, 10Product-Analytics, 10Epic, 10User-Elukey: Add wikidata ids to data lake tables - https://phabricator.wikimedia.org/T221890 (10Groceryheist) [19:51:59] 10Analytics, 10Product-Analytics, 10Epic, 10User-Elukey: Add wikidata ids to data lake tables - https://phabricator.wikimedia.org/T221890 (10Groceryheist) [20:35:15] joal: yt? [20:37:10] 10Analytics, 10Analytics-Data-Quality, 10Analytics-Kanban, 10Product-Analytics: Many revision events in mediawiki_history have missing page and namespace information - https://phabricator.wikimedia.org/T221338 (10Nuria) >It would be really useful if this could be fixed in the April snapshot, @JAllemandou i... [21:07:59] (03CR) 10Mforns: [V: 03+2] Add edit_hourly oozie job [analytics/refinery] - 10https://gerrit.wikimedia.org/r/501197 (https://phabricator.wikimedia.org/T220092) (owner: 10Mforns) [21:08:13] (03CR) 10Mforns: [V: 03+2] Add edit_hourly to list of tables to be purged of old snapshots [analytics/refinery] - 10https://gerrit.wikimedia.org/r/501328 (https://phabricator.wikimedia.org/T220092) (owner: 10Mforns) [21:09:14] (03CR) 10Mforns: [V: 03+2 C: 03+2] "Re-adding +2 from Joal and Nuria, only things that changed were 2 field renames and I already tested the loading and went fine." [analytics/refinery] - 10https://gerrit.wikimedia.org/r/501607 (https://phabricator.wikimedia.org/T211173) (owner: 10Mforns) [21:09:46] (03PS6) 10Mforns: Add edit_hourly to list of tables to be purged of old snapshots [analytics/refinery] - 10https://gerrit.wikimedia.org/r/501328 (https://phabricator.wikimedia.org/T220092) [21:09:55] (03CR) 10Mforns: [V: 03+2] Add edit_hourly to list of tables to be purged of old snapshots [analytics/refinery] - 10https://gerrit.wikimedia.org/r/501328 (https://phabricator.wikimedia.org/T220092) (owner: 10Mforns) [21:10:15] (03PS8) 10Mforns: Add oozie job to load edit_hourly to druid [analytics/refinery] - 10https://gerrit.wikimedia.org/r/501607 (https://phabricator.wikimedia.org/T211173) [21:10:19] (03CR) 10Mforns: [V: 03+2 C: 03+2] Add oozie job to load edit_hourly to druid [analytics/refinery] - 10https://gerrit.wikimedia.org/r/501607 (https://phabricator.wikimedia.org/T211173) (owner: 10Mforns) [21:28:46] 10Analytics, 10Analytics-Data-Quality, 10Analytics-Kanban, 10Product-Analytics: Many revision events in mediawiki_history have missing page and namespace information - https://phabricator.wikimedia.org/T221338 (10Nuria) > when calculating global monthly active editors (where only content edits are counted)... [23:09:45] 10Analytics, 10EventBus, 10Operations, 10Core Platform Team (Modern Event Platform (TEC2)), and 3 others: Possibly expand Kafka main-{eqiad,codfw} clusters in Q4 2019. - https://phabricator.wikimedia.org/T217359 (10mobrovac)