[04:21:51] RECOVERY - Check unit status of monitor_refine_event_sanitized_analytics_delayed on an-launcher1002 is OK: OK: Status of the systemd unit monitor_refine_event_sanitized_analytics_delayed https://wikitech.wikimedia.org/wiki/Analytics/Systems/Managing_systemd_timers [09:18:14] 10Analytics, 10Event-Platform: LandingPageImpression Event Platform Migration - https://phabricator.wikimedia.org/T282855 (10awight) [09:24:56] 10Analytics, 10Event-Platform: LandingPageImpression Event Platform Migration - https://phabricator.wikimedia.org/T282855 (10awight) @AndyRussG Do you need continue recording client IP and geolocation data in Hive for these events, or is that already handled at a different layer of the fundraising data pipelin... [09:32:58] (03PS1) 10Awight: [WIP] Add LandingPageImpression schema to analytics/legacy [schemas/event/secondary] - 10https://gerrit.wikimedia.org/r/691095 (https://phabricator.wikimedia.org/T282855) [10:26:12] (03CR) 10Addshore: "recheck" [schemas/event/secondary] - 10https://gerrit.wikimedia.org/r/689152 (owner: 10Martaannaj) [10:26:40] (03CR) 10jerkins-bot: [V: 04-1] Create wd_propertysuggester/client_ab_testing and wd_propertysuggester/server_ab_testing [schemas/event/secondary] - 10https://gerrit.wikimedia.org/r/689152 (owner: 10Martaannaj) [11:01:34] 10Analytics, 10DBA, 10Event-Platform, 10WMF-Architecture-Team, 10Services (later): Consistent MediaWiki state change events | MediaWiki events as source of truth - https://phabricator.wikimedia.org/T120242 (10akosiaris) Drive by comments by yours truly: * Do we have estimations (or even better hard data... [11:27:28] 10Analytics, 10LDAP-Access-Requests, 10SRE, 10CommRel-Specialists-Support (Apr-Jun-2021), 10Patch-For-Review: Please grant CRS access to Superset/Turnilo (deadline EOD Monday 17) - https://phabricator.wikimedia.org/T282589 (10elukey) [11:29:02] 10Analytics, 10LDAP-Access-Requests, 10SRE, 10CommRel-Specialists-Support (Apr-Jun-2021), 10Patch-For-Review: Please grant CRS access to Superset/Turnilo (deadline EOD Monday 17) - https://phabricator.wikimedia.org/T282589 (10elukey) >>! In T282589#7085443, @mpopov wrote: > Thanks so much @elukey you're... [11:30:41] 10Analytics, 10LDAP-Access-Requests, 10SRE, 10CommRel-Specialists-Support (Apr-Jun-2021), 10Patch-For-Review: Please grant CRS access to Superset/Turnilo (deadline EOD Monday 17) - https://phabricator.wikimedia.org/T282589 (10elukey) 05Open→03Resolved @Elitre everything should be done, please ping me... [12:04:49] https://scala-lang.org/blog/2021/05/14/scala3-is-here.html :O [12:26:43] 10Analytics, 10Event-Platform, 10Patch-For-Review: LandingPageImpression Event Platform Migration - https://phabricator.wikimedia.org/T282855 (10awight) [12:57:31] (03PS2) 10Awight: Add LandingPageImpression schema to analytics/legacy [schemas/event/secondary] - 10https://gerrit.wikimedia.org/r/691095 (https://phabricator.wikimedia.org/T282855) [13:29:40] dcausse: zpapierski whatcha doin today? i'd love a rdf-streaming-updater codewalkthrough :) [13:29:55] ottomata: sure! [13:29:57] sure, [13:30:17] ok, which one of us then :D [13:30:18] when's good? [13:30:26] both? :) [13:30:30] ottomata: finishing something, in 15min? [13:30:33] ok [13:30:34] pfct [13:30:37] I can whenever [13:30:44] a-team ^ in case anyone else is interested [13:31:03] ottomata: set up a meet [13:31:06] k [13:32:42] wdqs rdf-streaming-updater code walkthrough [13:32:42] Friday, May 14 · 9:45 – 10:15am [13:32:42] Google Meet joining info [13:32:42] Video call link: https://meet.google.com/gfv-enqr-ehs [13:32:43] Or dial: ‪(CA) +1 226-213-8281‬ PIN: ‪123 954 012 3577‬# [13:32:43] More phone numbers: https://tel.meet/gfv-enqr-ehs?pin=1239540123577 [13:33:55] milimetric: ^ [13:34:07] ottomata: relatedly https://wikitech.wikimedia.org/wiki/Wikidata_Query_Service/Flink_On_Kubernetes (mainly discussions with serviceops) [13:34:20] ottomata: 30min, I love your optimism :) [13:34:27] haha, well i had to put something [13:34:30] ty dcausse reading [14:48:01] (03PS1) 10Ottomata: Add example to link_suggestion_interaction 1.0.0 [schemas/event/secondary] - 10https://gerrit.wikimedia.org/r/691232 (https://phabricator.wikimedia.org/T278177) [14:57:24] (03CR) 10Ottomata: [C: 03+2] Add example to link_suggestion_interaction 1.0.0 [schemas/event/secondary] - 10https://gerrit.wikimedia.org/r/691232 (https://phabricator.wikimedia.org/T278177) (owner: 10Ottomata) [14:57:59] (03Merged) 10jenkins-bot: Add example to link_suggestion_interaction 1.0.0 [schemas/event/secondary] - 10https://gerrit.wikimedia.org/r/691232 (https://phabricator.wikimedia.org/T278177) (owner: 10Ottomata) [15:06:29] RECOVERY - Check unit status of produce_canary_events on an-launcher1002 is OK: OK: Status of the systemd unit produce_canary_events https://wikitech.wikimedia.org/wiki/Analytics/Systems/Managing_systemd_timers [15:18:03] (03PS1) 10Ottomata: Enable shouldGenerateExample [schemas/event/secondary] - 10https://gerrit.wikimedia.org/r/691236 (https://phabricator.wikimedia.org/T270134) [15:18:47] (03CR) 10Ottomata: "I implemented this in jsonschema-tools long ago, but apparently never enabled it!" [schemas/event/secondary] - 10https://gerrit.wikimedia.org/r/691236 (https://phabricator.wikimedia.org/T270134) (owner: 10Ottomata) [15:33:56] a-team gamezzZ?? [15:36:01] gonna skip today, i've had nonstop meetings and interviews all week [15:36:05] <3! [15:36:33] np! [16:25:09] 10Analytics, 10DBA, 10Event-Platform, 10WMF-Architecture-Team, 10Services (later): Consistent MediaWiki state change events | MediaWiki events as source of truth - https://phabricator.wikimedia.org/T120242 (10Ottomata) > Do we have estimations (or even better hard data) as to the number of missed events?... [16:25:31] 10Analytics, 10Event-Platform, 10Patch-For-Review: LandingPageImpression Event Platform Migration - https://phabricator.wikimedia.org/T282855 (10Ottomata) @awight you are a true hero :) [16:27:23] (03PS1) 10Ladsgroup: Add script to send ratio to max auto_increment value of tables [analytics/wmde/scripts] - 10https://gerrit.wikimedia.org/r/691242 (https://phabricator.wikimedia.org/T274419) [16:28:10] (03CR) 10jerkins-bot: [V: 04-1] Add script to send ratio to max auto_increment value of tables [analytics/wmde/scripts] - 10https://gerrit.wikimedia.org/r/691242 (https://phabricator.wikimedia.org/T274419) (owner: 10Ladsgroup) [16:31:36] (03PS2) 10Ladsgroup: Add script to send ratio to max auto_increment value of tables [analytics/wmde/scripts] - 10https://gerrit.wikimedia.org/r/691242 (https://phabricator.wikimedia.org/T274419) [16:32:24] (03CR) 10jerkins-bot: [V: 04-1] Add script to send ratio to max auto_increment value of tables [analytics/wmde/scripts] - 10https://gerrit.wikimedia.org/r/691242 (https://phabricator.wikimedia.org/T274419) (owner: 10Ladsgroup) [16:33:37] (03PS3) 10Ladsgroup: Add script to send ratio to max auto_increment value of tables [analytics/wmde/scripts] - 10https://gerrit.wikimedia.org/r/691242 (https://phabricator.wikimedia.org/T274419) [16:36:33] 10Analytics, 10Analytics-EventLogging, 10Analytics-Kanban, 10Better Use Of Data, and 4 others: Determine which remaining legacy EventLogging schemas need to be migrated or decommissioned - https://phabricator.wikimedia.org/T282131 (10Ottomata) [17:10:00] 10Analytics, 10Discovery, 10Platform Engineering, 10Product-Data-Infrastructure, 10SRE: Avoid accepting Kafka messages with whacky timestamps - https://phabricator.wikimedia.org/T282887 (10Ottomata) [17:10:16] 10Analytics, 10Discovery, 10Event-Platform, 10Platform Engineering, and 2 others: Avoid accepting Kafka messages with whacky timestamps - https://phabricator.wikimedia.org/T282887 (10Ottomata) [18:40:14] mforns: can i help with the virtualpageview druid job, i see there was a failure you were looking into? [18:41:02] yes, I think it's a permits error, but don't worry will do today [18:41:50] ok lemm eknow if i can help [18:43:48] ok, thanks ottomata :] [18:50:53] ottomata: ok, wanna pair? maybe you'll find this interesting... :] [18:51:30] sure mforns 3 mins [18:51:36] ofc [18:55:02] mforns: lost ya [19:59:53] 10Analytics, 10Analytics-EventLogging, 10Wikimedia-Developer-Portal, 10Documentation: Clean up EventLogging Schema: pages on meta - https://phabricator.wikimedia.org/T282584 (10Ottomata) > I'd say https://wikitech.wikimedia.org/wiki/Event_Platform/EventLogging_legacy plus many of the pages listed at https:... [20:00:29] 10Analytics, 10Analytics-EventLogging, 10Wikimedia-Developer-Portal, 10Documentation: Clean up EventLogging Schema: pages on meta - https://phabricator.wikimedia.org/T282584 (10Ottomata) I wanted to modify the EventLogging extension's schema namespace code to put a big ol' notification up, but I was told n... [20:01:01] 10Analytics, 10Analytics-EventLogging, 10Analytics-Kanban, 10Wikimedia-Developer-Portal, 10Documentation: Clean up EventLogging Schema: pages on meta - https://phabricator.wikimedia.org/T282584 (10Ottomata) a:03Ottomata [21:58:24] 10Analytics-EventLogging, 10Analytics-Radar, 10Metrics-Platform, 10Product-Data-Infrastructure, 10Vector (Vector (Tracking)): EventLogging revision popup gets hidden behind content in Vector - https://phabricator.wikimedia.org/T282550 (10Mholloway) I took a look at this earlier but will have to come back... [21:59:54] 10Analytics-EventLogging, 10Analytics-Radar, 10Metrics-Platform, 10Product-Data-Infrastructure, 10Vector (Vector (Tracking)): EventLogging revision popup gets hidden behind content in Vector - https://phabricator.wikimedia.org/T282550 (10Mholloway) This also doesn't occur on the Beta cluster. [22:30:57] 10Analytics: Analytics Hardware for Fiscal Year 2019/2020 - https://phabricator.wikimedia.org/T244211 (10Aklapper) @elukey: Ping - can this be closed? [23:10:38] 10Analytics, 10Analytics-EventLogging, 10Analytics-Kanban, 10Wikimedia-Developer-Portal, 10Documentation: Clean up EventLogging Schema: pages on meta - https://phabricator.wikimedia.org/T282584 (10Nuria) There is no third party (to our knowledge in the last 7 years) that is ever used this system so makes... [23:18:11] 10Analytics-EventLogging, 10Analytics-Radar, 10Metrics-Platform, 10Product-Data-Infrastructure, 10Vector (Vector (Tracking)): EventLogging revision popup gets hidden behind content in Vector - https://phabricator.wikimedia.org/T282550 (10Jdlrobson) Oh nice.. this might have got fixed by the patch I just...