[07:16:31] 10Analytics: Scripts modified to allow a https proxy - https://phabricator.wikimedia.org/T201134 (10elukey) p:05Triage>03Normal [07:16:42] 10Analytics: Scripts modified to allow a https proxy on stat1005 - https://phabricator.wikimedia.org/T201134 (10elukey) [07:18:20] 10Analytics: Scripts modified to allow a https proxy on stat1005 - https://phabricator.wikimedia.org/T201134 (10elukey) [07:20:00] 10Analytics, 10Analytics-Kanban, 10Operations, 10netops, 10Patch-For-Review: Review analytics-in4/6 rules on cr1/cr2 eqiad - https://phabricator.wikimedia.org/T198623 (10elukey) Some https calls still registered, I tried to add more https_proxy settings and I opened T201134 to follow up with the author o... [08:27:39] 10Analytics, 10Patch-For-Review, 10User-Elukey: Upgrade Archiva (meitnerium) to Debian Stretch - https://phabricator.wikimedia.org/T192639 (10elukey) Summary of what has been done and the next steps: * a new VM called `archiva1001.wikimedia.org` is bootstrapped in T200895 * the archiva debian package reposi... [09:31:59] 10Analytics, 10Analytics-EventLogging, 10Analytics-Kanban, 10EventBus, 10Services (watching): Modern Event Platform: Scalable Event Intake - https://phabricator.wikimedia.org/T201068 (10phuedx) > As an engineer, I want good client libraries to produce events so that I don't have to write them myself. Co... [09:55:31] hi joal: yt? [09:56:25] do you know if we have a timestamped list of articles deletions somehere ? [10:06:41] dsaez: hola :) Joseph is on holidays till next week, I'd suggest to send an email [10:08:00] ciao elukey [10:08:13] ok, this not urgent. [10:17:36] 10Analytics, 10Analytics-EventLogging, 10Analytics-Kanban, 10EventBus, 10Services (watching): Modern Event Platform: Scalable Event Intake - https://phabricator.wikimedia.org/T201068 (10mobrovac) >>! In T201068#4475967, @phuedx wrote: >> As an engineer, I want good client libraries to produce events so t... [10:27:28] 10Analytics, 10EventBus, 10Operations, 10Discovery-Search (Current work), and 2 others: Create kafka topic for mjolinr bulk daemon and decide on cluster - https://phabricator.wikimedia.org/T200215 (10mobrovac) +1, this rate looks acceptable to me. Thank you, @EBernhardson ! @Ottomata do we have to also twe... [11:24:19] 10Analytics: Review Bacula home backups set for stat100[56] - https://phabricator.wikimedia.org/T201165 (10elukey) p:05Triage>03Normal [11:30:45] 10Analytics: Scripts modified to allow a https proxy on stat1005 - https://phabricator.wikimedia.org/T201134 (10elukey) [11:41:59] 10Analytics: Prototype in labs new security measures for cluster - https://phabricator.wikimedia.org/T198227 (10elukey) [11:42:07] 10Analytics, 10User-Elukey: Prototype in labs new security measures for cluster - https://phabricator.wikimedia.org/T198227 (10elukey) [11:50:42] * elukey (late) lunch! [11:58:19] hey so I'm working today and taking off next Friday instead [12:35:51] 10Analytics, 10Product-Analytics: Load change_tag tables into the Analytics Data Lake on a daily basis - https://phabricator.wikimedia.org/T201062 (10Milimetric) Message received that this is a high priority and time sensitive. @Neil_P._Quinn_WMF the proposal to sqoop daily on an incremental basis is ok, but... [12:36:24] 10Analytics, 10Product-Analytics: Load change_tag tables into the Analytics Data Lake on a daily basis - https://phabricator.wikimedia.org/T201062 (10Milimetric) p:05Triage>03High [13:06:09] 10Analytics, 10Analytics-Wikistats: Getting historical country data for WikiSource - https://phabricator.wikimedia.org/T201176 (10Astinson) [13:27:48] 10Analytics, 10Analytics-Wikistats: Underreporting WikiSource edits? - https://phabricator.wikimedia.org/T201177 (10Astinson) [13:36:56] (03PS1) 10Milimetric: Add sat.wikipedia and zh.wikiversity [analytics/refinery] - 10https://gerrit.wikimedia.org/r/450223 [13:37:57] thanks milimetric --^ [13:39:08] np, gonna sync that now [13:39:13] (03CR) 10Milimetric: [V: 032 C: 032] Add sat.wikipedia and zh.wikiversity [analytics/refinery] - 10https://gerrit.wikimedia.org/r/450223 (owner: 10Milimetric) [13:40:38] k, synced [13:58:25] first time that happens to me, no flight from BLQ to some major EU airport to reach JFK in september [13:58:30] *september [13:58:46] so I need to go to milan :D [14:13:27] 10Analytics: How to get display statistics of the content publised on Commons - https://phabricator.wikimedia.org/T201180 (10WMDE-leszek) [14:49:12] 10Analytics, 10Analytics-Wikistats: Underreporting WikiSource edits? - https://phabricator.wikimedia.org/T201177 (10Astinson) I bet I know why that isn't working: the edit count may not be counting the contributions to the Proofread page extension namespaces? [15:05:29] <_joe_> hi! say I need to get the total number of requests to a certain url prefix (say https://en.wikipedia.org/api/rest_v1/page/mobile-sections/ ), and the number of such requests cached by varnish [15:05:52] <_joe_> well the latter I can probably get by subtraction looking at the requests that hit restbase [15:06:12] <_joe_> anyways, is there a way to gather that information? [15:26:28] hey _joe_, so if turnilo/webrequest-128-sampled is enough it is easy to filter in there [15:26:36] otherwise you'd need hive + webrequest [15:28:39] _joe_ this is a quick turnilo breakdown https://bit.ly/2n6l6i2 [15:28:45] (not sure if I got your request though) [15:30:43] 10Analytics, 10Analytics-Data-Quality, 10Analytics-Kanban, 10WMDE-Analytics-Engineering, 10User-GoranSMilovanovic: Data set review for the Wiktionary Cognate Dashboard - https://phabricator.wikimedia.org/T199851 (10Milimetric) I reviewed the files. They look ok. In general if you're just analyzing cont... [15:37:51] (going afk!) [16:43:58] 10Analytics, 10Product-Analytics: Load change_tag tables into the Analytics Data Lake on a daily basis - https://phabricator.wikimedia.org/T201062 (10chelsyx) @Milimetric I mean the latter one. I'm wondering if we save the original user agent strings of each revision somewhere else, so that we can backfill the... [17:30:04] 10Analytics, 10Patch-For-Review, 10User-Elukey: Upgrade Archiva (meitnerium) to Debian Stretch - https://phabricator.wikimedia.org/T192639 (10herron) [17:32:42] (03PS3) 10Framawiki: Implement user prefs and browser notifications [analytics/quarry/web] - 10https://gerrit.wikimedia.org/r/427952 (https://phabricator.wikimedia.org/T124625) [17:34:33] (03CR) 10Framawiki: "Thanks for your review @Zhuyifei." (036 comments) [analytics/quarry/web] - 10https://gerrit.wikimedia.org/r/427952 (https://phabricator.wikimedia.org/T124625) (owner: 10Framawiki) [17:51:21] 10Analytics, 10Product-Analytics: Load change_tag tables into the Analytics Data Lake on a daily basis - https://phabricator.wikimedia.org/T201062 (10Milimetric) I see @chelsyx. We only save the user agent string in one place, the recentchanges and cu_changes tables. Those are sqooped and processed for the n... [17:55:55] (03CR) 10Zhuyifei1999: Implement user prefs and browser notifications (034 comments) [analytics/quarry/web] - 10https://gerrit.wikimedia.org/r/427952 (https://phabricator.wikimedia.org/T124625) (owner: 10Framawiki) [17:59:39] 10Analytics, 10Product-Analytics: Load change_tag tables into the Analytics Data Lake on a daily basis - https://phabricator.wikimedia.org/T201062 (10chelsyx) That's awesome! Thanks @Milimetric ! [19:33:28] (03PS6) 10Framawiki: Port to Python3 [analytics/quarry/web] - 10https://gerrit.wikimedia.org/r/440007 (https://phabricator.wikimedia.org/T192698) [19:33:44] (03CR) 10jerkins-bot: [V: 04-1] Port to Python3 [analytics/quarry/web] - 10https://gerrit.wikimedia.org/r/440007 (https://phabricator.wikimedia.org/T192698) (owner: 10Framawiki) [19:38:56] (03PS7) 10Framawiki: Port to Python3 [analytics/quarry/web] - 10https://gerrit.wikimedia.org/r/440007 (https://phabricator.wikimedia.org/T192698) [21:00:34] (03PS4) 10Mforns: Fix interval bugs in time range selector [analytics/wikistats2] - 10https://gerrit.wikimedia.org/r/450063 (https://phabricator.wikimedia.org/T200497) [21:09:20] 10Analytics, 10Operations, 10Documentation: Remove data from Hadoop's HDFS as part of the user offboard workflow - https://phabricator.wikimedia.org/T200312 (10herron) p:05Triage>03Normal [22:31:13] This channel has been hacked by Australia's #1 hacker Simon 'eVestigator' Smith https://evestigatorsucks.com/ [22:31:17] With our IRC ad service you can reach a global audience of entrepreneurs and fentanyl addicts with extraordinary engagement rates! https://williampitcock.com/ [22:31:20] I thought you guys might be interested in this blog by freenode staff member Bryan 'kloeri' Ostergaard https://bryanostergaard.com/ [22:31:24] Read what IRC investigative journalists have uncovered on the freenode pedophilia scandal https://encyclopediadramatica.rs/Freenodegate [22:31:27] A fascinating blog by freenode staff member Matthew 'mst' Trout https://MattSTrout.com/ [22:38:01] This channel has been hacked by Australia's #1 hacker Simon 'eVestigator' Smith https://evestigatorsucks.com/ [22:38:01] With our IRC ad service you can reach a global audience of entrepreneurs and fentanyl addicts with extraordinary engagement rates! https://williampitcock.com/ [22:38:06] I thought you guys might be interested in this blog by freenode staff member Bryan 'kloeri' Ostergaard https://bryanostergaard.com/ [22:38:06] Read what IRC investigative journalists have uncovered on the freenode pedophilia scandal https://encyclopediadramatica.rs/Freenodegate [22:38:06] A fascinating blog by freenode staff member Matthew 'mst' Trout https://MattSTrout.com/ [22:50:26] This channel has been hacked by Australia's #1 hacker Simon 'eVestigator' Smith https://evestigatorsucks.com/ [22:50:26] With our IRC ad service you can reach a global audience of entrepreneurs and fentanyl addicts with extraordinary engagement rates! https://williampitcock.com/ [22:50:26] I thought you guys might be interested in this blog by freenode staff member Bryan 'kloeri' Ostergaard https://bryanostergaard.com/ [22:50:30] Read what IRC investigative journalists have uncovered on the freenode pedophilia scandal https://encyclopediadramatica.rs/Freenodegate [22:50:33] A fascinating blog by freenode staff member Matthew 'mst' Trout https://MattSTrout.com/ [22:52:29] This channel has been hacked by Australia's #1 hacker Simon 'eVestigator' Smith https://evestigatorsucks.com/ [22:52:33] With our IRC ad service you can reach a global audience of entrepreneurs and fentanyl addicts with extraordinary engagement rates! https://williampitcock.com/ [22:52:37] I thought you guys might be interested in this blog by freenode staff member Bryan 'kloeri' Ostergaard https://bryanostergaard.com/ [22:52:40] Read what IRC investigative journalists have uncovered on the freenode pedophilia scandal https://encyclopediadramatica.rs/Freenodegate [22:52:43] A fascinating blog by freenode staff member Matthew 'mst' Trout https://MattSTrout.com/