[02:53:44] (03CR) 10Michael DiPietro: add stop query function (031 comment) [analytics/quarry/web] - 10https://gerrit.wikimedia.org/r/710067 (https://phabricator.wikimedia.org/T71037) (owner: 10Michael DiPietro) [03:55:42] (03PS3) 10Fdans: Refactor graphmodel to allow more than one project [analytics/wikistats2] - 10https://gerrit.wikimedia.org/r/712547 (https://phabricator.wikimedia.org/T283254) [06:25:51] 10Analytics, 10Beta-Cluster-Infrastructure, 10Beta-Cluster-reproducible: 502, connect failed for intake-analytics.wikimedia.beta.wmflabs.org - https://phabricator.wikimedia.org/T289029 (10AlexisJazz) [07:59:31] 10Quarry: Add black formatting to quarry linter - https://phabricator.wikimedia.org/T288976 (10dcaro) We can copy the scripts from spicerack: https://gerrit.wikimedia.org/r/plugins/gitiles/operations/software/spicerack/+/refs/heads/master/tox.ini#33 That will allow formatting it too (and using isort also), and i... [08:41:37] 10Analytics, 10SRE, 10Patch-For-Review: Trash cleanup cron spams on an-test hosts - https://phabricator.wikimedia.org/T286442 (10BTullis) I think it's just this single host an-test-client1001 that's sending this daily logspam now, isn't it? To me, the issue looks like we should just be setting up `/home` as... [11:22:16] 10Analytics, 10Analytics-Kanban, 10 Data-Engineering, 10Data-Engineering-Kanban, 10Patch-For-Review: Test Alluxio as cache layer for Presto - https://phabricator.wikimedia.org/T266641 (10BTullis) I was unaware of some of the limitations of the community edition of Alluxio, as opposed to the enterprise ed... [13:08:13] (03PS1) 10Lucas Werkmeister (WMDE): Optimize SQL queries by avoiding UNIX_TIMESTAMP() [analytics/wmde/scripts] - 10https://gerrit.wikimedia.org/r/713463 [13:08:15] (03PS1) 10Lucas Werkmeister (WMDE): Track number of active items [analytics/wmde/scripts] - 10https://gerrit.wikimedia.org/r/713464 (https://phabricator.wikimedia.org/T286903) [13:24:34] (03CR) 10Ladsgroup: [C: 03+2] Optimize SQL queries by avoiding UNIX_TIMESTAMP() [analytics/wmde/scripts] - 10https://gerrit.wikimedia.org/r/713463 (owner: 10Lucas Werkmeister (WMDE)) [13:24:53] (03PS1) 10Ladsgroup: Optimize SQL queries by avoiding UNIX_TIMESTAMP() [analytics/wmde/scripts] - 10https://gerrit.wikimedia.org/r/713363 [13:24:57] (03CR) 10Ladsgroup: [C: 03+2] Optimize SQL queries by avoiding UNIX_TIMESTAMP() [analytics/wmde/scripts] - 10https://gerrit.wikimedia.org/r/713363 (owner: 10Ladsgroup) [13:25:37] (03Merged) 10jenkins-bot: Optimize SQL queries by avoiding UNIX_TIMESTAMP() [analytics/wmde/scripts] - 10https://gerrit.wikimedia.org/r/713463 (owner: 10Lucas Werkmeister (WMDE)) [13:25:57] (03Merged) 10jenkins-bot: Optimize SQL queries by avoiding UNIX_TIMESTAMP() [analytics/wmde/scripts] - 10https://gerrit.wikimedia.org/r/713363 (owner: 10Ladsgroup) [13:44:11] 10Analytics-Clusters, 10 Data-Engineering: Create analytics-test-eqiad zookeeper cluster - https://phabricator.wikimedia.org/T289056 (10BTullis) [13:44:32] 10Analytics-Clusters, 10 Data-Engineering: Create analytics-test-eqiad zookeeper cluster - https://phabricator.wikimedia.org/T289056 (10BTullis) [14:17:45] 10Analytics, 10 Data-Engineering, 10Growth-Team, 10Metrics-Platform, 10Product-Analytics: Migrated Server-side EventLogging events recording http.client_ip as 127.0.0.1 - https://phabricator.wikimedia.org/T288853 (10nettrom_WMF) I'm adding Data Engineering and Metrics Platform to get some visibility on t... [14:26:52] 10Analytics, 10 Data-Engineering, 10Growth-Team, 10Metrics-Platform, 10Product-Analytics: Migrated Server-side EventLogging events recording http.client_ip as 127.0.0.1 - https://phabricator.wikimedia.org/T288853 (10nettrom_WMF) Adding @Milimetric and @mforns so they can follow up on this. [14:28:34] (03PS13) 10Michael DiPietro: add stop query function [analytics/quarry/web] - 10https://gerrit.wikimedia.org/r/710067 (https://phabricator.wikimedia.org/T71037) [14:30:39] (03CR) 10jerkins-bot: [V: 04-1] add stop query function [analytics/quarry/web] - 10https://gerrit.wikimedia.org/r/710067 (https://phabricator.wikimedia.org/T71037) (owner: 10Michael DiPietro) [14:33:22] 10Analytics, 10Better Use Of Data, 10Metrics-Platform, 10Performance-Team, and 2 others: Switch mw.user.sessionId back to session-cookie persistence - https://phabricator.wikimedia.org/T223931 (10MSantos) [14:38:08] 10Quarry: Add black formatting to quarry linter - https://phabricator.wikimedia.org/T288976 (10Bstorm) >>! In T288976#7287588, @dcaro wrote: > We can copy the scripts from spicerack: https://gerrit.wikimedia.org/r/plugins/gitiles/operations/software/spicerack/+/refs/heads/master/tox.ini#33 > That will allow form... [14:40:19] 10Quarry: Add black formatting to quarry linter - https://phabricator.wikimedia.org/T288976 (10dcaro) >>! In T288976#7288540, @Bstorm wrote: >>>! In T288976#7287588, @dcaro wrote: >> We can copy the scripts from spicerack: https://gerrit.wikimedia.org/r/plugins/gitiles/operations/software/spicerack/+/refs/heads/... [14:41:23] 10Quarry: Add black formatting to quarry linter - https://phabricator.wikimedia.org/T288976 (10dcaro) About the 80 char lines, that's just a config value that can be changed, it's been a while since I cared what that number is xd [14:49:36] 10Quarry: Add black formatting to quarry linter - https://phabricator.wikimedia.org/T288976 (10Bstorm) That script just runs the command https://gerrit.wikimedia.org/r/plugins/gitiles/operations/software/spicerack/+/refs/heads/master/utils/format-code.sh You can set up a config (or run it with -l 80). However,... [14:56:11] 10Analytics, 10 Data-Engineering, 10Growth-Team, 10Metrics-Platform, 10Product-Analytics: Migrated Server-side EventLogging events recording http.client_ip as 127.0.0.1 - https://phabricator.wikimedia.org/T288853 (10Mholloway) I believe (though I'm not 100% sure) that all WebRequests on the MW production... [15:07:35] 10Analytics, 10 Data-Engineering, 10Growth-Team, 10Metrics-Platform, 10Product-Analytics: Migrated Server-side EventLogging events recording http.client_ip as 127.0.0.1 - https://phabricator.wikimedia.org/T288853 (10kostajh) >>! In T288853#7288640, @Mholloway wrote: > I believe (though I'm not 100% sure)... [15:30:01] I have a commit to refinery that can go out with this week's train if it's convenient. https://gerrit.wikimedia.org/r/c/analytics/refinery/+/712209 [15:30:45] I'm not sure if I should submit it while the train is stationary, or in motion. [15:40:57] 10Quarry: Add black formatting to quarry linter - https://phabricator.wikimedia.org/T288976 (10Bstorm) After side chats and double checking things, why don't we put a simpler check that just checks the whole repo in CI after we format, but perhaps also add a tox command to format things too because that would be... [15:42:05] 10Quarry: Add black formatting to quarry linter - https://phabricator.wikimedia.org/T288976 (10Bstorm) [15:56:15] Hola team good mornin [15:56:41] Hello razzi :-) [16:00:37] (03PS14) 10Michael DiPietro: add stop query function [analytics/quarry/web] - 10https://gerrit.wikimedia.org/r/710067 (https://phabricator.wikimedia.org/T71037) [16:02:17] (03CR) 10jerkins-bot: [V: 04-1] add stop query function [analytics/quarry/web] - 10https://gerrit.wikimedia.org/r/710067 (https://phabricator.wikimedia.org/T71037) (owner: 10Michael DiPietro) [16:09:08] 10Analytics-Clusters, 10Analytics-Kanban, 10 Data-Engineering, 10Data-Engineering-Kanban: Upgrade Matomo to latest upstream - https://phabricator.wikimedia.org/T275144 (10BTullis) a:05RKemper→03None [16:14:43] 10Analytics-Clusters, 10Analytics-Kanban, 10observability, 10Patch-For-Review, 10User-fgiunchedi: Setup Analytics team in VO/splunk oncall - https://phabricator.wikimedia.org/T273064 (10razzi) [16:26:13] (03PS15) 10Michael DiPietro: add stop query function [analytics/quarry/web] - 10https://gerrit.wikimedia.org/r/710067 (https://phabricator.wikimedia.org/T71037) [16:34:13] 10Analytics, 10Analytics-Kanban, 10Product-Analytics, 10wmfdata-python: wmfdata-python's Hive query output includes logspam - https://phabricator.wikimedia.org/T275233 (10BTullis) Has this improved at all recently? The default logging level for hive CLI queries has been reduced from `INFO` to `WARNING`, so... [17:25:12] 10Analytics, 10 Data-Engineering, 10Growth-Team, 10Metrics-Platform, 10Product-Analytics: Migrated Server-side EventLogging events recording http.client_ip as 127.0.0.1 - https://phabricator.wikimedia.org/T288853 (10Mholloway) Thanks, @kostajh. From earlier discussions with @Ottomata, I believe that the... [17:25:55] (03CR) 10Bstorm: add stop query function (031 comment) [analytics/quarry/web] - 10https://gerrit.wikimedia.org/r/710067 (https://phabricator.wikimedia.org/T71037) (owner: 10Michael DiPietro) [18:18:00] (03PS16) 10Michael DiPietro: add stop query function [analytics/quarry/web] - 10https://gerrit.wikimedia.org/r/710067 (https://phabricator.wikimedia.org/T71037) [18:19:36] (03CR) 10jerkins-bot: [V: 04-1] add stop query function [analytics/quarry/web] - 10https://gerrit.wikimedia.org/r/710067 (https://phabricator.wikimedia.org/T71037) (owner: 10Michael DiPietro) [18:25:09] (03PS17) 10Michael DiPietro: add stop query function [analytics/quarry/web] - 10https://gerrit.wikimedia.org/r/710067 (https://phabricator.wikimedia.org/T71037) [18:27:11] (03CR) 10jerkins-bot: [V: 04-1] add stop query function [analytics/quarry/web] - 10https://gerrit.wikimedia.org/r/710067 (https://phabricator.wikimedia.org/T71037) (owner: 10Michael DiPietro) [18:33:26] (03PS18) 10Michael DiPietro: add stop query function [analytics/quarry/web] - 10https://gerrit.wikimedia.org/r/710067 (https://phabricator.wikimedia.org/T71037) [18:40:32] (03CR) 10Michael DiPietro: add stop query function (031 comment) [analytics/quarry/web] - 10https://gerrit.wikimedia.org/r/710067 (https://phabricator.wikimedia.org/T71037) (owner: 10Michael DiPietro) [19:07:17] (03CR) 10Bstorm: [C: 03+1] "That operates very nicely! It's a bit weird that it ends up with "failed" as the status, but it's better than it running for half an hour," [analytics/quarry/web] - 10https://gerrit.wikimedia.org/r/710067 (https://phabricator.wikimedia.org/T71037) (owner: 10Michael DiPietro) [19:23:39] 10Analytics, 10 Data-Engineering, 10Growth-Team, 10Metrics-Platform, and 2 others: Migrated Server-side EventLogging events recording http.client_ip as 127.0.0.1 - https://phabricator.wikimedia.org/T288853 (10Mholloway) >>! In T288853#7289080, @Mholloway wrote: > I believe that the top-level `http` and `me... [20:33:12] 10Analytics, 10Product-Analytics (Kanban), 10Readers-Web-Backlog (Tracking): Add UniversalLanguageSelector to the allowlist - https://phabricator.wikimedia.org/T287256 (10jwang) [21:09:46] (03CR) 10Michael DiPietro: add stop query function (031 comment) [analytics/quarry/web] - 10https://gerrit.wikimedia.org/r/710067 (https://phabricator.wikimedia.org/T71037) (owner: 10Michael DiPietro) [21:42:28] 10Analytics, 10 Data-Engineering, 10Growth-Team, 10Metrics-Platform, and 2 others: Migrated Server-side EventLogging events recording http.client_ip as 127.0.0.1 - https://phabricator.wikimedia.org/T288853 (10Tgr) IMO there is value in client-side and server-side events indicating the client IP in an ident...