[00:41:53] Analytics, MediaWiki-API, Reading-Infrastructure-Team: Load API request count and latency data from Hadoop to a dashboard (limn?) - https://phabricator.wikimedia.org/T108414#1520419 (Tgr) NEW a:Tgr [00:42:22] Analytics, MediaWiki-API, Reading-Infrastructure-Team: Load API request count and latency data from Hadoop to a dashboard (limn?) - https://phabricator.wikimedia.org/T108414#1520429 (Tgr) [00:42:25] Analytics, MediaWiki-Authentication-and-authorization, Reading-Infrastructure-Team, MW-1.26-release, and 3 others: Create dashboard to track key authentication metrics before, during and after AuthManager rollout - https://phabricator.wikimedia.org/T91701#1520428 (Tgr) [00:42:42] Analytics, MediaWiki-API, Reading-Infrastructure-Team: Load API request count and latency data from Hadoop to a dashboard (limn?) - https://phabricator.wikimedia.org/T108414#1520419 (Tgr) [00:42:46] Analytics, Engineering-Community, MediaWiki-API, Research-and-Data, and 3 others: Metrics about the use of the Wikimedia web APIs - https://phabricator.wikimedia.org/T102079#1520432 (Tgr) [00:42:48] tgr, yeah, add me to the review when you write that, I'll make sure the load will be ok. [00:44:08] and check out the intermediate hourly aggregate data. If that's enough, you can usually query it without worrying about load, tgr [00:44:21] Analytics, MediaWiki-extensions-General-or-Unknown, Reading-Infrastructure-Team, Patch-For-Review: Track hook usage counts - https://phabricator.wikimedia.org/T106450#1520438 (Tgr) [00:44:25] Analytics, Engineering-Community, MediaWiki-API, Research-and-Data, and 3 others: Metrics about the use of the Wikimedia web APIs - https://phabricator.wikimedia.org/T102079#1355098 (Tgr) [00:44:30] That's wmf.pageview_hourly [00:54:09] Analytics, MediaWiki-API, Reading-Infrastructure-Team: Load API request count and latency data from Hadoop to a dashboard (limn?) - https://phabricator.wikimedia.org/T108414#1520419 (Tgr) [01:47:15] Analytics, Engineering-Community, MediaWiki-API, Research-and-Data, and 3 others: Metrics about the use of the Wikimedia web APIs - https://phabricator.wikimedia.org/T102079#1520665 (GWicke) There are now basic overall request rates available for RESTBase, with separate counters for public and priv... [08:56:18] Analytics, Engineering-Community, MediaWiki-API, Research-and-Data, and 3 others: Metrics about the use of the Wikimedia web APIs - https://phabricator.wikimedia.org/T102079#1521075 (Qgil) Thank you! Good, and I see that reports can be taken for a custom period, which will allow us to capture data... [12:49:52] Analytics-Tech-community-metrics, Engineering-Community, ECT-August-2015: Check whether it is true that we have lost 40% of code contributors in the past 12 months - https://phabricator.wikimedia.org/T103292#1521397 (Qgil) [12:52:35] Analytics-Tech-community-metrics, ECT-August-2015: Exclude third-party / pulled upstream code repositories from metrics - https://phabricator.wikimedia.org/T103984#1521405 (Qgil) [12:53:28] Analytics-Tech-community-metrics, Engineering-Community, ECT-August-2015: Automated generation of repositories for Korma - https://phabricator.wikimedia.org/T104845#1521408 (Qgil) [12:53:56] Analytics-Tech-community-metrics, ECT-August-2015: Mysterious repository breakdown(s)/sorting order - https://phabricator.wikimedia.org/T103474#1521409 (Qgil) [12:54:22] Analytics-Tech-community-metrics, ECT-August-2015: Remove deprecated repositories from korma.wmflabs.org code review metrics - https://phabricator.wikimedia.org/T101777#1521410 (Qgil) [12:56:06] Analytics-Tech-community-metrics, ECT-August-2015: Tech metrics should talk about "Affiliation" instead of organizations or companies - https://phabricator.wikimedia.org/T62091#1521413 (Qgil) [15:32:30] Analytics-Backlog, Reading-Admin, Research-and-Data, Research consulting: Request for data: sites traffic by topics/ subject areas and geographies - https://phabricator.wikimedia.org/T107613#1521528 (ezachte) I made a small change to the script which collects pageviews per category hierarchy, such th... [17:46:14] PROBLEM - Difference between raw and validated EventLogging overall message rates on graphite1001 is CRITICAL 20.00% of data above the critical threshold [30.0] [17:48:14] RECOVERY - Difference between raw and validated EventLogging overall message rates on graphite1001 is OK Less than 15.00% above the threshold [20.0] [19:57:52] Analytics, Engineering-Community, MediaWiki-API, Research-and-Data, and 3 others: Metrics about the use of the Wikimedia web APIs - https://phabricator.wikimedia.org/T102079#1521745 (GWicke) >>! In T102079#1521075, @Qgil wrote: > Where is it defined what makes a query "external"? In our productio... [20:32:04] Quarry: Query counter increases but draft query is not accessible when window is closed and query doesn't have a title - https://phabricator.wikimedia.org/T101394#1521767 (yuvipanda) Try now? They should show up as queries without titles... [20:32:35] Quarry: The last run time of all queries reports 5 months ago - https://phabricator.wikimedia.org/T87200#1521773 (yuvipanda) Is this still happeneing? [21:14:11] Quarry: Recurring queries - https://phabricator.wikimedia.org/T101835#1521826 (yuvipanda) An extra table would be required - schedules. It'll have: (id, query, schedule), where schedule is one of 'daily, weekly, monthly'. And then we'll have celerybeat or something wake up every minute or so, check the sched... [21:16:49] Quarry: Recurring queries - https://phabricator.wikimedia.org/T101835#1521836 (yuvipanda) An alternative is to use crontab like mechanics, but have those be randomly generated by the code when it is selected. This will distribute them randomly, and also give people an accurate estimate of when this gets upda... [21:37:57] Quarry: Recurring queries - https://phabricator.wikimedia.org/T101835#1521874 (valhallasw) The tsreports approach to this is regenerating on access, but showing the cached version while the regeneration is in process (plus an ETA for the new version).