[09:34:58] good evening a-team!!!! [09:35:05] good to be back :) [12:55:18] hi fdans, how was your time off? Europe is on vacation [12:57:07] milimetric: heey! it was awesome thank you, lots of weird and wonderful situations [12:57:26] good to know, I thought everyone was giving me the ol silent treatment [12:58:12] :) [13:46:49] (03PS3) 10Fdans: Update jobs to remove is_productive and update time to revert [analytics/refinery] - 10https://gerrit.wikimedia.org/r/346755 (https://phabricator.wikimedia.org/T157362) [14:25:29] (03PS1) 10Fdans: Change name of field to revision_seconds_to_identity_revert [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/348461 (https://phabricator.wikimedia.org/T157362) [14:53:06] (03CR) 10Milimetric: "I'm halfway through this, but haven't finished, just FYI I'm not ignoring it" (031 comment) [analytics/dashiki] - 10https://gerrit.wikimedia.org/r/347305 (owner: 10Fdans) [14:55:16] 06Analytics-Kanban: Verfify MaxMind is updated regularly - https://phabricator.wikimedia.org/T162616#3186303 (10Milimetric) got it, makes sense. I thought the workers were also downloading, but they're just including the sync. Makes sense. [14:57:39] 10Analytics, 06Research-and-Data: geowiki data for Global Innovation Index - https://phabricator.wikimedia.org/T131889#3186306 (10Milimetric) @Rafaesrey: for future reference, when you reply here you seem to always include a huge email signature. You might be doing that over email so that makes sense, but it... [14:59:07] 06Analytics-Kanban: Security Upgrade for piwik - https://phabricator.wikimedia.org/T158322#3186310 (10Milimetric) @elukey: it should be trivial to backup the db, try the upgrade, and if it fails recover. If you think that saves you time we can announce a slight down-time on piwik and do it. [15:17:17] 10Analytics: Adding breakdowns to mw edit history reconstruction: wiki projects, categories (cohort) - https://phabricator.wikimedia.org/T163113#3186338 (10Nuria) [15:20:13] 06Analytics-Kanban: Investigate rise in IE views from Pakistan since 2015 - https://phabricator.wikimedia.org/T157404#3186360 (10Nuria) a:03fdans [15:26:10] 10Analytics, 10Analytics-General-or-Unknown: Provide regular cross-wiki reports on flagged revisions status - https://phabricator.wikimedia.org/T44360#440120 (10Nuria) Ping @Nemo_bis is this still relevant? [15:32:21] 10Analytics, 10Pageviews-API: Endpoint for average view rate in Pageview API - https://phabricator.wikimedia.org/T162933#3186398 (10Nuria) [15:33:44] 10Analytics, 10Pageviews-API: Endpoint for average view rate in Pageview API - https://phabricator.wikimedia.org/T162933#3180228 (10Nuria) We should have an "editing tools" tag as this really seems like a backend that would be useful for those. [15:45:03] 10Analytics, 07Story: Story: VitalSignsUser selects Monthly Pageviews metric - https://phabricator.wikimedia.org/T75331#762282 (10Nuria) This is about changing configuration and adding monthly pageviews. Real easy. [15:45:17] 06Analytics-Kanban, 07Easy: Story: VitalSignsUser selects Monthly Pageviews metric - https://phabricator.wikimedia.org/T75331#3186449 (10Nuria) [15:48:47] 10Analytics: Fix the pageview API "top" spec and 404 reporting {slug} - https://phabricator.wikimedia.org/T117018#3186459 (10Nuria) p:05Normal>03Low [15:50:10] 10Analytics, 10Datasets-General-or-Unknown: Make AQS return 0 instead of no values {slug} - https://phabricator.wikimedia.org/T118402#3186469 (10Nuria) p:05Normal>03Low [15:52:40] 10Analytics: Screen cast for how to use Pivot (5 minutes) - https://phabricator.wikimedia.org/T148776#3186477 (10Nuria) [15:59:01] 10Analytics, 07Easy: Don't accept data from automated bots in Event Logging - https://phabricator.wikimedia.org/T67508#3186492 (10Nuria) p:05Normal>03High [16:04:28] 10Analytics, 07Easy: Don't accept data from automated bots in Event Logging - https://phabricator.wikimedia.org/T67508#3186496 (10Nuria) We can do this work now that we are parsing the user agent for incoming EventLogging data. We need to: add a "self-identified" bot filter for all incoming data. We just ne... [16:06:47] 10Analytics, 10Analytics-EventLogging: Events with unexpected webhost values - https://phabricator.wikimedia.org/T57449#3186506 (10Nuria) Given that data disappears after 90 days these events are not likely to be there, declining ticket. Next time please specify what is odd about data in ticket description. [16:06:53] 10Analytics, 10Analytics-EventLogging: Events with unexpected webhost values - https://phabricator.wikimedia.org/T57449#3186509 (10Nuria) 05Open>03declined [16:17:00] 10Analytics, 07Easy: Don't accept data from automated bots in Event Logging - https://phabricator.wikimedia.org/T67508#3186562 (10Nuria) We can publish bot-dentified events to a bot schema that is similar to EventError that is only pushed to hadoop (not to db): https://meta.wikimedia.org/wiki/Schema:EventError [16:23:31] 06Analytics-Kanban, 07Easy: Don't accept data from automated bots in Event Logging - https://phabricator.wikimedia.org/T67508#3186576 (10Nuria) a:03fdans [18:02:53] 10Analytics, 10Analytics-Cluster, 06Operations, 06Research-and-Data, 10Research-management: GPU upgrade for stats machine - https://phabricator.wikimedia.org/T148843#3186978 (10Halfak) FYI: Most of the discussion has taken place in T159838 [18:44:38] (03CR) 10Milimetric: "looks good, the two comments are optional, but feel free to merge and we can do them later." (031 comment) [analytics/dashiki] - 10https://gerrit.wikimedia.org/r/347305 (owner: 10Fdans) [18:49:32] milimetric: got it, will refactor the lookup to sitematrix , super cheap to do i just run out of time friday [18:49:54] 10Analytics: Reportupdater writes a README in the output folder - https://phabricator.wikimedia.org/T163134#3187234 (10Milimetric) [19:00:39] 10Analytics: Reportupdater writes a README in the output folder - https://phabricator.wikimedia.org/T163134#3187281 (10mpopov) I'd also recommend adding a "description" field that each report can have. Our config YAMLs have those (e.g. https://github.com/wikimedia/wikimedia-discovery-golden/blob/master/modules/m... [19:51:56] 06Analytics-Kanban: Check abnormal pageviews for XHamster - https://phabricator.wikimedia.org/T158071#3187440 (10Nuria) Took another look and used (for comparison) the page "13 reasons why" which has more traffic but still within the same order of magnitude in mobile. Looking at an hour of traffic definitely t... [19:52:20] 06Analytics-Kanban: Check abnormal pageviews for XHamster - https://phabricator.wikimedia.org/T158071#3187443 (10Nuria) {F7597701} {F7597705} [20:27:36] (03CR) 10Milimetric: Add annotations to tabs layout (031 comment) [analytics/dashiki] - 10https://gerrit.wikimedia.org/r/348227 (https://phabricator.wikimedia.org/T162482) (owner: 10Mforns)