[08:45:57] <wikibugs>	 10Analytics, 06Discovery: grant access to hue.wikimedia.org to Guillaume - https://phabricator.wikimedia.org/T158589#3042215 (10Gehel) 05Open>03Resolved Access has been granted, and it works! Thanks @elukey
[11:34:41] <elukey>	 milimetric: o/ - what sites do we track with piwik other than transparency? 
[11:35:07] <elukey>	 because I can't see from the UI where we track other things
[11:35:22] <elukey>	 but there is definitely more traffic :D
[12:49:19] * elukey lunch!
[14:36:27] <joal>	 Hi elukey - I indeed have no comment on the network ACLs :)
[14:36:52] <joal>	 elukey: To me, simpler is better  in the limit of what moritzm judges safe :)
[14:37:18] <elukey>	 :)
[15:15:49] <milimetric>	 elukey: yeah, there's the LDAP authentication and also separate piwik authentication.  I have the password on stat1002:/home/milimetric/piwik.credentials
[15:15:57] <milimetric>	 elukey: the websites we track are:
[15:16:36] <milimetric>	 foundation, iOS app, iOS beta app, foundation, wikimetrics, annual.wikimedia.org, edit team dashboards, wikipedia 15
[15:17:56] <elukey>	 milimetric: I just chmodded your file :D
[15:18:26] <elukey>	 no reason for others and wikidev to be able to read it
[15:19:03] <milimetric>	 yeah, good call, I mean, it's on stat1002 so if someone has those permissions then piwik is definitely less sensitive than other stuff they have access to
[15:19:10] <milimetric>	 but yeah, reducing surface area is always good
[15:21:58] <elukey>	 milimetric: I'd like to upgrade it to the 2.17 version and see if the error goes away, it might be something related to the backend..
[15:23:58] <milimetric>	 elukey: sure, sounds good to me
[15:24:26] <wikibugs>	 10Analytics-Tech-community-metrics: Deployment of IRC panel - https://phabricator.wikimedia.org/T138004#3043114 (10Aklapper) Still same status as six weeks ago in T138004#2923324...
[15:47:32] <wikibugs>	 (03PS7) 10Mforns: Add spark job to aggregate historical projectviews [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/337593 (https://phabricator.wikimedia.org/T156388)
[16:01:11] <fdans>	 elukey: standuppp
[16:01:35] <mforns>	 joal, standup???
[16:01:36] <fdans>	 joal: sameeee
[16:02:08] <wikibugs>	 06Analytics-Kanban, 13Patch-For-Review: Create EventStreams swagger spec docs endpoint - https://phabricator.wikimedia.org/T158066#3025501 (10Ottomata) a:03Ottomata
[16:02:34] <joal>	 fighting with hangout again :)
[16:03:35] <joal>	 Still something wrong :(
[16:28:19] <joal>	 mforns: can I take you a few minutes for metrics diffs review?
[16:28:32] <mforns>	 joal, sure!
[16:28:39] <mforns>	 omw
[16:31:08] <joal>	 https://appear.in/a-batcave
[16:33:04] <milimetric>	 try https://appear.in/wmf-analytics-batcave ?
[16:42:45] <wikibugs>	 06Analytics-Kanban, 06Operations, 10Traffic, 13Patch-For-Review, 15User-Elukey: Periodic 500s from piwik.wikimedia.org - https://phabricator.wikimedia.org/T154558#3043356 (10elukey) Checked the oxygen logs and the following UA is the only one getting 503s during the past 21 days:  ```244268 "Wikipedia/10...
[16:52:11] <wikibugs>	 06Analytics-Kanban, 06Operations, 10Traffic, 13Patch-For-Review, 15User-Elukey: Periodic 500s from piwik.wikimedia.org - https://phabricator.wikimedia.org/T154558#3043475 (10Milimetric) Ping @Fjalapeno this UA is the iOS app, right?  Any help you can provide Luca in finding out why we might be seeing 503...
[16:55:23] <wikibugs>	 06Analytics-Kanban, 06Operations, 10Traffic, 13Patch-For-Review, 15User-Elukey: Periodic 500s from piwik.wikimedia.org - https://phabricator.wikimedia.org/T154558#3043511 (10elukey) Just adding a note: I am seeing also others similar UA, that follows the same pattern.. but nothing else. I suspect that I...
[16:56:27] <wikibugs>	 06Analytics-Kanban, 13Patch-For-Review: Run a 1-off sqoop over the new labsdb servers - https://phabricator.wikimedia.org/T155658#3043515 (10JAllemandou) Last bit of checking - In metrics computed from reconstructed history.  | **metrics**                              |   **% difference in rows**   | **% diffe...
[16:56:34] <ottomata>	 hey milimetric
[16:57:16] <ottomata>	 why does reportupdater/output on stat1003 have almost everything in reportupdater/output/metrics
[16:57:32] <ottomata>	 ?
[16:57:55] <milimetric>	 no hard reason, just convention for this one api in dashiki
[16:58:00] <ottomata>	 hm ok
[16:58:15] <wikibugs>	 10Analytics, 10Analytics-Wikistats: Restore previous (January) reports on WikiStats - https://phabricator.wikimedia.org/T158500#3043526 (10ezachte) I found two anomalies so far, but can't reproduce the problem.  Anomaly 1) Possibly not related:  On every run obsolete temporary directories are removed from ../d...
[16:58:18] <milimetric>	 it uses /metrics as the root of {metric}/{submetric}/{wiki}.tsv pattern
[16:59:06] <milimetric>	 but that's ok, as long as people are using reportupdater we have a way of looking into every job starting from puppet
[16:59:07] <ottomata>	 milimetric:  https://analytics.wikimedia.org/datasets/periodic/reports/
[16:59:19] <milimetric>	 awesome, thanks
[16:59:23] <milimetric>	 I can switch the dashboards now
[16:59:40] <ottomata>	 cool
[16:59:49] <ottomata>	 so, the rsync -> thorium happens every 30 mins
[16:59:55] <ottomata>	 and the hardsync -> /datasets happens every *30
[17:00:04] <ottomata>	 so depending on timing, it could take up to an hour
[17:00:08] <ottomata>	 for new stuff to show up
[17:00:12] <milimetric>	 yep, makes sense
[17:10:05] <wikibugs>	 06Analytics-Kanban, 06Operations, 10Traffic, 06Wikipedia-iOS-App-Backlog, and 2 others: Periodic 500s from piwik.wikimedia.org - https://phabricator.wikimedia.org/T154558#3043573 (10Fjalapeno)
[17:13:51] <wikibugs>	 06Analytics-Kanban, 06Operations, 10Traffic, 06Wikipedia-iOS-App-Backlog, and 2 others: Periodic 500s from piwik.wikimedia.org - https://phabricator.wikimedia.org/T154558#3043580 (10Fjalapeno) @Milimetric having @joewalsh verify this for you
[17:28:10] <wikibugs>	 (03CR) 10Joal: "Comments inline - I think there can be less modifications for the same effect: instead of having a new sys endpoint, just have a new table" (034 comments) [analytics/aqs] - 10https://gerrit.wikimedia.org/r/338898 (https://phabricator.wikimedia.org/T156312) (owner: 10Fdans)
[17:30:23] <wikibugs>	 10Analytics, 06Developer-Relations, 10MediaWiki-API, 06Reading-Admin, and 3 others: Is User-Agent data PII when associated with Action API requests? - https://phabricator.wikimedia.org/T154912#3043631 (10Aklapper) >>! In T154912#2978774, @Tgr wrote: > * increasing the retention period is easy if there is a...
[17:41:25] <fdans>	 thanks for the review joal :)
[17:41:31] <joal>	 np fdans :)
[17:41:38] <joal>	 I hope it'll make sense fdans 
[17:44:32] <HaeB>	 joal, milimetric: have you been able to look further into making https://phabricator.wikimedia.org/T156628 public? (referenced in https://wikitech.wikimedia.org/w/index.php?title=Analytics%2FData%2FWebrequest&type=revision&diff=1492241&oldid=1395762 )
[17:45:12] <HaeB>	 would like to be able to look at the details, also to quantify the impact on overall pageviews (if any)
[17:45:31] <joal>	 HaeB: I think we agreed with milimetric it was ok - let's comfirm
[17:46:54] <musikanimal>	 hello friends, I found one article that is missing pageviews data yet it received on-wiki edits (not via API)
[17:46:58] <musikanimal>	 revision history: https://en.wikipedia.org/w/index.php?title=Hermaphrodites_with_Attitude&action=history
[17:47:18] <musikanimal>	 per-article daily endpoint for January 2017: https://wikimedia.org/api/rest_v1/metrics/pageviews/per-article/en.wikipedia/all-access/user/Hermaphrodites%20with%20Attitude/daily/2017010100/2017013100
[17:47:53] * elukey afk!!
[17:48:04] <musikanimal>	 any ideas why we get a 404 here? this doesn't seem to fall under one of the "gotchas"
[17:50:21] <musikanimal>	 The first edit on January 12 used Twinkle, which does use the API, but they would have had to load the page first to use Twinkle. Another user then edited later that same day without using any script, so would have also had to load the page in full
[17:57:31] <milimetric>	 musikanimal: nothing obvious seems to be different about that article title, please open an issue
[17:57:43] <musikanimal>	 ok will do
[17:58:33] <milimetric>	 HaeB / joal: I'm not sure that's safe, I don't remember agreeing it was, will chat HaeB privately
[17:58:38] <mforns>	 I was thinking sanitization could be the thing, but we do not apply k-anonimity to this dataset right?
[18:02:15] <joal>	 musikanimal: I have data for this page, but starting after 2017-02-16: https://wikimedia.org/api/rest_v1/metrics/pageviews/per-article/en.wikipedia/all-access/user/Hermaphrodites%20with%20Attitude/daily/2017010100/2017022000
[18:02:37] <musikanimal>	 yeah I saw that
[18:02:45] <musikanimal>	 strange! creating a phab now
[18:07:10] <wikibugs>	 10Analytics, 10Pageviews-API: Pageviews missing for article that received on-wiki edits - https://phabricator.wikimedia.org/T158681#3043790 (10MusikAnimal)
[18:07:14] <musikanimal>	 ^
[18:23:20] <wikibugs>	 06Analytics-Kanban, 06Operations, 10Traffic, 06Wikipedia-iOS-App-Backlog, and 2 others: Periodic 500s from piwik.wikimedia.org - https://phabricator.wikimedia.org/T154558#3043886 (10Fjalapeno) @Milimetric  @elukey verified that this is the iOS app
[18:27:27] <wikibugs>	 10Analytics-Tech-community-metrics, 06Developer-Relations: Measuring Time To First Code Change (TTFCC) - https://phabricator.wikimedia.org/T137201#3043927 (10Aklapper) 05Open>03declined Declining for the time being.  @Peter: If you have any feedback to T137201#2908904, please share your knowledge and reset...
[18:33:08] <travis-ci>	 wikimedia/mediawiki-extensions-EventLogging#636 (wmf/1.29.0-wmf.13 - 838abb7 : Translation updater bot): The build has errored.
[18:33:08] <travis-ci>	 Change view : https://github.com/wikimedia/mediawiki-extensions-EventLogging/compare/wmf/1.29.0-wmf.13
[18:33:08] <travis-ci>	 Build details : https://travis-ci.org/wikimedia/mediawiki-extensions-EventLogging/builds/203913904
[18:43:22] <wikibugs>	 06Analytics-Kanban, 06Operations, 10Traffic, 06Wikipedia-iOS-App-Backlog, and 2 others: Periodic 500s from piwik.wikimedia.org - https://phabricator.wikimedia.org/T154558#3043971 (10JoeWalsh) @Milimetric this UA is from the iOS app. In testing locally, I didn't see any 503s. A potential cause of the surge...
[18:43:34] <joal>	 Leaving for tonight a-team, see you tomorrow
[19:04:54] <wikibugs>	 10Analytics, 06Developer-Relations, 10MediaWiki-API, 06Reading-Admin, and 3 others: Is User-Agent data PII when associated with Action API requests? - https://phabricator.wikimedia.org/T154912#3044051 (10bd808) >>! In T154912#3043631, @Aklapper wrote: >>>! In T154912#2978774, @Tgr wrote: >> * increasing th...
[19:51:53] <wikibugs>	 10Analytics, 06Developer-Relations, 10MediaWiki-API, 06Reading-Admin, and 3 others: Is User-Agent data PII when associated with Action API requests? - https://phabricator.wikimedia.org/T154912#3044219 (10Tgr) >>! In T154912#3043631, @Aklapper wrote: > Does the question to #DevRel refer to the "+ all time"...
[20:22:57] <ashgrigas>	 milimetric mforns fdans started a new tab or our old spreadsheet to contain the questions mapped to metrics
[20:22:58] <ashgrigas>	 https://docs.google.com/spreadsheets/d/1M5m6z7YWSqxB3rqQstxPVBK-J5s70p1XMrTN7gYetC8/edit?usp=sharing
[20:23:07] <ashgrigas>	 please add some when you get a chance
[20:23:09] <ashgrigas>	 i started a few
[20:28:25] <milimetric>	 cool, will take a look a bit later
[20:34:42] <wikibugs>	 10Analytics, 10EventBus, 06Services (next): Page properties-change event is rejected if page was deleted - https://phabricator.wikimedia.org/T158702#3044489 (10Pchelolo)
[20:36:16] <wikibugs>	 10Analytics, 10EventBus, 06Services (next): Page properties-change event is rejected if page was deleted - https://phabricator.wikimedia.org/T158702#3044503 (10Ottomata) Not strongly opinionated, but for posterity purposes it sounds better to capture the event rather than not emit it.  So dumb that page_ids...
[20:51:27] <wikibugs>	 10Analytics, 10EventBus, 06Services (next): Page properties-change event is rejected if page was deleted - https://phabricator.wikimedia.org/T158702#3044489 (10mobrovac) Isn't the better question here: how does the event affect the page? I.e. if the page has already been deleted by the time the event fires,...
[20:54:48] <wikibugs>	 10Analytics, 10EventBus, 13Patch-For-Review, 06Services (next): Page properties-change event is rejected if page was deleted - https://phabricator.wikimedia.org/T158702#3044560 (10Pchelolo) @mobrovac So, I've found the way to get that original `page_id` for the page (see Gerrit) patch. On one hand, I agree...
[20:55:22] <wikibugs>	 10Analytics, 10EventBus, 13Patch-For-Review, 06Services (next): Page properties-change event is rejected if page was deleted - https://phabricator.wikimedia.org/T158702#3044561 (10Ottomata) What if the page is deleted, the properties are changed, and then later the page is restored?
[20:58:45] <wikibugs>	 10Analytics, 10EventBus, 13Patch-For-Review, 06Services (next): Page properties-change event is rejected if page was deleted - https://phabricator.wikimedia.org/T158702#3044563 (10mobrovac) >>! In T158702#3044561, @Ottomata wrote: > What if the page is deleted, the properties are changed, and then later th...
[21:03:37] <wikibugs>	 10Analytics, 10EventBus, 13Patch-For-Review, 06Services (next): Page properties-change event is rejected if page was deleted - https://phabricator.wikimedia.org/T158702#3044567 (10Pchelolo) >>! In T158702#3044563, @mobrovac wrote: >>>! In T158702#3044561, @Ottomata wrote: >> What if the page is deleted, th...