[05:25:32] Analytics, Discovery, Maps: Add daily totals to grafana maps graph - https://phabricator.wikimedia.org/T122494#1905739 (Yurik) NEW [11:55:56] Analytics, MobileFrontend, Reading-Web-Sprint-63-Ellip…: Make MobileWebUIClickTracking schema usable (too big) - https://phabricator.wikimedia.org/T108723#1905981 (bmansurov) a:bmansurov [13:03:29] Analytics, MobileFrontend, Patch-For-Review, Reading-Web-Sprint-63-Ellip…: Make MobileWebUIClickTracking schema usable (too big) - https://phabricator.wikimedia.org/T108723#1906058 (bmansurov) Is purging old data part of the task? [15:40:49] Analytics-Kanban, DBA, Patch-For-Review: Pending maintenance on the eventlogging databases (db1046, db1047, dbstore1002, other dbstores) - https://phabricator.wikimedia.org/T120187#1906174 (jcrespo) Thinking it again, and given the time of the day it is already, I would reschedule it for January 19th. [15:53:32] oh hello! i am in a car! [15:58:42] ottomata: a car with wifi? [15:58:47] so lonelyyyy [16:00:18] Analytics-Kanban, DBA, Patch-For-Review: Pending maintenance on the eventlogging databases (db1046, db1047, dbstore1002, other dbstores) - https://phabricator.wikimedia.org/T120187#1906185 (Nuria) >Thinking it again, and given the time of the day it is already, I would reschedule it for January 19th.... [16:04:45] Analytics-Backlog, Wikimedia-Developer-Summit-2016: Developer summit session: Pageview API from the Event Bus perspective - https://phabricator.wikimedia.org/T112956#1906190 (Nuria) >It would be nice if the API was available from api.php on wikis, I do not see this as a good thing (maybe I am missing so... [16:14:24] Analytics-Kanban, Discovery, Discovery-Analysis-Sprint, Patch-For-Review: Create UDFs for categorising referers - https://phabricator.wikimedia.org/T115919#1906204 (Nuria) [16:16:46] (CR) Nuria: [C: 2 V: 2] Functions for identifying search engines as referers. [analytics/refinery/source] - https://gerrit.wikimedia.org/r/247601 (https://phabricator.wikimedia.org/T115919) (owner: OliverKeyes) [16:35:42] Analytics-Kanban: Productionize last access jobs for daily and monthly calculations - https://phabricator.wikimedia.org/T122514#1906263 (Nuria) NEW a:Nuria [16:43:40] nuria: Morning :) [16:43:51] madhuvishy: hola [16:44:06] madhuvishy: do you want to do lonely standup in a bit? [16:44:06] Everyone except you and me are off today [16:44:12] Ha ha [16:44:31] madhuvishy: ya, i thought i was the only one here [16:44:56] I have nothing else to do so might as well work :) [16:45:26] Ok let's batcave at 9 then! [16:47:28] madhuvishy: k [16:55:26] Hello o/ [16:56:15] if you want I'll join the standup [16:56:32] elukey: sure, it i sonly madhuvishy and I today [16:59:59] Analytics-Backlog, Ops-Access-Requests, operations: add mforns, milimetric, nuria,ottomata, madhuvishy and joal to piwik-roots - https://phabricator.wikimedia.org/T122325#1906314 (Nuria) Excellent, that should be it for the time coming. [17:01:11] nuria: I requested to enter the batcave again, I think that the last time you had to grant me access :) [17:01:23] elukey: let me invite you [17:01:54] elukey: done [17:02:32] ahhhh it was ringing on my phone and not on my laptop [17:09:58] Analytics, MobileFrontend, Patch-For-Review, Reading-Web-Sprint-63-Ellip…: Make MobileWebUIClickTracking schema usable (too big) - https://phabricator.wikimedia.org/T108723#1906336 (Jdlrobson) @bmansurov don't worry about that I can sync with @nuria to make that happen in sign off [17:26:41] Analytics-Backlog, Wikimedia-Developer-Summit-2016: Developer summit session: Pageview API from the Event Bus perspective - https://phabricator.wikimedia.org/T112956#1906387 (Anomie) >>! In T112956#1906190, @Nuria wrote: > I do not see this as a good thing (maybe I am missing something here?) from an ap... [17:33:46] Analytics-Backlog, Wikimedia-Developer-Summit-2016: Developer summit session: Pageview API from the Event Bus perspective - https://phabricator.wikimedia.org/T112956#1906401 (Nuria) >Why is that freedom a desirable or necessary thing for this pageview API? End users would likely find it more useful if... [17:38:49] Analytics-Backlog, Wikimedia-Developer-Summit-2016: Developer summit session: Pageview API from the Event Bus perspective - https://phabricator.wikimedia.org/T112956#1906409 (Anomie) >>! In T112956#1906401, @Nuria wrote: > >>Why is that freedom a desirable or necessary thing for this pageview API? End... [17:42:23] Analytics, ContentTranslation-Analytics, MediaWiki-extensions-ContentTranslation, operations: schedule a daily run of ContentTranslation analytics scripts on terbium - https://phabricator.wikimedia.org/T122479#1906420 (Nuria) Amire80: Are you aware of the report updater code running on 1002, you... [17:54:42] Analytics-Cluster, FINCH, Wikimedia-General-or-Unknown: Browser and platform stats for logged-in vs. anon users for security and product support decisions - https://phabricator.wikimedia.org/T58575#1906440 (GWicke) @ori brought up [this more detailed JS support study by gov.uk](https://gds.blog.gov.u... [17:55:25] Analytics-Backlog, Ops-Access-Requests, operations: add mforns, milimetric, nuria,ottomata, madhuvishy and joal to piwik-roots - https://phabricator.wikimedia.org/T122325#1906442 (jcrespo) This has been commented on the weekly meeting, and while there was positivity about providing higher privileges fo... [17:56:01] Analytics, ContentTranslation-Analytics, MediaWiki-extensions-ContentTranslation, operations: access for amire80 to stat1002.eqiad.wmnet - https://phabricator.wikimedia.org/T122524#1906445 (Amire80) NEW [17:57:48] Analytics, ContentTranslation-Analytics, MediaWiki-extensions-ContentTranslation, operations: access for amire80 to stat1002.eqiad.wmnet - https://phabricator.wikimedia.org/T122524#1906454 (Krenair) [18:01:58] Analytics-Backlog, ContentTranslation-Analytics, MediaWiki-extensions-ContentTranslation, operations: schedule a daily run of ContentTranslation analytics scripts on terbium - https://phabricator.wikimedia.org/T122479#1906472 (Nuria) [18:02:45] Analytics, ContentTranslation-Analytics, MediaWiki-extensions-ContentTranslation, operations: access for amire80 to stat1002.eqiad.wmnet - https://phabricator.wikimedia.org/T122524#1906474 (Nuria) Some example of thetypes of queries you need to run will be great (no need of those to file for acces... [18:03:42] Analytics-Backlog, ContentTranslation-Analytics, MediaWiki-extensions-ContentTranslation, operations: schedule a daily run of ContentTranslation analytics scripts on terbium - https://phabricator.wikimedia.org/T122479#1906476 (jcrespo) Do this query mysql? [18:09:34] Analytics-Backlog, ContentTranslation-Analytics, MediaWiki-extensions-ContentTranslation, operations: schedule a daily run of ContentTranslation analytics scripts on terbium - https://phabricator.wikimedia.org/T122479#1906497 (Nuria) An example of the queries you are running will be most helpful. [18:17:02] Analytics-Backlog, Wikimedia-Developer-Summit-2016: Developer summit session: Pageview API from the Event Bus perspective - https://phabricator.wikimedia.org/T112956#1906517 (Nuria) @Anomie: Sorry but we are talking pass each other, we can continue this conversation perhaps more efficiently in person.... [18:21:36] Analytics-Backlog, ContentTranslation-Analytics, MediaWiki-extensions-ContentTranslation, operations: schedule a daily run of ContentTranslation analytics scripts on terbium - https://phabricator.wikimedia.org/T122479#1906530 (jcrespo) The idea is that on production, only *mediawiki code* runs- it... [18:27:08] Analytics-Cluster, FINCH, Wikimedia-General-or-Unknown: Browser and platform stats for logged-in vs. anon users for security and product support decisions - https://phabricator.wikimedia.org/T58575#1906538 (Nuria) Nice, very interesting. Please have in mind that their methodology might count as "j... [18:30:18] Analytics, ContentTranslation-Analytics, MediaWiki-extensions-ContentTranslation, operations: access for amire80 to stat1002.eqiad.wmnet - https://phabricator.wikimedia.org/T122524#1906540 (Amire80) Most of these will be for the wikishared database. When I run them on terbium, they take a few minu... [18:30:59] Analytics-Backlog, ContentTranslation-Analytics, MediaWiki-extensions-ContentTranslation, operations: schedule a daily run of ContentTranslation analytics scripts on terbium - https://phabricator.wikimedia.org/T122479#1906542 (Amire80) Most of these will be for the wikishared database. When I run t... [18:34:20] madhuvishy: [18:34:26] the offsets select: [18:34:41] https://www.irccloud.com/pastebin/W5UQOPl1/ [18:34:58] any ideas for better perf are welcome [18:37:14] Analytics, ContentTranslation-Analytics, MediaWiki-extensions-ContentTranslation, Ops-Access-Requests, operations: access for amire80 to stat1002.eqiad.wmnet - https://phabricator.wikimedia.org/T122524#1906557 (Dzahn) [18:52:00] Analytics-Backlog, Wikimedia-Developer-Summit-2016: Developer summit session: Pageview API from the Event Bus perspective - https://phabricator.wikimedia.org/T112956#1906605 (Anomie) >>! In T112956#1906517, @Nuria wrote: > @Anomie: Sorry but we are talking pass each other, we can continue this conversat... [18:53:10] nuria: i was thinking - how is per country breakdown more intensive [18:53:18] it's just one more group by right [18:53:24] same amount of data [18:54:01] yes, same amount of data but the "internal table" created with hash, date, project, country is just that much bigger [18:54:39] madhuvishy: i will try it but i suspect it will use quite a bit more memory (i might be wrong) [18:55:26] nuria: aah that is true - but in my head that doesn't seem like a lot more - i might be off too of course [18:56:55] madhuvishy: ya, we have to try it, the swap through the data is teh same, the grouping by will be a lot more intense cause you are producing amuch bigger intermediate result [19:05:20] Analytics-Backlog, ContentTranslation-Analytics, MediaWiki-extensions-ContentTranslation, operations: schedule a daily run of ContentTranslation analytics scripts on terbium - https://phabricator.wikimedia.org/T122479#1906626 (jcrespo) I've just added wikishared to the analytics slave as a replicat... [19:05:56] Analytics-Backlog, ContentTranslation-Analytics, MediaWiki-extensions-ContentTranslation, operations: schedule a daily run of ContentTranslation analytics scripts on terbium - https://phabricator.wikimedia.org/T122479#1906627 (jcrespo) [19:06:01] Analytics, ContentTranslation-Analytics, MediaWiki-extensions-ContentTranslation, Ops-Access-Requests, operations: access for amire80 to stat1002.eqiad.wmnet - https://phabricator.wikimedia.org/T122524#1906629 (jcrespo) [19:06:53] Analytics-Backlog, Wikimedia-Developer-Summit-2016: Developer summit session: Pageview API from the Event Bus perspective - https://phabricator.wikimedia.org/T112956#1906630 (Tgr) >>! In T112956#1904116, @Milimetric wrote: > I just mean, can we find like five to ten people that will say this is actually... [19:20:34] Analytics, MobileFrontend, Patch-For-Review, Reading-Web-Sprint-63-Ellip…, WMF-deploy-2016-01-12_(1.27.0-wmf.10): Make MobileWebUIClickTracking schema usable (too big) - https://phabricator.wikimedia.org/T108723#1906643 (Jdlrobson) Open>Resolved [19:23:54] Analytics, MobileFrontend, Patch-For-Review, Reading-Web-Sprint-63-Ellip…, WMF-deploy-2016-01-12_(1.27.0-wmf.10): Make MobileWebUIClickTracking schema usable (too big) - https://phabricator.wikimedia.org/T108723#1906648 (Jdlrobson) @nuria I see the purging strategy is 90 days for https://meta.wi... [19:27:32] Analytics, ContentTranslation-Analytics, MediaWiki-extensions-ContentTranslation, Ops-Access-Requests, operations: access for amire80 to stat1002.eqiad.wmnet - https://phabricator.wikimedia.org/T122524#1906665 (jcrespo) There are 3 things that you need to get access: - a signed NDA, that you... [19:29:24] Analytics, ContentTranslation-Analytics, MediaWiki-extensions-ContentTranslation, Ops-Access-Requests, operations: access for amire80 to stat1002.eqiad.wmnet - https://phabricator.wikimedia.org/T122524#1906673 (Nuria) I think Amire80 might alreday have acess to 1002, i seem to remember him hav... [19:32:35] Analytics, ContentTranslation-Analytics, MediaWiki-extensions-ContentTranslation, Ops-Access-Requests, operations: access for amire80 to stat1002.eqiad.wmnet - https://phabricator.wikimedia.org/T122524#1906680 (jcrespo) @Nuria, as far as I can see, unless I am misinterpreting the permissions,... [19:37:07] Analytics, ContentTranslation-Analytics, MediaWiki-extensions-ContentTranslation, Ops-Access-Requests, operations: access for amire80 to stat1002.eqiad.wmnet - https://phabricator.wikimedia.org/T122524#1906686 (Amire80) Adding @Arrbee (Runa) as supervisor. I only remember running stuff on ter... [19:41:01] Analytics-Backlog, Wikimedia-Developer-Summit-2016: Developer summit session: Pageview API from the Event Bus perspective - https://phabricator.wikimedia.org/T112956#1906696 (RobLa-WMF) >>! In T112956#1906517, @Nuria wrote: > @Anomie: Sorry but we are talking pass each other, we can continue this conver... [19:43:49] Analytics, ContentTranslation-Analytics, MediaWiki-extensions-ContentTranslation, Ops-Access-Requests, and 2 others: access for amire80 to stat1002.eqiad.wmnet - https://phabricator.wikimedia.org/T122524#1906697 (jcrespo) Aside from that patch, assuming it is granted I *may* have to provide extra... [20:02:27] Analytics-Backlog: Visualize unique devices data in dashiki - https://phabricator.wikimedia.org/T122533#1906757 (Nuria) NEW [20:28:11] Analytics-Backlog, Developer-Relations, MediaWiki-API, Reading-Admin, and 6 others: Metrics about the use of the Wikimedia web APIs - https://phabricator.wikimedia.org/T102079#1906849 (Qgil) [20:51:21] Analytics-Backlog, Wikimedia-Developer-Summit-2016: Developer summit session: Pageview API from the Event Bus perspective - https://phabricator.wikimedia.org/T112956#1906886 (Nuria) @Anomie: What is your question exactly, can you please restate it? (I am kind of lost in this back and forth) [21:37:15] Analytics, RESTBase: REST API entry point web request statistics at the Varnish level - https://phabricator.wikimedia.org/T122245#1907179 (GWicke) [21:37:18] Analytics-Backlog, Developer-Relations, MediaWiki-API, Reading-Admin, and 6 others: Metrics about the use of the Wikimedia web APIs - https://phabricator.wikimedia.org/T102079#1907178 (GWicke) [22:32:39] Analytics-Backlog, Wikimedia-Developer-Summit-2016: Developer summit session: Pageview API from the Event Bus perspective - https://phabricator.wikimedia.org/T112956#1907332 (Anomie) >>! In T112956#1906886, @Nuria wrote: > @Anomie: What is your question exactly, can you please restate it? (I am kind of... [22:54:30] Analytics-Tech-community-metrics, DevRel-December-2015, Easy, Google-Code-In-2015, Patch-For-Review: Names on scr-contributors.html should link to corresponding people.html page - https://phabricator.wikimedia.org/T118192#1907380 (Aklapper) Open>Resolved This change has been merged and is d... [22:57:30] Analytics-Tech-community-metrics, DevRel-December-2015, DevRel-January-2016: Improve Key performance indicator: code contributors new / gone - https://phabricator.wikimedia.org/T63563#1907382 (Aklapper) [23:07:46] Analytics-Tech-community-metrics, DevRel-December-2015, Easy, Google-Code-In-2015, Patch-For-Review: Clarify Demographics definitions on korma (Attracted vs. time served; retained) - https://phabricator.wikimedia.org/T97117#1907400 (Aklapper) (GCI-contributed [[ https://github.com/Bitergia/grimoi... [23:12:36] Analytics-Tech-community-metrics, DevRel-December-2015: What is contributors.html for, in contrast to who_contributes_code.html and sc[m,r]-contributors.html and top-contributors.html? - https://phabricator.wikimedia.org/T118522#1907422 (Aklapper) [23:12:40] Analytics-Tech-community-metrics, Developer-Relations, DevRel-December-2015: Check whether it is true that we have lost 40% of (Git) code contributors in the past 12 months - https://phabricator.wikimedia.org/T103292#1907423 (Aklapper) [23:12:40] Analytics-Tech-community-metrics, DevRel-December-2015: OwlBot seems to merge random user accounts in korma user data - https://phabricator.wikimedia.org/T119755#1907420 (Aklapper) Open>Resolved https://github.com/Bitergia/mediawiki-identities/commit/1bba45afaa3696d5f44a0a531b66be062a33e660#diff-934... [23:25:48] Analytics, MobileFrontend, Patch-For-Review, Reading-Web-Sprint-63-Ellip…, WMF-deploy-2016-01-12_(1.27.0-wmf.10): Make MobileWebUIClickTracking schema usable (too big) - https://phabricator.wikimedia.org/T108723#1907439 (dr0ptp4kt) @jdlrobson, to follow up on our videoconference: I'm indifferent... [23:44:05] (CR) EBernhardson: "i believe this should be safe to merge now. I've submitted two related patches, one to mediawiki-core that removes BC in the formatter, an" [analytics/refinery/source] - https://gerrit.wikimedia.org/r/255105 (owner: DCausse)