[02:05:31] Analytics-Wikistats: Provide total active editors for December 2014 - https://phabricator.wikimedia.org/T88403#1020012 (DarTar) Reproducing the wikistats definition in SQL is challenging and we know that AE data generated from the databases will produce [[ https://meta.wikimedia.org/wiki/Research:Refining_the... [02:12:07] fhocutt: I've come to the conclusion that nothing is straightforward :) [02:12:25] celery does some really complicated things that I would hate to have to do myself [02:12:47] and the ratio of what it does to the complexity of the learning curve is very good in my opinion [02:13:06] but in absolute terms, yes, the learning curve can be steeper than you would expect for "a queue". [02:41:48] Analytics-Wikistats: Discrepancies in historical total active editor numbers - https://phabricator.wikimedia.org/T87738#1020050 (Tbayer) [08:35:15] Popups, Analytics-EventLogging: Clicks on cite refs generates JavaScript errors in eventLogging when popups is active - https://phabricator.wikimedia.org/T88784#1020298 (Fomafix) NEW [12:08:48] Analytics-Tech-community-metrics: Remove the filter for key Wikimedia software projects in korma.wmflabs.org - https://phabricator.wikimedia.org/T86154#1020446 (Dicortazar) Once we remove the filter of key Wikimedia projects, there are some open questions: * projects to analyze: all of the projects that appea... [12:10:16] Analytics-Tech-community-metrics: "Contributors new and gone" in korma is stalled - https://phabricator.wikimedia.org/T88278#1020448 (Dicortazar) @Qgil This can be done during the February sprint. [12:10:28] Analytics-Tech-community-metrics: "Contributors new and gone" in korma is stalled - https://phabricator.wikimedia.org/T88278#1020449 (Dicortazar) [14:39:56] Multimedia, Analytics: Video view counts? - https://phabricator.wikimedia.org/T88775#1020605 (Tbayer) [14:41:17] Multimedia, Analytics: Video view counts? - https://phabricator.wikimedia.org/T88775#1020132 (Tbayer) I understand that it's indeed about Commons, and guess that Multimedia and Analytics might be relevant projects. [15:02:08] Analytics-Kanban, Analytics: Backfill event logging data after 02/05 outage - https://phabricator.wikimedia.org/T88692#1020626 (kevinator) p:Triage>High [15:18:03] Analytics-Cluster: Getting Ananth started - https://phabricator.wikimedia.org/T77196#1020653 (Nuria) [15:18:04] Analytics-Kanban, Analytics-Cluster: Geo-coding UDF - https://phabricator.wikimedia.org/T77683#1020652 (Nuria) Open>Resolved [15:22:53] Analytics-Kanban, Analytics-Cluster: Geo-coding UDF - https://phabricator.wikimedia.org/T77683#1020658 (kevinator) Code is here: https://gerrit.wikimedia.org/r/#/c/188012/ [16:34:21] (PS2) Jsahleen: Add additional dashboard for manual beta enablements for CX [analytics/limn-language-data] - https://gerrit.wikimedia.org/r/188556 (https://phabricator.wikimedia.org/T88516) [16:35:41] (CR) Milimetric: [C: 2] Add additional dashboard for manual beta enablements for CX [analytics/limn-language-data] - https://gerrit.wikimedia.org/r/188556 (https://phabricator.wikimedia.org/T88516) (owner: Jsahleen) [16:50:29] (PS1) Milimetric: Fix JSON syntax error [analytics/limn-language-data] - https://gerrit.wikimedia.org/r/189025 [16:52:06] (CR) Milimetric: [C: 2] Fix JSON syntax error [analytics/limn-language-data] - https://gerrit.wikimedia.org/r/189025 (owner: Milimetric) [17:01:37] Analytics-Tech-community-metrics: "Contributors new and gone" in korma is stalled - https://phabricator.wikimedia.org/T88278#1020753 (Dicortazar) a:Dicortazar>Acs [17:02:09] Analytics-Tech-community-metrics: "Contributors new and gone" in korma is stalled - https://phabricator.wikimedia.org/T88278#1008088 (Dicortazar) @acs is now in charge of this task to be done by the end of February [17:03:56] Analytics-Tech-community-metrics: Remove the filter for key Wikimedia software projects in korma.wmflabs.org - https://phabricator.wikimedia.org/T86154#1020766 (Dicortazar) a:Dicortazar>Acs [17:26:29] (PS1) Milimetric: Fix up sql scripts to work on a daily cron [analytics/limn-language-data] - https://gerrit.wikimedia.org/r/189030 [17:26:41] (CR) Milimetric: [C: 2] Fix up sql scripts to work on a daily cron [analytics/limn-language-data] - https://gerrit.wikimedia.org/r/189030 (owner: Milimetric) [17:26:50] (Merged) jenkins-bot: Fix up sql scripts to work on a daily cron [analytics/limn-language-data] - https://gerrit.wikimedia.org/r/189030 (owner: Milimetric) [17:34:48] (PS1) Milimetric: Remove parens from tab name [analytics/limn-language-data] - https://gerrit.wikimedia.org/r/189032 [17:39:54] Engineering-Community, Phabricator, Project-Creators: Analytics-Volunteering and Wikidata's Need-Volunteer tags - https://phabricator.wikimedia.org/T88266#1020837 (kevinator) @aklapper when the analytics team discussed identifying tasks a volunteer could take on, we also saw the opportunity to create a work b... [17:42:01] (CR) Jsahleen: [C: 2] "Looks good. Thanks!" [analytics/limn-language-data] - https://gerrit.wikimedia.org/r/189032 (owner: Milimetric) [17:42:07] (Merged) jenkins-bot: Remove parens from tab name [analytics/limn-language-data] - https://gerrit.wikimedia.org/r/189032 (owner: Milimetric) [17:43:01] Engineering-Community, Phabricator, Project-Creators: Analytics-Volunteering and Wikidata's Need-Volunteer tags - https://phabricator.wikimedia.org/T88266#1020842 (Aklapper) Ah. Thanks! Those easy ones should probably also have an "easy" tag, for consistency and less isolation (when a new contributor is simpl... [17:48:55] milimetric, I suddenly can't connect to analytics-store mysql any more... Is it happening to you also? [17:49:15] * milimetric checks [17:49:31] mforns: yes, I can not connect [17:49:42] error 2003 [17:49:48] HY000 [17:49:52] yes, same [17:49:59] k, :( [17:50:44] milimetric, what do you do in this cases? [17:51:02] mforns: find something else to work on :) [17:51:18] milimetric, ok, hehe [17:51:30] also, this: [17:51:53] springle: mforns and I are getting ERROR 2003: HY000 when trying to connect to analytics-store from stat1003 [17:52:31] right [17:54:26] milimetric: it crashed. don't know why [17:56:14] thanks, sean, I'm not sure either. I ran two really light queries on it a bit earlier, I think mforns was pushing it a bit harder, but nothing out of the ordinary [17:57:30] it's replaying transaction logs now. give it a while [17:58:08] thanks, no rush from my point of view [17:58:21] it caught a stack trace so there's that. we can check upstream bugs [17:58:28] * springle goes back to zzz :) [17:58:46] :( oops, sorry to wake you [17:58:57] milimetric: not you. pager [18:02:02] milimetric, I was certainly pushing it harder... although, at the time it crashed I had no queries running [18:02:41] yeah, it's probably not you, he's got a stack trace so I'm sure he'll let us know [18:25:49] Analytics-Kanban, Analytics-Cluster: WMF has technical documentation on UC by last visited date [5 pts] {bear} - https://phabricator.wikimedia.org/T88812#1020901 (kevinator) NEW [18:27:39] Analytics-Kanban, Analytics-Cluster: Implement Last Visited cookie - https://phabricator.wikimedia.org/T88813#1020908 (kevinator) NEW [18:28:03] Analytics-Kanban, Analytics-Cluster: Implement Last Visited cookie [34 pts] {bear} - https://phabricator.wikimedia.org/T88813#1020908 (kevinator) [18:30:30] Analytics-Kanban, Analytics-Cluster: WMF has report of monthly UCs by project [13 pts] {bear} - https://phabricator.wikimedia.org/T88814#1020916 (kevinator) NEW [19:16:42] Analytics-Kanban, Analytics-Cluster: Implement Last Visited cookie [34 pts] {bear} - https://phabricator.wikimedia.org/T88813#1021085 (kevinator) [19:16:43] Analytics-Kanban, Analytics-Cluster: WMF has report of monthly UCs by project [13 pts] {bear} - https://phabricator.wikimedia.org/T88814#1021084 (kevinator) [19:16:44] Analytics-Kanban, Analytics-Cluster: WMF has technical documentation on UC by last visited date [5 pts] {bear} - https://phabricator.wikimedia.org/T88812#1021086 (kevinator) [19:16:46] Analytics-Kanban, Analytics-Cluster: {epic} WMF has UC report per project per month & day {bear} - https://phabricator.wikimedia.org/T88647#1021083 (kevinator) [19:27:49] * YuviPanda gives away some of his profit to milimetric [19:28:08] milimetric: there’s also a turnkey python / uwsgi thing now :) [19:28:08] [19:50:15] that's very cool YuviPanda. I hope people find all this deliciousness and if not we should market it better [20:24:34] milimetric: BTW is there a phab task for the token generation in core work that Alex is doing? [20:24:48] kevinator: it's not token generation he's doing [20:25:04] it's "implement the Schema:Edit for wikitext editing" [20:25:14] one small part of which is he needs to make a token [20:25:25] but there's a function for that [20:25:57] there's a phab task, one sec [20:26:24] kevinator: https://phabricator.wikimedia.org/T88027 [20:29:27] So does the platform team need to do any work if there’s already a function for that? [20:29:27] milimetric: :) when I'm back from vacation! Will add service manifests [20:30:08] as far as I know the instrumentation code itself, like tracking the whole funnel, implies changing core [20:30:14] edit links, php, js, etc. [20:30:29] it's pretty massive and I think it'll need to be merged in core with Platform's supervision [20:30:41] ahh got it. [20:30:42] one sec, lemme see if wikitext is an extension [20:31:26] kevinator: phew, it's just an extension: https://git.wikimedia.org/blob/mediawiki%2Fextensions%2FWikiEditor/de5f3932b92468d8deb54e670676ed7e52d113fe/README [20:31:38] but, still, that's an extension that a lot of people care about [20:31:52] I'm not 100% sure but Platform will probably be involved in those code reviews [20:33:42] <--- Alex [20:34:06] thanks :-) [20:34:19] It has a dependency in core so that we can log whether a save attempt was a success or a failure [20:34:36] seems core doesn't currently have a hook for this, so I made https://gerrit.wikimedia.org/r/#/c/189049/ [20:35:03] Krenair: I’m logging dependencies on the platform team - that’s why I brought this up. [20:35:20] It's a mediawiki core change so doesn't depend on WMF. [20:36:08] ok [20:47:41] I clearly don't understand how core is managed :) [21:25:09] Analytics: Total pageviews (new definition) for Oct-Dec 2014 - https://phabricator.wikimedia.org/T88844#1021505 (Tbayer) [21:31:02] Analytics-Kanban, Analytics: Total pageviews (new definition) for Oct-Dec 2014 - https://phabricator.wikimedia.org/T88844#1021516 (kevinator) p:Triage>High [21:37:46] Analytics: Number of new registrations for Oct-Dec 2014 - https://phabricator.wikimedia.org/T88846#1021545 (Tbayer) NEW [21:49:56] white flag [21:49:57] I surrender [21:50:21] I have been working for two hours to set up a cron on stat1003 to run some simple SQL [21:51:17] Analytics: Review EL requests from Mediaviewer - https://phabricator.wikimedia.org/T88849#1021596 (ggellerman) NEW a:kevinator [21:51:19] and not only have I managed to screw up the original job that was doing fine [21:51:35] but I also managed to trap my script into a folder than I no longer have permissions to [21:51:43] INSIDE my home directory [21:52:30] fml [22:02:02] (CR) Mforns: [C: 1] "AWESOME :]" (5 comments) [analytics/limn-edit-data] - https://gerrit.wikimedia.org/r/188601 (owner: Milimetric) [22:09:01] Analytics: Number of new registrations for Oct-Dec 2014 - https://phabricator.wikimedia.org/T88846#1021705 (kevinator) I will assign this task to someone on the team following my triaging meeting with Dario on 2015-02-09. [22:09:12] Analytics-Kanban, Analytics: Total pageviews (new definition) for Oct-Dec 2014 - https://phabricator.wikimedia.org/T88844#1021707 (kevinator) I will assign this task to someone on the team following my triaging meeting with Dario on 2015-02-09. [22:09:47] (CR) Milimetric: [C: -1] "working on comments, thanks for the review. -1 for the problem you found in buildHierarchy (I won't be sad if you -1 me, really)" (3 comments) [analytics/limn-edit-data] - https://gerrit.wikimedia.org/r/188601 (owner: Milimetric) [22:20:23] (PS4) Mforns: Integrated logging [analytics/limn-mobile-data] - https://gerrit.wikimedia.org/r/180828 (https://phabricator.wikimedia.org/T84892) (owner: Rtnpro) [22:33:27] Analytics-Kanban, Analytics: Total pageviews (new definition) for Oct-Dec 2014 - https://phabricator.wikimedia.org/T88844#1021792 (Ironholds) It should be trivial; SELECT LEFT(timestamp,7) AS yearmonth, SUM(pageviews) FROM staging.pageviews04 WHERE is_automata=0 AND is_spider = 0 AND left(TIMESTAMP,7) IN('201... [22:35:20] Analytics-Visualization: Improve logging - https://phabricator.wikimedia.org/T84892#1021796 (kevinator) a:rtnpro>mforns [22:36:00] Analytics-Visualization: Improve logging - https://phabricator.wikimedia.org/T84892#933170 (kevinator) reassigning to @mforns since Baha requested a fix. [22:36:15] Analytics-Visualization, Analytics-Kanban: Improve logging - https://phabricator.wikimedia.org/T84892#1021800 (kevinator) [23:29:19] Just a quick heads up. Namenodes are having issues again. Fail-over fails. I am on it. [23:30:16] jgage: You around? [23:33:55] thanks qchris [23:34:57] if we need to turn off processing, please let me know [23:44:04] thanks qchris, ellery was wondering