[08:36:40] YuviPanda, Hey [08:37:42] YuviPanda, what's up? [10:30:06] Analytics-Wikimetrics, Analytics-Engineering: Arrange for security review - https://phabricator.wikimedia.org/T76782#824529 (Aklapper) (Once wikimetrics is "ready" for the security review, please assign to csteipp.) [10:53:37] rtnpro: hey! [10:53:40] rtnpro: just woke up :) [14:13:30] Analytics-Refinery: Raw webrequest partitions for 2014-11-09T18/2H not marked successful - https://phabricator.wikimedia.org/T77016 (QChris) NEW p:Normal [14:15:48] Analytics-Refinery: Raw webrequest partitions for 2014-11-09T18/2H not marked successful - https://phabricator.wikimedia.org/T77016#824905 (QChris) It affects only esams bits caches, but all of them. | Host | Start of issue | End of issue | | --- | --- | --- | | cp3019.esams.wikimedia.org | 2014-11-09T18:43:... [14:30:06] Analytics-Refinery: Raw webrequest partitions for 2014-12-04T18/2H not marked successful - https://phabricator.wikimedia.org/T77019 (QChris) NEW p:Normal [14:33:22] Analytics-Refinery: Raw webrequest partitions for 2014-12-04T18/2H not marked successful - https://phabricator.wikimedia.org/T77019#824929 (QChris) It affects only esams bits caches, but all of them. | Host | Start of issue | End of issue | | --- | --- | --- | | cp3019.esams.wikimedia.org | 2014-12-04T18:56:... [14:47:24] Analytics-Refinery: Raw webrequest partitions for 2014-12-07T18/1H not marked successful - https://phabricator.wikimedia.org/T77022#824958 (QChris) [14:48:23] Analytics-Refinery: Raw webrequest partitions for 2014-12-07T19/1H not marked successful - https://phabricator.wikimedia.org/T77023 (QChris) NEW p:Normal [14:48:54] Project-Management, Research-and-Data, Analytics-Engineering: Migration of Analytics to Phabricator - https://phabricator.wikimedia.org/T826#824972 (Qgil) In relation to T434, #Analytics-Engineering looks pretty active. Can we consider this team fully migrated to Phabricator, or are there still tasks / sprin... [14:49:15] Analytics-Refinery: Raw webrequest partitions for 2014-12-07T20/2H not marked successful - https://phabricator.wikimedia.org/T77024 (QChris) NEW p:Normal [14:50:04] Analytics-Refinery: Raw webrequest partitions for 2014-12-07T20/2H not marked successful - https://phabricator.wikimedia.org/T77024#824974 (QChris) 2014-12-07T18/1H is handled in https://phabricator.wikimedia.org/T77022 2014-12-07T19/1H is handled in https://phabricator.wikimedia.org/T77023 [14:50:49] Analytics-Refinery: Raw webrequest partitions for 2014-12-07T19/1H not marked successful - https://phabricator.wikimedia.org/T77023#824985 (QChris) [14:52:34] Analytics-Refinery: Raw webrequest partitions for 2014-12-07T18/1H not marked successful - https://phabricator.wikimedia.org/T77022#824958 (QChris) [15:14:25] Analytics-Refinery: Decide on job.properties vs. {workflow,coordinator,bundle}.properties - https://phabricator.wikimedia.org/T70570#825024 (Ottomata) Open>Invalid a:Ottomata Pretty sure not needed. Closing. [15:18:52] yooo qchris_meeting! [15:19:18] heya sir ottomata! [15:19:20] so, i know you told me recently [15:19:27] but, what's the stutus with media url ID UDF? [15:19:38] if we are going to get this contractor working on UDFs soon, [15:19:48] i would like to get that thing wrapped up so he can use it as an example. [15:19:58] The code is working. [15:20:02] i have not fully reviewed yet, because i think it is not ready? [15:20:05] But it could need polishing here and there. [15:20:10] should I review? [15:20:16] aside from that, what would block us from merging? [15:20:30] I would not invest time in reviewing it yet, becasue the RFC is not done yet. [15:20:42] Mhmmm. [15:20:44] hm. [15:20:55] is the RFC on a wiki? [15:20:56] But I do not expect tooo big changes. [15:21:02] Yes, the RFC is on-wiki. [15:21:09] got link? [15:21:20] We'll certainly get more columns. [15:21:27] Sure. I'll grab the link. 1sec. [15:21:50] https://www.mediawiki.org/wiki/Requests_for_comment/Media_file_request_counts [15:21:57] ottomata: ^ there it is [15:23:11] So the code currently uses more static things than I'd want. [15:23:35] and the resolution stuff needs more more, if we get more columns. [15:23:58] There are not too many tests on the UDF itself, but that should be fine, as the main logic [15:24:08] is in generic subproject. [15:26:20] yes, agree about tests. [15:26:29] ok. i will review today. probably will ahve qs for you [15:26:37] what needed done with webstatscollector? [15:27:03] k. Cool about the review. [15:27:22] For webstatscollecter, I guess only the "moving around of files on gadolinium" is needed. [15:27:28] * qchris keeps finger crossed. [15:27:54] From puppet, I figured that all the md5sum recomputation should happen automatically, but I'll monitor that of course. [15:28:40] That's copying /a/qchris/2014-12-07-pagecounts-backfilling files to /a/webstats/dumps [15:29:31] (Email subject: Backfilling for pagecounts-raw for localssl) [15:36:44] Analytics-EventLogging: Engineer reads documentation on Wikitech to set up a dashboard from EL data [3 pts] - https://phabricator.wikimedia.org/T76364#825048 (kevinator) [15:40:51] Analytics-EventLogging: Engineer knows by when to expect a dashboard from EL data [1 pts] - https://phabricator.wikimedia.org/T76365#825060 (kevinator) [15:41:26] ah ok, still goign through emails [15:41:39] Analytics-EventLogging: Engineer reads an email announcement about the documentation for creating a dashboard from EL data [1 pts] - https://phabricator.wikimedia.org/T76367#825063 (kevinator) p:Unbreak!>Normal [15:43:37] Analytics-Refinery: Raw webrequest partitions for 2014-12-07T18/1H not marked successful - https://phabricator.wikimedia.org/T77022#825080 (QChris) It affects only esams bits caches, but all of them. | Host | Start of issue | End of issue | | --- | --- | --- | | cp3019.esams.wikimedia.org | 2014-12-07T18:07:... [15:45:46] Analytics-Refinery: Raw webrequest partitions for 2014-12-07T19/1H not marked successful - https://phabricator.wikimedia.org/T77023#825086 (QChris) [15:52:19] Analytics-Refinery: Raw webrequest partitions for 2014-12-07T20/2H not marked successful - https://phabricator.wikimedia.org/T77024#825107 (QChris) It affects only esams bits caches, but all of them. | Host | Start of issue | End of issue | | --- | --- | --- | | cp3019.esams.wikimedia.org | 2014-12-07T20:29:... [15:53:08] qchris: how did you backfill webstatscollector pagecounts-all? [15:53:12] sorry [15:53:14] pagecounts-raw* [15:53:14] ? [15:53:16] from hive? [15:53:37] I stripped pagecounts-all-sites to the relevant sites. [15:53:46] That was a Bash script. [15:53:50] Let me find it ... [15:54:37] It is in /home/qchris/tmp/2014-12-07-pagecounts-backfilling/filter_all_sites_to_raw.sh [15:54:40] on stat1002 [15:55:01] Analytics-Refinery: Raw webrequest partitions for 2014-12-07T20/2H not marked successful - https://phabricator.wikimedia.org/T77024#825118 (Ottomata) HM. There is now an extra varnishkafka instance running on all bits servers (statsv). I wonder if the recent increase in bits message loss is related. [15:55:04] ah ok [15:55:08] interesting [15:55:14] so I should just mv these files in? [15:55:25] If possible, cp them. [15:55:28] ok [15:55:54] do you feel it is safe to overrwrite the existing files? [15:56:17] Yes. The existing files are wrong anyways, as they overcount. [15:56:51] I only generated files for the period between "merging localssl" and "deploying new C implementation of webstatscollector" [15:57:04] s/ C implementation of webstatscollector/webstatscollector/ [15:57:16] ok [16:00:01] Analytics-Engineering: Evaluate UX of Gerrit documentation - https://phabricator.wikimedia.org/T77059#825309 (ggellerman) [16:02:46] Analytics-Engineering: Getting Started in wikimetrics doc - https://phabricator.wikimedia.org/T77075#825421 (ggellerman) [16:13:30] Project-Management, Research-and-Data, Analytics-Engineering: Migration of Analytics to Phabricator - https://phabricator.wikimedia.org/T826#825684 (ggellerman) Here are Research & Data Trello boards: https://trello.com/b/k5N0ivoM/research-and-data https://trello.com/b/UcQSC5Au/research-and-data-backlog http... [16:14:46] qchris: filed copied. [16:14:55] ottomata: Thanks. [16:22:36] Analytics-Wikimetrics, Analytics-Engineering: Story: WikimetricsUser deletes user from cohort [21 pts] - https://phabricator.wikimedia.org/T75350#826066 (kevinator) @Capt_Swing, we brainstormed a couple of solutions. The first one is our favorite. In either case, it's not mandatory to remove invalid entries... [16:29:03] Analytics-Refinery: Raw webrequest partitions for 2014-12-01T18/2H not marked successful - https://phabricator.wikimedia.org/T77161 (QChris) NEW p:Normal [16:29:23] Analytics-Refinery: Raw webrequest partitions for 2014-12-01T18/2H not marked successful - https://phabricator.wikimedia.org/T77161#826273 (QChris) It affects only esams bits caches, but all of them. | Host | Start of issue | End of issue | | --- | --- | --- | | cp3019.esams.wikimedia.org | 2014-12-01T19:05:... [16:32:48] Analytics-Refinery: Raw webrequest partitions for 2014-11-30T19/1H not marked successful - https://phabricator.wikimedia.org/T77177#826439 (QChris) [16:32:58] Analytics-Refinery: Raw webrequest partitions for 2014-11-30T19/1H not marked successful - https://phabricator.wikimedia.org/T77177#826439 (QChris) It affects only esams bits caches, but all of them. | Host | Start of issue | End of issue | | --- | --- | --- | | cp3019.esams.wikimedia.org | 2014-11-30T19:32:... [16:38:11] Analytics-Refinery: Ananth to merge this change: https://gerrit.wikimedia.org/r/#/c/169346/ - https://phabricator.wikimedia.org/T77203 (ggellerman) NEW p:Triage [16:38:30] Analytics-Refinery: Getting Ananth started - https://phabricator.wikimedia.org/T77196#826613 (ggellerman) [16:41:28] Analytics-Refinery: collect UDF requirements - https://phabricator.wikimedia.org/T77222#826809 (ggellerman) p:Triage a:Ottomata [16:43:04] Analytics-Refinery: Getting Ananth started - https://phabricator.wikimedia.org/T77196#826879 (ggellerman) [16:55:19] Analytics-Dashiki, Analytics-Engineering: Vital Signs user reads description of metric - https://phabricator.wikimedia.org/T76741#827338 (Pginer-WMF) Both mockups look good. The main point to take int to account is that on repeated use this information becomes less relevant (compared to the graph). So showing... [17:27:46] Analytics-Refinery: Allow Mediawiki to set X-Analytics fields which means that Mediawiki code can set fields [17:31:02] Analytics-Refinery: Getting Ananth started - https://phabricator.wikimedia.org/T77196#828168 (kevinator) [17:32:53] Analytics-Refinery: Implement functionality to have things like page_id in the X-Analytics field - https://phabricator.wikimedia.org/T77416#828237 (ggellerman) [17:35:11] Analytics-Refinery: Allow Mediawiki to set X-Analytics fields which means that Mediawiki code can set fields - https://phabricator.wikimedia.org/T77389#828283 (Ottomata) [17:40:28] Analytics-Refinery: Decide on job.properties vs. {workflow,coordinator,bundle}.properties - https://phabricator.wikimedia.org/T70570#828361 (kevinator) Should this be higher priority? It doesn't seem like a big task and it's impacting current jobs. [17:40:38] Analytics-Refinery: Decide on job.properties vs. {workflow,coordinator,bundle}.properties - https://phabricator.wikimedia.org/T70570#828367 (kevinator) Should this be higher priority? It doesn't seem like a big task and it's impacting current jobs. [17:42:19] Analytics-Refinery: Implement functionality to have things like page_id in the X-Analytics field - https://phabricator.wikimedia.org/T77416#828237 (ggellerman) [18:13:08] Analytics-Wikimetrics, Analytics-Engineering: Story: WikimetricsUser deletes user from cohort [21 pts] - https://phabricator.wikimedia.org/T75350#829669 (Capt_Swing) @kevinator I think option 1 sounds really good. Do we only display the "Remove invalid" button if there are invalid users? Or, possibly we can g... [18:16:06] Project-Management, Research-and-Data, Analytics-Engineering: Migration of Analytics to Phabricator - https://phabricator.wikimedia.org/T826#829762 (Tnegrin) [18:17:48] Analytics-Wikimetrics, Analytics-Engineering: Story: WikimetricsUser deletes user from cohort [21 pts] - https://phabricator.wikimedia.org/T75350#829811 (kevinator) [18:18:44] (CR) Ottomata: [C: -1] "Comments inline." (14 comments) [analytics/refinery/source] - https://gerrit.wikimedia.org/r/169346 (owner: QChris) [18:21:35] Analytics-Refinery: Geo-coding UDF - https://phabricator.wikimedia.org/T77683 (Tnegrin) NEW p:Normal a:Ottomata [18:37:10] Analytics-Refinery: Getting Ananth started - https://phabricator.wikimedia.org/T77196#830297 (kevinator) [18:42:35] Analytics-Refinery: Geo-coding UDF - https://phabricator.wikimedia.org/T77683#830312 (ggellerman) [18:49:25] Labs-Team, Analytics-Engineering: LabsDB problems negatively affect analytics tools like Wikimetrics, Vital Signs, Quarry, etc. - https://phabricator.wikimedia.org/T76075#830524 (Tnegrin) [19:05:24] (PS2) Merlijn van Deen: Add meta info for run, rev and query [analytics/quarry/web] - https://gerrit.wikimedia.org/r/178128 [19:07:55] (PS2) Merlijn van Deen: Add metadata to json output [analytics/quarry/web] - https://gerrit.wikimedia.org/r/178129 [19:08:01] (CR) jenkins-bot: [V: -1] Add metadata to json output [analytics/quarry/web] - https://gerrit.wikimedia.org/r/178129 (owner: Merlijn van Deen) [19:08:36] (CR) Yuvipanda: [C: -1] Add meta info for run, rev and query (1 comment) [analytics/quarry/web] - https://gerrit.wikimedia.org/r/178128 (owner: Merlijn van Deen) [19:29:46] (PS3) Merlijn van Deen: Add meta info for run, rev and query [analytics/quarry/web] - https://gerrit.wikimedia.org/r/178128 [19:30:47] (PS3) Merlijn van Deen: Add metadata to json output [analytics/quarry/web] - https://gerrit.wikimedia.org/r/178129 [19:30:53] (CR) jenkins-bot: [V: -1] Add metadata to json output [analytics/quarry/web] - https://gerrit.wikimedia.org/r/178129 (owner: Merlijn van Deen) [19:31:10] (CR) Yuvipanda: [C: 2] Add meta info for run, rev and query [analytics/quarry/web] - https://gerrit.wikimedia.org/r/178128 (owner: Merlijn van Deen) [19:31:21] (Merged) jenkins-bot: Add meta info for run, rev and query [analytics/quarry/web] - https://gerrit.wikimedia.org/r/178128 (owner: Merlijn van Deen) [19:32:19] (PS4) Merlijn van Deen: Add metadata to json output [analytics/quarry/web] - https://gerrit.wikimedia.org/r/178129 [19:34:12] (CR) Yuvipanda: [C: 2] Add metadata to json output [analytics/quarry/web] - https://gerrit.wikimedia.org/r/178129 (owner: Merlijn van Deen) [19:34:18] (Merged) jenkins-bot: Add metadata to json output [analytics/quarry/web] - https://gerrit.wikimedia.org/r/178129 (owner: Merlijn van Deen) [19:41:51] Labs-Team, Analytics-Engineering: LabsDB problems negatively affect analytics tools like Wikimetrics, Vital Signs, Quarry, etc. - https://phabricator.wikimedia.org/T76075#831356 (Springle) MariaDB 10.0.15 upgrade done. Seems good with no *new* replication glitches that we've found. About to run the resync pro... [19:44:52] FINCH, Research-and-Data, Analytics-Engineering: Define user segments in a way that Product and Analytics can actually use in database queries - https://phabricator.wikimedia.org/T76908#831375 (ggellerman) [19:47:29] Analytics-Refinery: Allow Mediawiki to set X-Analytics fields which means that Mediawiki code can set fields - https://phabricator.wikimedia.org/T77389#831399 (Ironholds) JFYI: Christian and I have been chatting about this and I think it would remove a lot of silliness/complexity from the pageviews definition. [19:48:06] FINCH, Research-and-Data, Analytics-Engineering: Define user segments in a way that Product and Analytics can actually use in database queries - https://phabricator.wikimedia.org/T76908#831401 (ggellerman) [22:19:51] (CR) QChris: "> I am also hesitant to add a new maven module just for this." (10 comments) [analytics/refinery/source] - https://gerrit.wikimedia.org/r/169346 (owner: QChris) [22:26:48] James_F: I'm checking out your patch now [22:27:11] it looks like pasting the sql with tabs into mysql makes it freak out [22:27:29] i'm kind of idly replacing the tabs with spaces - ok if i submit a patchset? [22:34:09] milimetric: Hmm; it worked in my SQL client. [22:34:40] odd :) [22:34:44] milimetric: But if it breaks then let's replace them. :-) Totally OK to submit a patchset. [22:34:48] We use 4-char tabs but I can fiddle. [22:35:16] i made them 4-char [22:35:30] also - you have one line commented out with # in aborts_rates [22:35:34] did you mean that commented out? [22:35:38] i think it only likes -- [22:36:05] nope - i'm wrong, it doesn't care :) - but do you want it commented out? [22:37:03] James_F: ^ [22:37:20] line 3 there: https://gerrit.wikimedia.org/r/#/c/177943/1/edit/aborts_rates.sql,cm [22:38:00] milimetric: Yeah, it was intentional. [22:38:17] milimetric: It made the request very slow so I was going to leave it for now [22:38:50] hm - slowness seems to be the same, about 5 seconds in each case [22:39:03] the server gets hammered on sometimes, so it might not be you [22:41:25] (PS2) Milimetric: Provide some initial raw graphs for basic numbers [analytics/limn-edit-data] - https://gerrit.wikimedia.org/r/177943 (owner: Jforrester) [22:42:21] milimetric: Sure, but it's also a messy number. [22:42:37] (CR) Milimetric: [C: 2 V: 2] Provide some initial raw graphs for basic numbers [analytics/limn-edit-data] - https://gerrit.wikimedia.org/r/177943 (owner: Jforrester) [22:42:43] Whee. [22:43:02] milimetric: OK, if this works we should be self-serving for at least the initial run on these charts hereinafter. Thank you hugely! [22:43:04] :) now i'm going to push the dashboard.json to limn [22:43:10] * James_F nods. [22:43:13] and then at some point the data will be available and the graphs will start working [22:43:18] until then, it'll look empty [22:43:21] Is that something we can do, or do we need to ask you each time? [22:43:33] pushing the dashboard.json? [22:43:44] one sec, lemme check if you have rights [22:45:08] James_F: no you don't have rights right now. Would you like them? You would have to pip install limn-deploy [1] and then run "fab edit deploy.only_data" [22:45:11] [1] https://github.com/wikimedia/limn-deploy [22:45:30] milimetric: That looks… potentially OK. [22:45:41] * James_F worries about having access to things he doesn't know how to fix. :-) [22:45:51] James_F: it's totally fine to ping me :) [22:46:06] takes me like a second and then I can help troubleshoot if something goes wrong [22:46:26] * James_F nods. [22:46:29] OK, then… sure. [22:46:30] we'll do pings for now, if I get unresponsive, let me know and I'll set you guys up [22:46:35] * James_F nods. [22:46:37] That works. [22:47:12] k, then you have your empty looking dashboard for now, hopefully will be full in around an hour [22:47:13] http://edit-reportcard.wmflabs.org/ [22:47:30] i've gotta run soon but you have my cell if you need me. [22:47:31] Is the cron running? [22:48:13] See the bottom graph – it's only got data from Thursday. [22:50:39] Analytics: After switch to local ssl terminators, pagecounts-raw (C implementation of webstatscollector) overcounts HTTPS from some data-centers. - https://phabricator.wikimedia.org/T76390#832022 (QChris) Open>Resolved Backfilling is now complete. [22:50:40] Analytics: Network outage on 2014-11-30 affecting analytics infrastructure - https://phabricator.wikimedia.org/T76334#832024 (QChris) [22:51:40] James_F: yeah, weird - the file hasn't been updated since Thursday, the cron is running and not getting any errors... [22:51:41] Analytics: Network outage on 2014-11-30 affecting analytics infrastructure - https://phabricator.wikimedia.org/T76334#832025 (QChris) Open>Resolved Backfilling pagecounts-raw has been completed [22:52:03] milimetric: Is it writing to the wrong place or something silly? [22:52:30] i just ran it manually and it updated the file... [22:52:33] quite odd [22:52:53] the logging is so bad... grr... rtnpro has a great patch that will fix that, we should merge it soon [22:54:35] i'm gonna poke around - ottomata you got a second to help troubleshoot? [22:55:20] milimetric: yea i'm here for a little bit more [22:55:29] what'sup? [22:55:32] ottomata, JFYI: I'm in talks with your Ops brethren about experimenting with the MaxMind V2 API [22:55:49] so, if you get some really weird requests for builds around geolocation code: my fault. Hate mail to the usual address ;p [22:56:01] but it's probably worth knowing, now that y'all are planning to build UDFs [22:56:10] hopefully someone else will mail it! but that's good. i'm all for using the new lib if yall want to and we can [22:56:11] (that we might switch to the new API and I will be experimenting with it) [22:56:13] sorry [22:56:14] build* it [22:56:16] :) [22:56:20] heh [22:56:20] ottomata: so if i run generate.py manually on stat1003, passing it /a/limn-edit-data/edit as the config, it works [22:56:25] Ironholds: i'm all for it! [22:56:25] and generates the file in the right place [22:56:31] actually it turns out Faidon is the debian/ubuntu maintainer for libmaxminddb [22:56:34] so, convenient! [22:56:36] ah cool! [22:56:37] didn't know that [22:56:38] and the log file seems to show the cron running [22:56:56] checking [22:57:18] IOError: [Errno 13] Permission denied: '/a/limn-public-data/edit/datafiles/saves_rates_comparative_attempts.csv' [22:57:18] but when it runs through the cron the output must be either going somewhere else or not be allowed to write to that file? [22:57:22] ah :) [22:57:23] yeah [22:57:27] where do you see that?! [22:57:41] in the stderr when i ran it. ummmm, lemme fix that so that goes to the log... [22:57:46] wetalked about htis the other day but didnt' do it [22:57:53] looks like you created a directory? [22:57:54] drwxr-xr-x 2 milimetric wikidev 4096 Dec 4 20:26 . [22:57:59] should go to /var/log/limn-data/limn-edit-data.log right? [22:58:14] yeah, but stderr doesn't go there rigiht now [22:58:17] ah! it probably created it when i first ran it [22:58:19] just stdout [22:58:21] yeah, that's a prob [22:58:28] fixing [22:58:39] thanks much [22:59:29] whee [22:59:44] and Faidon has libmaxminddb on stat2. I know what I'm spending my evening writing. [23:03:06] James_F: ottomata fixed up a problem I caused, the files got generated and should be rsynced soon. They should be updating every hour from now on [23:03:21] *soon -> not sure how soon [23:03:32] thanks Andrew :) [23:04:14] i got a new one now [23:04:15] IOError: [Errno 13] Permission denied: 'history.json' [23:04:17] milimetric: ^ [23:04:22] File "/srv/limn-mobile-data/generate.py", line 115, in save_history [23:04:23] f = open(LOG_FILE, 'w') [23:04:23] IOError: [Errno 13] Permission denied: 'history.json' [23:05:13] ottomata: it's not critical, but probably the same problem. When I ran it, it generated that file [23:05:17] and now the other user can't write to it [23:05:22] milimetric: Brilliant. Thanks! [23:05:24] note to self: do not run [23:05:43] (Thanks ottomata too. :-)) [23:05:51] do not run unless you can sudo -u stats run it :) [23:06:11] milimetric: do you know where it is trying to write history.json? [23:07:24] ottomata: checking code, i thought i did [23:08:13] ah [23:08:15] cwd, milimetric [23:08:18] that should probably change [23:08:18] ottomata: this is hairy, for sure - yea [23:08:29] it's bad because it's the same but different users are trying to do it right? [23:08:35] put it in argv[1] or somehting? [23:08:35] ok, i'll file a ticket [23:08:37] yea [23:09:09] k [23:09:10] cool [23:09:12] yeah that should work [23:12:28] Analytics-Engineering: Generate.py needs to write to a separate history.json file per configured instance - https://phabricator.wikimedia.org/T77936 (Milimetric) NEW p:Triage [23:12:53] kevinator: ^^ that would be a great volunteer task for someone trying to learn our infrastructure [23:13:15] fhocutt: you were such a volunteer, but I know you were interested in wikimetrics. Take a look though, just in case ^ [23:13:35] thanks, milimetric, will do [23:14:55] learning the infrastructure is a good thing! I could do that. [23:15:05] Analytics-Engineering: Generate.py needs to write to a separate history.json file per configured instance - https://phabricator.wikimedia.org/T77936#832113 (Fhocutt) [23:17:42] fhocutt: check out those links and feel free to get started. Are you familiar with gerrit and how everything works in our ecosystem? [23:18:26] milimetric, nope, I've read a bit of the dev-getting-started docs but not done anything with that [23:18:56] ok, then take a look at the task and shoot me an email with your plan and questions. [23:19:03] you can reach me at dandreescu@wikimedia.org [23:19:16] thanks, milimetric, will do. [23:19:39] have a good night fhocutt, i'll look for the email [23:23:47] Quarry: Add date when query was last run - https://phabricator.wikimedia.org/T77941 (Capt_Swing) NEW p:Normal [23:27:55] Quarry: Make the query description window expanable - https://phabricator.wikimedia.org/T77945#832191 (Capt_Swing) [23:28:12] Analytics-EventLogging: Unique UDID (Placeholder) - https://phabricator.wikimedia.org/T77946#832198 (Jaredzimmerman-WMF) [23:40:59] Quarry: Allow comments on queries - https://phabricator.wikimedia.org/T71543#832306 (Capt_Swing) If we add comment functionality, we should also add some notification mechanism. The query author is unlikely to notice that someone has commented on their query if they don't get a ping of some sort. [23:41:28] Quarry: Allow comments on queries - https://phabricator.wikimedia.org/T71543#832312 (yuvipanda) [23:42:32] Quarry: Allow comments on queries - https://phabricator.wikimedia.org/T71543#832317 (Capt_Swing) yep... ugh. That's not going to be trivial. [23:45:53] Multimedia, Analytics-EventLogging, MediaWiki-Vagrant: Fix EventLogging on Vagrant - https://phabricator.wikimedia.org/T77781#832338 (Gilles) [23:48:33] Analytics, Multimedia: Gather more accurate statistics about curation - https://phabricator.wikimedia.org/T77034#832352 (Gilles) [23:53:41] milimetric: hi, no that the datasources folder is gone in limn-mobile-data, how do I generate a graph? [23:54:25] MediaWiki-extensions-UploadWizard, Analytics, Multimedia, MediaWiki-extensions-MultimediaViewer: Add metrics to graphite - https://phabricator.wikimedia.org/T77805#832389 (Gilles) [23:55:08] Analytics, Multimedia: Per-file view stats - https://phabricator.wikimedia.org/T77541#832395 (Gilles) [23:56:15] Quarry: Allow comments on queries - https://phabricator.wikimedia.org/T71543#832409 (yuvipanda) Yup. only option is if flow is flexible enough, IMO. [23:59:09] (CR) Nuria: ">Thank you! I'm happy to, could you give some more info on how it can be improved?" [analytics/dashiki] - https://gerrit.wikimedia.org/r/177487 (owner: Unicodesnowman) [23:59:45] Analytics, Multimedia: Add .gitreview files to new repos - https://phabricator.wikimedia.org/T77436#832438 (Gilles)