[04:27:14] Analytics / Tech community metrics: "Volume of open changesets" graph should show reviews pending every month - https://bugzilla.wikimedia.org/70278#c14 (Alvaro) REOP>PATC "pending reviews waiting for reviewer" (Waiting for Reviewer) is now implemented as a "evolution time metric" (not backlog an... [04:31:44] Analytics / Tech community metrics: "Volume of open changesets" graph should show reviews pending every month - https://bugzilla.wikimedia.org/70278#c15 (Alvaro) Hmmm, the last change from "pending" to "Waiting" I am not sure bout it. Changed "pending" to "New changesets" using the same label than in... [06:12:14] Analytics / Tech community metrics: "Volume of open changesets" graph should show reviews pending every month - https://bugzilla.wikimedia.org/70278#c16 (Quim Gil) Alright, the shape of the green line makes more sense now. At least now we see a steady increase instead of a sudden change of trend in the... [06:45:45] Analytics / Tech community metrics: "Volume of open changesets" graph should show reviews pending every month - https://bugzilla.wikimedia.org/70278 (Quim Gil) [06:45:45] Analytics / Tech community metrics: Code review metrics should not include [WIP] changesets - https://bugzilla.wikimedia.org/66283#c3 (Quim Gil) RESO/FIX>REOP I just realized that #11 WikimediaEvents "Waiting for review" at http://korma.wmflabs.org/browser/gerrit_review_queue.html?page=2 is marki... [07:00:07] (PS1) Yurik: download only when needed [analytics/zero-sms] - https://gerrit.wikimedia.org/r/159976 [07:00:09] (PS1) Yurik: Opera ip parser [analytics/zero-sms] - https://gerrit.wikimedia.org/r/159977 [07:00:56] (CR) Yurik: [C: 2] download only when needed [analytics/zero-sms] - https://gerrit.wikimedia.org/r/159976 (owner: Yurik) [07:00:56] (CR) Yurik: [V: 2] download only when needed [analytics/zero-sms] - https://gerrit.wikimedia.org/r/159976 (owner: Yurik) [07:01:01] (CR) Yurik: [C: 2 V: 2] Opera ip parser [analytics/zero-sms] - https://gerrit.wikimedia.org/r/159977 (owner: Yurik) [07:07:11] (PS1) Yurik: Removed dup opera script [analytics/zero-sms] - https://gerrit.wikimedia.org/r/159978 [07:07:36] (CR) Yurik: [C: 2 V: 2] Removed dup opera script [analytics/zero-sms] - https://gerrit.wikimedia.org/r/159978 (owner: Yurik) [07:25:24] (PS1) Gilles: Add new schema version to action TSV [analytics/multimedia] - https://gerrit.wikimedia.org/r/159979 [07:27:09] (CR) Gilles: [C: 2 V: 2] "Tested on stat1003" [analytics/multimedia] - https://gerrit.wikimedia.org/r/159979 (owner: Gilles) [07:27:14] (Merged) jenkins-bot: Add new schema version to action TSV [analytics/multimedia] - https://gerrit.wikimedia.org/r/159979 (owner: Gilles) [08:10:59] Analytics / Tech community metrics: "Volume of open changesets" graph should show reviews pending every month - https://bugzilla.wikimedia.org/70278#c17 (Alvaro) (In reply to Quim Gil from comment #16) > Alright, the shape of the green line makes more sense now. At least now we > see a steady increase... [08:27:14] Analytics / Tech community metrics: "Volume of open changesets" graph should show reviews pending every month - https://bugzilla.wikimedia.org/70278#c18 (Quim Gil) (In reply to Alvaro from comment #17) > > You are comparing time evolution with backlog time distribution. This two > time series are the... [08:34:15] (PS1) Gilles: Add more actions [analytics/multimedia/config] - https://gerrit.wikimedia.org/r/159984 [08:34:35] (CR) Gilles: [C: 2 V: 2] "Tested locally, pointing to the live tsvs" [analytics/multimedia/config] - https://gerrit.wikimedia.org/r/159984 (owner: Gilles) [10:47:14] Analytics / Tech community metrics: "Volume of open changesets" graph should show reviews pending every month - https://bugzilla.wikimedia.org/70278#c19 (Alvaro) (In reply to Quim Gil from comment #18) > (In reply to Alvaro from comment #17) > > > > You are comparing time evolution with backlog time d... [10:51:29] Analytics / Tech community metrics: "Volume of open changesets" graph should show reviews pending every month - https://bugzilla.wikimedia.org/70278#c20 (Alvaro) Quim, Jesus has sent you a proposal for the definition for the metrics we are working for. Focusing in the "Waiting for review", the way to d... [14:10:46] otoomata: gzip change is here [14:10:55] ottomata (duh): https://gerrit.wikimedia.org/r/#/c/159181/ [14:11:58] k done [14:18:37] ottomata: and the bumping up of the module: https://gerrit.wikimedia.org/r/159998 [14:19:53] done [14:20:03] Ironholds: hiya [14:57:39] (CR) Milimetric: "once the package.json is fixed, it looks good, just some suggestions (mostly using lodash seems like a good idea)." (5 comments) [analytics/dashiki] - https://gerrit.wikimedia.org/r/159838 (https://bugzilla.wikimedia.org/70727) (owner: Nuria) [15:55:41] milimetric: python q for you [15:56:19] shoot ottomata [16:00:33] ok [16:00:47] http://www.codeshare.io/aITwc [16:00:49] milimetric: [16:00:51] this is what I want to do [16:00:55] i have a bunch of json [16:01:16] in a string [16:01:21] and I want to use format() on it [16:01:21] but [16:01:39] since format expects the templatized parts to be enclosed in {} [16:01:46] i get KeyError [16:01:49] when I run format() [16:01:51] now [16:02:34] this [16:02:34] http://stackoverflow.com/questions/16356810/string-format-a-json-string-gives-keyerror [16:02:50] says to just enclose the string in extra { } [16:02:50] but [16:02:56] right [16:02:57] that only seems to work if the object does not have sub objects [16:03:05] ooh, right [16:03:11] (this is the real json i'm trying to format) [16:03:11] https://en.wikipedia.org/wiki/Special:Search/test%20some%20stuff?srbackend=CirrusSearch&cirrusDumpQuery=yes [16:03:34] i want to be able to replace every occurance of "test some stuff" [16:03:38] with a custom string [16:04:53] i'll look for something better but you could parse out the json, walk it and set any string that's equal to "{format_me}" to what you want, then dump it back to string [16:05:53] well, i want it as a dict to pass to urllib2 data for post [16:05:57] so i need to parse the json anyway [16:06:36] but, that sounds annoying, mayb eI have to escape every JSON bracket by doubling it? [16:07:07] yeah, this works: [16:07:11] https://www.irccloud.com/pastebin/29YlG8mU [16:07:44] yeah [16:07:51] ok i'll see if can do that [16:07:53] but how do you replace that without replacing the format_me thing [16:08:17] oh, you replace to format_me after the double curlies, k [16:10:14] yeahhh that works [16:10:22] yes [16:10:31] thanks [16:33:56] ok, milimetric, another q [16:34:05] do you have experience sending JSON via POST in urlib2? [16:34:20] yes, but it's awful - you can't use requests? [16:34:27] derrr, dunno? [16:34:35] the library requests: http://docs.python-requests.org/en/latest/ [16:34:49] readingh... [16:35:04] http://docs.python-requests.org/en/latest/user/quickstart/#more-complicated-post-requests [16:35:14] that looks awesome, trying now [16:35:34] sadists wrote urllib [16:37:01] whoa, this is so much better [16:37:02] whoa [16:37:03] thank you [17:08:45] (PS2) Nuria: Cache busting strategy for js and css [analytics/dashiki] - https://gerrit.wikimedia.org/r/159838 (https://bugzilla.wikimedia.org/70727) [17:10:31] Analytics / Wikimetrics: Admin script is really slow now that there are lots of reports - https://bugzilla.wikimedia.org/70775 (Dan Andreescu) NEW p:Unprio s:normal a:None Problem is when it checks for existing reports - because it matches by name. It should match by recurrent == 1 as well... [17:11:01] Analytics / Wikimetrics: Admin script is really slow now that there are lots of reports - https://bugzilla.wikimedia.org/70775 (Dan Andreescu) a:Dan Andreescu [17:29:07] (PS1) Milimetric: Speed up admin script by adding an index [analytics/wikimetrics] - https://gerrit.wikimedia.org/r/160031 (https://bugzilla.wikimedia.org/70775) [17:35:56] (PS7) Milimetric: Add toggle functionality [analytics/dashiki] - https://gerrit.wikimedia.org/r/159407 [18:16:10] (PS1) Milimetric: Cleanup style and behavior [analytics/dashiki] - https://gerrit.wikimedia.org/r/160050 [18:16:21] (PS2) Milimetric: Cleanup style and behavior [analytics/dashiki] - https://gerrit.wikimedia.org/r/160050 [18:20:37] (PS8) Nuria: Add toggle functionality [analytics/dashiki] - https://gerrit.wikimedia.org/r/159407 (owner: Milimetric) [18:31:41] (PS3) Milimetric: Cleanup style and behavior [analytics/dashiki] - https://gerrit.wikimedia.org/r/160050 [18:35:38] (CR) Milimetric: [C: 2 V: 2] Cache busting strategy for js and css [analytics/dashiki] - https://gerrit.wikimedia.org/r/159838 (https://bugzilla.wikimedia.org/70727) (owner: Nuria) [18:36:27] (PS9) Milimetric: Add toggle functionality [analytics/dashiki] - https://gerrit.wikimedia.org/r/159407 [18:37:04] (CR) Nuria: [C: 2 V: 2] Add toggle functionality [analytics/dashiki] - https://gerrit.wikimedia.org/r/159407 (owner: Milimetric) [18:40:49] (PS4) Nuria: Cleanup style and behavior [analytics/dashiki] - https://gerrit.wikimedia.org/r/160050 (owner: Milimetric) [18:48:09] (CR) Nuria: [C: 2 V: 2] Cleanup style and behavior [analytics/dashiki] - https://gerrit.wikimedia.org/r/160050 (owner: Milimetric) [18:52:25] DarTar: whenever you have a minute, I could use your help to figure out some stuff about using stat1003. [18:53:30] kaldari: sure, I’ll come over to your desk in 5 if you’re there [18:53:55] (PS1) Milimetric: Build First Release [analytics/dashiki] - https://gerrit.wikimedia.org/r/160062 [18:54:12] (CR) Milimetric: [C: 2 V: 2] Build First Release [analytics/dashiki] - https://gerrit.wikimedia.org/r/160062 (owner: Milimetric) [18:55:34] Analytics / Wikimetrics: Story:c WikimetricsUser runs 'Rolling Surviving New Active Editors' report - https://bugzilla.wikimedia.org/67460 (Dan Andreescu) PATC>RESO/FIX [18:55:34] Analytics / Wikimetrics: Story:b WikimetricsUser runs 'Rolling New Active Editors' report - https://bugzilla.wikimedia.org/67459 (Dan Andreescu) PATC>RESO/FIX [18:55:46] Analytics / Visualization: Story: EEVSUser adds/removes a metric/project - https://bugzilla.wikimedia.org/68142 (Dan Andreescu) NEW>RESO/FIX [20:09:15] Analytics / Tech community metrics: "Volume of open changesets" graph should show reviews pending every month - https://bugzilla.wikimedia.org/70278#c21 (Alvaro) With the proposal metrics definition we have updated the Waiting for review metric in korma. You can check the new graph in: http://korma.wm... [20:36:55] DarTar: That works, I was just using the wrong port number. I’ll update the documentation as well. [20:37:05] nice, thanks [20:37:36] milimetric: is any EEVS instance (prod or staging) up by any chance? [20:37:43] I wanted to show it to kaldari [20:37:50] DarTar: if you give us like ... 10 minutes? [20:37:50] nuria: ^ [20:37:51] :) [20:37:56] oh sure :) [20:51:12] DarTar: https://metrics.wmflabs.org/static/public/dash/ [20:51:20] (under active messing around by us atm) [20:51:53] milimetric: nice, thanks [20:51:55] kaldari: ^^ [20:52:01] that’s what I was referring to [20:52:26] kaldari: try and search for something like Portuguese Wikinews [20:52:32] oh, fancy :) [20:53:10] kaldary: still much WIP [20:53:17] kaldari: still much WIP [20:53:44] but should live on its current form for about a week [20:55:18] and it’s real datahz, for all projects [21:04:59] Analytics / Wikistats: Identify MSIE 11 somehow - https://bugzilla.wikimedia.org/64125#c4 (Erik Zachte) NEW>RESO/FIX Manual scan with zgrep on 1:1000 sampled log shows 3.9% of text/html lines in sampled squid log are for MSIE 11.0 I add regexp for the new format to SquidCountArchiveProcessLogRec... [21:05:09] DarTar: is the normal way to general datasets on stat1003 with a cronjob? [21:05:37] or is there a fanicier job manager? [21:05:38] kaldari: that’s the normal / duct-tape way of generating them [21:05:55] I’m fine with cron if that’s OK with other folks :) [21:05:58] YuviPanda’s scheduler is a much more robust way of doing that [21:06:28] I’m using cron for the various EE dashboards [21:06:30] DarTar: so how does his scheduler work? Is it just always running? [21:06:59] yes, and there is a config file specifying the frequency for specific jobs [21:12:44] (PS1) Milimetric: Fix glitches and rebuild [analytics/dashiki] - https://gerrit.wikimedia.org/r/160092 [21:17:48] (CR) Nuria: [C: 2 V: 2] Fix glitches and rebuild [analytics/dashiki] - https://gerrit.wikimedia.org/r/160092 (owner: Milimetric) [21:18:41] DarTar: reload and that's the last version we leave you with for the weekend [21:18:43] enjoy! [21:18:45] nite everyone! [21:19:01] nice, thanks milimetric [21:20:12] milimetric, nuria: w00t – are the new metrics that I see listed (like RNAE) already being populated with data? [21:20:38] DarTar: we will start populating those this weekend [21:20:52] <3 [21:21:27] I’ve never seen this data for smaller projects, can’t wait