[01:40:56] (PS1) Fhocutt: Make non-Latin characters display in json reports - WIP [analytics/wikimetrics] - https://gerrit.wikimedia.org/r/199814 (https://phabricator.wikimedia.org/T93023) [01:41:03] (CR) jenkins-bot: [V: -1] Make non-Latin characters display in json reports - WIP [analytics/wikimetrics] - https://gerrit.wikimedia.org/r/199814 (https://phabricator.wikimedia.org/T93023) (owner: Fhocutt) [05:52:29] Analytics, Analytics-EventLogging, Analytics-Kanban, operations, Patch-For-Review: Disk space full on vanadium from logs in /var/log/upstart - https://phabricator.wikimedia.org/T93185#1152291 (yuvipanda) Resolved>Open > PROBLEM - Disk space on vanadium is CRITICAL: DISK CRITICAL - free sp... [05:52:48] milimetric: nuria ^ [05:56:11] why are you all awake [05:56:33] also, nuria, did you replicate my Awesome Brilliant Error Checking Plan? :D [05:56:50] (reading up) [06:37:18] Analytics-EventLogging, Hovercards: Large number of popup events not validating - https://phabricator.wikimedia.org/T91272#1152364 (Prtksxna) >>! In T91272#1123916, @Nuria wrote: > New schema events have to be tested using teh dev server in vagrant:https://www.mediawiki.org/wiki/Extension:EventLogging/Gu... [10:45:37] Analytics-Tech-community-metrics, ECT-March-2015: Instructions to update user data in korma - https://phabricator.wikimedia.org/T88277#1152611 (Dicortazar) Thanks a lot for the changes. Those were merged into the database through the SortingHat command line tool. However, some minor comments. If there's... [12:18:00] dammit vanadium [12:18:31] thx YuviPanda|flight [12:18:41] milimetric it cleared up [12:18:50] yeah, but i'm gonna take a look at what happened [12:18:55] cool [12:19:03] after they trimmed logging I thought it would stop [12:22:14] this is /srv not /var/log [12:22:19] different [12:23:23] you should enjoy that epic flight, don't worry about this :) [12:24:53] we should clean /srv/ up, it doesn't seem to be actively written to, just used for ad-hoc backups [12:27:52] milimetric: ah, ok :) [12:34:43] Analytics-Tech-community-metrics, Wikimedia-Git-or-Gerrit, ECT-March-2015: Basic metrics about contributors exercising +2/-2 permissions in Gerrit - https://phabricator.wikimedia.org/T59038#1152775 (Dicortazar) Please, have a look at the first version. In order to keep in line with upstream, the firs... [13:03:24] Analytics-Tech-community-metrics, Wikimedia-Git-or-Gerrit, ECT-March-2015: Basic metrics about contributors exercising +2/-2 permissions in Gerrit - https://phabricator.wikimedia.org/T59038#1152837 (Qgil) Well, there is a disconnect between what we had agreed in February and what we are being offered... [13:07:12] Analytics-Tech-community-metrics, ECT-March-2015: Instructions to update user data in korma - https://phabricator.wikimedia.org/T88277#1152840 (Qgil) >>! In T88277#1152611, @Dicortazar wrote: > > With respect to how to proceed, given that we're not automatically merging your changes, I'm considering the o... [13:34:49] Analytics-Tech-community-metrics, Wikimedia-Git-or-Gerrit, ECT-March-2015: Basic metrics about contributors exercising +2/-2 permissions in Gerrit - https://phabricator.wikimedia.org/T59038#1152898 (Dicortazar) There is indeed a disconnect, but as I commented, we were trying to keep inline with upstre... [13:35:26] Analytics-Tech-community-metrics, ECT-March-2015, Patch-For-Review: "Age of unreviewed changesets by affiliation" shows negative number of changesets - https://phabricator.wikimedia.org/T72600#1152899 (Dicortazar) Also in mine. Checking this!. I though you referred to a previous one. [14:05:25] Analytics-Kanban, Analytics-Visualization, Patch-For-Review: Provide temporary home for VE visualizations {lion} - https://phabricator.wikimedia.org/T89255#1152967 (kevinator) [14:10:52] Analytics-Kanban: Clean up the /srv directory in Vanadium - https://phabricator.wikimedia.org/T94026#1152977 (Milimetric) NEW [14:16:20] milimetric, ottomata: "ok, i found it but this doesn't alarm to us and it should ->Disk space on vanadium is CRITICAL: DISK CRITICAL - free space: /srv 12711 MB (3% inode=99%)" [14:16:55] Analytics-Kanban, Analytics-Visualization: Controls help you navigate between the Visual Editor sunburst visualizer and timeseries visualizer {lion} - https://phabricator.wikimedia.org/T89254#1152987 (Milimetric) Open>Resolved [14:17:04] Analytics-Kanban: Implement adjustments to Visual Editor dashboards {lion} - https://phabricator.wikimedia.org/T91418#1152992 (Milimetric) Open>Resolved [14:20:57] Analytics-Kanban, Analytics-Visualization, Patch-For-Review: Provide temporary home for VE visualizations {lion} - https://phabricator.wikimedia.org/T89255#1153010 (kevinator) Here is the location: https://edit-analysis.wmflabs.org/adhoc.html#ve-success-rate-by-user-type.tsv for example it's the root t... [14:36:14] milimetric: https://gerrit.wikimedia.org/r/#/c/198782/3/modules/limn/templates/static.vhost.erb [14:50:30] Analytics-Tech-community-metrics, Wikimedia-Git-or-Gerrit, ECT-March-2015: Basic metrics about contributors exercising +2/-2 permissions in Gerrit - https://phabricator.wikimedia.org/T59038#1153096 (Dicortazar) Hi again! To follow with the discussion, please find attached the aforementioned contribut... [14:56:28] Analytics-Tech-community-metrics, Wikimedia-Git-or-Gerrit, ECT-March-2015: Active Gerrit users on a monthly basis - https://phabricator.wikimedia.org/T86152#1153128 (Dicortazar) For those interested in the mockup discussion, we're having it at {T59038}. [15:05:51] Analytics-Wikimetrics: Story: user wants to be able to re-run a failed report more easily - https://phabricator.wikimedia.org/T88610#1153160 (Nuria) Reasons a report fail: The system cannot do it: database is down or fails (metric is too large) Labs problems: fluke (network outage) We need an error... [15:09:33] o/ springle [15:09:59] I'm looking to add an index to a eventlogging table on analytics-store. Would you like me to make a phab task? [15:19:04] Analytics-Tech-community-metrics: Provide list of oldest open Gerrit changesets without code review - https://phabricator.wikimedia.org/T94035#1153222 (Aklapper) NEW [15:19:39] Analytics-Tech-community-metrics: Provide list of open Gerrit changesets with most activity which aren't -1/-2'ed - https://phabricator.wikimedia.org/T94036#1153232 (Aklapper) NEW [15:26:01] Analytics-Tech-community-metrics, ECT-April-2015: Provide list of oldest open Gerrit changesets without code review - https://phabricator.wikimedia.org/T94035#1153259 (Qgil) [15:26:26] Analytics-Tech-community-metrics, ECT-April-2015: Provide list of open Gerrit changesets with most activity which aren't -1/-2'ed - https://phabricator.wikimedia.org/T94036#1153264 (Qgil) [15:26:39] ottomata, do you need the changes now? or can it be after tasking? [15:27:02] naw that's fine [15:27:15] ok, will do [15:27:18] was going to ask my scala expert about your quantiles problem [15:27:26] i feel like this has got to be already done, you shoudlnt' have to code it [15:27:29] ya know? [15:27:36] oh! yes sure [15:28:14] but if we have to end up coding them, I think it will not be too difficult or long [15:29:05] aye [15:48:29] ottomata: we're talkin data stores! [15:50:08] WHO [15:50:13] taskers? [15:52:09] Analytics-Tech-community-metrics, Wikimedia-Git-or-Gerrit, ECT-March-2015: Basic metrics about contributors exercising +2/-2 permissions in Gerrit - https://phabricator.wikimedia.org/T59038#1153372 (Qgil) Alright, thank you! About {F105526} * OK to the graph. * OK to the two tables. BUT I think the... [16:14:24] Analytics-Tech-community-metrics, Wikimedia-Git-or-Gerrit, ECT-March-2015: Basic metrics about contributors exercising +2/-2 permissions in Gerrit - https://phabricator.wikimedia.org/T59038#1153436 (Dicortazar) I agree with your labels-renaming suggestions. Let's use them And with respect to the char... [16:45:37] (PS1) Mforns: [WIP] Add Apps session metrics job [analytics/refinery/source] - https://gerrit.wikimedia.org/r/199935 (https://phabricator.wikimedia.org/T86535) [16:45:54] ottomata, https://gerrit.wikimedia.org/r/#/c/199935/ [16:46:37] here's the code as it just was, I copy-pasted there. I know that's not the format, but I have to leave now for 2 hours, when bak, I'll give it some proper structure. [16:48:31] mforns, aww! [16:48:45] * Ironholds is reviewing your code [16:48:58] How much of the logic did you adapt straight from the C++? Not a complaint, more flattering ;p [16:49:30] Ironholds, hehe ok, it is not finished though. we're still sorting out a percentile library [16:49:40] or maybe implementation [16:51:42] Ironholds, I did not use C++ code, because spark is centered on RDDs, and that was so different for me, that I like had to figure each line of code from scratch [16:51:58] ahh, okay [16:52:08] just great minds thinking alike, then; the sessioniser looks familiar [16:52:52] Ironholds, wait, you write sessionise with 's', oh sorry my fault, wrote with 'z' [16:53:50] heh [16:53:54] AmEng/BrEng difference, I guess? [16:55:49] oh! well, I speak spanish english [17:06:26] (CR) Fhocutt: Make non-Latin characters display in json reports - WIP (1 comment) [analytics/wikimetrics] - https://gerrit.wikimedia.org/r/199814 (https://phabricator.wikimedia.org/T93023) (owner: Fhocutt) [17:06:28] it looks like HDFS is supported and Cassandra is community supported for Druid: http://druid.io/docs/latest/Deep-Storage.html [17:07:00] and it sounds like a task to index new data in batch can run in Hadoop and uses Yarn for resource management, but the querying and all that stuff doesn't deal with Yarn, I think [17:19:41] ottomata: how do you update the operations/debs depot where logster parsers are hosted [17:32:15] Analytics, Analytics-EventLogging, Analytics-Kanban, operations, Patch-For-Review: Disk space full on vanadium from logs in /var/log/upstart - https://phabricator.wikimedia.org/T93185#1153713 (Nuria) Given that eventlogging does not write anything to /srv (other than code source, which is tiny)... [17:33:40] nuria: via gerrit [17:34:03] ottomata: but how do those changes get deployed to the labs instances? [17:34:07] https://gerrit.wikimedia.org/r/#/admin/projects/operations/debs/logster [17:34:08] ah [17:34:11] debian package [17:34:19] git-buildpackage [17:34:25] i build a new one in my local vm [17:34:31] and then upload to apt.wm.org [17:34:34] i probably ahve to do it for you [17:34:36] if you want to test [17:34:38] you can buidl a .deb [17:34:40] and then jsut dpkg -i it [17:35:26] ottomata: given that is python i do not need to build to test i can modify locally, ok, then when I am done with changes I will send you a CR and you can build & upload [17:36:10] ok cool [17:36:11] yup [17:36:45] ottomata: pageview graph every hour looks kind of strange but I will let it capture one more day to see: https://graphite.wmflabs.org/render/?width=586&height=308&_salt=1427391354.221&target=analytics.wikimetrics.pageviews.requests.value&from=00%3A00_20150325&until=23%3A59_20150326 [17:42:48] Analytics, Analytics-EventLogging, Analytics-Kanban, operations, Patch-For-Review: Disk space full on vanadium from logs in /var/log/upstart - https://phabricator.wikimedia.org/T93185#1153740 (Nuria) Issues with getting a larger infklow of events and thus disk getting filled up on /srv (as event... [17:44:05] Analytics-Kanban: Clean up the /srv directory in Vanadium - https://phabricator.wikimedia.org/T94026#1153742 (Nuria) I do not thinkwe can clean up incoming logs we need for backfilling or for future referennce. I have removed anything but those. What we need to do here is to swap the box. We have had an item... [17:45:08] Analytics, Analytics-EventLogging, Analytics-Kanban, operations, Patch-For-Review: Disk space full on vanadium from logs in /var/log/upstart - https://phabricator.wikimedia.org/T93185#1153751 (Nuria) Pending ticket to sap vanadium box: https://phabricator.wikimedia.org/T90363 [17:46:16] ottomata: for the issue with vanadium getting fulled we have trimmed logs as much as possible, but incoming stream of events still needs to be saved to disk, in this case I think what needs to happen is that we need to swap the box with the ones ori provisioned [17:46:24] ottomata: here is the task: https://phabricator.wikimedia.org/T90363 [17:48:57] nuria: do we need to keep 3 months of data? [17:49:14] ottomata: yes, but not in vanadium, in 1002 [17:50:08] ottomata: in vanadium with having a month is sufficient as we need data for backfilling but we normally backfill right away [17:50:33] ottomata: so *ad most* I would say vanadium (or EL box) should keep a month [17:50:53] hm, well that would help :) [17:50:58] very easily immediately [17:51:49] ottomata: but we cannot delete data there without changing teh crons that move it to 1002 right/ [17:52:08] ottomata: where is the 90 day limit now? [17:52:16] ottomata: i can look [17:52:35] hm [17:53:31] found it [17:53:31] https://github.com/wikimedia/operations-puppet/blob/production/modules/eventlogging/templates/logrotate.erb [17:53:40] change that to 30 or 31 or whatever [17:53:45] maxage 90 [17:57:04] ottomata: and this is pruning logs older than >90 on 1002 right? [17:57:06] https://github.com/wikimedia/operations-puppet/blob/production/modules/statistics/manifests/rsync/eventlogging.pp [17:57:32] yes [17:57:33] no [17:57:37] oh [17:57:44] yes [17:57:45] exactly [18:07:03] ottomata: ok, done: https://gerrit.wikimedia.org/r/199957 [18:26:24] Analytics-EventLogging, Analytics-Kanban: Edit Schema module loaded by EL client side is not being updated - https://phabricator.wikimedia.org/T94059#1153900 (Milimetric) NEW a:Milimetric [18:32:21] Analytics-EventLogging, Analytics-Kanban: Edit Schema module loaded by EL client side is not being updated - https://phabricator.wikimedia.org/T94059#1153921 (Milimetric) From Krenair in https://phabricator.wikimedia.org/T93586 while looking into the instrumentation: Bypassing cache serves the new versio... [18:33:44] Analytics-EventLogging, MediaWiki-extensions-WikimediaEvents, VisualEditor, WikiEditor: Make all Event Logging instrumentation target the same Schema:Edit revision - https://phabricator.wikimedia.org/T93586#1153930 (Milimetric) Open>Resolved a:Milimetric The instrumentation from the Edit... [18:34:14] Analytics-EventLogging, MediaWiki-extensions-WikimediaEvents, VisualEditor, WikiEditor: Make all Event Logging instrumentation target the same Schema:Edit revision - https://phabricator.wikimedia.org/T93586#1153933 (Milimetric) the EL task is: https://phabricator.wikimedia.org/T94059 [18:39:03] nuria: this issue is nasty: https://phabricator.wikimedia.org/T94059, are you going to lunch? [18:39:34] milimetric: no, not yet, lemme look [18:40:07] it's basically - EL is not giving them the right schema because its cache invalidation is not done properly (I haven't looked myself, but seems to be the case) [18:41:37] milimetric: but EL doesn't cache anything remember? Just receives URLs with schema +version [18:43:25] nuria: client side, the module [18:43:36] and how it handles the loading of schema modules via resource loader I think [18:43:48] but I've got to look through the code because that stuff's foreign to me [18:44:09] I can't see how it could've been broken for so long without others noticing, but maybe they did and just never told us [18:44:45] milimetric: nah, i do not think so, it's that the way that changes are split of among php and resource loader for js is not optimal. [19:08:48] nuria: yeah, this is a bug, I get it now [19:09:01] Analytics-EventLogging, Analytics-Kanban: Edit Schema module loaded by EL client side is not being updated - https://phabricator.wikimedia.org/T94059#1154076 (Nuria) The events coming into the system are from both schemas, numbers for today: nuria@vanadium:~/VE-events-march-26$ wc -l Edit_events.txt 242... [19:10:18] milimetric: There are events from both schemas: it could be 1) deployment (newest code hasn't been deployed everywhere) 2) caching issues with versions (doesn't seem likely as I think what is cached on php is the module name and this is not a new module) [19:11:20] Analytics-EventLogging, Analytics-Kanban: Edit Schema module loaded by EL client side is not being updated - https://phabricator.wikimedia.org/T94059#1154087 (Nuria) Or it could also be your newest code is not yet deploed everywhere and it is (lawfully) requesting the older schema, let me do some greps on... [19:13:36] nuria: no, it's none of those. The problem is when they're using ResourceLoader to request modules, the way that https://github.com/wikimedia/mediawiki-extensions-EventLogging/blob/master/includes/ResourceLoaderSchemaModule.php computes the modified time causes it to be cached forever [19:13:58] because it's not returning the actual modified time, but some time far in the future (it's just adding the rev id) [19:15:06] so if someone requests the schema:edit module separately, it would be fine [19:15:28] but when they request it in "batch" mode which I don't quite understand, this way of computing modified time is problematic [19:20:00] milimetric: i do not get it if time returned is wrong it should be so for all clients [19:20:12] Roan just explained it really well in detail [19:20:12] milimetric: right??? i must be missing something here [19:20:14] I totally get it now [19:20:31] you can read his explanation in -visuaeditor or I can explain it in hangout [19:20:33] in the VE channel ? if so let me me re-read [19:20:36] yes [19:40:52] Analytics-EventLogging, Analytics-Kanban: Edit Schema module loaded by EL client side is not being updated - https://phabricator.wikimedia.org/T94059#1154189 (Mattflaschen) See @Krinkle's comment. It may be that the correct schema numbers are all coming from the [server-side logging](https://git.wikimedi... [19:42:30] Analytics-EventLogging, Analytics-Kanban: Edit Schema module loaded by EL client side is not being updated - https://phabricator.wikimedia.org/T94059#1154206 (Nuria) Never mind my two last comments there, looks like the issues with clienbt side caching are dependent on the js request a user has done, thus... [19:51:59] Analytics-EventLogging, Analytics-Kanban: Edit Schema module loaded by EL client side is not being updated - https://phabricator.wikimedia.org/T94059#1154277 (Nuria) >See @Krinkle's comment. It may be that the correct schema numbers are all coming from the server-side logging, No, no, those are from clien... [20:11:32] Analytics-EventLogging, Analytics-Kanban: Edit Schema module loaded by EL client side is not being updated - https://phabricator.wikimedia.org/T94059#1154331 (Krinkle) a:Milimetric>Krinkle [20:14:14] nuria: so why are the logs in /srv and /var ? [20:14:33] milimetric: ehhh.. where else could they be? [20:14:42] i mean, why are they in both of those places [20:14:46] I figured they'd only be in one... [20:15:14] milimetric: I imagine that app logs log to srv because it is a bigger partition [20:15:47] well, there's /var/log/eventlogging/* and /srv/log/eventlogging/* they don't appear sym-links of each other and they both appear to grow the same way and have the same files [20:15:52] bigger than /var that is [20:16:05] milimetric: right cause they contain different things [20:16:08] (CR) Bmansurov: Update limn graphs (untested) (1 comment) [analytics/limn-mobile-data] - https://gerrit.wikimedia.org/r/199162 (https://phabricator.wikimedia.org/T93690) (owner: Jdlrobson) [20:16:35] no I mean they have the same exact files with the same exact sizes, run this: [20:16:42] ll /var/log/eventlogging/ /srv/log/eventlogging/ [20:17:23] milimetric: var/log/eventlogging will have files for client-side and server side events, right? [20:17:40] here, i'll paste what I get when I run it [20:17:49] https://www.irccloud.com/pastebin/DLbSQjzu [20:17:59] it's *literally* the same *exact* thing [20:18:19] milimetric: wait ... [20:19:38] milimetric: They used to be symlinked at some point. [20:19:49] (Not sure if that has been removed by someone in the meantime) [20:20:16] /srv is bigger, so it seemed better to use that for logging [20:20:17] when I look at /srv/ and /var/ they don't seem to have symlinks to each other [20:20:31] weird, because /srv is fuller [20:20:32] look at ... /var/log [20:20:44] eventlogging in there should be a symlink. [20:20:46] (IIRC) [20:20:59] ah yes :) [20:21:04] :-) [20:21:09] qchris, milimetric : yeah [20:21:11] I was thinking log would be the symlink [20:21:22] ok, makes sense, thx [20:21:25] This symlink is there, so one finds the logs through both paths. [20:21:57] confusion solved, thx [20:22:00] IIRC there was some discussion between o-ri, otto-mata and me whether /srv or /var/log would be better. So we had both. [20:22:19] The discussion should be in gerrit if you need it. [20:22:20] yw. [20:24:13] Analytics-Kanban: Clean up the /srv directory in Vanadium - https://phabricator.wikimedia.org/T94026#1154389 (Milimetric) Open>Invalid a:Milimetric no cleanup is possible because /srv is the actual place logs are stored. /var/log/eventlogging is just a symlink. [20:24:56] milimetric: breaking for lunch but will be back so ping me if needed (will be working on VCL if nothing comes up with EL) [20:25:15] man that pinged me anyway [20:25:16] thx nuria, no worries [20:25:17] i think otto pings me [20:25:17] haha [20:25:18] enjoy lunch [20:25:22] nice try! [20:25:23] otto? [20:25:27] yup [20:25:32] * qchris shakes fist at stalk words! [20:25:35] :) [20:25:35] haha [20:25:35] :-D [20:25:43] *you* are the one to talk? [20:25:45] Sorry for the unintentional ping then. [20:25:49] alexander? [20:25:52] milimetric: :-P [20:26:04] :) [20:27:17] Analytics-Kanban: Clean up the /srv directory in Vanadium - https://phabricator.wikimedia.org/T94026#1154423 (Nuria) See this one: we reduced the amount of logs in vanadium to 30 days, short of changing box to add more disk space this is best we can do: https://gerrit.wikimedia.org/r/#/c/199957/ [21:19:46] Hi, I am a gossip aspirant and the project that I have proposed is integration of LangugaeTool with VisualEditor. I need some stats to determine the feasibility of my approach. [21:20:15] Can anyone tell me the number of edits per minute made via VisualEditor ? [21:20:29] And the % distribution of same across languages? [21:21:08] *gsco [21:21:11] *gsoc [21:21:24] Damn autocorrect. [21:21:40] I am *not* a gossip aspirant. [22:03:56] ankita-ks: I thought there was a graph for that ... but now I cannot find one that still holds data ... :-/ [22:04:10] Anyways ... you can get information on that directly from the wikis. [22:04:13] like: [22:04:25] https://en.wikipedia.org/w/index.php?namespace=&tagfilter=visualeditor&limit=500&title=Special%3ARecentChanges [22:04:38] ^ shows you the last 500 visualeditor edits. [22:05:12] They come with a timestamp ... so you can easily compute a rate by subtracting the first from the last ts and divide by the count. [22:05:27] (The above page is for enwiki only) [22:05:52] If you've got labs access (anyone can sign up for it. It's free :-) ) you can use the [22:06:28] change_tag table and look for ct_tag columns having 'visualeditor' as value. [22:07:37] milimetric, yt? [22:07:53] (PS1) Milimetric: Update for April meeting [analytics/reportcard/data] - https://gerrit.wikimedia.org/r/200043 [22:08:00] mforns: howdy [22:08:03] heya [22:08:13] (CR) Milimetric: [C: 2 V: 2] Update for April meeting [analytics/reportcard/data] - https://gerrit.wikimedia.org/r/200043 (owner: Milimetric) [22:08:17] I just read your email on VE and params [22:08:29] yes [22:09:02] have you already started figuring out how to do that? [22:09:21] are you still around today? [22:10:20] mforns: not for long [22:10:25] but no, I haven't started [22:10:29] i just had meetings so far [22:10:56] ok, fine, so how about let me look at it tomorrow morning, before you start, and I respond your email? [22:11:16] milimetric, ^ (sorry, forgot) [22:11:54] mforns: no problem, yea [22:11:59] milimetric, ok [22:11:59] either way [22:12:13] it's all i'll work on tomorrow [22:12:35] then i'm gone next week so i'd love to finish the data gathering part before that [22:12:45] milimetric, so your initial idea was to have a report file for each wiki/editor? [22:12:50] ok [22:13:39] mforns: yeah, the format is like metrics///.json [22:13:46] and .tsv [22:13:52] sorry - .tsv not json pshh [22:13:57] milimetric, aha [22:14:04] ok, gotta go eat this amazing burger that my wife just made [22:14:10] <3 have a nice night, talk tomorrow [22:14:12] oooooooooooh [22:14:17] night! [22:14:50] qchris : thank you. looking at it now. :) [22:14:59] Awesome! [22:16:28] Analytics-EventLogging, Analytics-Kanban: Edit Schema module loaded by EL client side is not being updated - https://phabricator.wikimedia.org/T94059#1155401 (Krinkle) Open>Resolved