[00:03:39] 10Analytics, 10Analytics-Wikistats: Improve Wikistats UI for mobile - https://phabricator.wikimedia.org/T176143#3614935 (10Nuria) Add responsive layout [00:13:31] 10Analytics, 10Analytics-Wikistats: wikistats UI: mobile responsivness for most used pages based on piwik data - https://phabricator.wikimedia.org/T176143#3838969 (10Nuria) [00:19:20] 10Analytics, 10Analytics-Kanban, 10Analytics-Wikistats: Beta Release: Resiliency, Rollback and Deployment of Data - https://phabricator.wikimedia.org/T177965#3838982 (10Nuria) [00:47:11] 10Analytics-Kanban, 10Analytics-Wikistats: Wikistats Bug: Menu to select projects doesn't work (sometimes?) - https://phabricator.wikimedia.org/T179530#3839200 (10jmatazzoni) I figured out how to type in the language I need after selecting a project (not the best UX, I agree). But on Chrome, selecting the lang... [00:58:27] Hi ebernhardson, It looks like the cluster is locked up right now on a PySpark process from you (704 vcores). Do you have any idea when it will be wrapped up? [00:58:51] Shilad: doh, i didn't realise it grabbed that many. sec [01:00:13] i'll update the script to set spark.dynamicAllocation.maxExecutors in the future, should prevent that [01:01:54] Thank you! I thought something like that may be going on! [01:02:55] ebernhardson: unrelated question, if you have a minute about cirrus search logs. I heard you know them well! [01:03:06] Shilad: lol, yes i do :) [01:03:35] this might answer the first part of questions, about general structure: https://github.com/wikimedia/mediawiki-event-schemas/blob/master/avro/mediawiki/CirrusSearchRequestSet/CirrusSearchRequestSet.idl [01:03:39] I am trying to combine searches and page views into user sessions. [01:03:58] Yes! I have been poking around that code and the MediaWiki source for the extension where it is logged. [01:04:21] Shilad: ahh good. Yes the logs themselves are pretty low level .. so figuring out what they actually mean requires digging around [01:04:41] In webrequests (where pageviews come from) ip is actually ip or x-forwarded for if it is defined. [01:04:53] Looking through source it looks like this is also true for cirrussearch logs. [01:04:57] Does that seem right? [01:05:11] I am using ip + UA for a session hash [01:05:46] Shilad: should be, yes. Although we don't look at the ip much beyond using it to filter high-volume ip's [01:06:06] we log that 'identity' string, but of course you wont be able to tie that back to general web reuqests [01:06:36] I thought about recreated the identity string from webrequests but that's a little hairy for detailed reasons. [01:07:01] For the "requests" array... [01:07:25] How is a grouping of requests defined? Is it just all requests from a browser within a particular time frame? [01:07:53] Shilad: no, those are all requests the backend performs against elasticsearch to respond to a single request from a browser to mediawiki [01:09:55] * Shilad Tries to pull up an example of requests to make sure he understands it... [01:10:39] Shilad: so the user might submit the autocomplete form on en.wikipedia.org. Often the first thing that happens is a near match search to see if we can send them directly to the page, skipping the search result. If that fails you end up in the full text pipeline where we will issue a request to enwiki_content, along with the various sister wikis. [01:11:41] if the request to enwiki_content has no results but has a did you mean suggestion, we might run the did you mean suggestion for another enwiki_query inside the same request. If we have < 3 results we will run a language detection algo against the query string and depending on that might issue a request for content of (for example) ruwiki [01:11:55] all of those end up in the same 'requests' array because they all happened inside a single request from the browser to mediawiki [01:12:12] yes i know this is complex and not obvious :P [01:12:33] ebernhardson: This is exactly what I was wondering. [01:12:39] Thanks! [01:13:31] So if a user is typing and getting autocomplete results for each keystroke, does each keystroke have a separate entry? [01:14:03] In the general case, yes. But there are some additional complexities around caching [01:14:38] The api that serves autocomplete results is edge-cached by varnish for users that are not logged in. Often the first few letters of a query are served directly from that cache and never hit mediawiki [01:16:16] i suppose not even necessarily the first few letters. I just tested each step in the query 'english' on en.wikipedia.org as a logged out user and every one of those responses came from the edge cache [01:16:25] ebernhardson: That makes sense. Thanks! I am trying to understand what "search phrases" are typically associated with a page. But autocomplete doesn't really fit that model, because autocompelte is fragments of phrases. [01:16:27] (which is also how they manage to get back to my browser in <10ms) [01:16:56] Interesting! So are those unlikely to be logged anywhere? [01:17:14] Shilad: they will be in the webrequest logs, but because they never hit the mediawiki backend they wont be in the cirrus logs [01:18:00] i've actually gotta run, meeting some people for that star wars movie in 40 minutes and need to cross a bay. But feel free to ping me tomorrow [01:18:00] Great! That brings up a related question. Do all search requests in cirrus come through the webrequest log? [01:18:12] Shilad: yes [01:18:28] No problem. Sorry for keeping you. I'll ask more later. That's enough to get me going. Thanks, ebernhardson! [01:18:29] well, like 99.9% probably. There might be some maintenance and update tasks that get logged as well [02:18:17] 10Analytics-Kanban, 10Documentation: Document Dashiki - https://phabricator.wikimedia.org/T182477#3839351 (10Milimetric) Ok, so the last two bullet points were a bit ambitious to do all in one task. I added the docs and will merge the other "link to the config" task. [02:21:23] 10Analytics-Kanban, 10Documentation: Document Dashiki - https://phabricator.wikimedia.org/T182477#3839354 (10Milimetric) [02:24:58] (03PS1) 10Milimetric: Add links to the rendered config wiki article [analytics/dashiki] - 10https://gerrit.wikimedia.org/r/398411 (https://phabricator.wikimedia.org/T182477) [02:30:49] (03PS1) 10Milimetric: Add MIT license [analytics/wikimetrics] - 10https://gerrit.wikimedia.org/r/398412 (https://phabricator.wikimedia.org/T60753) [02:31:41] (03CR) 10jerkins-bot: [V: 04-1] Add MIT license [analytics/wikimetrics] - 10https://gerrit.wikimedia.org/r/398412 (https://phabricator.wikimedia.org/T60753) (owner: 10Milimetric) [02:32:02] 10Analytics-Cluster, 10Analytics-Kanban, 10Patch-For-Review: Support multi DC statsv - https://phabricator.wikimedia.org/T179093#3839371 (10Krinkle) Thanks for the clarification. Two last questions. If I understand correctly, the outcome of Proposed is: 1. Statsv in codfw will actively write to statsd in eqi... [02:33:04] (03CR) 10Milimetric: "Hey, Lego, so there are a lot more committers on this repo than I thought. I wanted to double check with you: is it ok to just license it" [analytics/wikimetrics] - 10https://gerrit.wikimedia.org/r/398412 (https://phabricator.wikimedia.org/T60753) (owner: 10Milimetric) [02:34:43] 10Analytics-Kanban: Making geowiki data public - https://phabricator.wikimedia.org/T131280#3839373 (10Milimetric) a:03Milimetric [02:37:12] 10Analytics-Kanban: Read the python code and design the Hadoop version - https://phabricator.wikimedia.org/T182944#3839376 (10Milimetric) p:05Triage>03Normal [02:38:19] (03CR) 10Legoktm: "Looking at that list, at least Dereckson isn't/wasn't a WMF employee, but we can ask him if he's OK with this. I'm not sure about everyone" [analytics/wikimetrics] - 10https://gerrit.wikimedia.org/r/398412 (https://phabricator.wikimedia.org/T60753) (owner: 10Milimetric) [02:39:42] (03CR) 10Milimetric: "Definitely not all employees, but I thought all were under some contract. If they have to be employees then I'll have to reach out to a l" [analytics/wikimetrics] - 10https://gerrit.wikimedia.org/r/398412 (https://phabricator.wikimedia.org/T60753) (owner: 10Milimetric) [02:44:22] (03CR) 10Legoktm: "Any type of WMF contract should be fine. He's listed at the bottom of the contributor list with 2 commits." [analytics/wikimetrics] - 10https://gerrit.wikimedia.org/r/398412 (https://phabricator.wikimedia.org/T60753) (owner: 10Milimetric) [07:01:11] 10Analytics, 10Analytics-Wikistats: Wikistats Bug : wrong data in Top viewed articles (about frwiki) - https://phabricator.wikimedia.org/T182954#3839590 (10Manu1400) [08:24:48] 10Analytics, 10Operations, 10ops-eqiad: Decommission kafka1018 - https://phabricator.wikimedia.org/T182955#3839641 (10elukey) [08:25:21] 10Analytics-Kanban, 10Operations, 10ops-eqiad, 10Patch-For-Review, 10User-Elukey: kafka1018 fails to boot - https://phabricator.wikimedia.org/T181518#3792843 (10elukey) kafka1023 is now fully productionized and catching up with the missing partitions. Opened https://phabricator.wikimedia.org/T182955 to d... [09:00:30] hello people [09:00:44] mysql on bohrium is corrupted (again) after a crash of ganeti [09:00:53] last backup seems to be 2 days ago [09:25:48] so, we need to wipe again and reload mysql [09:26:04] it will mean 2 days of data loss + time for the db to complete the load [09:26:08] so ~3d [09:50:59] in progress [09:51:51] Hey! I'm testing the Wikistats2 Alpha and I think I got the most unexpected message on a Wikimedia project: "Your ad blocker is preventing Wikistats from reaching the server. Disable it to be able to see all metrics correctly." XD [09:53:00] Trizek: hey! What do you mean? [09:53:27] I had the message I quote message on top of my screen. [09:54:01] I don't believed that my Ad blocker would be a blocker to display a Wikimedia service. [09:54:48] yep it blocks some JS functionality iirc, but I am far from a web ui expert :D [09:55:03] there is a phab task about it, I can try to look for it if you want more data [09:55:21] I'll search for it, thanks! [10:05:17] 10Analytics-Kanban, 10Analytics-Wikistats: Review the alert message about adblocker preventing AQS requests - https://phabricator.wikimedia.org/T182958#3839781 (10Trizek-WMF) [10:05:22] 10Analytics-Kanban, 10Analytics-Wikistats: Review the alert message about adblocker preventing AQS requests - https://phabricator.wikimedia.org/T182958#3839781 (10Trizek-WMF) [10:09:37] 10Analytics, 10Analytics-Wikistats: When searching for a project language, display a full list of languages - https://phabricator.wikimedia.org/T182959#3839801 (10Trizek-WMF) [10:09:55] 10Analytics, 10Analytics-Wikistats: When searching for a project language, display a full list of languages - https://phabricator.wikimedia.org/T182960#3839812 (10Trizek-WMF) [10:12:24] 10Analytics, 10Analytics-Wikistats: When searching for a project language, allow user to type the wiki's URL - https://phabricator.wikimedia.org/T182961#3839829 (10Trizek-WMF) [10:14:11] 10Analytics-Kanban, 10Analytics-Wikistats: Wikistats Bug: Menu to select projects doesn't work (sometimes?) - https://phabricator.wikimedia.org/T179530#3727714 (10Trizek-WMF) >>! In T179530#3837937, @Elitre wrote: > well... I wonder if others would consider that as "broken" as I did, then. TY! I haven't under... [10:19:53] 10Analytics, 10Analytics-Wikistats: Allow namespace selection on Top Viewed Articles - https://phabricator.wikimedia.org/T182964#3839881 (10Trizek-WMF) [11:29:54] 10Analytics, 10Analytics-Wikistats: When searching for a project language, display a full list of languages - https://phabricator.wikimedia.org/T182960#3840067 (10jhsoby) [11:29:56] 10Analytics, 10Analytics-Wikistats: When searching for a project language, display a full list of languages - https://phabricator.wikimedia.org/T182959#3840069 (10jhsoby) [11:35:01] just produced the first webrequest data from cp1008 to Kafka Jumbo via TLS! [11:35:04] \o/ [11:47:06] 10Analytics, 10Pageviews-API: Filter top pages by namespace/category - https://phabricator.wikimedia.org/T182975#3840107 (10jberkel) [11:52:06] 10Analytics, 10Analytics-Wikistats: When searching for a project language, display a full list of languages - https://phabricator.wikimedia.org/T182960#3839812 (10Elitre) I believe https://phabricator.wikimedia.org/T179530#3837170 answers this. [12:03:49] 10Analytics-Kanban: EventLogging purging alarm - https://phabricator.wikimedia.org/T182978#3840161 (10mforns) [12:04:13] 10Analytics-Kanban: EventLogging purging alarm - https://phabricator.wikimedia.org/T182978#3840172 (10mforns) Luca submitted this fix: https://gerrit.wikimedia.org/r/#/c/398264/ and it was merged [12:04:27] 10Analytics-Kanban: EventLogging purging alarm - https://phabricator.wikimedia.org/T182978#3840175 (10mforns) [12:14:35] mforns: merged! [12:14:42] :] [12:14:52] thanks [12:19:52] * elukey lunch! [13:18:20] (03PS1) 10Ladsgroup: Use WikimediaUI color pallet in header [analytics/wikistats2] - 10https://gerrit.wikimedia.org/r/398459 [13:18:48] (03PS2) 10Ladsgroup: Use WikimediaUI color palette in header [analytics/wikistats2] - 10https://gerrit.wikimedia.org/r/398459 [13:53:52] (03CR) 10Mforns: "Access-method breakdown looks good! but there are still some previous comments to address." (031 comment) [analytics/aqs] - 10https://gerrit.wikimedia.org/r/393591 (https://phabricator.wikimedia.org/T181520) (owner: 10Fdans) [14:09:01] Hi team - sorry for late start [14:09:15] elukey: Great new on jumbo side :) [14:14:28] (03CR) 10Mforns: [C: 031] "LGTM! Just left some comments on super minor things" (034 comments) [analytics/dashiki] - 10https://gerrit.wikimedia.org/r/398411 (https://phabricator.wikimedia.org/T182477) (owner: 10Milimetric) [14:14:47] 10Analytics, 10Analytics-Wikistats: Wikistats v2 has a weird localization issues on search - https://phabricator.wikimedia.org/T182987#3840462 (10jcrespo) [14:27:58] 10Analytics, 10Analytics-Wikistats: Wikistats Bug : wrong data in Top viewed articles (about frwiki) - https://phabricator.wikimedia.org/T182954#3839590 (10JAllemandou) Hi @Manu1400 Thanks for this ticket. As most data in wikistats-v2 is updated monthly, we decided toshow only last month top pageviews. This mi... [14:38:35] 10Analytics, 10Analytics-Wikistats: [Wikistats2] The detail page for tops metrics does not indicate time range - https://phabricator.wikimedia.org/T182990#3840528 (10mforns) [14:39:00] 10Analytics, 10Analytics-Wikistats: Wikistats Bug : wrong data in Top viewed articles (about frwiki) - https://phabricator.wikimedia.org/T182954#3839590 (10mforns) Hi @Manu1400 , thanks for reporting this You are right, Wikistats is not real-time neither daily updated. For now, it is updated once per month, a... [14:39:31] oh joal you beat me in commenting in that task :/ :] [14:41:52] huhuhu :) [14:42:01] (03PS2) 10Milimetric: Add created-by component with Dashiki explanation [analytics/dashiki] - 10https://gerrit.wikimedia.org/r/398411 (https://phabricator.wikimedia.org/T182477) [14:42:12] (03CR) 10Milimetric: Add created-by component with Dashiki explanation (034 comments) [analytics/dashiki] - 10https://gerrit.wikimedia.org/r/398411 (https://phabricator.wikimedia.org/T182477) (owner: 10Milimetric) [14:42:36] k, mforns, thanks for the cleanup pointers, I was a little tired last night doing that [14:42:52] np milimetric looks great [14:42:54] let's see what Nuria thinks too and we can deploy [14:42:59] sure [14:44:31] mforns: I'm about to start looking at the geowiki code, and thinking about how to implement it in Hadoop [14:44:40] if you or joal are interested, I can do it in the cave [14:44:45] milimetric: interested ! [14:44:48] sure, omw [15:34:55] 10Analytics-Cluster, 10Analytics-Kanban, 10Operations, 10Traffic, 10User-Elukey: TLS security review of the Kafka stack - https://phabricator.wikimedia.org/T182993#3840663 (10elukey) p:05Triage>03Normal [15:35:39] this --^ means that we made a huge progress but we'll not meet the cache::misc goal [15:38:37] mforns, milimetric : let me look at dashiki patch on my computer, i did not get as far yesterday [15:49:17] elukey: Hola! question piwik is undergoing maintenance? [15:49:21] https://piwik.wikimedia.org/ [15:50:46] Trizek: an addblocker will block certain javascript requests so yes, it would be active whne you look at the site until those urls are whitelisted by addblockers [15:50:48] nuria_: yes, the db got corrupted today after a ganeti failure :( I am restoring the db now [15:51:07] I've set piwik in maintenance mode [15:51:24] elukey: ok, there are other services running on ganetti right? [15:51:31] Thank nuria_. I've suggested a rephrasing https://phabricator.wikimedia.org/T182958#3839781 [15:52:09] nuria_: sure why? [15:52:43] elukey: just wondering waht is making ganetti die, but you might know [15:53:35] nuria_: ongoing issue that we still don't explain - https://phabricator.wikimedia.org/T181121 [15:53:57] 10Analytics-Kanban, 10Analytics-Wikistats: Review the alert message about adblocker preventing AQS requests - https://phabricator.wikimedia.org/T182958#3840735 (10Nuria) a:03Nuria [15:54:56] nuria_: last backup was 2 days ago, I'll add this to the list of known outages [16:02:40] 10Analytics-Kanban, 10Operations, 10ops-eqiad, 10Patch-For-Review, 10User-Elukey: kafka1018 fails to boot - https://phabricator.wikimedia.org/T181518#3840744 (10elukey) [16:02:53] 10Analytics-Kanban, 10Patch-For-Review: Top is ordering items by name and not by value - https://phabricator.wikimedia.org/T182772#3840749 (10Milimetric) [16:03:02] 10Analytics-Kanban, 10Analytics-Wikistats: Privacy pageview threshold for map report - https://phabricator.wikimedia.org/T181508#3840752 (10mforns) [16:03:14] 10Analytics-Kanban, 10Analytics-Wikistats: Privacy pageview threshold for map report - https://phabricator.wikimedia.org/T181508#3792503 (10mforns) [16:03:38] 10Analytics-Kanban, 10Analytics-Wikistats: Add link to new wikistats 2.0 to wikistats 1.0 pages - https://phabricator.wikimedia.org/T182001#3840755 (10Nuria) [16:03:57] 10Analytics-Kanban, 10Analytics-Wikistats: Privacy pageview threshold for map report - https://phabricator.wikimedia.org/T181508#3792503 (10mforns) [16:05:25] 10Analytics-Kanban, 10Analytics-Wikistats: Privacy pageview threshold for map report - https://phabricator.wikimedia.org/T181508#3840759 (10mforns) I added some documentation for the concerns we discussed and the decisions we took: https://wikitech.wikimedia.org/wiki/Analytics/AQS/Pageviews/Pageviews_by_country [16:15:13] please elukey merge: https://gerrit.wikimedia.org/r/#/c/396324/ [16:19:03] nuria_: done :) [16:27:25] nuria_: I've run the cron manually, where is the data supposed to show up? (I mean the website) [16:28:49] ah https://gerrit.wikimedia.org/r/#/c/396324/5/modules/dumps/files/web/html/analytics_index.html [16:28:54] nope [16:29:01] https://dumps.wikimedia.org/other/analytics/ [16:29:15] 10Analytics, 10Analytics-Wikistats: Wikistats 2.0 Bug at swwiki - https://phabricator.wikimedia.org/T182859#3840841 (10Milimetric) This has been fixed and deployed, I'll merge it into the task that fixed it. [16:29:47] joal: are you goint to send another code review to fix the typo in https://dumps.wikimedia.org/other/analytics/ ? [16:29:52] or do you want me to? [16:30:15] elukey: I can do no problem [16:30:43] super thanks [16:30:47] <3 [16:31:17] 10Analytics-Kanban, 10Patch-For-Review: Top is ordering items by name and not by value - https://phabricator.wikimedia.org/T182772#3840856 (10Milimetric) [16:31:19] 10Analytics, 10Analytics-Wikistats: Wikistats 2.0 Bug at swwiki - https://phabricator.wikimedia.org/T182859#3840858 (10Milimetric) [16:31:33] ah joal, did you see https://grafana.wikimedia.org/dashboard/db/analytics-hadoop?panelId=48&fullscreen&orgId=1&from=now-7d&to=now ? [16:31:45] nope :( [16:31:52] I added it the last time [16:35:32] a-team: well, that was easy :) https://superset.wikimedia.org/superset/dashboard/uniquedevices/ [16:35:39] I didn't even do anything!!! [16:35:42] what magic is this... [16:36:26] O.o [16:37:54] milimetric: I dont know how, but you did that fast :) [16:38:02] now we need to think about filtering milimetric [16:38:16] I literally did nothing. I just created a dashboard called unique-devices and everything else happened magically [16:38:19] I'm scared [16:38:48] milimetric: It's because I created a slice minutes ago :) [16:38:56] ah!!! I just saw that [16:39:00] I'm like what are slices?! [16:39:06] k, haha, makes sense [16:39:07] cool [16:39:09] :) [16:39:32] Slice is a part of dashboard (like a graph, a number, or a filter) [16:39:40] milimetric: We need to add a filter [16:39:47] For the moment it's incorrect ) [16:40:19] And we should probably differenciate montly/daily, and per-domain and per-family :) [16:41:06] joal: i'm playing with it now, added a domain == en.wikipedia.org filter [16:41:25] I'll rename it to Unique-Devices-enwiki-monthly [16:41:26] great :) [16:41:36] milimetric: I suggest somnething different [16:41:46] let us bikeshed! [16:41:51] milimetric: I suggest no filter in slice, but generic filter in dashboard [16:42:15] milimetric: give me 10 minutes, I prepare fire then I'll be back :) [16:45:40] 10Analytics: Setup regular backups from mysql eventlogging master - https://phabricator.wikimedia.org/T183000#3840880 (10Nuria) [16:56:57] milimetric: I'm ready ! [16:57:54] joal: cave? [16:58:01] sure, OMW ! [17:01:07] 10Analytics, 10User-Elukey: Setup regular backups from mysql eventlogging master - https://phabricator.wikimedia.org/T183000#3840928 (10elukey) [17:26:51] * elukey off!! have a good weekend people [17:27:09] Bye elukey - Thanks for Clicksteam :) [18:01:05] 10Analytics-Kanban, 10Patch-For-Review, 10User-Elukey: Add the prometheus jmx exporter to all the Hadoop daemons - https://phabricator.wikimedia.org/T177458#3841202 (10elukey) Some useful docs: https://cwiki.apache.org/confluence/display/EAG/Hadoop+JMX+Monitoring+and+Alerting https://github.com/DataDog/the-... [19:29:33] Hey halfak - I had the mission to pass you a hello from Nicolas Jullien :) [19:29:44] o/ joal [19:29:49] Thanks! [19:29:50] And b the way, you also receive a hello from me, long time no see mate [19:29:52] Hi back to him :) [19:30:12] Yeah! It has been a little while [19:30:33] BTW, are you going to be around for Allhands in a month? [19:31:03] Not this year - NaƩ is still too young for me to be willing to leave my wife caring both for that long [19:36:14] halfak: But I'll definitely miss that -- I've been hearing of plans for that for two month, and I'm a bit jealous :) [19:36:46] 10Analytics: Hand off of Christian's MaxMind geolocation databases repository - https://phabricator.wikimedia.org/T89453#3841476 (10Nuria) p:05Low>03Normal [19:37:00] That's a bummer. :( Maybe I can organize the Scoring Platform offsite in Britany ;) [19:37:08] HaeB: older copies of maxmind are at : /srv/stat1002-a/user_dirs_from_stat1002/milimetric/GeoIP-toolbox/MaxMind-database [19:37:15] Most likely going to be Berlin though [19:37:20] halfak: If you come to Europe, I'll try to make a move :) [19:37:29] you have dates? [19:37:43] Not yet. Needed some things to stabilize. [19:37:49] Still waiting on that actually. [19:37:53] nuria_: excellent, will take a look [19:38:12] 10Analytics: Hand off of Christian's MaxMind geolocation databases repository - https://phabricator.wikimedia.org/T89453#1036629 (10Nuria) Turns out that this data is actually quite useful, let's productionize its upkeeping [19:38:32] Probably going to be early summer/late spring at this point. [19:39:02] ok halfak - Depending on dates and your plans, I could have some fun joining for a few days :) [19:48:03] milimetric: I think the bundling did not save any time on the dashboard in the prod case , which kind of tells me that bundle is too big as local case benefits quite a bit . It does save about 50 ms on the detail page case [19:51:47] I profiled it before and after with the prod build, nuria, for me the page was ready 200 ms faster with the Detail bundle split out [20:03:44] milimetric: oh wow [21:31:39] (03PS1) 10Joal: Correct bug in mediawiki raw revision table [analytics/refinery] - 10https://gerrit.wikimedia.org/r/398552 [22:13:21] (03PS1) 10Nuria: Change addblocker text [analytics/wikistats2] - 10https://gerrit.wikimedia.org/r/398598 (https://phabricator.wikimedia.org/T182958)