[00:06:00] DarTar: see cloud, they fixed it [00:06:05] ottomata[m]: yt? [00:24:07] nuria_, Sagan: yay [00:24:47] :) [00:32:07] !log finished sqooping pagelinks for missing dbs, hdfs -put a SUCCESS flag in the 2018-02 snapshot, jobs should run unless Hue is still lying to itself [00:32:08] Logged the message at https://www.mediawiki.org/wiki/Analytics/Server_Admin_Log [00:32:22] (by jobs above I meant the monthly clickstream jobs) [00:36:13] (03PS10) 10Milimetric: Compute geowiki statistics from cu_changes data [analytics/refinery] - 10https://gerrit.wikimedia.org/r/413265 (https://phabricator.wikimedia.org/T188113) [00:38:33] (03CR) 10Milimetric: "This is almost completely ready for review. The only part that doesn't work is the last step of the druid loader, and I feel like Joal wo" [analytics/refinery] - 10https://gerrit.wikimedia.org/r/413265 (https://phabricator.wikimedia.org/T188113) (owner: 10Milimetric) [09:07:39] !log Rerun clickstream-wf-2018-2 [09:07:41] Logged the message at https://www.mediawiki.org/wiki/Analytics/Server_Admin_Log [09:07:55] Thanks a lot Dan for yesterday sqooping ! [18:28:21] 10Analytics, 10Data-release, 10Research, 10Privacy: An expert panel to produce recommendations on open data sharing for public good - https://phabricator.wikimedia.org/T189339#4040472 (10Nuria) See: https://blog.wikimedia.org/2013/12/24/handling-our-user-data-a-response/ https://blog.wikimedia.org/2014/02/... [18:39:09] Hello people, Druid today had a brief outage [18:39:38] I believe that some queries timeout out and caused also AQS to be a bit chatty on the ops channel [18:39:59] once stuff get cached, all good [18:40:31] didn't investigate exactly what happened, will open a task on monday, but I suspect it was due to the new mw-history data [18:40:34] all good now :) [20:10:37] Thanks for having checked druid elukey [20:10:54] This outage is weird as data got loaded yesterday night [20:18:04] Hm - Looking at charts, the requests that have happened around 16:40 UTC were different than the ones happenning around 9:30 (there actually was a lot more requests at 9:30, but the load on druid was super smaller) [20:18:52] I need to investigate more, but my guess would be full-history requests (like computing daily edits for all projects since 2001) [20:19:02] I'll investigate on monday looking at logs [20:19:06] Tcho!