[02:10:18] (PS31) Joal: [WIP] Refactor Mediawiki History scala code [analytics/refinery/source] - https://gerrit.wikimedia.org/r/301837 (https://phabricator.wikimedia.org/T141548) [04:03:50] (PS26) Joal: [WIP] Join and denormalize all histories into one [analytics/refinery/source] - https://gerrit.wikimedia.org/r/307903 (owner: Milimetric) [09:27:56] !log started 0021136-161020124223818-oozie-oozi-C to re-run wf-text-2016-11-6-01 -> 07 [09:27:57] Logged the message at https://www.mediawiki.org/wiki/Analytics/Server_Admin_Log [09:50:18] thanks joal! [11:15:38] (PS32) Joal: [WIP] Refactor Mediawiki History scala code [analytics/refinery/source] - https://gerrit.wikimedia.org/r/301837 (https://phabricator.wikimedia.org/T141548) [11:16:46] (PS27) Joal: [WIP] Join and denormalize all histories into one [analytics/refinery/source] - https://gerrit.wikimedia.org/r/307903 (owner: Milimetric) [17:39:46] !log started 0021694-161020124223818-oozie-oozi-C to rerun wf-text-2016-11-6-15 [17:39:47] Logged the message at https://www.mediawiki.org/wiki/Analytics/Server_Admin_Log [17:39:50] joal: --^ [17:40:20] noticed elukey, I was willing to wait for potentially more collocated failures, but you have it :) [17:44:14] felt bad that you re-run all of them this weekend :( [17:44:32] you shouldn't, it's very ok, I worked anyway ;) [17:44:49] Tomorrow I'll have a small day, so I covered this weekend [17:44:50] I started varnishlog on cp4001[67] (uslfo) to catch VSL errors like timeouts or overflow [17:45:12] but for the moment it seems only the same problem as we saw in ulpload [17:45:15] *upload [17:45:22] so not related to varnishkafka configs [17:52:37] * elukey afk again :) [19:50:41] !log started 0021806-161020124223818-oozie-oozi-C to rerun wf-text-2016-11-6-16 [19:50:42] Logged the message at https://www.mediawiki.org/wiki/Analytics/Server_Admin_Log