[01:14:03] 06Analytics-Kanban: Investigate duplicate EventLogging rows - https://phabricator.wikimedia.org/T142667#2897783 (10Nuria) NavigationTiming duplicates, about 2%... mmm yearmonth totalevents dupes_percentage 201610 12500127 3.13 201611 11927725 2.90 201612 7834400 2.80 [09:33:48] moritzm: funny things that we discovered yesterday - it turned out that your requests to restart hadoop java daemons for security upgrades were saving us from a big leak on the Yarn node managers :D [09:33:58] https://grafana.wikimedia.org/dashboard/db/analytics-hadoop?panelId=17&fullscreen&from=now-24h&to=now - I restarted them yesterday [09:35:33] elukey: heh, nice. that's the beauty of the openjdk updates bunding security fixes with regular bugfixes :-) [09:36:03] moritzm: I wanted to make that joke as well :) [12:40:25] * elukey lunch! [14:35:18] hi team :] [14:35:21] Hey mforns [14:35:46] mforns: One file to go and I'm doooOOOOOOOOooone ! [14:36:07] one file? the docs? [14:36:14] the comments actually :) [14:36:26] aha! cooool [15:34:39] joal: https://issues.apache.org/jira/browse/YARN-5482 [15:35:56] elukey: yes, that's what we found yesterday - but no mention of 2.6 though [15:36:50] out for lunch! [15:38:04] maaaaan, we have some spanish guy here :) [15:38:15] Having lunch at 4pm :) [15:38:32] This is really more of a duplicate of YARN-5341 since this was reported against 2.7. It's fixed in 2.7.4. Backporting YARN-5296 could also fix the issue but causes other problems, hence why we fixed it specifically for 2.7 in YAN-5341. [15:39:01] joal: it if was reported against 2.7 it doesn't mean that it wasn't there for 2.6 [15:39:16] or maybe I didn't get your point [15:39:30] elukey: they are usually correct in the 'Affect version' field - maybe not this time [15:40:07] well it can be "up to 2.7" [15:40:29] anyhow, from what I can see CDH 5.9 is shipped with the bugfix :) [15:43:59] it is also funny to check "leaks" in the hadoop changelogs [15:44:39] 06Analytics-Kanban, 06Operations, 15User-Elukey: Yarn node manager JVM memory leaks - https://phabricator.wikimedia.org/T153951#2899094 (10elukey) https://issues.apache.org/jira/browse/HADOOP-13362 (https://issues.apache.org/jira/browse/YARN-5482 has a more simple description and points to it) seems to be a... [15:47:28] joal: updated --^ [16:52:46] mforns: still here? [16:56:01] joal, sure! [16:56:17] 'sup? [16:56:30] mforns: batcave for a minute, trying to have better paragraph on secondary sorting :) [16:57:01] omw [17:27:06] (03PS12) 10Joal: Add mediawiki history spark jobs to refinery-job [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/325312 (https://phabricator.wikimedia.org/T141548) [17:32:01] Gone for holidays a-team :) [17:32:10] Talk to you next yesar ;) [17:32:24] bye joal! have happy christmas days! [17:35:22] o/ [17:53:41] * elukey goes in holiday mode [17:53:44] byeeee o/ [19:02:42] Joyeux noël everyone! Closing down, see you in the new year A-Team!!