[17:51:01] <wikibugs>	 Analytics / EventLogging: Cleaning up of some (?) EventLogging schemata for Growth - https://bugzilla.wikimedia.org/68931 (christian) NEW>RESO/FIX
[19:43:31] <Ironholds>	 qchris_away, when you get back, got a sec for a quick question around XFFs?
[20:50:46] <wikibugs>	 Analytics / Tech community metrics: "Age of unreviewed changesets by affiliation" shows negative number of changesets - https://bugzilla.wikimedia.org/70600#c6 (Quim Gil) Álvaro, when do you think we will have a solution for this problem? This is the last bug in http://korma.wmflabs.org/browser/gerrit_...
[22:36:16] <qchris>	 Ironholds: What's up with XFFs?
[22:36:49] <Ironholds>	 qchris, ack, sorry, resolved and I forgot to update in here. My bad :(
[22:37:01] <qchris>	 No worries.
[22:37:04] <qchris>	 :-)
[22:37:16] <Ironholds>	 Erik and I were discussing how he handled spider identification, and he got confused between the read and edit identification, and informed me that any IP with more than N requests in a time period would be excluded
[22:37:30] <Ironholds>	 ...at which point I went "..wait. But, HTTPS.". We got it worked out.
[22:38:58] <qchris>	 I do not fully follow ... but if you got it worked out ... all the better :-D
[22:49:02] <andrewbogott>	 qchris: Are you there?  If not, can someone PM me an email address for them?
[22:49:24] <qchris>	 andrewbogott: Who is "them"?
[22:49:39] <qchris>	 my email address is christian@quelltextlich.at
[22:49:48] <andrewbogott>	 'them' is you :)
[22:50:26] <andrewbogott>	 qchris: You have quite a lot of labs instances with broken puppet.  Can I count on you to catch them up to the ldap change sometime soon?
[22:50:58] <andrewbogott>	 I was going to fix them myself but quickly noticed that puppet is explicitly disabled on qchris-master (which rules over many of the other troubled instances)
[22:50:59] <qchris>	 Oh. We should update them. I missed that.
[22:51:03] <andrewbogott>	 and I didn't want to break things too much :)
[22:51:19] <qchris>	 I do not use ldap much there ...
[22:51:29] <qchris>	 So I guess I just kill them and recreate them.
[22:51:32] <andrewbogott>	 you do, actually :)
[22:51:56] <andrewbogott>	 ldap governs every single user account.  So every time you log in it involves an ldap check
[22:52:13] <qchris>	 Right :-)
[22:52:26] <andrewbogott>	 But, yeah, fix puppet or recreate the instances, either way is fine with me :)
[22:54:14] <andrewbogott>	 Anyway, I'll keep my hands off those instances until later tomorrow :)
[22:54:37] <qchris>	 Ok. I'll take care of all that start in "qchris-"
[22:54:50] <qchris>	 Any other instances that I should go over?
[22:55:35] <andrewbogott>	 hm… zookeeper0 relies on a puppetmaster that doesn't exist anymore.  I think that's also in the analytics project
[22:55:59] <qchris>	 I guess that's an ottomata instance.
[22:56:03] <qchris>	 I'll ping him.
[22:56:06] <andrewbogott>	 The full list of troubled instances is here:  https://wikitech.wikimedia.org/wiki/Ldap_rename
[22:56:18] <qchris>	 Thanks!
[22:56:24] <andrewbogott>	 Totally unsorted, though -- I'll see if I can produce a similar report sorted by project or something
[22:56:47] <andrewbogott>	 When I generated that report I was expecting the list to be… smaller
[22:56:49] <qchris>	 kafka ones too.
[22:57:10] <andrewbogott>	 yeah
[22:57:38] <qchris>	 Ok ... there are even more analytics instances.
[22:57:44] <qchris>	 I'll reach out to the team as a whole.
[22:57:54] <andrewbogott>	 Yeah, looks like more or less all of them.  y'all must like your role::puppet::self
[22:58:06] <qchris>	 Totally!
[22:58:08] <qchris>	 :-)
[22:58:30] <andrewbogott>	 Sorry about the short notice -- generally I try to leave multiple weeks for something like this but I'm pinched between not having had a new ldap server until a few days ago and the impending doom of the old one in Tampa.
[22:59:03] <qchris>	 We only have one problematic instance (wikimetrics1)
[22:59:14] <qchris>	 I guess we need to update that one.
[22:59:32] <qchris>	 That might take some time.
[23:00:31] <andrewbogott>	 how is that one different?
[23:01:09] <qchris>	 It serves Wikimetrics ... a service analytics considers to be "production".
[23:01:27] <qchris>	 This is bad in many ways, but still ... that's the way it is.
[23:02:15] <qchris>	 Since the switch for the instances (although I saw the switch in the puppet repo) caught me a bit by surprise ... was there some
[23:02:20] <qchris>	 email with upgrading instructions?
[23:05:15] <andrewbogott>	 sure, if you look in the labs list...
[23:05:28] <andrewbogott>	 subject " IMPORTANT: ldap renaming"
[23:05:40] <andrewbogott>	 There's the original announcement, and also bryan responded with a step-by-step
[23:05:47] <qchris>	 Oh ... labs list ... I am not on that one. ... I guess I should subscribe there.
[23:05:52] <andrewbogott>	 yep!
[23:06:03] <qchris>	 Ok thanks. I'll point the analytics team to that email then.
[23:06:05] <andrewbogott>	 https://lists.wikimedia.org/mailman/listinfo/labs-l
[23:06:09] <qchris>	 Thanks!
[23:06:10] <andrewbogott>	 thanks