[02:35:58] <milimetric>	 fyi: one of my apache log files on limn1 got 300M of text, all GETs like this one: "GET /server-status?auto HTTP/1.1" 200 24092 "-" "Python-urllib/2.7"
[02:36:13] <milimetric>	 wondering if some tool went crazy ^
[02:38:04] <YuviPanda>	 milimetric: that's probably a sad little NRPE check checking to see if apache is up, reporting it to someone and then failing since it has nobody to report to
[02:38:45] <milimetric>	 hm... so why would someone set that up to hit my site of all places...
[02:39:03] <YuviPanda>	 it's probably from localhost
[02:39:11] <YuviPanda>	 you probably have a puppet role that sets it up along with apache
[02:39:13] <YuviPanda>	 or something like that
[03:03:02] <wikibugs>	 6Labs, 10Incident-20150617-LabsNFSOutage, 3Labs-Sprint-102, 3Labs-Sprint-103, and 3 others: Audit projects' use of NFS, and remove it where not necessary - https://phabricator.wikimedia.org/T102240#1802931 (10yuvipanda) a:5yuvipanda>3None
[05:53:45] <legoktm>	 YuviPanda: I cleaned up the code a bit and it's now at https://git.legoktm.com/legoktm/newusers
[06:13:40] <MaxSem>	 how do I get a list of replicas in tool labs? the docs say /etc/hosts but it has nothing interesting
[06:16:49] <legoktm>	 it used to be in /etc/hosts, now it's in DNS I think
[06:16:56] <legoktm>	 MaxSem: all.dblist - private.dblist?
[06:17:23] <MaxSem>	 well, that's cheating:P
[06:45:13] <YuviPanda>	 MaxSem: dblist is the real thing :P
[06:45:15] <YuviPanda>	 I guess
[06:45:27] <YuviPanda>	 MaxSem: there's also a meta something table somewhere that Coren probably knows better about
[06:45:45] <MaxSem>	 meh, too lazy for reading tables
[06:48:40] <YuviPanda>	 yeah but fuck /etc/hosts with large number of unpuppetized things
[06:48:45] * YuviPanda shudders a little bit at that memory
[07:02:53] <wikibugs>	 6Labs, 6Discovery, 10Maps: Request to enable critical alert notifications for maps-warper instance on shinken.wmflabs.org - https://phabricator.wikimedia.org/T116053#1803096 (10yuvipanda) a:5yuvipanda>3None
[07:02:55] <wikibugs>	 6Labs, 10Tool-Labs, 3Labs-Sprint-115, 3labs-sprint-116, 3labs-sprint-118: Write admission controller disabling mounting of unauthorized volumes - https://phabricator.wikimedia.org/T112718#1803097 (10yuvipanda) a:5yuvipanda>3None
[07:03:01] <wikibugs>	 6Labs, 3Labs-Sprint-105: NFS exports broken for new projects which want NFS - https://phabricator.wikimedia.org/T104881#1803105 (10yuvipanda) a:5yuvipanda>3None
[07:03:05] <wikibugs>	 6Labs: Investigate account-creation-assistance project's use of NFS and look for replacements - https://phabricator.wikimedia.org/T103156#1803106 (10yuvipanda) a:5yuvipanda>3None
[07:04:09] <wikibugs>	 6Labs, 10Tool-Labs, 3labs-sprint-118, 3labs-sprint-119: Enforce that containers from a user run with the uid assigned to that user - https://phabricator.wikimedia.org/T116504#1803126 (10yuvipanda) Wheee! See pull request in previous comment for details, but we have this deployed in our cluster now. Need to...
[07:04:20] <wikibugs>	 6Labs, 10Tool-Labs, 3labs-sprint-118, 3labs-sprint-119: Enforce that containers from a user run with the uid assigned to that user - https://phabricator.wikimedia.org/T116504#1803127 (10yuvipanda) a:3yuvipanda
[07:13:56] <MaxSem>	 YuviPanda, I SCREAM BLOODY MURDER
[07:13:57] <MaxSem>	 5.3.10-1ubuntu3.20+wmf1 with Suhosin-Patch (cli) (built: Oct  1 2015 09:55:22)
[07:14:35] <MaxSem>	 even though login has 5.5
[07:16:45] <legoktm>	 MaxSem: -l release=trusty
[07:16:59] <MaxSem>	 sane defaults ftw
[07:20:13] <YuviPanda>	 MaxSem: sure once you tell me how to get the current set of people who are using 'jsub' and expecting all their bugs to work
[07:20:18] <YuviPanda>	 to continue working
[07:20:37] <MaxSem>	 they generate it themselves
[07:20:58] <MaxSem>	 WHEN YOU DRAG THEM INTO 21ST CENTURY FORCEFULLY
[07:21:30] <YuviPanda>	 heh
[07:21:42] <YuviPanda>	 I was going to work with legoktm to move wikibugs to the 21st century tomorrow
[07:21:47] <YuviPanda>	 some of that might still happen. let's see
[07:21:56] <YuviPanda>	 but I think I need a while to recuperate
[07:30:02] <legoktm>	 MaxSem: https://github.com/legoktm/harej-bots/commit/100ec4be9fd771f49d884fd5b1d19cdce84ba70b
[07:30:30] * MaxSem high-fives legoktm 
[07:32:08] <legoktm>	 :D
[09:52:08] <valhallasw`cloud>	 MaxSem: show databases;? ;-)
[09:52:37] <MaxSem>	 aha, and filter their names...
[09:53:11] <jynus>	 what was the question?
[09:53:32] <valhallasw`cloud>	 MaxSem: there should also be a database with wikis, I think on toolsdb.
[09:53:47] <MaxSem>	 how to get a list of replica dbs, jynus 
[09:53:48] <jynus>	 because "pager grep search" is usually the answer
[09:54:02] <MaxSem>	 I ended up doing https://github.com/MaxSem/pagecounts/blob/master/pagecounts.php
[09:54:11] <valhallasw`cloud>	 MaxSem: let's take a step back ;-) what do you need them for
[09:54:18] <valhallasw`cloud>	 do you want to show the user a list of possible wikis?
[09:54:40] <MaxSem>	 ^^
[09:54:56] <valhallasw`cloud>	  meta_p.wiki
[09:55:16] <jynus>	 https://noc.wikimedia.org/db.php
[09:57:35] <valhallasw`cloud>	 MaxSem: https://quarry.wmflabs.org/query/4031
[09:57:41] <_joe_>	 valhallasw`cloud: I'm merging the redis toollabs patch 
[09:57:48] <valhallasw`cloud>	 _joe_: thanks!
[09:58:26] <_joe_>	 {{done}}
[09:59:58] <valhallasw`cloud>	 yep, puppet is happy again :-)
[10:14:57] <shinken-wm>	 RECOVERY - Puppet failure on tools-redis-01 is OK: OK: Less than 1.00% above the threshold [0.0]
[10:34:14] <shinken-wm>	 RECOVERY - Puppet failure on tools-redis-02 is OK: OK: Less than 1.00% above the threshold [0.0]
[17:57:14] <andrewbogott>	 chasemp, Coren, are we having our ironic meeting now?  I recall something about a conflict but can’t remember the details
[17:58:16] <chasemp>	 Ah yes the conflict itself was canceled.  Give me an extra 5m and sure?
[17:58:36] <andrewbogott>	 np
[17:58:47] <andrewbogott>	 The ops session is in 2 hours, right?
[18:00:07] <chasemp>	 I think it was moved to next week
[18:01:02] <Coren>	 andrewbogott: I'll be there in a bit - my laptop was not signed in since the 2fa was added.  :-)
[18:02:01] <ostriches>	 YuviPanda: Got a second to help with a shinken problem?
[18:02:40] <andrewbogott>	 chasemp: oh, yes it was!  I really need to stop adding personal entries to my calendar, lots of duplication
[18:06:58] <fhocutt>	 Coren: anyone end up getting back to you on the yahoo API creds yet?
[18:08:24] <Coren>	 fhocutt: No, I'm in a meeting for just a little bit but ima poke 'em again.  It's a bit harder to figure out since the people who used to handle it are (coincidentally) both gone so I have to track down who now handles this.  :-)
[18:09:52] <fhocutt>	 Coren: when you figure that out, could you document it somewhere?
[18:09:59] <Coren>	 fhocutt: Yes.
[18:10:07] <fhocutt>	 thanks.
[18:14:28] <Earwig>	 fhocutt: hey
[18:14:35] <fhocutt>	 hey!
[18:14:50] <Earwig>	 I'm sure there's a way you can get around it without the key..
[18:15:05] <Earwig>	 at least temporarily
[18:23:25] <wikibugs>	 6Labs, 10Labs-Team-Backlog: Support bare-metal server allocation in labs -- bootstrap mode - https://phabricator.wikimedia.org/T95185#1804253 (10Andrew)
[18:23:27] <wikibugs>	 6Labs: Investigate moving mwoffliner onto a labs-on-real-hardware machine - https://phabricator.wikimedia.org/T117081#1804251 (10Andrew) 5Open>3stalled This is on hold, pending allocation questions.
[18:23:42] <wikibugs>	 6Labs, 10Labs-Team-Backlog: Find an Ops-internal project to host on labs bare metal. - https://phabricator.wikimedia.org/T118588#1804254 (10Andrew) 3NEW
[18:33:05] <wikibugs>	 6Labs, 10Labs-Infrastructure: labcontrol2001:  What is it?  What is it for? - https://phabricator.wikimedia.org/T118591#1804289 (10Andrew) 3NEW
[18:50:15] <wikibugs>	 6Labs, 10Labs-Infrastructure: labcontrol2001:  What is it?  What is it for? - https://phabricator.wikimedia.org/T118591#1804364 (10yuvipanda) Is bigfoot real? Where do caterpillars go when they pupate? What happens when you cross a blackhole's horizon? Can you even cross a black hole's horizon? Can Yuvi ever w...
[19:06:59] <fhocutt>	 Earwig: I tried making some of the changes, but I wasn't sure where the module it was actually using was--need to poke around PATH stuff more
[19:07:10] <Earwig>	 hmm
[19:11:24] <fhocutt>	 I'd really rather not need to change the code :/
[20:30:33] <YuviPanda>	 legoktm: give me links to the wikibugs stuff?
[20:34:38] <legoktm>	 YuviPanda: labs/tools/wikibugs2.git
[20:34:44] <legoktm>	 YuviPanda: https://www.mediawiki.org/wiki/Wikibugs
[20:35:01] <legoktm>	 I never got around to porting the web poll'er thing
[20:35:17] <YuviPanda>	 kk
[20:41:23] <YuviPanda>	 legoktm: ok, so to reiterate
[20:41:33] <YuviPanda>	 we have two processes
[20:41:38] <YuviPanda>	 that iterate via redis
[20:42:05] <legoktm>	 yes
[21:47:35] <YuviPanda>	 legoktm: heh, too exhausted for that now I think. what's the other new tool you had?
[22:06:35] <legoktm>	 YuviPanda: https://git.legoktm.com/legoktm/newusers one file CGI script