[21:21:14] <legoktm>	 test
[21:22:26] <legoktm>	 greg-g: add http://ur1.ca/jdj61 to the topic?
[21:22:38] <bd808>	 twentyafterfour: So the sum up, the scap trebuchet source repo on tin had messed up permissions. Reedy moved it and let puppet recreate. icinga spam ensued. now there are a handful of hosts that seem to have local permissions problems.
[21:24:35] <Krinkle>	 I guess wikibugs needs an update, too. To report project:Phrabricator requests here.
[21:26:10] <greg-g>	 Krinkle: yeah, basically everything that goes to -qa now plus #phabricator (not #phabricator.org) (at least for now)
[21:26:27] <Krinkle>	 Those go to -devtools currently
[21:27:20] <greg-g>	 right, hence the "plus" :)
[21:27:25] <Krinkle>	 greg-g: I noticed Antoine is duplicating instead of moving. Is that on purpose?
[21:27:33] <greg-g>	 until we redirect the channels, yeah
[21:27:50] <greg-g>	 I wanted to dupe notifs, get it all setup in here, then redirect the channels and undupe
[21:28:26] <Krinkle>	 I'm not sure what the benefit is? But ok.
[21:28:36] * greg-g needs to refind the irc magic commands 
[21:29:12] <greg-g>	 Krinkle: "no downtime" for irc notifications, basically, arguable how important that is :)
[21:29:44] <Krinkle>	 WHy would there be downtime? They go in -qa now, We move each bot one by one from -qa to -devtools. Why to both?
[21:29:47] <Krinkle>	 Why(
[21:30:00] <greg-g>	 because not everyone is in here
[21:30:02] <greg-g>	 (yet)
[21:30:11] <Krinkle>	 k
[21:30:19] <Krinkle>	 could also move humans before bots :P
[21:30:33] <greg-g>	 same problem then :)
[21:30:49] <Krinkle>	 humans can be in both and don't require changes in 10 repos that week to get deployed each
[21:30:55] <Krinkle>	 Anyway, I'm not bothered.
[21:31:12] * greg-g nods
[21:31:24] * greg-g goes to start on quarterly review stuff
[21:36:00] <Reedy>	 bd808: Do we just get ops to chmod 644 /srv/deployment/scap/scap/scap via dsh/salt?
[21:36:47] <twentyafterfour>	 so any idea what caused the permissions to get messed up in the first place?
[21:37:05] <bd808>	 Reedy: I think I had rob to that way long ago when we first changed over to deploying scap via trebuchet.
[21:37:20] <Reedy>	 which permissions? ;)
[21:37:41] <bd808>	 so maybe it is needed each time? Actually I kind of remember having someone set group sticky bits
[21:38:06] <Reedy>	 dsh -g mediawiki-installation -M -F 40 -- "chmod 644 /srv/deployment/scap/scap/scap/*"
[21:38:48] <twentyafterfour>	 Reedy: any of them
[21:39:28] <Reedy>	 it's more confusing that it's not even consistent
[21:40:12] <twentyafterfour>	 so these are files that were deployed with trebuchet? so that's likely the culprit?
[21:40:34] <twentyafterfour>	 or maybe it's the chaos monkeys
[21:40:49] <Reedy>	 yeah, via trebuchet
[21:42:59] <greg-g>	 trebuchet deploys scap which deploys mediawiki. :)
[21:47:47] <bd808>	 and salt deploys trebuchet when told to do that by puppet
[21:48:30] <twentyafterfour>	 lol
[21:48:44] <twentyafterfour>	 I think we might have a few too many redundant deployment tools guys
[21:49:11] <twentyafterfour>	 in my mind it should be puppet and scap, maybe mcollective. but 3 max
[21:49:57] <greg-g>	 see also: https://phabricator.wikimedia.org/T85008
[21:50:03] <greg-g>	 "Determine Trebuchet/git-deploy maintenance plan"
[21:53:33] <Reedy>	 bd808: Right, got mutante to fix the permissions
[21:53:36] <Reedy>	 scap works without error now
[21:54:01] <bd808>	 kewl
[21:54:04] <Reedy>	 I guess I should note this on wikitech as a known caveat
[21:59:12] <wmf-insecte>	 Yippee, build fixed!
[21:59:12] <wmf-insecte>	 Project browsertests-UniversalLanguageSelector-commons.wikimedia.beta.wmflabs.org-linux-firefox-sauce build #388: FIXED in 14 min: https://integration.wikimedia.org/ci/job/browsertests-UniversalLanguageSelector-commons.wikimedia.beta.wmflabs.org-linux-firefox-sauce/388/
[22:00:12] <Reedy>	 gj team