[00:03:22] <wikibugs>	 3Continuous-Integration: Do not run HHVM tests on mediawiki-core < 1.24 branches - https://phabricator.wikimedia.org/T85036#937346 (10Krinkle) a:3Krinkle
[00:04:24] <wmf-insecte>	 Yippee, build fixed!
[00:04:25] <wmf-insecte>	 Project browsertests-MultimediaViewer-en.wikipedia.beta.wmflabs.org-linux-chrome-sauce build #354: FIXED in 35 min: https://integration.wikimedia.org/ci/job/browsertests-MultimediaViewer-en.wikipedia.beta.wmflabs.org-linux-chrome-sauce/354/
[00:04:54] <wmf-insecte>	 Project beta-scap-eqiad build #34640: STILL FAILING in 57 sec: https://integration.wikimedia.org/ci/job/beta-scap-eqiad/34640/
[00:13:52] <wikibugs>	 3Continuous-Integration: Do not run HHVM tests on mediawiki-core < 1.24 branches - https://phabricator.wikimedia.org/T85036#937352 (10Krinkle) * integration/config [`705ba6959e`](https://github.com/wikimedia/integration-config/commit/705ba6959e92e4c3026a73096c06cdcbd41d471a#diff-3): Add mediawiki-php-hhvm jobs *...
[00:14:25] <Krinkle>	 bd808: You there?
[00:14:46] <bd808>	 Krinkle: yeah, what's up?
[00:15:05] <Krinkle>	 bd808: Wanna fix https://phabricator.wikimedia.org/T85036#937352 ? Or would it be trivial and can I just as well do it.
[00:15:34] <Krinkle>	 Wanna make sure you know, too :)
[00:16:12] <wmf-insecte>	 Yippee, build fixed!
[00:16:12] <wmf-insecte>	 Project beta-scap-eqiad build #34641: FIXED in 2 min 8 sec: https://integration.wikimedia.org/ci/job/beta-scap-eqiad/34641/
[00:16:36] <bd808>	 Ah. Can I review the patch instead of trying to write it?
[00:16:50] <bd808>	 It's good to know this is easy though
[00:17:02] <Krinkle>	 bd808: teh writing is easy. The hard part is deploying it.
[00:17:12] <Krinkle>	 And you'll need it local to deploy it.
[00:17:16] <bd808>	 I've done a couple zuul deploys
[00:17:31] <Krinkle>	 Ah, right. It's only a zuul update.
[00:18:18] <Krinkle>	 bd808: OK. Writing patch
[00:20:28] <grrrit-wm>	 (03PS1) 10Krinkle: Don't run hhvm jobs on fundraising/REL1_23 branch in mediawiki-core [integration/config] - 10https://gerrit.wikimedia.org/r/181217 
[00:21:23] <Krinkle>	 bd808: ^
[00:22:24] <bd808>	 looks simple enough.
[00:23:13] <bd808>	 touches quite a few pipelines I see
[00:23:46] <Krinkle>	 It's generic for extension branches as well.
[00:23:49] <Krinkle>	 Yeah
[00:23:50] <Krinkle>	 Mmm
[00:23:54] <Krinkle>	 I could "simplify" that
[00:24:06] <Krinkle>	 fundraising has no extension branches, right?
[00:24:23] <bd808>	 I don't know honestly
[00:25:05] <grrrit-wm>	 (03PS2) 10Krinkle: Don't run hhvm jobs on fundraising/REL1_23 branch in mediawiki-core [integration/config] - 10https://gerrit.wikimedia.org/r/181217 
[00:28:39] <grrrit-wm>	 (03CR) 10BryanDavis: [C: 031] Don't run hhvm jobs on fundraising/REL1_23 branch in mediawiki-core [integration/config] - 10https://gerrit.wikimedia.org/r/181217 (owner: 10Krinkle)
[00:33:18] <bd808>	 Krinkle: I can push that out on Monday if you'd like. My wife is telling me that it's time to go have dinner instead of working now. :)
[00:33:53] <Krinkle>	 bd808: OK. Follow [[mw:CI/Z]] on deployment. And !log in -op that you're loading Zuul to deploy said change
[00:34:00] <Krinkle>	 reloading*
[00:34:09] <bd808>	 *nod* can and will do
[00:34:14] <Krinkle>	 it preserves the queue and is graceful, so no worries about when you do that
[00:34:37] <Krinkle>	 Alrighty. Thanks!
[00:34:40] <bd808>	 yeah. you just have to watch and make sure gearman starts up right mostly right?
[00:35:38] <grrrit-wm>	 (03CR) 10BryanDavis: "I'll deploy this on Monday if hashar doesn't beat me to it." [integration/config] - 10https://gerrit.wikimedia.org/r/181217 (owner: 10Krinkle)
[00:35:41] <Krinkle>	 bd808: no, don't restart zuul or jenkins (which may need fresh gearman). Merely "reloading", which just re-reads config from disk while zuul stays on
[00:36:09] <bd808>	 `service zuul reload` got it
[00:36:52] <Krinkle>	 During the reload it'll post pone popping new items from the queue (but maintain accepting things in the queue) and then afterwards it continues processingn with the new config
[00:38:55] <bd808>	 o/ have a good break.
[00:39:51] <shinken-wm>	 PROBLEM - Puppet failure on deployment-db2 is CRITICAL: CRITICAL: 44.44% of data above the critical threshold [0.0]  
[00:47:18] <wikibugs>	 3Continuous-Integration: Jenkins: Run jobs in disposable VMs - https://phabricator.wikimedia.org/T47499#937396 (10greg) (Just came across this, pasting for record keeping: https://wiki.jenkins-ci.org/display/JENKINS/JClouds+Plugin )
[01:04:50] <shinken-wm>	 RECOVERY - Puppet failure on deployment-db2 is OK: OK: Less than 1.00% above the threshold [0.0]  
[01:44:04] <wmf-insecte>	 Project beta-scap-eqiad build #34648: FAILURE in 30 min: https://integration.wikimedia.org/ci/job/beta-scap-eqiad/34648/
[01:48:36] <wmf-insecte>	 Yippee, build fixed!
[01:48:36] <wmf-insecte>	 Project beta-scap-eqiad build #34649: FIXED in 2 min 25 sec: https://integration.wikimedia.org/ci/job/beta-scap-eqiad/34649/
[02:39:36] <wikibugs>	 3MediaWiki-extensions-Score, Beta-Cluster: FileBackendException using <score> tag on beta labs: No backend defined with the name 'global-multiwrite'  - https://phabricator.wikimedia.org/T85049#937531 (10Spage) 3NEW
[03:35:39] <wmf-insecte>	 Project beta-scap-eqiad build #34661: FAILURE in 1 min 36 sec: https://integration.wikimedia.org/ci/job/beta-scap-eqiad/34661/
[03:45:35] <wmf-insecte>	 Yippee, build fixed!
[03:45:36] <wmf-insecte>	 Project beta-scap-eqiad build #34662: FIXED in 1 min 29 sec: https://integration.wikimedia.org/ci/job/beta-scap-eqiad/34662/
[04:11:16] <shinken-wm>	 PROBLEM - Puppet staleness on deployment-sca-cache01 is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [43200.0]  
[04:35:39] <wmf-insecte>	 Project beta-scap-eqiad build #34667: FAILURE in 1 min 42 sec: https://integration.wikimedia.org/ci/job/beta-scap-eqiad/34667/
[04:45:44] <wmf-insecte>	 Yippee, build fixed!
[04:45:44] <wmf-insecte>	 Project beta-scap-eqiad build #34668: FIXED in 1 min 44 sec: https://integration.wikimedia.org/ci/job/beta-scap-eqiad/34668/
[05:15:05] <wmf-insecte>	 Project browsertests-Flow-en.wikipedia.beta.wmflabs.org-linux-chrome-sauce build #393: FAILURE in 55 min: https://integration.wikimedia.org/ci/job/browsertests-Flow-en.wikipedia.beta.wmflabs.org-linux-chrome-sauce/393/
[05:35:38] <wmf-insecte>	 Project browsertests-VisualEditor-en.wikipedia.beta.wmflabs.org-linux-firefox-sauce build #479: FAILURE in 1 hr 11 min: https://integration.wikimedia.org/ci/job/browsertests-VisualEditor-en.wikipedia.beta.wmflabs.org-linux-firefox-sauce/479/
[06:14:51] <wmf-insecte>	 Project beta-scap-eqiad build #34677: FAILURE in 52 sec: https://integration.wikimedia.org/ci/job/beta-scap-eqiad/34677/
[06:25:06] <wmf-insecte>	 Project beta-scap-eqiad build #34678: STILL FAILING in 1 min 8 sec: https://integration.wikimedia.org/ci/job/beta-scap-eqiad/34678/
[06:35:33] <wmf-insecte>	 Project beta-scap-eqiad build #34679: STILL FAILING in 1 min 35 sec: https://integration.wikimedia.org/ci/job/beta-scap-eqiad/34679/
[06:44:15] <wmf-insecte>	 Yippee, build fixed!
[06:44:15] <wmf-insecte>	 Project browsertests-Flow-en.wikipedia.beta.wmflabs.org-windows_8-internet_explorer-sauce build #344: FIXED in 44 min: https://integration.wikimedia.org/ci/job/browsertests-Flow-en.wikipedia.beta.wmflabs.org-windows_8-internet_explorer-sauce/344/
[06:45:41] <wmf-insecte>	 Yippee, build fixed!
[06:45:42] <wmf-insecte>	 Project beta-scap-eqiad build #34680: FIXED in 1 min 43 sec: https://integration.wikimedia.org/ci/job/beta-scap-eqiad/34680/
[06:55:32] <wmf-insecte>	 Project beta-scap-eqiad build #34681: FAILURE in 1 min 34 sec: https://integration.wikimedia.org/ci/job/beta-scap-eqiad/34681/
[07:00:48] <shinken-wm>	 PROBLEM - Puppet failure on deployment-db2 is CRITICAL: CRITICAL: 66.67% of data above the critical threshold [0.0]  
[07:06:12] <wmf-insecte>	 Yippee, build fixed!
[07:06:12] <wmf-insecte>	 Project beta-scap-eqiad build #34682: FIXED in 2 min 7 sec: https://integration.wikimedia.org/ci/job/beta-scap-eqiad/34682/
[07:15:32] <wmf-insecte>	 Project beta-scap-eqiad build #34683: FAILURE in 1 min 30 sec: https://integration.wikimedia.org/ci/job/beta-scap-eqiad/34683/
[07:25:48] <wmf-insecte>	 Yippee, build fixed!
[07:25:48] <shinken-wm>	 RECOVERY - Puppet failure on deployment-db2 is OK: OK: Less than 1.00% above the threshold [0.0]  
[07:25:49] <wmf-insecte>	 Project beta-scap-eqiad build #34684: FIXED in 1 min 44 sec: https://integration.wikimedia.org/ci/job/beta-scap-eqiad/34684/
[07:45:03] <wmf-insecte>	 Yippee, build fixed!
[07:45:04] <wmf-insecte>	 Project browsertests-Math-en.wikipedia.beta.wmflabs.org-linux-firefox-sauce build #299: FIXED in 2 min 15 sec: https://integration.wikimedia.org/ci/job/browsertests-Math-en.wikipedia.beta.wmflabs.org-linux-firefox-sauce/299/
[07:59:38] <wmf-insecte>	 Project browsertests-MultimediaViewer-en.wikipedia.beta.wmflabs.org-linux-chrome-sauce build #355: FAILURE in 32 min: https://integration.wikimedia.org/ci/job/browsertests-MultimediaViewer-en.wikipedia.beta.wmflabs.org-linux-chrome-sauce/355/
[08:00:52] <wmf-insecte>	 Yippee, build fixed!
[08:00:53] <wmf-insecte>	 Project browsertests-UniversalLanguageSelector-commons.wikimedia.beta.wmflabs.org-linux-firefox-sauce build #349: FIXED in 22 min: https://integration.wikimedia.org/ci/job/browsertests-UniversalLanguageSelector-commons.wikimedia.beta.wmflabs.org-linux-firefox-sauce/349/
[12:21:34] <wikibugs>	 3Continuous-Integration: jenkins on release branch has problem when patch set contains js files - https://phabricator.wikimedia.org/T67085#937745 (10Umherirrender) 5Open>3Resolved a:3Umherirrender REL1_22 is out of live
[12:31:39] <shinken-wm>	 PROBLEM - Puppet failure on deployment-mx is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [0.0]  
[12:35:13] <wmf-insecte>	 Project beta-scap-eqiad build #34715: FAILURE in 1 min 6 sec: https://integration.wikimedia.org/ci/job/beta-scap-eqiad/34715/
[12:45:12] <wmf-insecte>	 Project beta-scap-eqiad build #34716: STILL FAILING in 1 min 7 sec: https://integration.wikimedia.org/ci/job/beta-scap-eqiad/34716/
[12:55:36] <wmf-insecte>	 Yippee, build fixed!
[12:55:36] <wmf-insecte>	 Project beta-scap-eqiad build #34717: FIXED in 1 min 29 sec: https://integration.wikimedia.org/ci/job/beta-scap-eqiad/34717/
[13:40:37] <grrrit-wm>	 (03CR) 10Hashar: [C: 032] "Week-end deploy! Thanks for the patch :]" [integration/config] - 10https://gerrit.wikimedia.org/r/181217 (owner: 10Krinkle)
[13:41:29] <grrrit-wm>	 (03Merged) 10jenkins-bot: Don't run hhvm jobs on fundraising/REL1_23 branch in mediawiki-core [integration/config] - 10https://gerrit.wikimedia.org/r/181217 (owner: 10Krinkle)
[13:49:58] <wikibugs>	 3Continuous-Integration: Do not run HHVM tests on mediawiki-core < 1.24 branches - https://phabricator.wikimedia.org/T85036#937801 (10hashar) 5Open>3Resolved I have deployed the change and sent a dummy patch against the fundraising/REL1_23 https://gerrit.wikimedia.org/r/#/c/181251/ .  The hhvm job is no more...
[18:11:49] <shinken-wm>	 PROBLEM - Puppet failure on deployment-bastion is CRITICAL: CRITICAL: 20.00% of data above the critical threshold [0.0]  
[18:22:13] <shinken-wm>	 PROBLEM - Puppet failure on deployment-redis02 is CRITICAL: CRITICAL: 44.44% of data above the critical threshold [0.0]  
[18:41:49] <shinken-wm>	 RECOVERY - Puppet failure on deployment-bastion is OK: OK: Less than 1.00% above the threshold [0.0]  
[18:47:12] <shinken-wm>	 RECOVERY - Puppet failure on deployment-redis02 is OK: OK: Less than 1.00% above the threshold [0.0]  
[18:53:56] <wmf-insecte>	 Project browsertests-UploadWizard-commons.wikimedia.beta.wmflabs.org-linux-chrome-sauce build #367: FAILURE in 10 min: https://integration.wikimedia.org/ci/job/browsertests-UploadWizard-commons.wikimedia.beta.wmflabs.org-linux-chrome-sauce/367/
[18:54:57] <wmf-insecte>	 Project beta-scap-eqiad build #34753: FAILURE in 56 sec: https://integration.wikimedia.org/ci/job/beta-scap-eqiad/34753/
[19:05:04] <wmf-insecte>	 Project beta-scap-eqiad build #34754: STILL FAILING in 1 min 1 sec: https://integration.wikimedia.org/ci/job/beta-scap-eqiad/34754/
[19:15:26] <wmf-insecte>	 Yippee, build fixed!
[19:15:27] <wmf-insecte>	 Project beta-scap-eqiad build #34755: FIXED in 1 min 23 sec: https://integration.wikimedia.org/ci/job/beta-scap-eqiad/34755/
[19:23:44] <wmf-insecte>	 Project browsertests-Flow-en.wikipedia.beta.wmflabs.org-linux-firefox-sauce build #427: FAILURE in 1 hr 1 min: https://integration.wikimedia.org/ci/job/browsertests-Flow-en.wikipedia.beta.wmflabs.org-linux-firefox-sauce/427/
[20:13:09] <wmf-insecte>	 Yippee, build fixed!
[20:13:10] <wmf-insecte>	 Project browsertests-Flow-en.wikipedia.beta.wmflabs.org-linux-chrome-sauce build #394: FIXED in 54 min: https://integration.wikimedia.org/ci/job/browsertests-Flow-en.wikipedia.beta.wmflabs.org-linux-chrome-sauce/394/
[20:38:47] <wmf-insecte>	 Yippee, build fixed!
[20:38:48] <wmf-insecte>	 Project browsertests-VisualEditor-en.wikipedia.beta.wmflabs.org-linux-firefox-sauce build #480: FIXED in 1 hr 15 min: https://integration.wikimedia.org/ci/job/browsertests-VisualEditor-en.wikipedia.beta.wmflabs.org-linux-firefox-sauce/480/
[20:55:33] <wmf-insecte>	 Yippee, build fixed!
[20:55:33] <wmf-insecte>	 Project browsertests-MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-chrome-sauce build #401: FIXED in 1 hr 10 min: https://integration.wikimedia.org/ci/job/browsertests-MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-chrome-sauce/401/
[22:56:05] <wmf-insecte>	 Yippee, build fixed!
[22:56:06] <wmf-insecte>	 Project browsertests-MultimediaViewer-en.wikipedia.beta.wmflabs.org-linux-chrome-sauce build #356: FIXED in 33 min: https://integration.wikimedia.org/ci/job/browsertests-MultimediaViewer-en.wikipedia.beta.wmflabs.org-linux-chrome-sauce/356/