[00:17:18] Yippee, build fixed! [00:17:19] Project selenium-Flow » firefox,beta,Linux,contintLabsSlave && UbuntuTrusty build #167: 09FIXED in 1 min 17 sec: https://integration.wikimedia.org/ci/job/selenium-Flow/BROWSER=firefox,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=Linux,label=contintLabsSlave%20&&%20UbuntuTrusty/167/ [01:05:21] PROBLEM - Puppet run on deployment-eventlogging04 is CRITICAL: CRITICAL: 33.33% of data above the critical threshold [0.0] [01:36:10] 10Gerrit, 06Repository-Admins: Rename the Semantic Forms extension to "Page Forms" - https://phabricator.wikimedia.org/T147582#2701101 (10Peachey88) @Yaron_Koren: Phab project renamed, to #mediawiki-extensions-page_forms (We swap spaces with either - or _) and aliases setup for `mediawiki-extensions-SemanticFo... [01:36:51] 10Gerrit, 06Repository-Admins: Rename the Semantic Forms extension to "Page Forms" - https://phabricator.wikimedia.org/T147582#2701102 (10Peachey88) [01:45:19] RECOVERY - Puppet run on deployment-eventlogging04 is OK: OK: Less than 1.00% above the threshold [0.0] [01:54:18] 03Scap3: Consider using `pluginbase` for loading plugins - https://phabricator.wikimedia.org/T147699#2701106 (10mmodell) [03:43:42] Project mediawiki-core-code-coverage build #2310: 04STILL FAILING in 43 min: https://integration.wikimedia.org/ci/job/mediawiki-core-code-coverage/2310/ [04:02:06] RECOVERY - Long lived cherry-picks on puppetmaster on deployment-puppetmaster is OK: OK: Less than 100.00% above the threshold [0.0] [04:18:21] Project selenium-MultimediaViewer » firefox,beta,Linux,contintLabsSlave && UbuntuTrusty build #165: 04FAILURE in 22 min: https://integration.wikimedia.org/ci/job/selenium-MultimediaViewer/BROWSER=firefox,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=Linux,label=contintLabsSlave%20&&%20UbuntuTrusty/165/ [05:22:44] PROBLEM - Puppet run on deployment-mx is CRITICAL: CRITICAL: 20.00% of data above the critical threshold [0.0] [06:02:44] RECOVERY - Puppet run on deployment-mx is OK: OK: Less than 1.00% above the threshold [0.0] [08:55:06] PROBLEM - Puppet run on deployment-tin is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [0.0] [09:18:32] PROBLEM - Puppet run on deployment-mira is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [0.0] [11:04:56] PROBLEM - Puppet run on deployment-db03 is CRITICAL: CRITICAL: 50.00% of data above the critical threshold [0.0] [11:39:53] RECOVERY - Puppet run on deployment-db03 is OK: OK: Less than 1.00% above the threshold [0.0] [12:38:03] PROBLEM - Puppet run on deployment-elastic07 is CRITICAL: CRITICAL: 60.00% of data above the critical threshold [0.0] [12:56:58] PROBLEM - Puppet run on deployment-eventlogging03 is CRITICAL: CRITICAL: 60.00% of data above the critical threshold [0.0] [13:04:53] PROBLEM - Puppet run on deployment-redis01 is CRITICAL: CRITICAL: 30.00% of data above the critical threshold [0.0] [13:13:01] RECOVERY - Puppet run on deployment-elastic07 is OK: OK: Less than 1.00% above the threshold [0.0] [13:31:59] RECOVERY - Puppet run on deployment-eventlogging03 is OK: OK: Less than 1.00% above the threshold [0.0] [13:44:54] RECOVERY - Puppet run on deployment-redis01 is OK: OK: Less than 1.00% above the threshold [0.0] [13:46:28] Yippee, build fixed! [13:46:29] Project selenium-VisualEditor » firefox,beta,Linux,contintLabsSlave && UbuntuTrusty build #173: 09FIXED in 2 min 28 sec: https://integration.wikimedia.org/ci/job/selenium-VisualEditor/BROWSER=firefox,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=Linux,label=contintLabsSlave%20&&%20UbuntuTrusty/173/ [14:52:58] PROBLEM - Puppet run on deployment-eventlogging03 is CRITICAL: CRITICAL: 20.00% of data above the critical threshold [0.0] [15:07:23] (03PS1) 10Yurik: Kartographer depends on WikimediaMessages [integration/config] - 10https://gerrit.wikimedia.org/r/314825 [15:11:12] paladox, ^ [15:11:16] could you merge it plz? [15:12:21] no point just merging, needs deploying too [15:12:36] Reedy, yep, thats' what i meant :) [15:12:59] * yurik would've loved to do it himself, but alas, no clue where to even begin [15:13:26] Reedy, btw, lets work early next week on getting zero stuff deployed. has been long enough ;) [15:14:44] well, merged would definitely be nice :P [15:15:39] hehe, we could allocate an hour or two [15:15:49] depl window [15:15:57] or could do it during swat [15:16:25] if we merge, it'll ride the train [15:16:55] Reedy, i would prefer to do cherrypicking [15:17:02] better do it by hand [15:32:58] RECOVERY - Puppet run on deployment-eventlogging03 is OK: OK: Less than 1.00% above the threshold [0.0] [15:36:09] yurik: What is left outstanding? [15:36:25] Reedy, nothing to my knowledge [15:36:34] the urge to jfdi ;D [15:39:48] PROBLEM - Puppet run on deployment-phab02 is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [0.0] [15:41:01] heh [15:41:07] i'll double check it again :) [15:43:30] Reedy, https://github.com/wikimedia/operations-mediawiki-config/blob/master/wmf-config/mobile.php#L39 [15:43:44] it uses globals, but the extension is using the new config [15:43:50] will that peacefully coexist? [15:44:43] Project mediawiki-core-code-coverage build #2311: 04STILL FAILING in 44 min: https://integration.wikimedia.org/ci/job/mediawiki-core-code-coverage/2311/ [15:46:40] I don't see any obvious conflicts [15:46:45] Might be worth setting a merge strategy [15:46:50] Should be easily testable locally [15:51:03] PROBLEM - Puppet run on deployment-phab01 is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [0.0] [15:54:50] yurik: JsonConfig is already converted too [15:54:58] So I guess it's workin [15:56:00] :) [15:56:12] * yurik takes a looong vacation [16:00:15] Reedy, can you update zuul? https://gerrit.wikimedia.org/r/#/c/314825/ [16:00:23] or who has the power to fix it? [16:00:31] I think I have the rights, but I don't know how to do it [16:00:56] Reedy, git pull ;) [16:01:04] if only i knew which machine to do it on :) [16:03:13] gallium? [16:03:23] https://www.mediawiki.org/wiki/Continuous_integration/Zuul#Deploy_configuration [16:04:03] Reedy, i don't have +2 on zuul repo [16:04:48] instructions look scary [16:04:48] Neither do I [16:14:21] 10Beta-Cluster-Infrastructure, 05Goal, 07Tracking: Consolidate, remove, and/or downsize Beta Cluster instances to help with [[wikitech:Purge_2016]] - https://phabricator.wikimedia.org/T142288#2701707 (10AlexMonk-WMF) [16:15:39] 10Beta-Cluster-Infrastructure, 05Goal, 07Tracking: Consolidate, remove, and/or downsize Beta Cluster instances to help with [[wikitech:Purge_2016]] - https://phabricator.wikimedia.org/T142288#2530145 (10AlexMonk-WMF) [16:17:45] yurik: test failure again [16:27:36] 10Beta-Cluster-Infrastructure, 05Goal, 07Tracking: Consolidate, remove, and/or downsize Beta Cluster instances to help with [[wikitech:Purge_2016]] - https://phabricator.wikimedia.org/T142288#2701724 (10AlexMonk-WMF) We now have a quota allowing 39 more instances, 28 VCPUs, about 71GB RAM, a couple of floati... [16:29:19] PROBLEM - Puppet run on deployment-restbase02 is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [0.0] [16:43:30] PROBLEM - Puppet run on deployment-restbase01 is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [0.0] [19:01:13] 10Gerrit, 13Patch-For-Review, 07Upstream: Gerrit in Microsoft Edge doesn't display the git commands in the download box - https://phabricator.wikimedia.org/T145130#2701804 (10Paladox) 05Open>03Resolved a:03Paladox This was broken on insider releases when they first released new build in mid agust this... [21:37:44] PROBLEM - Puppet run on deployment-ms-fe01 is CRITICAL: CRITICAL: 60.00% of data above the critical threshold [0.0] [22:42:45] RECOVERY - Puppet run on deployment-ms-fe01 is OK: OK: Less than 1.00% above the threshold [0.0] [22:57:01] (03CR) 10Paladox: [C: 031] Kartographer depends on WikimediaMessages [integration/config] - 10https://gerrit.wikimedia.org/r/314825 (owner: 10Yurik) [22:57:35] paladox, can you merge it? [23:07:34] yurik: Probably not. And he can't deploy it either [23:09:24] i looked at the integration/config - lots of reviews by him [23:11:29] Doesn't mean he has any rights [23:12:31] PROBLEM - Puppet run on deployment-cache-text04 is CRITICAL: CRITICAL: 20.00% of data above the critical threshold [0.0] [23:52:28] RECOVERY - Puppet run on deployment-cache-text04 is OK: OK: Less than 1.00% above the threshold [0.0]