[00:08:43] Project beta-scap-eqiad build #210530: 15ABORTED in 3 min 27 sec: https://integration.wikimedia.org/ci/job/beta-scap-eqiad/210530/ [00:22:17] PROBLEM - Free space - all mounts on deployment-tin is CRITICAL: CRITICAL: deployment-prep.deployment-tin.diskspace._mnt.byte_percentfree (No valid datapoints found)deployment-prep.deployment-tin.diskspace.root.byte_percentfree (<11.11%) [00:37:17] RECOVERY - Free space - all mounts on deployment-tin is OK: OK: deployment-prep.deployment-tin.diskspace._mnt.byte_percentfree (No valid datapoints found) [00:43:18] PROBLEM - Free space - all mounts on deployment-tin is CRITICAL: CRITICAL: deployment-prep.deployment-tin.diskspace._mnt.byte_percentfree (No valid datapoints found)deployment-prep.deployment-tin.diskspace.root.byte_percentfree (<22.22%) [01:42:50] PROBLEM - SSH on integration-slave-docker-1015 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [01:47:40] RECOVERY - SSH on integration-slave-docker-1015 is OK: SSH OK - OpenSSH_6.7p1 Debian-5+deb8u4 (protocol 2.0) [02:09:58] PROBLEM - Puppet errors on deployment-elastic05 is CRITICAL: CRITICAL: 30.00% of data above the critical threshold [0.0] [02:28:16] RECOVERY - Free space - all mounts on deployment-tin is OK: OK: deployment-prep.deployment-tin.diskspace._mnt.byte_percentfree (No valid datapoints found) [02:34:14] PROBLEM - Free space - all mounts on deployment-tin is CRITICAL: CRITICAL: deployment-prep.deployment-tin.diskspace._mnt.byte_percentfree (No valid datapoints found)deployment-prep.deployment-tin.diskspace.root.byte_percentfree (<55.56%) [02:49:58] RECOVERY - Puppet errors on deployment-elastic05 is OK: OK: Less than 1.00% above the threshold [0.0] [05:49:35] PROBLEM - Free space - all mounts on deployment-fluorine02 is CRITICAL: CRITICAL: deployment-prep.deployment-fluorine02.diskspace._srv.byte_percentfree (<10.00%) [06:49:17] RECOVERY - Free space - all mounts on deployment-tin is OK: OK: deployment-prep.deployment-tin.diskspace._mnt.byte_percentfree (No valid datapoints found) [06:54:32] RECOVERY - Free space - all mounts on deployment-fluorine02 is OK: OK: All targets OK [06:55:16] PROBLEM - Free space - all mounts on deployment-tin is CRITICAL: CRITICAL: deployment-prep.deployment-tin.diskspace._mnt.byte_percentfree (No valid datapoints found)deployment-prep.deployment-tin.diskspace.root.byte_percentfree (<22.22%) [07:21:22] (03PS1) 10Hashar: Migrate 4 extensions to Quibble [integration/config] - 10https://gerrit.wikimedia.org/r/437396 (https://phabricator.wikimedia.org/T183512) [07:23:57] (03CR) 10Hashar: [C: 032] Migrate 4 extensions to Quibble [integration/config] - 10https://gerrit.wikimedia.org/r/437396 (https://phabricator.wikimedia.org/T183512) (owner: 10Hashar) [07:25:14] (03Merged) 10jenkins-bot: Migrate 4 extensions to Quibble [integration/config] - 10https://gerrit.wikimedia.org/r/437396 (https://phabricator.wikimedia.org/T183512) (owner: 10Hashar) [07:25:22] 10Continuous-Integration-Infrastructure (shipyard), 10Release-Engineering-Team (Kanban), 10releng-201718-q3, 10Epic, 10Patch-For-Review: [EPIC] Migrate Mediawiki jobs from Nodepool to Docker - https://phabricator.wikimedia.org/T183512#4255917 (10hashar) [07:39:59] (03PS1) 10Hashar: Archive mediawiki/skins/CustomPage [integration/config] - 10https://gerrit.wikimedia.org/r/437398 (https://phabricator.wikimedia.org/T196429) [07:40:35] (03CR) 10Hashar: [C: 032] Archive mediawiki/skins/CustomPage [integration/config] - 10https://gerrit.wikimedia.org/r/437398 (https://phabricator.wikimedia.org/T196429) (owner: 10Hashar) [07:41:33] 10Continuous-Integration-Infrastructure (shipyard), 10Release-Engineering-Team (Kanban), 10releng-201718-q3, 10Epic, 10Patch-For-Review: [EPIC] Migrate Mediawiki jobs from Nodepool to Docker - https://phabricator.wikimedia.org/T183512#4255956 (10hashar) [07:41:55] (03Merged) 10jenkins-bot: Archive mediawiki/skins/CustomPage [integration/config] - 10https://gerrit.wikimedia.org/r/437398 (https://phabricator.wikimedia.org/T196429) (owner: 10Hashar) [07:52:40] (03PS1) 10Hashar: Archive mediawiki/extensions/DidYouMean [integration/config] - 10https://gerrit.wikimedia.org/r/437399 (https://phabricator.wikimedia.org/T196430) [07:54:22] (03CR) 10Hashar: [C: 032] Archive mediawiki/extensions/DidYouMean [integration/config] - 10https://gerrit.wikimedia.org/r/437399 (https://phabricator.wikimedia.org/T196430) (owner: 10Hashar) [07:54:57] 10Continuous-Integration-Infrastructure (shipyard), 10Release-Engineering-Team (Kanban), 10releng-201718-q3, 10Epic, 10Patch-For-Review: [EPIC] Migrate Mediawiki jobs from Nodepool to Docker - https://phabricator.wikimedia.org/T183512#4256034 (10hashar) [07:55:40] (03Merged) 10jenkins-bot: Archive mediawiki/extensions/DidYouMean [integration/config] - 10https://gerrit.wikimedia.org/r/437399 (https://phabricator.wikimedia.org/T196430) (owner: 10Hashar) [08:19:03] (03PS1) 10Hashar: Migrate EditNotify to Quibble [integration/config] - 10https://gerrit.wikimedia.org/r/437408 (https://phabricator.wikimedia.org/T183512) [08:19:16] (03CR) 10Hashar: [C: 032] Migrate EditNotify to Quibble [integration/config] - 10https://gerrit.wikimedia.org/r/437408 (https://phabricator.wikimedia.org/T183512) (owner: 10Hashar) [08:20:34] (03Merged) 10jenkins-bot: Migrate EditNotify to Quibble [integration/config] - 10https://gerrit.wikimedia.org/r/437408 (https://phabricator.wikimedia.org/T183512) (owner: 10Hashar) [08:22:07] 10Continuous-Integration-Infrastructure (shipyard), 10Release-Engineering-Team (Kanban), 10releng-201718-q3, 10Epic, 10Patch-For-Review: [EPIC] Migrate Mediawiki jobs from Nodepool to Docker - https://phabricator.wikimedia.org/T183512#4256090 (10hashar) [08:31:36] (03PS1) 10Hashar: Archive EditOwn [integration/config] - 10https://gerrit.wikimedia.org/r/437411 (https://phabricator.wikimedia.org/T196433) [08:32:12] 10Continuous-Integration-Infrastructure (shipyard), 10Release-Engineering-Team (Kanban), 10releng-201718-q3, 10Epic, 10Patch-For-Review: [EPIC] Migrate Mediawiki jobs from Nodepool to Docker - https://phabricator.wikimedia.org/T183512#4256140 (10hashar) [08:32:22] (03CR) 10Hashar: [C: 032] Archive EditOwn [integration/config] - 10https://gerrit.wikimedia.org/r/437411 (https://phabricator.wikimedia.org/T196433) (owner: 10Hashar) [08:33:45] (03Merged) 10jenkins-bot: Archive EditOwn [integration/config] - 10https://gerrit.wikimedia.org/r/437411 (https://phabricator.wikimedia.org/T196433) (owner: 10Hashar) [08:41:15] 10Continuous-Integration-Infrastructure (shipyard), 10Release-Engineering-Team (Kanban), 10releng-201718-q3, 10Epic, 10Patch-For-Review: [EPIC] Migrate Mediawiki jobs from Nodepool to Docker - https://phabricator.wikimedia.org/T183512#4256152 (10hashar) [08:48:38] 10Release-Engineering-Team (Kanban), 10MediaWiki-extensions-Other: EditSubpages extension fails mediawiki/core webdriver.io tests - https://phabricator.wikimedia.org/T196436#4256182 (10hashar) [08:49:00] 10Continuous-Integration-Infrastructure (shipyard), 10Release-Engineering-Team (Kanban), 10releng-201718-q3, 10Epic, 10Patch-For-Review: [EPIC] Migrate Mediawiki jobs from Nodepool to Docker - https://phabricator.wikimedia.org/T183512#4256192 (10hashar) [08:54:52] 10Phabricator, 10LDAP: Fix @Jarry1250's Phab account who cannot log in due to T138672 (two LDAP records) - https://phabricator.wikimedia.org/T138653#4256210 (10Aklapper) T138672 about the general problem in the code base has T138672#4255611 which implies (I think?) that we could try to delete one account in Ph... [09:07:23] PROBLEM - Puppet errors on deployment-cpjobqueue is CRITICAL: CRITICAL: 50.00% of data above the critical threshold [0.0] [09:19:10] (03PS1) 10Hashar: Archive InterwikiIntegration [integration/config] - 10https://gerrit.wikimedia.org/r/437421 (https://phabricator.wikimedia.org/T196442) [09:19:26] (03CR) 10Hashar: [C: 032] Archive InterwikiIntegration [integration/config] - 10https://gerrit.wikimedia.org/r/437421 (https://phabricator.wikimedia.org/T196442) (owner: 10Hashar) [09:20:16] 10Continuous-Integration-Infrastructure (shipyard), 10Release-Engineering-Team (Kanban), 10releng-201718-q3, 10Epic, 10Patch-For-Review: [EPIC] Migrate Mediawiki jobs from Nodepool to Docker - https://phabricator.wikimedia.org/T183512#4256366 (10hashar) [09:20:58] (03Merged) 10jenkins-bot: Archive InterwikiIntegration [integration/config] - 10https://gerrit.wikimedia.org/r/437421 (https://phabricator.wikimedia.org/T196442) (owner: 10Hashar) [09:22:29] 10Release-Engineering-Team (Kanban), 10MediaWiki-extensions-Other: EditSubpages extension fails mediawiki/core webdriver.io tests - https://phabricator.wikimedia.org/T196436#4256385 (10hashar) [09:22:40] 10Continuous-Integration-Infrastructure (shipyard), 10Release-Engineering-Team (Kanban), 10releng-201718-q3, 10Epic, 10Patch-For-Review: [EPIC] Migrate Mediawiki jobs from Nodepool to Docker - https://phabricator.wikimedia.org/T183512#4236179 (10hashar) [09:29:06] 10Continuous-Integration-Infrastructure (shipyard), 10Release-Engineering-Team (Kanban), 10releng-201718-q3, 10Epic, 10Patch-For-Review: [EPIC] Migrate Mediawiki jobs from Nodepool to Docker - https://phabricator.wikimedia.org/T183512#4256419 (10hashar) [09:29:27] 10Continuous-Integration-Infrastructure (shipyard), 10Release-Engineering-Team (Kanban), 10releng-201718-q3, 10Epic, 10Patch-For-Review: [EPIC] Migrate Mediawiki jobs from Nodepool to Docker - https://phabricator.wikimedia.org/T183512#4236301 (10hashar) [09:47:03] 10Continuous-Integration-Infrastructure (shipyard), 10Release-Engineering-Team (Kanban), 10releng-201718-q3, 10Epic, 10Patch-For-Review: [EPIC] Migrate Mediawiki jobs from Nodepool to Docker - https://phabricator.wikimedia.org/T183512#4256457 (10DonaldTrump3000) [09:52:09] (03PS1) 10Hashar: Migrate LanguageSelector to Quibble [integration/config] - 10https://gerrit.wikimedia.org/r/437429 (https://phabricator.wikimedia.org/T183512) [09:52:20] (03CR) 10Hashar: [C: 032] Migrate LanguageSelector to Quibble [integration/config] - 10https://gerrit.wikimedia.org/r/437429 (https://phabricator.wikimedia.org/T183512) (owner: 10Hashar) [09:52:41] 10Continuous-Integration-Infrastructure (shipyard), 10Release-Engineering-Team (Kanban), 10releng-201718-q3, 10Epic, 10Patch-For-Review: [EPIC] Migrate Mediawiki jobs from Nodepool to Docker - https://phabricator.wikimedia.org/T183512#4256466 (10hashar) [09:53:45] (03Merged) 10jenkins-bot: Migrate LanguageSelector to Quibble [integration/config] - 10https://gerrit.wikimedia.org/r/437429 (https://phabricator.wikimedia.org/T183512) (owner: 10Hashar) [09:56:31] 10Continuous-Integration-Infrastructure (shipyard), 10Release-Engineering-Team (Kanban), 10releng-201718-q3, 10Epic, 10Patch-For-Review: [EPIC] Migrate Mediawiki jobs from Nodepool to Docker - https://phabricator.wikimedia.org/T183512#4256476 (10Aklapper) [10:12:38] 10Release-Engineering-Team (Kanban), 10Release Pipeline: Build Math extension container on Postmerge - https://phabricator.wikimedia.org/T196414#4255383 (10zeljkofilipin) In case you need an automated way to test if Math extension is installed, [[ https://phabricator.wikimedia.org/diffusion/EMAT/browse/master/... [10:20:16] RECOVERY - Free space - all mounts on deployment-tin is OK: OK: deployment-prep.deployment-tin.diskspace._mnt.byte_percentfree (No valid datapoints found) [10:20:20] 10Release-Engineering-Team (Kanban), 10MediaWiki-extensions-Other: EditSubpages extension fails mediawiki/core webdriver.io tests - https://phabricator.wikimedia.org/T196436#4256532 (10zeljkofilipin) > Assuming the extensions tests are run first and that we have admin rights on the wiki, we should be able to w... [10:26:16] PROBLEM - Free space - all mounts on deployment-tin is CRITICAL: CRITICAL: deployment-prep.deployment-tin.diskspace._mnt.byte_percentfree (No valid datapoints found)deployment-prep.deployment-tin.diskspace.root.byte_percentfree (<22.22%) [10:40:28] 10Phabricator, 10Community-Liaisons, 10Developer-Relations, 10Developer-Wishlist (2017), 10Goal: Consolidate the many tech events calendars in Phabricator's calendar - https://phabricator.wikimedia.org/T1035#4256558 (10Tgr) Meanwhile, Meta seems to be moving to a wiki-based calendar: https://meta.wikimed... [11:03:51] (03PS1) 10Hashar: Migrate LastModified to Quibble [integration/config] - 10https://gerrit.wikimedia.org/r/437442 (https://phabricator.wikimedia.org/T183512) [11:04:17] 10Continuous-Integration-Infrastructure (shipyard), 10Release-Engineering-Team (Kanban), 10releng-201718-q3, 10Epic, 10Patch-For-Review: [EPIC] Migrate Mediawiki jobs from Nodepool to Docker - https://phabricator.wikimedia.org/T183512#4256613 (10hashar) [11:04:26] (03CR) 10Hashar: [C: 032] Migrate LastModified to Quibble [integration/config] - 10https://gerrit.wikimedia.org/r/437442 (https://phabricator.wikimedia.org/T183512) (owner: 10Hashar) [11:05:46] (03Merged) 10jenkins-bot: Migrate LastModified to Quibble [integration/config] - 10https://gerrit.wikimedia.org/r/437442 (https://phabricator.wikimedia.org/T183512) (owner: 10Hashar) [11:42:04] (03PS1) 10Tpt: Adds Candalua to the Zuul email whiltelist [integration/config] - 10https://gerrit.wikimedia.org/r/437449 [11:45:20] 10Continuous-Integration-Config: Add Candalua to the CI user whitelist - https://phabricator.wikimedia.org/T196451#4256732 (10Tpt) [11:45:48] (03PS2) 10Tpt: Adds Candalua to the Zuul email whiltelist [integration/config] - 10https://gerrit.wikimedia.org/r/437449 (https://phabricator.wikimedia.org/T196451) [11:57:31] (03CR) 10Candalua: [C: 031] Adds Candalua to the Zuul email whiltelist [integration/config] - 10https://gerrit.wikimedia.org/r/437449 (https://phabricator.wikimedia.org/T196451) (owner: 10Tpt) [11:57:52] (03PS1) 10Hashar: Migrate LiveTranslate to Quibble [integration/config] - 10https://gerrit.wikimedia.org/r/437454 (https://phabricator.wikimedia.org/T183512) [11:58:14] (03CR) 10Hashar: [C: 032] Migrate LiveTranslate to Quibble [integration/config] - 10https://gerrit.wikimedia.org/r/437454 (https://phabricator.wikimedia.org/T183512) (owner: 10Hashar) [11:59:33] (03Merged) 10jenkins-bot: Migrate LiveTranslate to Quibble [integration/config] - 10https://gerrit.wikimedia.org/r/437454 (https://phabricator.wikimedia.org/T183512) (owner: 10Hashar) [12:00:19] 10Continuous-Integration-Infrastructure (shipyard), 10Release-Engineering-Team (Kanban), 10releng-201718-q3, 10Epic, 10Patch-For-Review: [EPIC] Migrate Mediawiki jobs from Nodepool to Docker - https://phabricator.wikimedia.org/T183512#4256765 (10hashar) [12:07:26] !log Update cxserver to 7fb7671 [12:07:28] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [12:08:00] hashar: Can you look at, https://phabricator.wikimedia.org/T196037 [12:08:37] Thanks :) [12:32:25] PROBLEM - Puppet errors on deployment-zotero01 is CRITICAL: CRITICAL: 60.00% of data above the critical threshold [0.0] [12:32:35] 10Continuous-Integration-Infrastructure: Is there a way to specify different different inter-extension-dependencies for REL-Branches? - https://phabricator.wikimedia.org/T196454#4257048 (10Osnard) [12:46:35] no_justification, thcipriani, can you help me please? [13:18:45] PROBLEM - Puppet errors on deployment-maps03 is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [0.0] [13:46:15] RECOVERY - Free space - all mounts on deployment-tin is OK: OK: deployment-prep.deployment-tin.diskspace._mnt.byte_percentfree (No valid datapoints found) [13:52:16] PROBLEM - Free space - all mounts on deployment-tin is CRITICAL: CRITICAL: deployment-prep.deployment-tin.diskspace._mnt.byte_percentfree (No valid datapoints found)deployment-prep.deployment-tin.diskspace.root.byte_percentfree (<22.22%) [13:54:48] 10Continuous-Integration-Config: Ensure extension master branch still works with the indicated MediaWiki version - https://phabricator.wikimedia.org/T196467#4257580 (10hashar) [14:24:33] PROBLEM - Puppet errors on deployment-sca04 is CRITICAL: CRITICAL: 40.00% of data above the critical threshold [0.0] [14:27:39] 10Release-Engineering-Team, 10DNS, 10Operations, 10Traffic, and 2 others: Move Foundation Wiki to new URL when new Wikimedia Foundation website launches - https://phabricator.wikimedia.org/T188776#4019041 (10Liuxinyu970226) Personally, KATM...'s comment give me another probably challenge: Instead of still... [15:04:32] RECOVERY - Puppet errors on deployment-sca04 is OK: OK: Less than 1.00% above the threshold [0.0] [15:12:13] 10Release-Engineering-Team (Kanban), 10VisualEditor, 10User-zeljkofilipin: language-screenshots-VisualEditor fails with `stderr: warning: failed to remove cache` - https://phabricator.wikimedia.org/T196374#4257837 (10zeljkofilipin) a:05zeljkofilipin>03None [15:29:38] 10Release-Engineering-Team (Kanban), 10Wikidata, 10Wikidata-Ministry-Of-Magic-Tech-Debt, 10Wikidata-Turtles-Tech-Debt, and 4 others: Run Wikibase daily browser tests on Jenkins - https://phabricator.wikimedia.org/T167432#4257865 (10zeljkofilipin) [[ https://integration.wikimedia.org/ci/job/selenium-Wikibas... [15:35:53] (03PS1) 10Zfilipin: WIP Increase timeout of daily Selenium jobs [integration/config] - 10https://gerrit.wikimedia.org/r/437486 (https://phabricator.wikimedia.org/T167432) [15:38:51] PROBLEM - SSH on integration-slave-docker-1015 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:41:26] 10Release-Engineering-Team (Kanban), 10Wikidata, 10Wikidata-Ministry-Of-Magic-Tech-Debt, 10Wikidata-Turtles-Tech-Debt, and 4 others: Run Wikibase daily browser tests on Jenkins - https://phabricator.wikimedia.org/T167432#4257923 (10zeljkofilipin) selenium-Wikibase-chrome is [[ https://integration.wikimedia... [15:44:50] 10Release-Engineering-Team (Kanban), 10Wikidata, 10Wikidata-Ministry-Of-Magic-Tech-Debt, 10Wikidata-Turtles-Tech-Debt, and 4 others: Run Wikibase daily browser tests on Jenkins - https://phabricator.wikimedia.org/T167432#4257928 (10zeljkofilipin) [15:52:15] PROBLEM - Free space - all mounts on deployment-tin is CRITICAL: CRITICAL: deployment-prep.deployment-tin.diskspace._mnt.byte_percentfree (No valid datapoints found)deployment-prep.deployment-tin.diskspace.root.byte_percentfree (<22.22%) WARN: deployment-prep.deployment-tin.diskspace._srv.byte_percentfree (<77.78%) [15:53:29] 10Release-Engineering-Team (Kanban), 10Wikidata, 10Wikidata-Ministry-Of-Magic-Tech-Debt, 10Wikidata-Turtles-Tech-Debt, and 4 others: Run Wikibase daily browser tests on Jenkins - https://phabricator.wikimedia.org/T167432#4258001 (10zeljkofilipin) [15:53:34] 10Release-Engineering-Team (Kanban), 10Wikidata, 10Wikidata-Ministry-Of-Magic-Tech-Debt, 10Wikidata-Turtles-Tech-Debt, and 4 others: Run Wikibase daily browser tests on Jenkins - https://phabricator.wikimedia.org/T167432#3687032 (10zeljkofilipin) [15:54:13] 10Release-Engineering-Team (Kanban), 10Wikidata, 10Wikidata-Ministry-Of-Magic-Tech-Debt, 10Wikidata-Turtles-Tech-Debt, and 4 others: Run Wikibase daily browser tests on Jenkins - https://phabricator.wikimedia.org/T167432#3687033 (10zeljkofilipin) [15:57:15] 10Release-Engineering-Team (Kanban), 10Patch-For-Review, 10Release, 10Train Deployments: 1.32.0-wmf.6 deployment blockers - https://phabricator.wikimedia.org/T191052#4258011 (10thcipriani) 05Open>03Resolved [15:57:45] (03PS1) 10Hashar: Migrate MsCatSelect to Quibble [integration/config] - 10https://gerrit.wikimedia.org/r/437499 (https://phabricator.wikimedia.org/T183512) [15:58:40] RECOVERY - SSH on integration-slave-docker-1015 is OK: SSH OK - OpenSSH_6.7p1 Debian-5+deb8u4 (protocol 2.0) [15:59:29] (03CR) 10Hashar: [C: 032] Migrate MsCatSelect to Quibble [integration/config] - 10https://gerrit.wikimedia.org/r/437499 (https://phabricator.wikimedia.org/T183512) (owner: 10Hashar) [16:00:52] (03Merged) 10jenkins-bot: Migrate MsCatSelect to Quibble [integration/config] - 10https://gerrit.wikimedia.org/r/437499 (https://phabricator.wikimedia.org/T183512) (owner: 10Hashar) [16:08:11] Project mwext-phpunit-coverage-publish build #5187: 04FAILURE in 3.5 sec: https://integration.wikimedia.org/ci/job/mwext-phpunit-coverage-publish/5187/ [16:09:37] PROBLEM - Long lived cherry-picks on puppetmaster on deployment-puppetmaster03 is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [0.0] [16:09:38] Yippee, build fixed! [16:09:38] Project mwext-phpunit-coverage-publish build #5188: 09FIXED in 1 min 4 sec: https://integration.wikimedia.org/ci/job/mwext-phpunit-coverage-publish/5188/ [16:37:24] RECOVERY - Puppet errors on deployment-zotero01 is OK: OK: Less than 1.00% above the threshold [0.0] [16:47:29] 10Continuous-Integration-Infrastructure (shipyard), 10Release-Engineering-Team (Kanban), 10releng-201718-q3, 10Epic, 10Patch-For-Review: [EPIC] Migrate Mediawiki jobs from Nodepool to Docker - https://phabricator.wikimedia.org/T183512#4258154 (10hashar) [16:48:06] (03PS1) 10Hashar: Migrate NSFileRepo to Quibble [integration/config] - 10https://gerrit.wikimedia.org/r/437507 [16:53:31] (03CR) 10Hashar: [C: 04-2] "Still broken" [integration/config] - 10https://gerrit.wikimedia.org/r/437507 (owner: 10Hashar) [16:58:03] PROBLEM - Puppet errors on deployment-conf03 is CRITICAL: CRITICAL: 22.22% of data above the critical threshold [0.0] [17:01:38] PROBLEM - Puppet errors on integration-publishing is CRITICAL: CRITICAL: 30.00% of data above the critical threshold [0.0] [17:05:55] PROBLEM - Puppet errors on deployment-sca02 is CRITICAL: CRITICAL: 30.00% of data above the critical threshold [0.0] [17:06:40] PROBLEM - Puppet errors on deployment-changeprop is CRITICAL: CRITICAL: 20.00% of data above the critical threshold [0.0] [17:09:25] PROBLEM - Puppet errors on deployment-aqs01 is CRITICAL: CRITICAL: 40.00% of data above the critical threshold [0.0] [17:10:57] PROBLEM - Puppet errors on deployment-elastic05 is CRITICAL: CRITICAL: 40.00% of data above the critical threshold [0.0] [17:17:58] PROBLEM - Puppet errors on deployment-tin is CRITICAL: CRITICAL: 30.00% of data above the critical threshold [0.0] [17:20:03] PROBLEM - Puppet errors on deployment-sentry01 is CRITICAL: CRITICAL: 50.00% of data above the critical threshold [0.0] [17:20:11] PROBLEM - Puppet errors on deployment-mathoid is CRITICAL: CRITICAL: 44.44% of data above the critical threshold [0.0] [17:20:16] who broke it [17:21:06] 10Continuous-Integration-Infrastructure (shipyard), 10Release-Engineering-Team (Kanban), 10releng-201718-q3, 10Epic, 10Patch-For-Review: [EPIC] Migrate Mediawiki jobs from Nodepool to Docker - https://phabricator.wikimedia.org/T183512#4258286 (10hashar) [17:22:36] PROBLEM - Puppet errors on deployment-restbase02 is CRITICAL: CRITICAL: 30.00% of data above the critical threshold [0.0] [17:24:23] PROBLEM - Puppet errors on deployment-ircd is CRITICAL: CRITICAL: 44.44% of data above the critical threshold [0.0] [17:25:32] 10Release-Engineering-Team (Kanban), 10Scap, 10Patch-For-Review, 10Scoring-platform-team (Current): Support git-lfs in scap - https://phabricator.wikimedia.org/T180627#4258301 (10Halfak) Thanks for your tests, @awight, and for bumping the prioritization. FWIW, we have had this model deployed in our Cloud... [17:27:24] PROBLEM - Puppet errors on deployment-pdfrender02 is CRITICAL: CRITICAL: 20.00% of data above the critical threshold [0.0] [17:29:16] PROBLEM - Puppet errors on deployment-restbase01 is CRITICAL: CRITICAL: 55.56% of data above the critical threshold [0.0] [17:29:31] PROBLEM - Puppet errors on deployment-cache-upload04 is CRITICAL: CRITICAL: 20.00% of data above the critical threshold [0.0] [17:30:32] PROBLEM - Puppet errors on deployment-poolcounter04 is CRITICAL: CRITICAL: 40.00% of data above the critical threshold [0.0] [17:30:33] PROBLEM - Puppet errors on deployment-mcs01 is CRITICAL: CRITICAL: 50.00% of data above the critical threshold [0.0] [17:30:47] PROBLEM - puppet on jenkins-slave-01.git.eqiad.wmflabs is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): File[/var/lib/prometheus/node.d] [17:30:50] Krenair ^^ [17:30:58] prometheus related [17:31:12] PROBLEM - Puppet errors on deployment-prometheus01 is CRITICAL: CRITICAL: 33.33% of data above the critical threshold [0.0] [17:31:54] PROBLEM - Puppet errors on deployment-fluorine02 is CRITICAL: CRITICAL: 60.00% of data above the critical threshold [0.0] [17:32:44] anyone seen this yet: Fatal error: Parameter $args is variadic and has a type constraint (array); variadic params with type constraints are not supported in non-Hack files in /home/jenkins/workspace/mediawiki-extensions-hhvm-jessie/src/vendor/phpunit/phpunit-mock-objects/src/Framework/MockObject/Generator.php [17:32:46] PROBLEM - Puppet errors on deployment-memc04 is CRITICAL: CRITICAL: 60.00% of data above the critical threshold [0.0] [17:34:20] PROBLEM - Puppet errors on deployment-parsoid09 is CRITICAL: CRITICAL: 40.00% of data above the critical threshold [0.0] [17:35:23] PROBLEM - Puppet errors on deployment-logstash2 is CRITICAL: CRITICAL: 66.67% of data above the critical threshold [0.0] [17:37:50] ebernhardson: dont use variadic because of hhvm ? :] [17:37:58] hashar: but thats inside the vendor repo of phpunit [17:38:21] PROBLEM - Puppet errors on deployment-cache-text04 is CRITICAL: CRITICAL: 60.00% of data above the critical threshold [0.0] [17:39:07] Tell upstream? ;) [17:39:33] Reedy: why would they care? they require php 7 :P [17:39:53] phpunit also don't care about security [17:39:59] make of that what you will... [17:40:29] Just remove the type constraint? ;) [17:40:36] Reedy: inside jenkins vendor repository? [17:40:59] hackhackhack [17:41:29] so, the alternate is that we can't be the only repository that uses mock objects. How is core passing it's test suite? [17:41:40] That's not committed vendor though, iirc [17:42:13] Have we merged any variadac stuff into core yet? [17:42:16] I know there were a few patches around [17:42:36] Reedy: the thing is i'm not using variadics [17:42:44] Only just https://gerrit.wikimedia.org/r/#/c/427817/ [17:42:45] Reedy: all i'm doing is running the test suite that already exists [17:42:57] 10Continuous-Integration-Infrastructure (shipyard), 10Release-Engineering-Team (Kanban), 10releng-201718-q3, 10Epic, 10Patch-For-Review: [EPIC] Migrate Mediawiki jobs from Nodepool to Docker - https://phabricator.wikimedia.org/T183512#4258425 (10hashar) [17:42:58] but it's sourcing vendor repositories that do use variadics somehow [17:43:45] I'm guessing it's using phpunit 6.5 rather than 4.8 [17:44:04] PROBLEM - Puppet errors on deployment-sca01 is CRITICAL: CRITICAL: 66.67% of data above the critical threshold [0.0] [17:44:42] (03PS1) 10Hashar: zuul: update Foxtrott email [integration/config] - 10https://gerrit.wikimedia.org/r/437518 [17:45:13] (03CR) 10Hashar: [C: 032] "This way when you send a patch or CR+2, tests will run and the change will be merged by CI." [integration/config] - 10https://gerrit.wikimedia.org/r/437518 (owner: 10Hashar) [17:45:20] PROBLEM - Puppet errors on deployment-imagescaler01 is CRITICAL: CRITICAL: 40.00% of data above the critical threshold [0.0] [17:46:30] (03Merged) 10jenkins-bot: zuul: update Foxtrott email [integration/config] - 10https://gerrit.wikimedia.org/r/437518 (owner: 10Hashar) [17:46:46] ebernhardson: AFAIK, it should be using older phpunit, because 6.5 has "php": "^7.0", which isn't matched by hhvm in non php7 mode [17:47:36] And phpunit 4 shouldn't have variadac because it's not in php 5.5 [17:47:45] hmm [17:48:38] I wonder if something has just got out of whack [17:50:06] ebernhardson: https://github.com/doctrine/dbal/issues/2567#issuecomment-264926023 [17:50:07] lol [17:50:44] 10Continuous-Integration-Infrastructure (shipyard), 10Release-Engineering-Team (Kanban), 10releng-201718-q3, 10Epic, 10Patch-For-Review: [EPIC] Migrate Mediawiki jobs from Nodepool to Docker - https://phabricator.wikimedia.org/T183512#4258479 (10hashar) [17:51:06] 10Continuous-Integration-Infrastructure (shipyard), 10Release-Engineering-Team (Kanban), 10releng-201718-q3, 10Epic, 10Patch-For-Review: [EPIC] Migrate Mediawiki jobs from Nodepool to Docker - https://phabricator.wikimedia.org/T183512#4238236 (10hashar) [17:53:04] 17:22:07 PHPUnit 4.8.36 by Sebastian Bergmann and contributors. [17:53:33] phpunit/phpunit-mock-objects:2.3.8 [17:54:51] PROBLEM - Puppet errors on integration-puppetmaster01 is CRITICAL: CRITICAL: 30.00% of data above the critical threshold [0.0] [17:54:52] ebernhardson: Isn't that the generator throwing the error? Not the one causing it? [17:55:13] ie when it's trying to create a mock of.. something [17:55:19] hmm, maybe [17:56:00] line 290 is an eval [17:56:00] https://github.com/sebastianbergmann/phpunit-mock-objects/blob/2.3/src/Framework/MockObject/Generator.php#L290 [17:56:20] So, I guess the real problem here.. Is working out what/where is actually broken [17:56:25] (what test of what repo) [17:56:44] Though, at the bottom... [17:56:45] Fatal error: Class undefined: Mock_SearchConfig_58ed87b2 [17:56:58] hmm, so we do have variadics somewhere. I'll poke around [17:57:36] public function getElement( $configName, ...$path ) { [17:57:41] I don't see any types though [17:58:04] i guess phpunit must be deciding to add an array annotation there for some reason :S [17:58:26] PROBLEM - Puppet errors on deployment-zotero01 is CRITICAL: CRITICAL: 40.00% of data above the critical threshold [0.0] [17:58:56] Maybe [17:59:01] Generation being too smart? [18:00:05] I wonder if core is passing... Because although we've added variadac, we're not trying to mock any of the classes with functions that use it [18:00:16] So it's mostly "luck" it works in core [18:00:47] 10MediaWiki-Codesniffer: SingleSpaceBeforeSingleLineComment fixer should move (instead of strip) indentation of commented-out code - https://phabricator.wikimedia.org/T171418#4258560 (10Krinkle) [18:01:07] PROBLEM - Puppet errors on integration-slave-jessie-1002 is CRITICAL: CRITICAL: 44.44% of data above the critical threshold [0.0] [18:02:03] PROBLEM - Puppet errors on deployment-db03 is CRITICAL: CRITICAL: 20.00% of data above the critical threshold [0.0] [18:02:56] 10MediaWiki-Codesniffer: SingleSpaceBeforeSingleLineComment fixer should move (instead of strip) indentation of commented-out code - https://phabricator.wikimedia.org/T171418#3464334 (10Krinkle) In terms of implementation, I don't think it would be feasible or desirable to preserve the indentation within the com... [18:04:03] ebernhardson: It's your own faults for testing too much [18:05:04] ebernhardson: Are all of the classes you're changing mocked out in tests? [18:05:09] PROBLEM - Puppet errors on deployment-elastic07 is CRITICAL: CRITICAL: 55.56% of data above the critical threshold [0.0] [18:05:47] Reedy: Solution 1) delete tests :) [18:06:11] Reedy: only some, i can probably find a way to do this without mocks [18:06:21] Or, just don't change to variadaic in all places yet [18:06:27] Leave a TODO for when HHVM dies [18:06:47] 10Continuous-Integration-Infrastructure, 10Operations, 10SRE-Access-Requests, 10Patch-For-Review: Add Reedy to contint-docker group - https://phabricator.wikimedia.org/T196192#4249720 (10RobH) If no objections are noted, I'll be merging this live tomorrow, Wednesday, 2018-06-06. [18:07:08] Reedy: what was it before about 6.5? I looked and see i have 6.5 locally which passes the test suite [18:07:25] PHP 6.5 can be used on PHP7 [18:07:30] But we can't use it on HHVM [18:07:34] ahh, ok [18:08:15] So, when we drop HHVM support, we can stop using old phpunit everywhere too [18:08:49] Reedy: Well, we can, it's just that composer won't even try given it identifies as PHP 5.6.99 [18:09:14] If phpunit upstream were to patch their composer file like we did to allow HHVM, or if we'd install phpunit by other means with e.g. --ignore-paltform-req then it'd be fine [18:09:16] PROBLEM - Puppet errors on saucelabs-01 is CRITICAL: CRITICAL: 33.33% of data above the critical threshold [0.0] [18:09:18] PROBLEM - Puppet errors on saucelabs-03 is CRITICAL: CRITICAL: 40.00% of data above the critical threshold [0.0] [18:09:25] (I think) [18:10:10] probably :P [18:10:39] 10Continuous-Integration-Infrastructure, 10Operations, 10SRE-Access-Requests, 10Patch-For-Review: Add Reedy to contint-docker group - https://phabricator.wikimedia.org/T196192#4249720 (10hashar) +1 [18:11:30] 10Release-Engineering-Team (Kanban), 10Scap, 10Patch-For-Review, 10Scoring-platform-team (Current): Support git-lfs in scap - https://phabricator.wikimedia.org/T180627#4258612 (10mmodell) I don't quite know what could be going wrong but I'm looking into it. [18:11:58] (03PS3) 10Hashar: Adds Candalua to the Zuul email whiltelist [integration/config] - 10https://gerrit.wikimedia.org/r/437449 (https://phabricator.wikimedia.org/T196451) (owner: 10Tpt) [18:12:12] (03CR) 10Hashar: [C: 032] Adds Candalua to the Zuul email whiltelist [integration/config] - 10https://gerrit.wikimedia.org/r/437449 (https://phabricator.wikimedia.org/T196451) (owner: 10Tpt) [18:13:13] PROBLEM - Puppet errors on deployment-mira is CRITICAL: CRITICAL: 30.00% of data above the critical threshold [0.0] [18:13:25] (03Merged) 10jenkins-bot: Adds Candalua to the Zuul email whiltelist [integration/config] - 10https://gerrit.wikimedia.org/r/437449 (https://phabricator.wikimedia.org/T196451) (owner: 10Tpt) [18:14:08] PROBLEM - Puppet errors on deployment-db04 is CRITICAL: CRITICAL: 60.00% of data above the critical threshold [0.0] [18:14:13] 10Release-Engineering-Team, 10DNS, 10Operations, 10Traffic, and 2 others: Move Foundation Wiki to new URL when new Wikimedia Foundation website launches - https://phabricator.wikimedia.org/T188776#4258618 (10Aklapper) @Liuxinyu970226 : How is that related to the topic of this task...? [18:16:02] 10Release-Engineering-Team, 10DNS, 10Operations, 10Traffic, and 2 others: Move Foundation Wiki to new URL when new Wikimedia Foundation website launches - https://phabricator.wikimedia.org/T188776#4258622 (10greg) @Varnent current timeline for this? I'm trying to determine who can do it. [18:16:02] PROBLEM - Puppet errors on deployment-urldownloader is CRITICAL: CRITICAL: 50.00% of data above the critical threshold [0.0] [18:16:02] PROBLEM - Puppet errors on deployment-elastic06 is CRITICAL: CRITICAL: 30.00% of data above the critical threshold [0.0] [18:17:17] PROBLEM - Free space - all mounts on deployment-tin is CRITICAL: CRITICAL: deployment-prep.deployment-tin.diskspace._mnt.byte_percentfree (No valid datapoints found)deployment-prep.deployment-tin.diskspace.root.byte_percentfree (<11.11%) WARN: deployment-prep.deployment-tin.diskspace._srv.byte_percentfree (<100.00%) [18:18:34] 10Release-Engineering-Team (Kanban), 10Scap, 10Patch-For-Review, 10Scoring-platform-team (Current): Support git-lfs in scap - https://phabricator.wikimedia.org/T180627#4258635 (10mmodell) ok it seems that the .gitconfig for git lfs wasn't installed. We should really do this via puppet. [18:20:08] 10Continuous-Integration-Infrastructure: Is there a way to specify different different inter-extension-dependencies for REL-Branches? - https://phabricator.wikimedia.org/T196454#4257048 (10hashar) My first guess is MediaWiki REL1_27 does not support extension.json with `manifest_version: 2`. The issue is ExtJSB... [18:20:12] Urgh. Anyone got an idea how/who to debug https://phabricator.wikimedia.org/T196471 shown when going to https://sv.wikipedia.org/wiki/Wikipedia:Wikipediafr%C3%A5gor/Arkiv_2017 ? [18:20:54] Page just shows "PHP fatal error: Call to undefined method __PHP_Incomplete_Class::getEntityType()" [18:21:09] PROBLEM - Puppet errors on integration-slave-jessie-1001 is CRITICAL: CRITICAL: 30.00% of data above the critical threshold [0.0] [18:21:12] PROBLEM - Puppet errors on saucelabs-02 is CRITICAL: CRITICAL: 20.00% of data above the critical threshold [0.0] [18:21:13] ^ greg-g (sorry, no better idea who to ping and cannot judge if other pages might be affected; better safe than sorry) [18:21:28] 10Continuous-Integration-Config, 10Patch-For-Review: Add Candalua to the CI user whitelist - https://phabricator.wikimedia.org/T196451#4258642 (10hashar) 05Open>03Resolved a:03hashar Should be good now. [18:21:58] PROBLEM - Puppet errors on deployment-memc05 is CRITICAL: CRITICAL: 20.00% of data above the critical threshold [0.0] [18:22:02] PROBLEM - Puppet errors on deployment-mediawiki06 is CRITICAL: CRITICAL: 40.00% of data above the critical threshold [0.0] [18:22:40] PROBLEM - Puppet errors on deployment-apertium02 is CRITICAL: CRITICAL: 20.00% of data above the critical threshold [0.0] [18:24:56] 10Release-Engineering-Team (Kanban), 10Scap, 10Patch-For-Review, 10Scoring-platform-team (Current): Support git-lfs in scap - https://phabricator.wikimedia.org/T180627#4258653 (10mmodell) the magic command to initialize lfs on a given `$target`: `SSH_AUTH_SOCK=/run/keyholder/proxy.sock ssh -l deploy-servi... [18:25:22] andre__: wikidata [18:25:28] thanks [18:25:31] PROBLEM - Puppet errors on deployment-sca04 is CRITICAL: CRITICAL: 50.00% of data above the critical threshold [0.0] [18:26:00] just getting a stack trace [18:26:08] <3. [18:27:35] yeah, updating the task... [18:28:27] There's a fair few of them, so marked it as high and just pinged Lydia [18:33:48] what is https://phabricator.wikimedia.org/project/profile/3402/ ? :) [18:34:12] About 7 hours old :P [18:35:57] 10Beta-Cluster-Infrastructure, 10Release-Engineering-Team (Next), 10Patch-For-Review: Beta puppetmaster cherry-pick process - https://phabricator.wikimedia.org/T135427#4258727 (10Krenair) ```root@deployment-puppetmaster03:/var/lib/git/operations/puppet# git log --pretty=format:"%h (%ar) %an - %s" --graph --d... [18:40:43] root@deployment-puppetmaster03:/var/lib/git/operations/puppet# git log --pretty=format:%an origin/production..HEAD | sort -d | uniq -c | sort -nr [18:40:43] 9 Alex Monk [18:40:43] 3 Antoine Musso [18:40:43] 2 Root [18:40:43] 2 Mukunda Modell [18:40:44] 2 Filippo Giunchedi [18:40:46] 1 Tyler Cipriani [18:40:48] 1 Timo Tijhof [18:40:50] 1 Gergő Tisza [18:40:52] :/ [18:43:15] Krenair: +1 for listing them on Phab with a gerrit link matching the Change-Id [18:44:18] RECOVERY - Puppet errors on saucelabs-03 is OK: OK: Less than 1.00% above the threshold [0.0] [18:45:42] PROBLEM - SSH on integration-slave-docker-1017 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:49:03] RECOVERY - Puppet errors on deployment-sca01 is OK: OK: Less than 1.00% above the threshold [0.0] [18:51:02] RECOVERY - Puppet errors on deployment-urldownloader is OK: OK: Less than 1.00% above the threshold [0.0] [18:53:12] RECOVERY - Puppet errors on deployment-mira is OK: OK: Less than 1.00% above the threshold [0.0] [18:54:59] RECOVERY - Puppet errors on deployment-sentry01 is OK: OK: Less than 1.00% above the threshold [0.0] [18:55:13] RECOVERY - Puppet errors on deployment-mathoid is OK: OK: Less than 1.00% above the threshold [0.0] [18:55:19] RECOVERY - Puppet errors on deployment-imagescaler01 is OK: OK: Less than 1.00% above the threshold [0.0] [18:55:33] RECOVERY - SSH on integration-slave-docker-1017 is OK: SSH OK - OpenSSH_6.7p1 Debian-5+deb8u4 (protocol 2.0) [18:56:03] RECOVERY - Puppet errors on deployment-elastic06 is OK: OK: Less than 1.00% above the threshold [0.0] [18:57:59] RECOVERY - Puppet errors on deployment-tin is OK: OK: Less than 1.00% above the threshold [0.0] [18:59:22] RECOVERY - Puppet errors on deployment-ircd is OK: OK: Less than 1.00% above the threshold [0.0] [19:00:34] RECOVERY - Puppet errors on deployment-sca04 is OK: OK: Less than 1.00% above the threshold [0.0] [19:01:08] RECOVERY - Puppet errors on integration-slave-jessie-1001 is OK: OK: Less than 1.00% above the threshold [0.0] [19:01:12] RECOVERY - Puppet errors on saucelabs-02 is OK: OK: Less than 1.00% above the threshold [0.0] [19:01:58] RECOVERY - Puppet errors on deployment-memc05 is OK: OK: Less than 1.00% above the threshold [0.0] [19:02:01] RECOVERY - Puppet errors on deployment-mediawiki06 is OK: OK: Less than 1.00% above the threshold [0.0] [19:02:36] RECOVERY - Puppet errors on deployment-restbase02 is OK: OK: Less than 1.00% above the threshold [0.0] [19:02:40] RECOVERY - Puppet errors on deployment-apertium02 is OK: OK: Less than 1.00% above the threshold [0.0] [19:04:14] RECOVERY - Puppet errors on deployment-restbase01 is OK: OK: Less than 1.00% above the threshold [0.0] [19:04:50] RECOVERY - Puppet errors on integration-puppetmaster01 is OK: OK: Less than 1.00% above the threshold [0.0] [19:05:33] RECOVERY - Puppet errors on deployment-mcs01 is OK: OK: Less than 1.00% above the threshold [0.0] [19:06:07] RECOVERY - Puppet errors on integration-slave-jessie-1002 is OK: OK: Less than 1.00% above the threshold [0.0] [19:06:09] RECOVERY - Puppet errors on deployment-prometheus01 is OK: OK: Less than 1.00% above the threshold [0.0] [19:06:53] RECOVERY - Puppet errors on deployment-fluorine02 is OK: OK: Less than 1.00% above the threshold [0.0] [19:07:23] RECOVERY - Puppet errors on deployment-pdfrender02 is OK: OK: Less than 1.00% above the threshold [0.0] [19:07:46] RECOVERY - Puppet errors on deployment-memc04 is OK: OK: Less than 1.00% above the threshold [0.0] [19:08:04] RECOVERY - Puppet errors on deployment-conf03 is OK: OK: Less than 1.00% above the threshold [0.0] [19:08:24] RECOVERY - Puppet errors on deployment-zotero01 is OK: OK: Less than 1.00% above the threshold [0.0] [19:09:28] RECOVERY - Puppet errors on deployment-cache-upload04 is OK: OK: Less than 1.00% above the threshold [0.0] [19:10:07] RECOVERY - Puppet errors on deployment-elastic07 is OK: OK: Less than 1.00% above the threshold [0.0] [19:10:24] RECOVERY - Puppet errors on deployment-logstash2 is OK: OK: Less than 1.00% above the threshold [0.0] [19:10:33] RECOVERY - Puppet errors on deployment-poolcounter04 is OK: OK: Less than 1.00% above the threshold [0.0] [19:11:38] RECOVERY - Puppet errors on integration-publishing is OK: OK: Less than 1.00% above the threshold [0.0] [19:12:04] RECOVERY - Puppet errors on deployment-db03 is OK: OK: Less than 1.00% above the threshold [0.0] [19:13:20] RECOVERY - Puppet errors on deployment-cache-text04 is OK: OK: Less than 1.00% above the threshold [0.0] [19:14:21] RECOVERY - Puppet errors on deployment-parsoid09 is OK: OK: Less than 1.00% above the threshold [0.0] [19:15:53] RECOVERY - Puppet errors on deployment-sca02 is OK: OK: Less than 1.00% above the threshold [0.0] [19:16:39] RECOVERY - Puppet errors on deployment-changeprop is OK: OK: Less than 1.00% above the threshold [0.0] [19:19:08] RECOVERY - Puppet errors on deployment-db04 is OK: OK: Less than 1.00% above the threshold [0.0] [19:19:14] RECOVERY - Puppet errors on saucelabs-01 is OK: OK: Less than 1.00% above the threshold [0.0] [19:19:26] RECOVERY - Puppet errors on deployment-aqs01 is OK: OK: Less than 1.00% above the threshold [0.0] [19:20:58] RECOVERY - Puppet errors on deployment-elastic05 is OK: OK: Less than 1.00% above the threshold [0.0] [19:24:12] PROBLEM - SSH on integration-slave-docker-1021 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [19:29:03] RECOVERY - SSH on integration-slave-docker-1021 is OK: SSH OK - OpenSSH_6.7p1 Debian-5+deb8u4 (protocol 2.0) [19:30:03] 10Beta-Cluster-Infrastructure, 10Release-Engineering-Team (Next), 10Patch-For-Review: Beta puppetmaster cherry-pick process - https://phabricator.wikimedia.org/T135427#4258926 (10Krenair) I made a very crappy script at `deployment-puppetmaster03:/root/make_T135427_table.py` containing this: ```lang=python,na... [19:30:13] Krinkle, ^ [19:41:39] Krinkle, ^ I made it also extract tasks and gerrit change statuses [19:44:18] 10Continuous-Integration-Infrastructure (shipyard), 10Release-Engineering-Team (Kanban), 10releng-201718-q3, 10Epic, 10Patch-For-Review: [EPIC] Migrate Mediawiki jobs from Nodepool to Docker - https://phabricator.wikimedia.org/T183512#4258967 (10hashar) [19:45:00] if I have two patches in extension that need to be merged together, is there a way to do it? [19:45:15] SMalyshev, as in, they depend on each other? [19:45:22] namely, extension X defines an interface, and extension Y uses it, and I need to change it [19:45:48] so if I change the interface, Y needs to be patched, but patch would work only together with change [19:46:02] if it's a legitimate dependency then if you've ensured that it's documented etc. I don't see why it can't just be done [19:46:44] merge the one creating the interface, then merge the one depending on it [19:46:46] Krenair: well, if I make it Depends-On, then it would require for other one to be merged first [19:46:53] but they depend on each other [19:46:58] :/ [19:47:08] how do the tests pass? [19:47:21] shouldn't they reject that kind of situation outright? [19:47:26] Krenair: they don't, that's the point. I hope if I add depends-on, they will [19:48:13] not sure exactly what the answer is, could try depends-on on both commits and see what happens [19:48:45] Krenair: but then I won't be able to merge them because depends-on requires dependency to go first? [19:53:29] SMalyshev: If this is about showSuggestion(), then I'd say split it up in to. E.g. first introduce showSuggestion() and deprecate the old parameter, but make it call the new method high up in the build() method. Then remove it in a follow-up commit. [19:54:06] basically just add one line calling the new method to the existing commit [19:54:24] Krinkle: hmm not sure what you mean... yes, it's about suggestions but it's not a new method, it's dropping a parameter from an old one [19:54:36] SMalyshev: And introducing showSuggestion() to be used instead, right? [19:54:50] setSuggestion * [19:54:59] unfortunately, php is very picky about interfaces, so implementation and signature should match exactly [19:55:08] which makes it tricky to change it [19:55:19] Krinkle: adding is not a problem. Removing the parameter is [19:55:23] Yeah, keeping the old parameter is fine. [19:55:28] Oh I see what you mean. [19:55:39] Krinkle: but I don't want to keep the parameter, that's the whole point of it! [19:55:42] If you have to keep the old parameter, even if unused/deprecated, how do you remove it from both sides. [19:55:58] yeah how I remove it? [19:56:00] Well, it's good practice to do the removal at a later time once it is unused everywhere. [19:56:11] But yeah, in this case given PHP strict, that's still the same issue. [19:56:17] well, there would be no point of it being unused [19:56:43] PROBLEM - SSH on integration-slave-docker-1017 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [19:56:44] at least no more unused then now - it's not practically used already (that's why I want to remove it) but it's still in the function signature [19:57:03] You'd have a few hours/days to let production prove it is unused, including e.g. private wmf-config code or somethere we're not thinking abuot. [19:57:11] and I can't change signature only on one side, because o php rules [19:57:30] The CirrusSearch code is currently passing it, right? [19:57:39] Krinkle: I pretty much know it's unused, I wrote that code in Wikibase :) [19:57:59] and it's pretty recent, so very little chance anybody could use it [19:58:43] Anyway, best practices aside, imagine we've got a simple commit that just removes the parameter and the deprecated if-block at the top of build(); Question remains, how to remove a parameter from an interface in a way that PHP can pass on. [19:59:05] yeah [19:59:05] !log deployed to BC: [mobileapps/deploy@7ecc3b6]: Update mobileapps to 66727b7 [19:59:07] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [19:59:21] that's the question, exactly [19:59:39] if I know how to do this, the rest I'll figure out [20:00:12] SMalyshev: So, from a cursory test, it seems adding parameters is fine, but missing is not. [20:00:20] So you'd remove from Wikibase first, and then from consumers. [20:00:23] That should work. [20:00:43] so Cirrus depending on Wikibase [20:00:58] hmm... let me see if that works, if it does, then I'm good [20:01:15] the added parameter must be optional for it to pass strict [20:01:34] RECOVERY - SSH on integration-slave-docker-1017 is OK: SSH OK - OpenSSH_6.7p1 Debian-5+deb8u4 (protocol 2.0) [20:01:51] Krinkle: yeah sure [20:02:14] https://3v4l.org/Oqeer [20:02:15] PROBLEM - Free space - all mounts on deployment-tin is CRITICAL: CRITICAL: deployment-prep.deployment-tin.diskspace._mnt.byte_percentfree (No valid datapoints found)deployment-prep.deployment-tin.diskspace.root.byte_percentfree (<22.22%) WARN: deployment-prep.deployment-tin.diskspace._srv.byte_percentfree (<100.00%) [20:03:06] hmmm I thought that didn't work... but apparently it does. Maybe it didn't in older php, or maybe I just have false memory [20:03:26] that's good news, it probably solves my problem with a bit of hackery [20:03:41] Krinkle: thanks [20:04:51] PROBLEM - SSH on integration-slave-docker-1015 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [20:05:11] PROBLEM - SSH on integration-slave-docker-1021 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [20:10:02] RECOVERY - SSH on integration-slave-docker-1021 is OK: SSH OK - OpenSSH_6.7p1 Debian-5+deb8u4 (protocol 2.0) [20:13:52] 10Beta-Cluster-Infrastructure, 10Release-Engineering-Team (Next), 10Patch-For-Review: Beta puppetmaster cherry-pick process - https://phabricator.wikimedia.org/T135427#4259064 (10mmodell) @krenair: I could probably make a conduit endpoint to receive that table and update the task from inside a cron job. [20:22:09] thcipriani, a what endpoint? [20:22:18] 10Continuous-Integration-Config, 10RelEng-Archive-FY201718-Q2, 10Composer, 10Patch-For-Review, 10Wikimedia-log-errors (Jenkins Failure): Composer\Downloader\TransportException in mwext-testextension-hhvm-jessie - https://phabricator.wikimedia.org/T182266#4259128 (10Krinkle) [20:22:33] Krenair: #REDIRECT twentyafterfour [20:22:38] :) [20:22:40] oops [20:22:45] 10Continuous-Integration-Config, 10RelEng-Archive-FY201718-Q2, 10Composer, 10Patch-For-Review, 10Wikimedia-log-errors (Jenkins Failure): Composer\Downloader\TransportException in jobs with mediawiki or composer - https://phabricator.wikimedia.org/T182266#3818521 (10Krinkle) [20:22:48] sorry [20:22:51] :) [20:23:09] no worries, mental beat skip inducing :) [20:23:39] I'm trying to remember what conduit was [20:24:17] API [20:24:31] https://phabricator.wikimedia.org/conduit/ [20:24:41] oh the phab API [20:24:47] yes [20:24:52] wait [20:24:58] I thought wikimedia really really hated extending phab [20:25:16] 10Continuous-Integration-Config, 10RelEng-Archive-FY201718-Q2, 10Composer, 10Patch-For-Review, 10Wikimedia-log-errors (Jenkins Failure): Composer\Downloader\TransportException in jobs with mediawiki or composer - https://phabricator.wikimedia.org/T182266#3818521 (10Krinkle) This happens both for HHVM and... [20:28:07] 10Beta-Cluster-Infrastructure, 10Release-Engineering-Team (Next), 10Patch-For-Review: Beta puppetmaster cherry-pick process - https://phabricator.wikimedia.org/T135427#4259155 (10Krenair) >>! In T135427#4259064, @mmodell wrote: > @krenair: I could probably make a conduit endpoint to receive that table and up... [20:29:58] 10Beta-Cluster-Infrastructure, 10Release-Engineering-Team (Next), 10Patch-For-Review: Beta puppetmaster cherry-pick process - https://phabricator.wikimedia.org/T135427#4259156 (10mmodell) @krenair: Good point, that probably would do it. [20:32:28] 10Continuous-Integration-Infrastructure (shipyard), 10Release-Engineering-Team (Kanban), 10releng-201718-q3, 10Epic, 10Patch-For-Review: [EPIC] Migrate Mediawiki jobs from Nodepool to Docker - https://phabricator.wikimedia.org/T183512#4259173 (10hashar) [20:34:44] RECOVERY - SSH on integration-slave-docker-1015 is OK: SSH OK - OpenSSH_6.7p1 Debian-5+deb8u4 (protocol 2.0) [20:40:51] PROBLEM - SSH on integration-slave-docker-1015 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [20:43:50] PROBLEM - Puppet errors on integration-slave-jessie-android is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [0.0] [20:45:40] RECOVERY - SSH on integration-slave-docker-1015 is OK: SSH OK - OpenSSH_6.7p1 Debian-5+deb8u4 (protocol 2.0) [20:46:47] 10Continuous-Integration-Infrastructure (shipyard), 10Release-Engineering-Team (Kanban), 10releng-201718-q3, 10Epic, 10Patch-For-Review: [EPIC] Migrate Mediawiki jobs from Nodepool to Docker - https://phabricator.wikimedia.org/T183512#4259234 (10hashar) [20:47:54] (03PS1) 10Hashar: Migrate SocialLogin to Quibble [integration/config] - 10https://gerrit.wikimedia.org/r/437622 (https://phabricator.wikimedia.org/T183512) [20:48:40] (03PS1) 10Hashar: Archive mediawiki/extensions/SolrStore [integration/config] - 10https://gerrit.wikimedia.org/r/437623 (https://phabricator.wikimedia.org/T196513) [20:49:54] (03CR) 10Hashar: [C: 032] Migrate SocialLogin to Quibble [integration/config] - 10https://gerrit.wikimedia.org/r/437622 (https://phabricator.wikimedia.org/T183512) (owner: 10Hashar) [20:49:56] (03CR) 10Hashar: [C: 032] Archive mediawiki/extensions/SolrStore [integration/config] - 10https://gerrit.wikimedia.org/r/437623 (https://phabricator.wikimedia.org/T196513) (owner: 10Hashar) [20:50:02] (03PS1) 10Hashar: Archive mediawiki/extensions/SkelJS [integration/config] - 10https://gerrit.wikimedia.org/r/437624 (https://phabricator.wikimedia.org/T196509) [20:50:12] (03CR) 10Hashar: [C: 032] Archive mediawiki/extensions/SkelJS [integration/config] - 10https://gerrit.wikimedia.org/r/437624 (https://phabricator.wikimedia.org/T196509) (owner: 10Hashar) [20:51:03] 10Continuous-Integration-Infrastructure (shipyard), 10Release-Engineering-Team (Kanban), 10releng-201718-q3, 10Epic, 10Patch-For-Review: [EPIC] Migrate Mediawiki jobs from Nodepool to Docker - https://phabricator.wikimedia.org/T183512#4259250 (10hashar) [20:51:13] (03Merged) 10jenkins-bot: Migrate SocialLogin to Quibble [integration/config] - 10https://gerrit.wikimedia.org/r/437622 (https://phabricator.wikimedia.org/T183512) (owner: 10Hashar) [20:51:25] (03Merged) 10jenkins-bot: Archive mediawiki/extensions/SolrStore [integration/config] - 10https://gerrit.wikimedia.org/r/437623 (https://phabricator.wikimedia.org/T196513) (owner: 10Hashar) [20:51:32] (03Merged) 10jenkins-bot: Archive mediawiki/extensions/SkelJS [integration/config] - 10https://gerrit.wikimedia.org/r/437624 (https://phabricator.wikimedia.org/T196509) (owner: 10Hashar) [21:01:01] [21:51:36] I was looking at this recently : https://www.phacility.com/phabricator/ I wasn't sure if it was a spoof at first but it does appear to be real and awesome :) [21:01:02] lol [21:01:56] 10Continuous-Integration-Config, 10RelEng-Archive-FY201718-Q2, 10Composer, 10Patch-For-Review, and 2 others: Composer\Downloader\TransportException in jobs with mediawiki or composer - https://phabricator.wikimedia.org/T182266#4259273 (10Tgr) [[https://github.com/composer/packagist/issues/470|composer/pack... [21:18:24] 10Phabricator, 10LDAP: Having difficulty logging into Phabricator via LDAP when multiple accounts returned for username - https://phabricator.wikimedia.org/T138672#4259288 (10Quiddity) a:03Andrew [21:28:13] 10Release-Engineering-Team (Kanban), 10Patch-For-Review, 10Release, 10Train Deployments: 1.32.0-wmf.6 deployment blockers - https://phabricator.wikimedia.org/T191052#4259312 (10Krinkle) [21:28:50] 10Release-Engineering-Team (Kanban), 10Scap: Automate the Train - https://phabricator.wikimedia.org/T196515#4259313 (10thcipriani) [21:30:47] 10Release-Engineering-Team (Kanban), 10Scap: Automate updating deployment notes - https://phabricator.wikimedia.org/T196516#4259326 (10thcipriani) [21:33:04] PROBLEM - SSH on integration-slave-docker-1014 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [21:35:19] 10Release-Engineering-Team (Kanban), 10Scap: Automate weekly branch cut - https://phabricator.wikimedia.org/T196517#4259349 (10thcipriani) [21:37:57] RECOVERY - SSH on integration-slave-docker-1014 is OK: SSH OK - OpenSSH_6.7p1 Debian-5+deb8u4 (protocol 2.0) [21:46:40] RECOVERY - Puppet errors on deployment-webperf11 is OK: OK: Less than 1.00% above the threshold [0.0] [21:48:34] marlier: ^ :) [21:49:28] Krinkle 👍 [21:50:53] PROBLEM - SSH on integration-slave-docker-1020 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [21:55:44] RECOVERY - SSH on integration-slave-docker-1020 is OK: SSH OK - OpenSSH_6.7p1 Debian-5+deb8u4 (protocol 2.0) [22:08:01] 10Continuous-Integration-Config, 10Mobile-Content-Service, 10Patch-For-Review, 10Reading-Infrastructure-Team-Backlog (Kanban): Create a CI task for MCS periodic tests - https://phabricator.wikimedia.org/T177896#4259400 (10Mholloway) @Jdforrester-WMF If you know your way around the CI infrastructure, assist... [22:13:15] 10Continuous-Integration-Config, 10RelEng-Archive-FY201718-Q2, 10Composer, 10Patch-For-Review, and 2 others: Composer\Downloader\TransportException in jobs with mediawiki or composer - https://phabricator.wikimedia.org/T182266#4259404 (10hashar) Last time I checked ( T182266#3830378 ) https://packagist.org... [22:18:45] PROBLEM - SSH on integration-slave-docker-1017 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [22:43:32] RECOVERY - SSH on integration-slave-docker-1017 is OK: SSH OK - OpenSSH_6.7p1 Debian-5+deb8u4 (protocol 2.0) [22:44:20] 10Beta-Cluster-Infrastructure, 10RelEng-Archive-FY201718-Q1, 10media-storage, 10Patch-For-Review: deployment-ms-be03.deployment-prep and deployment-ms-be04.deployment-prep have high load / system CPU - https://phabricator.wikimedia.org/T160990#3117645 (10Krenair) It has come up while reviewing cherry-picks... [22:54:06] PROBLEM - SSH on integration-slave-docker-1014 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [22:56:53] PROBLEM - SSH on integration-slave-docker-1015 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [23:03:57] RECOVERY - SSH on integration-slave-docker-1014 is OK: SSH OK - OpenSSH_6.7p1 Debian-5+deb8u4 (protocol 2.0) [23:06:41] RECOVERY - SSH on integration-slave-docker-1015 is OK: SSH OK - OpenSSH_6.7p1 Debian-5+deb8u4 (protocol 2.0) [23:10:08] PROBLEM - SSH on integration-slave-docker-1014 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [23:11:19] 10Release-Engineering-Team (Kanban), 10Scap: Document scap swat command - https://phabricator.wikimedia.org/T196411#4259488 (10mmodell) a:03mmodell [23:12:18] RECOVERY - Free space - all mounts on deployment-tin is OK: OK: deployment-prep.deployment-tin.diskspace._mnt.byte_percentfree (No valid datapoints found) [23:14:06] 10Release-Engineering-Team (Kanban), 10Wikibugs, 10Patch-For-Review: Deprecate -devtools and redirect to -releng? - https://phabricator.wikimedia.org/T185285#4259494 (10mmodell) close this then? [23:14:57] RECOVERY - SSH on integration-slave-docker-1014 is OK: SSH OK - OpenSSH_6.7p1 Debian-5+deb8u4 (protocol 2.0) [23:17:49] PROBLEM - SSH on integration-slave-docker-1015 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [23:22:42] RECOVERY - SSH on integration-slave-docker-1015 is OK: SSH OK - OpenSSH_6.7p1 Debian-5+deb8u4 (protocol 2.0) [23:30:43] PROBLEM - SSH on integration-slave-docker-1017 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [23:33:49] PROBLEM - SSH on integration-slave-docker-1015 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [23:59:01] no_justification: the script (we have one?) we use for removing wmf branches, does not include vendor? It seems various 1.31 branches still hang around there. [23:59:31] clean.py [23:59:39] In mw config repo [23:59:54] It should iterate all submodules [23:59:58] I don't like manual lists