[03:51:34] RECOVERY - Puppet errors on deployment-cache-text04 is OK: OK: Less than 1.00% above the threshold [0.0] [05:10:29] PROBLEM - Free space - all mounts on deployment-fluorine02 is CRITICAL: CRITICAL: deployment-prep.deployment-fluorine02.diskspace._srv.byte_percentfree (<44.44%) [07:00:30] RECOVERY - Free space - all mounts on deployment-fluorine02 is OK: OK: All targets OK [08:21:39] 10Continuous-Integration-Config, 10Release-Engineering-Team (Someday), 10MediaWiki-extensions-SendGrid: Extensions with PHP 5.6+ as requirements making Jenkins to fail on merge when CR+2 - https://phabricator.wikimedia.org/T185451 (10hashar) 05declined>03Resolved As you want :] [08:30:02] 10Continuous-Integration-Config, 10MathSearch, 10Patch-For-Review: mwext-testextension-zend should load extension mathsearch after math - https://phabricator.wikimedia.org/T117659 (10thiemowmde) Please change this code to **not** use any of the Wikibase constants, but read the incoming format as MIME type. E... [08:36:19] (03PS1) 10Hashar: HierarchyBuilder depends on PageForms [integration/config] - 10https://gerrit.wikimedia.org/r/444431 [08:36:49] (03CR) 10Hashar: [C: 032] HierarchyBuilder depends on PageForms [integration/config] - 10https://gerrit.wikimedia.org/r/444431 (owner: 10Hashar) [08:38:16] (03Merged) 10jenkins-bot: HierarchyBuilder depends on PageForms [integration/config] - 10https://gerrit.wikimedia.org/r/444431 (owner: 10Hashar) [09:04:02] (03PS1) 10Hashar: Migrate OpenIDConnect to Quibble without Selenium [integration/config] - 10https://gerrit.wikimedia.org/r/444432 (https://phabricator.wikimedia.org/T183512) [09:04:14] (03CR) 10Hashar: [C: 032] Migrate OpenIDConnect to Quibble without Selenium [integration/config] - 10https://gerrit.wikimedia.org/r/444432 (https://phabricator.wikimedia.org/T183512) (owner: 10Hashar) [09:05:35] (03PS2) 10Hashar: Migrate OpenIDConnect to Quibble without Selenium [integration/config] - 10https://gerrit.wikimedia.org/r/444432 (https://phabricator.wikimedia.org/T183512) [09:05:37] (03PS1) 10Hashar: Migrate MediaWikiAuth to Quibble without Selenium [integration/config] - 10https://gerrit.wikimedia.org/r/444433 (https://phabricator.wikimedia.org/T183512) [09:05:54] (03CR) 10Hashar: [C: 032] Migrate OpenIDConnect to Quibble without Selenium [integration/config] - 10https://gerrit.wikimedia.org/r/444432 (https://phabricator.wikimedia.org/T183512) (owner: 10Hashar) [09:05:57] (03CR) 10Hashar: [C: 032] Migrate MediaWikiAuth to Quibble without Selenium [integration/config] - 10https://gerrit.wikimedia.org/r/444433 (https://phabricator.wikimedia.org/T183512) (owner: 10Hashar) [09:07:16] (03Merged) 10jenkins-bot: Migrate OpenIDConnect to Quibble without Selenium [integration/config] - 10https://gerrit.wikimedia.org/r/444432 (https://phabricator.wikimedia.org/T183512) (owner: 10Hashar) [09:08:16] 10Continuous-Integration-Infrastructure (shipyard), 10Release-Engineering-Team (Kanban), 10releng-201718-q3, 10Epic, 10Patch-For-Review: [EPIC] Migrate Mediawiki jobs from Nodepool to Docker - https://phabricator.wikimedia.org/T183512 (10hashar) [09:08:17] (03Merged) 10jenkins-bot: Migrate MediaWikiAuth to Quibble without Selenium [integration/config] - 10https://gerrit.wikimedia.org/r/444433 (https://phabricator.wikimedia.org/T183512) (owner: 10Hashar) [09:49:25] 10Continuous-Integration-Infrastructure, 10Release-Engineering-Team (Kanban): Add "gmp" php extension to Quibble images - https://phabricator.wikimedia.org/T199047 (10hashar) p:05Triage>03Normal [09:50:41] 10Continuous-Integration-Infrastructure, 10Release-Engineering-Team (Kanban): Add "gmp" php extension to Quibble images - https://phabricator.wikimedia.org/T199047 (10hashar) [10:13:30] (03PS1) 10Hashar: docker: add php-gmp to stretch image [integration/config] - 10https://gerrit.wikimedia.org/r/444435 (https://phabricator.wikimedia.org/T199047) [10:16:25] (03CR) 10Hashar: [C: 032] docker: add php-gmp to stretch image [integration/config] - 10https://gerrit.wikimedia.org/r/444435 (https://phabricator.wikimedia.org/T199047) (owner: 10Hashar) [10:17:13] (03PS1) 10Hashar: Bump php7 Quibble jobs to 0.0.19-2 [integration/config] - 10https://gerrit.wikimedia.org/r/444436 (https://phabricator.wikimedia.org/T199047) [10:17:55] (03Merged) 10jenkins-bot: docker: add php-gmp to stretch image [integration/config] - 10https://gerrit.wikimedia.org/r/444435 (https://phabricator.wikimedia.org/T199047) (owner: 10Hashar) [10:30:39] 10Continuous-Integration-Infrastructure (shipyard), 10Release-Engineering-Team (Kanban), 10releng-201718-q3, 10Epic, 10Patch-For-Review: [EPIC] Migrate Mediawiki jobs from Nodepool to Docker - https://phabricator.wikimedia.org/T183512 (10hashar) [10:33:46] 10Continuous-Integration-Infrastructure (shipyard), 10Release-Engineering-Team (Kanban), 10releng-201718-q3, 10Epic, 10Patch-For-Review: [EPIC] Migrate Mediawiki jobs from Nodepool to Docker - https://phabricator.wikimedia.org/T183512 (10hashar) [11:00:14] 10Gerrit, 10WMF-Legal, 10Privacy: Using Gerrit/git requires the email registered via wikitech and ends ups being voluntary disclosed (break of privacy?) - https://phabricator.wikimedia.org/T151529 (10Kaartic) 05Open>03Resolved [11:00:52] 10Gerrit, 10WMF-Legal, 10Privacy: Using Gerrit/git requires the email registered via wikitech and ends ups being voluntary disclosed (break of privacy?) - https://phabricator.wikimedia.org/T151529 (10Kaartic) I do see a huge banner stating the email address would be public. Hence closing this. {F23462549} [11:08:43] 10Gerrit, 10WMF-Legal, 10Privacy: Using Gerrit/git requires the email registered via wikitech and ends ups being voluntary disclosed (break of privacy?) - https://phabricator.wikimedia.org/T151529 (10TerraCodes) 05Resolved>03Open That only shows up when creating an account. [12:30:09] 10Gerrit, 10WMF-Legal, 10Privacy: Using Gerrit/git requires the email registered via wikitech and ends ups being voluntary disclosed (break of privacy?) - https://phabricator.wikimedia.org/T151529 (10Krenair) Well that's when it becomes publicly available. [13:20:00] 10Beta-Cluster-Infrastructure, 10Services (next): RESTBase errors on logstash-beta - https://phabricator.wikimedia.org/T186994 (10mobrovac) p:05Triage>03Normal [14:13:58] 10Gerrit, 10WMF-Legal, 10Privacy: Using Gerrit/git requires the email registered via wikitech and ends ups being voluntary disclosed (break of privacy?) - https://phabricator.wikimedia.org/T151529 (10Aklapper) 05Open>03Resolved [15:14:14] 10Gerrit, 10WMF-Legal, 10Privacy: Using Gerrit/git requires the email registered via wikitech and ends ups being voluntary disclosed (break of privacy?) - https://phabricator.wikimedia.org/T151529 (10Krenair) Unless you're saying there should also be a notice when you change your email, though I suspect the... [15:23:36] 10Gerrit: Gerrit's "Show Diffs" button does not always expand all diffs for each changed file - https://phabricator.wikimedia.org/T199012 (10Aklapper) [16:27:00] (03PS1) 10MarcoAurelio: Add Phan and sec-check tests for NukeDPL [integration/config] - 10https://gerrit.wikimedia.org/r/444444 [16:30:58] (03CR) 10MarcoAurelio: "444 444 :-)" [integration/config] - 10https://gerrit.wikimedia.org/r/444444 (owner: 10MarcoAurelio) [16:42:46] !log deleted deployment-puppetmaster02. root and home files are in archives under deployment-puppetmaster03:/root/ [16:42:49] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [16:50:24] 10Beta-Cluster-Infrastructure, 10Operations, 10Security-Team, 10Patch-For-Review: Delete deployment-mediawiki06 - https://phabricator.wikimedia.org/T192996 (10Krenair) @elukey you created this instance, know what it's for? [16:54:10] !log deleted deployment-redis02 T179371 [16:54:14] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [16:54:14] T179371: Move deployment-prep redis instances to stretch - https://phabricator.wikimedia.org/T179371 [16:54:59] !log deleted deployment-redis01 T179371 [16:55:03] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [16:57:33] PROBLEM - Host deployment-puppetmaster02 is DOWN: CRITICAL - Host Unreachable (10.68.21.200) [16:59:45] 10Beta-Cluster-Infrastructure, 10Operations, 10Security-Team, 10Patch-For-Review: Delete deployment-mediawiki06 - https://phabricator.wikimedia.org/T192996 (10elukey) It was probably a regular mw appserver for beta, don't have specific memories about it. [18:31:27] !log deleted deployment-mx T184244 [18:31:31] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [18:31:32] T184244: Puppet broken on deployment-mx due to systemd on trusty - https://phabricator.wikimedia.org/T184244 [18:32:06] 10Beta-Cluster-Infrastructure, 10Patch-For-Review, 10Puppet: Puppet broken on deployment-mx due to systemd on trusty - https://phabricator.wikimedia.org/T184244 (10Krenair) So now I think we just need to get https://gerrit.wikimedia.org/r/#/c/operations/puppet/+/436431/ merged ? [18:44:47] 10Beta-Cluster-Infrastructure, 10Operations, 10Security-Team, 10Patch-For-Review: Delete deployment-mediawiki06 - https://phabricator.wikimedia.org/T192996 (10Krenair) Alright let's merge the above and delete this instance? [19:10:11] 10Release-Engineering-Team, 10Performance-Team, 10MW-1.32-release-notes (WMF-deploy-2018-06-26 (1.32.0-wmf.10)), 10Patch-For-Review: Save Timing increased 50% since 2018-06-28 20:53 - https://phabricator.wikimedia.org/T198483 (10daniel) @aaron Thanks for spotting this! If I see this correctly, the issue i... [19:46:31] 10Beta-Cluster-Infrastructure, 10Patch-For-Review: Get letsencrypt wildcard cert for *.beta.wmflabs.org domains - https://phabricator.wikimedia.org/T182927 (10Krenair) So the ordinary puppetised renewal ran overnight and removed my wildcard cert from usage. Guess I should try to find some way to puppetise this... [20:14:04] 10Beta-Cluster-Infrastructure, 10CX-cxserver: Move apertium to deployment-sca* hosts in Beta Cluster - https://phabricator.wikimedia.org/T142152 (10Krinkle) As of today there are still three `sca` hosts in Beta (sca03 was deleted?). There are no `scb` hosts. | deployment-sca01 | debian-8.2-jessie | m1.small... [20:16:53] PROBLEM - Host deployment-apertium02 is DOWN: CRITICAL - Host Unreachable (10.68.22.254) [20:16:59] !log Shutting off deployment-apertium02 (T142152) [20:17:04] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [20:17:04] T142152: Move apertium to deployment-sca* hosts in Beta Cluster - https://phabricator.wikimedia.org/T142152 [20:41:16] 10Release-Engineering-Team (Kanban), 10Release, 10Train Deployments: 1.31.0-wmf.20 deployment blockers - https://phabricator.wikimedia.org/T183959 (10Krinkle) [20:42:07] PROBLEM - Puppet errors on integration-slave-docker-1008 is CRITICAL: CRITICAL: 55.56% of data above the critical threshold [0.0] [21:17:08] RECOVERY - Puppet errors on integration-slave-docker-1008 is OK: OK: Less than 1.00% above the threshold [0.0] [22:00:49] (03PS2) 10Krinkle: [MwEmbedSupport] Archive [integration/config] - 10https://gerrit.wikimedia.org/r/443006 (https://phabricator.wikimedia.org/T197918) (owner: 10Jforrester) [22:01:07] (03CR) 10jerkins-bot: [V: 04-1] [MwEmbedSupport] Archive [integration/config] - 10https://gerrit.wikimedia.org/r/443006 (https://phabricator.wikimedia.org/T197918) (owner: 10Jforrester) [22:20:22] (03PS1) 10QChris: Allow “Gerrit Managers” to import history [labs/tools/facebook-messenger-chatbot] (refs/meta/config) - 10https://gerrit.wikimedia.org/r/444477 [22:20:24] (03CR) 10QChris: [V: 031 C: 032] Allow “Gerrit Managers” to import history [labs/tools/facebook-messenger-chatbot] (refs/meta/config) - 10https://gerrit.wikimedia.org/r/444477 (owner: 10QChris) [22:20:41] (03CR) 10QChris: [V: 032 C: 032] Allow “Gerrit Managers” to import history [labs/tools/facebook-messenger-chatbot] (refs/meta/config) - 10https://gerrit.wikimedia.org/r/444477 (owner: 10QChris) [22:21:39] (03PS1) 10QChris: Import done. Revoke import grants [labs/tools/facebook-messenger-chatbot] (refs/meta/config) - 10https://gerrit.wikimedia.org/r/444478 [22:21:41] (03CR) 10QChris: [V: 032 C: 032] Import done. Revoke import grants [labs/tools/facebook-messenger-chatbot] (refs/meta/config) - 10https://gerrit.wikimedia.org/r/444478 (owner: 10QChris) [22:22:47] (03PS3) 10Krinkle: [Parsoid] Stop injecting MwEmbedHandler as a dependency, it's a no-op [integration/config] - 10https://gerrit.wikimedia.org/r/443002 (owner: 10Jforrester) [22:28:50] (03CR) 10Krinkle: [C: 031] "Rebased to resolve conflict with "Poem" addition for Parsoid." [integration/config] - 10https://gerrit.wikimedia.org/r/443002 (owner: 10Jforrester) [22:29:08] (03CR) 10Krinkle: [C: 032] [Parsoid] Stop injecting MwEmbedHandler as a dependency, it's a no-op [integration/config] - 10https://gerrit.wikimedia.org/r/443002 (owner: 10Jforrester) [22:31:03] (03Merged) 10jenkins-bot: [Parsoid] Stop injecting MwEmbedHandler as a dependency, it's a no-op [integration/config] - 10https://gerrit.wikimedia.org/r/443002 (owner: 10Jforrester) [22:54:44] (03CR) 10Krinkle: [C: 032] "Regenerated and deployed update to https://integration.wikimedia.org/ci/job/parsoidsvc-hhvm-parsertests-jessie/j" [integration/config] - 10https://gerrit.wikimedia.org/r/443002 (owner: 10Jforrester)