[00:06:42] PROBLEM - Free space - all mounts on deployment-logstash03 is CRITICAL: (Service Check Timed Out) [00:07:25] PROBLEM - Free space - all mounts on deployment-deploy02 is CRITICAL: (Service Check Timed Out) [00:07:50] PROBLEM - Free space - all mounts on deployment-memc06 is CRITICAL: (Service Check Timed Out) [00:07:54] PROBLEM - Free space - all mounts on deployment-imagescaler01 is CRITICAL: (Service Check Timed Out) [00:07:57] PROBLEM - Free space - all mounts on deployment-sca04 is CRITICAL: (Service Check Timed Out) [00:08:02] PROBLEM - Free space - all mounts on deployment-eventstreams-1 is CRITICAL: (Service Check Timed Out) [00:08:03] PROBLEM - Free space - all mounts on deployment-xhgui01 is CRITICAL: (Service Check Timed Out) [00:08:06] PROBLEM - Free space - all mounts on deployment-jobrunner03 is CRITICAL: (Service Check Timed Out) [00:08:09] PROBLEM - Free space - all mounts on deployment-restbase03 is CRITICAL: (Service Check Timed Out) [00:08:14] PROBLEM - Free space - all mounts on deployment-elastic05 is CRITICAL: (Service Check Timed Out) [00:08:19] PROBLEM - Free space - all mounts on deployment-kafka-jumbo-1 is CRITICAL: (Service Check Timed Out) [00:08:20] PROBLEM - Free space - all mounts on deployment-ores01 is CRITICAL: (Service Check Timed Out) [00:08:24] PROBLEM - Free space - all mounts on deployment-mx02 is CRITICAL: (Service Check Timed Out) [00:08:24] PROBLEM - Free space - all mounts on deployment-kafka-jumbo-2 is CRITICAL: (Service Check Timed Out) [00:08:27] PROBLEM - Free space - all mounts on integration-agent-docker-1008 is CRITICAL: (Service Check Timed Out) [00:08:32] PROBLEM - Free space - all mounts on deployment-puppetmaster04 is CRITICAL: (Service Check Timed Out) [00:08:32] PROBLEM - Free space - all mounts on integration-agent-docker-1001 is CRITICAL: (Service Check Timed Out) [00:08:32] PROBLEM - Free space - all mounts on integration-agent-docker-1009 is CRITICAL: (Service Check Timed Out) [00:08:34] PROBLEM - Free space - all mounts on deployment-memc05 is CRITICAL: (Service Check Timed Out) [00:08:35] PROBLEM - Free space - all mounts on deployment-docker-changeprop01 is CRITICAL: (Service Check Timed Out) [00:08:35] PROBLEM - Free space - all mounts on deployment-prometheus02 is CRITICAL: (Service Check Timed Out) [00:08:37] PROBLEM - Free space - all mounts on deployment-mailman01 is CRITICAL: (Service Check Timed Out) [00:08:37] PROBLEM - Free space - all mounts on deployment-zookeeper02 is CRITICAL: (Service Check Timed Out) [00:08:49] PROBLEM - Free space - all mounts on deployment-db05 is CRITICAL: (Service Check Timed Out) [00:08:50] PROBLEM - Free space - all mounts on integration-castor03 is CRITICAL: (Service Check Timed Out) [00:08:54] PROBLEM - Free space - all mounts on integration-agent-docker-1012 is CRITICAL: (Service Check Timed Out) [00:08:56] PROBLEM - Free space - all mounts on deployment-fluorine02 is CRITICAL: (Service Check Timed Out) [00:09:01] PROBLEM - Free space - all mounts on deployment-mediawiki-07 is CRITICAL: (Service Check Timed Out) [00:09:13] PROBLEM - Free space - all mounts on deployment-aqs02 is CRITICAL: (Service Check Timed Out) [00:09:33] PROBLEM - Free space - all mounts on deployment-docker-mathoid01 is CRITICAL: (Service Check Timed Out) [00:09:46] PROBLEM - Free space - all mounts on deployment-mediawiki-09 is CRITICAL: (Service Check Timed Out) [00:09:46] PROBLEM - Free space - all mounts on deployment-restbase02 is CRITICAL: (Service Check Timed Out) [00:12:19] RECOVERY - Free space - all mounts on deployment-deploy02 is OK: OK: All targets OK [00:12:40] RECOVERY - Free space - all mounts on deployment-memc06 is OK: OK: All targets OK [00:12:46] RECOVERY - Free space - all mounts on deployment-imagescaler01 is OK: OK: All targets OK [00:12:51] RECOVERY - Free space - all mounts on deployment-sca04 is OK: OK: All targets OK [00:12:56] RECOVERY - Free space - all mounts on deployment-eventstreams-1 is OK: OK: All targets OK [00:12:57] RECOVERY - Free space - all mounts on deployment-xhgui01 is OK: OK: All targets OK [00:12:57] RECOVERY - Free space - all mounts on deployment-jobrunner03 is OK: OK: deployment-prep.deployment-jobrunner03.diskspace.root.byte_percentfree (More than half of the datapoints are undefined) [00:12:58] RECOVERY - Free space - all mounts on deployment-restbase03 is OK: OK: All targets OK [00:13:07] RECOVERY - Free space - all mounts on deployment-elastic05 is OK: OK: deployment-prep.deployment-elastic05.diskspace._var_log.byte_percentfree (No valid datapoints found) deployment-prep.deployment-elastic05.diskspace._var_lib_elasticsearch.byte_percentfree (No valid datapoints found) [00:13:09] RECOVERY - Free space - all mounts on deployment-kafka-jumbo-1 is OK: OK: deployment-prep.deployment-kafka-jumbo-1.diskspace._mnt_kafka.byte_percentfree (No valid datapoints found) deployment-prep.deployment-kafka-jumbo-1.diskspace._srv_kafka.byte_percentfree (More than half of the datapoints are undefined) [00:13:11] RECOVERY - Free space - all mounts on deployment-ores01 is OK: OK: All targets OK [00:13:12] RECOVERY - Free space - all mounts on deployment-kafka-jumbo-2 is OK: OK: deployment-prep.deployment-kafka-jumbo-2.diskspace._mnt_kafka.byte_percentfree (No valid datapoints found) deployment-prep.deployment-kafka-jumbo-2.diskspace.root.byte_percentfree (More than half of the datapoints are undefined) [00:13:12] RECOVERY - Free space - all mounts on deployment-mx02 is OK: OK: All targets OK [00:13:18] RECOVERY - Free space - all mounts on integration-agent-docker-1008 is OK: OK: integration.integration-agent-docker-1008.diskspace._var_lib_docker.byte_percentfree (More than half of the datapoints are undefined) [00:13:21] RECOVERY - Free space - all mounts on deployment-puppetmaster04 is OK: OK: All targets OK [00:13:22] RECOVERY - Free space - all mounts on integration-agent-docker-1001 is OK: OK: All targets OK [00:13:25] RECOVERY - Free space - all mounts on integration-agent-docker-1009 is OK: OK: All targets OK [00:13:27] RECOVERY - Free space - all mounts on deployment-memc05 is OK: OK: All targets OK [00:13:27] RECOVERY - Free space - all mounts on deployment-mailman01 is OK: OK: All targets OK [00:13:28] RECOVERY - Free space - all mounts on deployment-prometheus02 is OK: OK: All targets OK [00:13:28] RECOVERY - Free space - all mounts on deployment-docker-changeprop01 is OK: OK: All targets OK [00:13:28] RECOVERY - Free space - all mounts on deployment-zookeeper02 is OK: OK: All targets OK [00:13:41] RECOVERY - Free space - all mounts on deployment-db05 is OK: OK: All targets OK [00:13:41] RECOVERY - Free space - all mounts on integration-castor03 is OK: OK: All targets OK [00:13:47] RECOVERY - Free space - all mounts on integration-agent-docker-1012 is OK: OK: All targets OK [00:13:49] RECOVERY - Free space - all mounts on deployment-fluorine02 is OK: OK: All targets OK [00:13:52] RECOVERY - Free space - all mounts on deployment-mediawiki-07 is OK: OK: deployment-prep.deployment-mediawiki-07.diskspace._srv.byte_percentfree (More than half of the datapoints are undefined) [00:14:06] RECOVERY - Free space - all mounts on deployment-aqs02 is OK: OK: All targets OK [00:14:25] RECOVERY - Free space - all mounts on deployment-docker-mathoid01 is OK: OK: All targets OK [00:14:39] RECOVERY - Free space - all mounts on deployment-mediawiki-09 is OK: OK: All targets OK [00:14:39] RECOVERY - Free space - all mounts on deployment-restbase02 is OK: OK: deployment-prep.deployment-restbase02.diskspace._var_log.byte_percentfree (No valid datapoints found) [00:19:18] 10phan-taint-check-plugin: Ensure __CLASS__ doesn't end up in a filename - https://phabricator.wikimedia.org/T259986 (10Legoktm) p:05Triage→03Low [00:19:29] 10phan-taint-check-plugin: Use phan to ensure __CLASS__ doesn't end up in a filename - https://phabricator.wikimedia.org/T259986 (10Legoktm) [05:03:27] 10Phabricator, 10Release-Engineering-Team (Development services), 10Release-Engineering-Team-TODO (Release-Engineering-Team-TODO (2020-07-01 to 2020-09-30 (Q1))), 10Trust-and-Safety, 10User-greg: Remove Phabricator 2FA from AndyRussG - https://phabricator.wikimedia.org/T258842 (10AndyRussG) Thanks again! :) [06:40:39] 10Release-Engineering-Team, 10MediaWiki-Vagrant, 10Parsoid: Decide the fate of Parsoid/JS Puppet in Mediawiki-Vagrant - https://phabricator.wikimedia.org/T259988 (10VulpesVulpes825) [06:41:07] 10Release-Engineering-Team, 10MediaWiki-Vagrant, 10Parsoid: Decide the fate of Parsoid/JS Puppet in Mediawiki-Vagrant - https://phabricator.wikimedia.org/T259988 (10VulpesVulpes825) [06:41:55] 10Release-Engineering-Team, 10MediaWiki-Vagrant, 10Parsoid: Decide the fate of Parsoid/JS Puppet in Mediawiki-Vagrant - https://phabricator.wikimedia.org/T259988 (10VulpesVulpes825) [06:44:45] 10Release-Engineering-Team, 10MediaWiki-Vagrant, 10Parsoid, 10RESTBase: Support RESTBase using Parsoid/PHP in MediaWiki-Vagrant - https://phabricator.wikimedia.org/T259989 (10VulpesVulpes825) [06:45:17] 10Release-Engineering-Team, 10MediaWiki-Vagrant, 10Parsoid, 10RESTBase: Support RESTBase using Parsoid/PHP in MediaWiki-Vagrant - https://phabricator.wikimedia.org/T259989 (10VulpesVulpes825) [06:46:52] 10Release-Engineering-Team, 10MediaWiki-Vagrant, 10Parsoid, 10WMDE-Templates-FocusArea, 10Patch-For-Review: Support Parsoid/PHP in MediaWiki-Vagrant - https://phabricator.wikimedia.org/T258940 (10VulpesVulpes825) Adding #release-engineering-team based on [[ https://www.mediawiki.org/wiki/Developers/Maint... [06:48:27] 10Release-Engineering-Team, 10MediaWiki-Vagrant, 10Parsoid, 10WMDE-Templates-FocusArea, 10Patch-For-Review: Support Parsoid/PHP in MediaWiki-Vagrant - https://phabricator.wikimedia.org/T258940 (10VulpesVulpes825) The patch works flawlessly, but it is best for us to consider how we should be dealt with th... [08:28:28] PROBLEM - Host deployment-changeprop is DOWN: CRITICAL - Host Unreachable (172.16.5.21) [08:28:28] PROBLEM - Host deployment-cpjobqueue is DOWN: CRITICAL - Host Unreachable (172.16.4.124) [08:28:28] PROBLEM - Host deployment-chromium02 is DOWN: CRITICAL - Host Unreachable (172.16.4.14) [11:00:36] PROBLEM - Host deployment-mcs01 is DOWN: CRITICAL - Host Unreachable (172.16.5.64) [18:22:28] 10Release-Engineering-Team, 10MediaWiki-Vagrant, 10Parsoid, 10WMDE-Templates-FocusArea, 10Patch-For-Review: Support Parsoid/PHP in MediaWiki-Vagrant - https://phabricator.wikimedia.org/T258940 (10cscott) >>! In T258940#6337309, @awight wrote: > In the future this will be as simple as enabling one or two... [19:51:11] 10Phabricator, 10Documentation: Document workboard column triggers - https://phabricator.wikimedia.org/T227300 (10Aklapper) 05Open→03Resolved a:03Aklapper Documented: https://www.mediawiki.org/w/index.php?title=Phabricator/Project_management&type=revision&diff=4026918&oldid=3895183 [20:16:21] 10Phabricator: Spaces request for ...Tech Sr Leadership - https://phabricator.wikimedia.org/T259156 (10Aklapper) I was wrong; I did not have to join the ACL projects myself (and hence be able to look at tasks in the two Spaces) but only had to edit the "Can Edit" policy. I have given rights to @debt to edit the... [20:16:27] 10Release-Engineering-Team, 10MediaWiki-Vagrant, 10Parsoid, 10WMDE-Templates-FocusArea, 10Patch-For-Review: Support Parsoid/PHP in MediaWiki-Vagrant - https://phabricator.wikimedia.org/T258940 (10awight) (on the deployment strategy tangent,) >>! In T258940#6371425, @cscott wrote: > I don't actually view... [20:16:37] 10Phabricator: Spaces request for ...Tech Sr Leadership - https://phabricator.wikimedia.org/T259156 (10Aklapper) //In case// that the projects #WMF-CTO-Team-Backlog and #WMF-CTO-Admin-Sensitive and #wmf-cto-team-inprogress are not actively used anymore, * [all open tasks in these projects](https://phabricator.wi... [20:21:04] 10Release-Engineering-Team, 10MediaWiki-Vagrant, 10Parsoid, 10WMDE-Templates-FocusArea, 10Patch-For-Review: Support Parsoid/PHP in MediaWiki-Vagrant - https://phabricator.wikimedia.org/T258940 (10awight) This might be impossible, but now I'm thinking that an even more ideal migration strategy would be if... [21:35:41] 10Gerrit, 10Patch-For-Review: Use WMF Gerrit's logo as favicon - https://phabricator.wikimedia.org/T257218 (10QChris) Since it seems the second poll with the circled original gerrit did not happen, I'll try to move forward with the green git icon (winner of V21). [21:50:39] PROBLEM - Parsoid on deployment-parsoid11 is CRITICAL: connect to address 172.16.1.115 and port 8000: Connection refused [23:54:20] PROBLEM - Host deployment-sentry01 is DOWN: CRITICAL - Host Unreachable (172.16.5.16)