[00:26:37] PROBLEM - Puppet run on deployment-kafka05 is CRITICAL: CRITICAL: 60.00% of data above the critical threshold [0.0] [01:01:36] RECOVERY - Puppet run on deployment-kafka05 is OK: OK: Less than 1.00% above the threshold [0.0] [02:42:36] PROBLEM - Puppet run on deployment-elastic08 is CRITICAL: CRITICAL: 22.22% of data above the critical threshold [0.0] [03:13:29] PROBLEM - Puppet run on deployment-cache-text04 is CRITICAL: CRITICAL: 40.00% of data above the critical threshold [0.0] [03:22:40] RECOVERY - Puppet run on deployment-elastic08 is OK: OK: Less than 1.00% above the threshold [0.0] [03:37:43] PROBLEM - Puppet run on deployment-ms-fe01 is CRITICAL: CRITICAL: 60.00% of data above the critical threshold [0.0] [03:53:29] RECOVERY - Puppet run on deployment-cache-text04 is OK: OK: Less than 1.00% above the threshold [0.0] [03:56:09] PROBLEM - Puppet run on integration-slave-jessie-1005 is CRITICAL: CRITICAL: 66.67% of data above the critical threshold [0.0] [04:12:44] RECOVERY - Puppet run on deployment-ms-fe01 is OK: OK: Less than 1.00% above the threshold [0.0] [04:15:22] PROBLEM - Puppet staleness on deployment-db1 is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [43200.0] [04:17:45] Yippee, build fixed! [04:17:45] Project selenium-MultimediaViewer ยป firefox,beta,Linux,contintLabsSlave && UbuntuTrusty build #152: 09FIXED in 21 min: https://integration.wikimedia.org/ci/job/selenium-MultimediaViewer/BROWSER=firefox,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=Linux,label=contintLabsSlave%20&&%20UbuntuTrusty/152/ [04:27:01] PROBLEM - Puppet staleness on deployment-db2 is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [43200.0] [04:31:10] RECOVERY - Puppet run on integration-slave-jessie-1005 is OK: OK: Less than 1.00% above the threshold [0.0] [06:44:48] 06Release-Engineering-Team (Deployment-Blockers), 05Release: MW-1.28.0-wmf.20 deployment blockers - https://phabricator.wikimedia.org/T144644#2665103 (10hashar) 05Open>03Resolved [09:36:54] PROBLEM - Puppet run on deployment-redis01 is CRITICAL: CRITICAL: 55.56% of data above the critical threshold [0.0] [10:11:53] RECOVERY - Puppet run on deployment-redis01 is OK: OK: Less than 1.00% above the threshold [0.0] [11:28:32] 06Release-Engineering-Team, 07Documentation, 07Easy: Merge Wikimedia's "Deployment checklist for new extensions" doc pages - https://phabricator.wikimedia.org/T142081#2522000 (10Mayank.jindal5) @greg @Aklapper I want to solve this issue. Can you provide some guidance how can I do this as this is my first ta... [12:14:33] PROBLEM - Puppet run on integration-slave-trusty-1003 is CRITICAL: CRITICAL: 44.44% of data above the critical threshold [0.0] [12:49:33] RECOVERY - Puppet run on integration-slave-trusty-1003 is OK: OK: Less than 1.00% above the threshold [0.0] [13:00:25] 10Gerrit: Gerrit needs a very wide screen or has big horizontal scroll - https://phabricator.wikimedia.org/T38471#2665410 (10Paladox) This is fixed in polygerrit and upstream I think are only taking bug fixes for the gwt skin. Polygerrit is mobile friendly, it resizes depending on screen size. It also resizes o... [14:08:29] 06Release-Engineering-Team, 07Documentation, 07Easy: Merge Wikimedia's "Deployment checklist for new extensions" doc pages - https://phabricator.wikimedia.org/T142081#2665474 (10Aklapper) @Mayank.jindal5: Thanks for your interest and help! See https://en.wikipedia.org/wiki/Wikipedia:Merging#How_to_merge basi... [14:36:00] PROBLEM - Puppet run on deployment-elastic07 is CRITICAL: CRITICAL: 40.00% of data above the critical threshold [0.0] [15:16:02] RECOVERY - Puppet run on deployment-elastic07 is OK: OK: Less than 1.00% above the threshold [0.0] [16:21:53] Not sure how much it's related to releng but It's not possible to connect to deployment-tin.deployment-prep.eqiad.wmflabs [16:21:59] for me [16:22:10] <|404> it's releng [16:22:17] <|404> lemme check if I can [16:23:12] Oh wait [16:23:15] <|404> Amir1: it's not only you [16:23:17] they changed it [16:23:18] to [16:23:19] tin2 [16:23:20] i think [16:23:21] <|404> ssh: connect to host deployment-tin port 22: No route to host [16:23:25] or mira [16:23:31] <|404> ssh: Could not resolve hostname deployment-tin2: Name or service not known [16:23:35] yep [16:23:45] <|404> mira works. [16:23:50] oh [16:23:52] https://wikitech.wikimedia.org/wiki/Special:Ask/-5B-5BResource-20Type::instance-5D-5D-5B-5BProject::deployment-2Dprep-5D-5D/-3F%3DFQDN-23/-3FInstance-20Type/-3FImage-20Id/-3FPublic-20IP/-3FNumber-20of-20CPUs/-3FRAM-20Size/-3FAmount-20of-20Storage/-3FModification-20date/format%3Dbroadtable/limit%3D20/offset%3D20/sort%3DModification-20date/order%3DDESC/mainlab [16:23:52] el%3DFQDN [16:23:55] <|404> and it doesn't throw a notice currently [16:23:58] one tin and no mira [16:24:08] https://wikitech.wikimedia.org/wiki/Nova_Resource:Deployment-prep [16:24:13] <|404> Amir1: I can connect to deployment-mira [16:24:14] (click on further results) [16:24:28] <|404> luke081515@deployment-mira:~$ [16:24:46] okay thanks. They should send announcement somewhere [16:24:58] deployment-mira [16:25:04] yep [16:25:42] See https://phabricator.wikimedia.org/T146505 [16:44:31] PROBLEM - Puppet run on deployment-cache-text04 is CRITICAL: CRITICAL: 33.33% of data above the critical threshold [0.0] [17:19:33] PROBLEM - Puppet run on deployment-apertium01 is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [0.0] [17:24:29] RECOVERY - Puppet run on deployment-cache-text04 is OK: OK: Less than 1.00% above the threshold [0.0] [17:26:44] PROBLEM - Puppet run on deployment-mx is CRITICAL: CRITICAL: 66.67% of data above the critical threshold [0.0] [17:53:58] PROBLEM - Puppet run on deployment-eventlogging03 is CRITICAL: CRITICAL: 20.00% of data above the critical threshold [0.0] [18:01:45] RECOVERY - Puppet run on deployment-mx is OK: OK: Less than 1.00% above the threshold [0.0] [18:24:21] PROBLEM - Host integration-puppetmaster is DOWN: CRITICAL - Host Unreachable (10.68.16.42) [18:33:58] RECOVERY - Puppet run on deployment-eventlogging03 is OK: OK: Less than 1.00% above the threshold [0.0] [18:54:50] PROBLEM - Puppet run on integration-slave-trusty-1004 is CRITICAL: CRITICAL: 22.22% of data above the critical threshold [0.0] [19:34:49] RECOVERY - Puppet run on integration-slave-trusty-1004 is OK: OK: Less than 1.00% above the threshold [0.0] [21:22:38] PROBLEM - Keyholder status on deployment-mira is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [0.0]