[00:39:06] PROBLEM - SSH on deployment-conftool is CRITICAL: Server answer [01:04:08] RECOVERY - SSH on deployment-conftool is OK: SSH OK - OpenSSH_6.7p1 Debian-5+deb8u1 (protocol 2.0) [01:18:48] 3Scap3, 10scap: Need a way to restart services without deploying via scap - https://phabricator.wikimedia.org/T119449#2091998 (10mmodell) [02:08:32] 10Continuous-Integration-Infrastructure, 3Scap3, 10scap, 10Packaging: Develop a CI Testing and Release pipeline for the SCAP package (and potentially other debian packages that we maintain) - https://phabricator.wikimedia.org/T127741#2092085 (10mmodell) Ok this works now. The package gets installed in a re... [02:09:19] 10Continuous-Integration-Infrastructure, 3Scap3, 10scap, 10Packaging: Develop a CI Testing and Release pipeline for the SCAP package (and potentially other debian packages that we maintain) - https://phabricator.wikimedia.org/T127741#2092086 (10mmodell) [02:13:39] 10Continuous-Integration-Infrastructure, 3Scap3, 10scap, 10Packaging: Develop a CI Testing and Release pipeline for the SCAP package (and potentially other debian packages that we maintain) - https://phabricator.wikimedia.org/T127741#2092087 (10mmodell) [02:17:44] 10scap, 6Operations, 6Performance-Team, 7HHVM, 10Scap3 (Scap3-MediaWiki-MVP): Make scap able to depool/repool servers via the conftool API - https://phabricator.wikimedia.org/T104352#2092092 (10mmodell) [02:17:47] 6Release-Engineering-Team, 10scap, 6Operations, 10Scap3 (Scap3-MediaWiki-MVP): Depool proxies temporarily while scap is ongoing to avoid taxing those nodes - https://phabricator.wikimedia.org/T125629#2092091 (10mmodell) [02:19:15] 10scap, 10Scap3 (Scap3-MediaWiki-MVP), 7WorkType-NewFunctionality: Remove apache dependency from scap3 deployment host - https://phabricator.wikimedia.org/T116630#2092096 (10mmodell) [02:19:17] 10scap, 10Scap3 (Scap3-MediaWiki-MVP): Bring co-master / fanout capabilities to `deploy` and friends - https://phabricator.wikimedia.org/T121276#1874432 (10mmodell) [02:21:33] 10scap, 10Scap3 (Scap3-MediaWiki-MVP): refreshCdbJsonFiles should be rewritten in python - https://phabricator.wikimedia.org/T125685#2092099 (10mmodell) a:3thcipriani [02:24:17] 10scap, 10Scap3 (Scap3-MediaWiki-MVP), 7WorkType-NewFunctionality: Scap3 check to monitor logstash and detect changes in error frequency - https://phabricator.wikimedia.org/T110068#1568286 (10mmodell) p:5Normal>3Low [03:11:40] Project browsertests-MultimediaViewer-en.wikipedia.beta.wmflabs.org-linux-firefox-sauce build #898: 04FAILURE in 21 min: https://integration.wikimedia.org/ci/job/browsertests-MultimediaViewer-en.wikipedia.beta.wmflabs.org-linux-firefox-sauce/898/ [04:23:21] Project browsertests-MultimediaViewer-en.wikipedia.beta.wmflabs.org-windows_7-internet_explorer-9-sauce build #741: 04FAILURE in 31 min: https://integration.wikimedia.org/ci/job/browsertests-MultimediaViewer-en.wikipedia.beta.wmflabs.org-windows_7-internet_explorer-9-sauce/741/ [04:58:57] 10Continuous-Integration-Infrastructure, 3Scap3, 10scap, 10Packaging: Develop a CI Testing and Release pipeline for the SCAP package (and potentially other debian packages that we maintain) - https://phabricator.wikimedia.org/T127741#2092242 (10mmodell) [04:58:58] 10Deployment-Systems, 3Scap3: scap3 upstream/debian versioning - https://phabricator.wikimedia.org/T127828#2092241 (10mmodell) [05:26:45] Project browsertests-MultimediaViewer-en.wikipedia.beta.wmflabs.org-windows_7-internet_explorer-11-sauce build #718: 04FAILURE in 24 min: https://integration.wikimedia.org/ci/job/browsertests-MultimediaViewer-en.wikipedia.beta.wmflabs.org-windows_7-internet_explorer-11-sauce/718/ [05:42:06] PROBLEM - SSH on deployment-conftool is CRITICAL: Server answer [05:47:06] RECOVERY - SSH on deployment-conftool is OK: SSH OK - OpenSSH_6.7p1 Debian-5+deb8u1 (protocol 2.0) [05:53:06] PROBLEM - SSH on deployment-conftool is CRITICAL: Server answer [06:33:13] Project browsertests-VisualEditor-en.wikipedia.beta.wmflabs.org-linux-firefox-sauce build #36: 04FAILURE in 6 min 13 sec: https://integration.wikimedia.org/ci/job/browsertests-VisualEditor-en.wikipedia.beta.wmflabs.org-linux-firefox-sauce/36/ [08:58:07] RECOVERY - SSH on deployment-conftool is OK: SSH OK - OpenSSH_6.7p1 Debian-5+deb8u1 (protocol 2.0) [09:09:06] PROBLEM - SSH on deployment-conftool is CRITICAL: Server answer [10:18:27] (03PS3) 10Legoktm: Extension APC was discontinued [integration/config] - 10https://gerrit.wikimedia.org/r/274911 (owner: 10Siebrand) [10:18:45] (03CR) 10Legoktm: [C: 032] Extension APC was discontinued [integration/config] - 10https://gerrit.wikimedia.org/r/274911 (owner: 10Siebrand) [10:19:40] (03Merged) 10jenkins-bot: Extension APC was discontinued [integration/config] - 10https://gerrit.wikimedia.org/r/274911 (owner: 10Siebrand) [10:20:30] !log deploying https://gerrit.wikimedia.org/r/274911 [10:20:37] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL, Master [11:52:01] RECOVERY - Free space - all mounts on deployment-fluorine is OK: OK: All targets OK [12:39:08] RECOVERY - SSH on deployment-conftool is OK: SSH OK - OpenSSH_6.7p1 Debian-5+deb8u1 (protocol 2.0) [12:45:06] PROBLEM - SSH on deployment-conftool is CRITICAL: Server answer [12:54:48] Yippee, build fixed! [12:54:49] Project browsertests-GettingStarted-en.wikipedia.beta.wmflabs.org-linux-firefox-sauce build #783: 09FIXED in 48 sec: https://integration.wikimedia.org/ci/job/browsertests-GettingStarted-en.wikipedia.beta.wmflabs.org-linux-firefox-sauce/783/ [13:00:07] RECOVERY - SSH on deployment-conftool is OK: SSH OK - OpenSSH_6.7p1 Debian-5+deb8u1 (protocol 2.0) [13:06:07] PROBLEM - SSH on deployment-conftool is CRITICAL: Server answer [13:11:06] RECOVERY - SSH on deployment-conftool is OK: SSH OK - OpenSSH_6.7p1 Debian-5+deb8u1 (protocol 2.0) [15:27:57] 5Gerrit-Migration, 7Epic: Align Wikimedia and Phabricator code review processes - https://phabricator.wikimedia.org/T167#2092911 (10mmodell) [15:28:00] 5Gerrit-Migration: Identify features Gerrit users would miss in Phabricator - https://phabricator.wikimedia.org/T23#2092912 (10mmodell) [15:28:03] 5Gerrit-Migration, 10Differential: Define an equivalent to Gerrit's +-1 +-2 for code review evaluation - https://phabricator.wikimedia.org/T138#2092907 (10mmodell) 5Open>3declined Closing per greg's comment and developer summit consensus. [15:30:36] 10scap, 10Scap3 (Scap3-MediaWiki-MVP), 7WorkType-NewFunctionality: Remove apache dependency from scap3 deployment host - https://phabricator.wikimedia.org/T116630#2092916 (10mmodell) p:5Normal>3High [15:31:23] 10Deployment-Systems, 3Scap3: scap3 upstream/debian versioning - https://phabricator.wikimedia.org/T127828#2092921 (10mmodell) [15:31:25] 10Continuous-Integration-Infrastructure, 3Scap3, 10scap, 10Packaging: Develop a CI Testing and Release pipeline for the SCAP package (and potentially other debian packages that we maintain) - https://phabricator.wikimedia.org/T127741#2092920 (10mmodell) 5Open>3Resolved [15:44:05] PROBLEM - SSH on deployment-conftool is CRITICAL: Server answer [17:20:58] 5Gerrit-Migration, 10Differential, 7Documentation: Document best practices to amend a change written by another contributor - https://phabricator.wikimedia.org/T121751#2093057 (10mmodell) >>! In T121751#1910137, @Luke081515 wrote: > The problem: > In gerrit, you can correct a mistake made by a user, or corre... [18:34:07] RECOVERY - SSH on deployment-conftool is OK: SSH OK - OpenSSH_6.7p1 Debian-5+deb8u1 (protocol 2.0) [18:40:05] PROBLEM - SSH on deployment-conftool is CRITICAL: Server answer [19:10:07] RECOVERY - SSH on deployment-conftool is OK: SSH OK - OpenSSH_6.7p1 Debian-5+deb8u1 (protocol 2.0) [19:16:06] PROBLEM - SSH on deployment-conftool is CRITICAL: Server answer [19:26:07] RECOVERY - SSH on deployment-conftool is OK: SSH OK - OpenSSH_6.7p1 Debian-5+deb8u1 (protocol 2.0) [20:53:05] PROBLEM - SSH on deployment-conftool is CRITICAL: Server answer [21:17:21] 5Gerrit-Migration, 10Differential, 7Documentation: Document best practices to amend a change written by another contributor - https://phabricator.wikimedia.org/T121751#2093243 (10Luke081515) But not the commit content, for example if a user made a little mistake :-/ [21:59:16] PROBLEM - Host cache-rsync is DOWN: CRITICAL - Host Unreachable (10.68.23.165) [22:39:45] Yippee, build fixed! [22:39:46] Project browsertests-Flow-en.wikipedia.beta.wmflabs.org-linux-firefox-sauce build #978: 09FIXED in 28 min: https://integration.wikimedia.org/ci/job/browsertests-Flow-en.wikipedia.beta.wmflabs.org-linux-firefox-sauce/978/ [23:22:09] Yippee, build fixed! [23:22:09] Project browsertests-VisualEditor-en.wikipedia.beta.wmflabs.org-linux-firefox-sauce-T128731 build #15: 09FIXED in 7 min 8 sec: https://integration.wikimedia.org/ci/job/browsertests-VisualEditor-en.wikipedia.beta.wmflabs.org-linux-firefox-sauce-T128731/15/