[00:02:20] 10Deployment-Systems: scap-purge-l10n-cache is broken - https://phabricator.wikimedia.org/T118659#1806057 (10Reedy) [00:12:30] PUSH STAGING Pushing changes to staging area... [00:12:30] Username for 'https://phabricator.wikimedia.org': [00:12:30] Password for 'https://phabricator.wikimedia.org': [00:12:30] fatal: unable to access 'https://phabricator.wikimedia.org/diffusion/PHSTAGE/harbormaster-staging.git/': The requested URL returned error: 403 [00:12:30] STAGING FAILED Unable to push changes to the staging area. [00:12:31] Updated an existing Differential revision: [00:12:34] Revision URI: https://phabricator.wikimedia.org/D50 [00:12:36] What does this even mean? [00:13:11] What password is it? [00:13:20] ldap? mw? some phab specific/ [00:13:30] https://phabricator.wikimedia.org/D50 [00:16:07] I think the password is from https://phabricator.wikimedia.org/settings/panel/vcspassword/ Reedy [00:16:19] I just got that far [00:17:51] Krenair: yup, it is [00:18:03] To https://phabricator.wikimedia.org/diffusion/PHSTAGE/harbormaster-staging.git [00:18:03] * [new tag] c1d3ab567ef388baf04f05657f25413ab7c32953 -> phabricator/diff/159 [00:18:03] STAGING PUSHED Pushed a copy of the changes to tag "phabricator/diff/159" in the staging area. [00:18:03] Updated an existing Differential revision: [00:18:03] Revision URI: https://phabricator.wikimedia.org/D50 [00:18:31] Hmm [00:18:33] What's this? [00:18:33] [2015-11-15 00:17:33] ERROR 2: DOMDocument::loadXML(): Empty string supplied as input at [/usr/share/arcanist/src/unit/engine/NoseTestEngine.php:120] [00:19:53] 10Deployment-Systems: DOMDocument::loadXML(): Empty string supplied as input at [/usr/share/arcanist/src/unit/engine/NoseTestEngine.php:120] - https://phabricator.wikimedia.org/T118665#1806060 (10Reedy) 3NEW [00:19:56] Filed [00:22:17] Why do you have to login to phab to view https://phabricator.wikimedia.org/D50 ? [00:24:48] typical phab [00:24:50] file a bug [00:25:17] It's marked as public [00:26:23] https://phabricator.wikimedia.org/T118666#1806071 [00:27:52] Krenair: What about files? [00:28:02] I seem to recall one for those too [00:28:04] https://phabricator.wikimedia.org/F2964563 needs login [00:28:27] Made it public [00:29:40] 5Gerrit-Migration, 6Phabricator: Have to login to view differential stuff - https://phabricator.wikimedia.org/T118666#1806079 (10Krenair) [00:30:10] IIRC files start as private to the uploader, but are viewable by anyone who can see any object it's attached on [00:30:19] or something [00:30:24] Yeah [00:31:43] 10Differential, 6Phabricator: Have to login to view differential stuff - https://phabricator.wikimedia.org/T118666#1806083 (10greg) odddd...... @mmodell ? [00:32:14] 10Differential, 5Gerrit-Migration, 6Phabricator: Have to login to view differential stuff - https://phabricator.wikimedia.org/T118666#1806086 (10Reedy) [00:33:14] tested in incognito mode etc [00:54:32] 5Gerrit-Migration, 6Phabricator: Disable policies on Differential - https://phabricator.wikimedia.org/T118669#1806107 (10Krenair) 3NEW [01:20:55] Reedy: Lemme double check. [01:21:08] Ah, I see T118669 [01:23:09] 10Differential, 5Gerrit-Migration, 6Phabricator: Have to login to view differential stuff - https://phabricator.wikimedia.org/T118666#1806163 (10demon) 5Open>3Resolved a:3demon Default view/use policy was set to All Users instead of Public. Probably old defaults or from early testing. This should now b... [01:23:21] Krenair: Fixed that part. [01:25:48] 5Gerrit-Migration, 6Phabricator: Disable policies on Differential - https://phabricator.wikimedia.org/T118669#1806167 (10demon) p:5Triage>3Normal [01:33:24] 10Deployment-Systems: scap-purge-l10n-cache is broken - https://phabricator.wikimedia.org/T118659#1806180 (10demon) 5Open>3Resolved a:3demon [01:33:48] It's not deployed yet ;) [01:34:44] https://phabricator.wikimedia.org/diffusion/MSCA/browse/master/ [01:34:49] ascii art is broken :P [01:37:01] Project browsertests-Wikidata-SmokeTests-linux-firefox-sauce build #441: 04FAILURE in 20 min: https://integration.wikimedia.org/ci/job/browsertests-Wikidata-SmokeTests-linux-firefox-sauce/441/ [01:37:08] 10Differential: Using HTTPS credentials to push to staging after cloning via HTTPS is counter-intuitive - https://phabricator.wikimedia.org/T118672#1806182 (10Reedy) 3NEW [03:16:07] Yippee, build fixed! [03:16:07] Project browsertests-MultimediaViewer-en.wikipedia.beta.wmflabs.org-linux-firefox-sauce build #780: 09FIXED in 26 min: https://integration.wikimedia.org/ci/job/browsertests-MultimediaViewer-en.wikipedia.beta.wmflabs.org-linux-firefox-sauce/780/ [04:21:18] Project beta-update-databases-eqiad build #4395: 04FAILURE in 1 min 18 sec: https://integration.wikimedia.org/ci/job/beta-update-databases-eqiad/4395/ [05:22:29] Yippee, build fixed! [05:22:30] Project beta-update-databases-eqiad build #4396: 09FIXED in 2 min 28 sec: https://integration.wikimedia.org/ci/job/beta-update-databases-eqiad/4396/ [05:29:55] Yippee, build fixed! [05:29:55] Project browsertests-MultimediaViewer-en.wikipedia.beta.wmflabs.org-windows_7-internet_explorer-11-sauce build #603: 09FIXED in 27 min: https://integration.wikimedia.org/ci/job/browsertests-MultimediaViewer-en.wikipedia.beta.wmflabs.org-windows_7-internet_explorer-11-sauce/603/ [06:39:26] RECOVERY - Free space - all mounts on deployment-bastion is OK: OK: All targets OK [09:38:28] Project browsertests-Echo-en.wikipedia.beta.wmflabs.org-linux-chrome-sauce build #674: 04FAILURE in 1 min 27 sec: https://integration.wikimedia.org/ci/job/browsertests-Echo-en.wikipedia.beta.wmflabs.org-linux-chrome-sauce/674/ [09:57:26] PROBLEM - Host deployment-cache-parsoid04 is DOWN: CRITICAL - Host Unreachable (10.68.19.197) [12:55:01] Project browsertests-GettingStarted-en.wikipedia.beta.wmflabs.org-linux-firefox-sauce build #660: 04FAILURE in 1 min 0 sec: https://integration.wikimedia.org/ci/job/browsertests-GettingStarted-en.wikipedia.beta.wmflabs.org-linux-firefox-sauce/660/ [13:01:45] Project browsertests-MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-chrome-sauce build #849: 04FAILURE in 29 min: https://integration.wikimedia.org/ci/job/browsertests-MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-chrome-sauce/849/ [14:09:10] twentyafterfour: Is there any progress at the moment in T117441? [14:14:34] (03PS1) 10Paladox: [WikiEditor] Migrate to extensions gate [integration/config] - 10https://gerrit.wikimedia.org/r/253165 [14:16:02] (03PS1) 10Paladox: [CodeEditor] Migrate to extensions gate [integration/config] - 10https://gerrit.wikimedia.org/r/253166 [14:17:06] (03PS2) 10Paladox: [CodeEditor] Migrate to extensions gate [integration/config] - 10https://gerrit.wikimedia.org/r/253166 [14:18:18] (03CR) 10jenkins-bot: [V: 04-1] [CodeEditor] Migrate to extensions gate [integration/config] - 10https://gerrit.wikimedia.org/r/253166 (owner: 10Paladox) [14:21:39] (03PS3) 10Paladox: [CodeEditor] Migrate to extensions gate [integration/config] - 10https://gerrit.wikimedia.org/r/253166 [14:22:49] (03CR) 10jenkins-bot: [V: 04-1] [CodeEditor] Migrate to extensions gate [integration/config] - 10https://gerrit.wikimedia.org/r/253166 (owner: 10Paladox) [14:28:10] Project browsertests-Echo-en.wikipedia.beta.wmflabs.org-linux-firefox-sauce build #691: 04FAILURE in 2 min 10 sec: https://integration.wikimedia.org/ci/job/browsertests-Echo-en.wikipedia.beta.wmflabs.org-linux-firefox-sauce/691/ [16:04:44] 10Deployment-Systems, 6Release-Engineering-Team, 3Scap3: scap creating directories owned by root on mira - https://phabricator.wikimedia.org/T118691#1806687 (10Reedy) 3NEW [16:06:06] 10Deployment-Systems, 6Release-Engineering-Team, 3Scap3: scap creating directories owned by root on mira - https://phabricator.wikimedia.org/T118691#1806694 (10Reedy) NB I deleted the php-1.26 directories from mira manually [16:24:37] why is ganglia monitor taking 100% cpu on deployment-zookeeper01? what the heck is that host anyway? [16:25:14] Isn't it hadoop stuff? [17:42:01] 10Differential, 5Gerrit-Migration, 6Phabricator: Have to login to view differential stuff - https://phabricator.wikimedia.org/T118666#1806723 (10Negative24) @demon So instead of it being a "default" policy its a master policy that will override a more relaxed (specific) policy? [19:47:25] This https://integration.wikimedia.org/zuul/ seems to have been frozen. [20:00:11] 10Differential, 5Gerrit-Migration, 6Phabricator: Have to login to view differential stuff - https://phabricator.wikimedia.org/T118666#1806774 (10Luke081515) Yeah, that's true. If you set all to public, but the "Can use application" setting is not pulic, it will override **all**. [20:02:23] PROBLEM - Free space - all mounts on deployment-bastion is CRITICAL: CRITICAL: deployment-prep.deployment-bastion.diskspace._var.byte_percentfree (<66.67%) [20:02:47] 10Differential, 5Gerrit-Migration, 6Phabricator: Have to login to view differential stuff - https://phabricator.wikimedia.org/T118666#1806784 (10Luke081515) 5Resolved>3Open Please set "Can use" policy of [[https://phabricator.wikimedia.org/applications/view/PhabricatorAuditApplication/|audit]] to public... [20:02:55] 10Differential, 5Gerrit-Migration, 6Phabricator: Have to login to view differential stuff - https://phabricator.wikimedia.org/T118666#1806786 (10Luke081515) a:5demon>3None [20:42:15] Luke081515: No progress to speak of but it's on my radar, I should be able to work on it soon (re T117441) [20:42:28] ok, thanks [21:20:35] Yippee, build fixed! [21:20:35] Project browsertests-QuickSurveys-en.m.wikipedia.beta.wmflabs.org-linux-chrome-sauce build #71: 09FIXED in 4 min 34 sec: https://integration.wikimedia.org/ci/job/browsertests-QuickSurveys-en.m.wikipedia.beta.wmflabs.org-linux-chrome-sauce/71/ [21:52:04] (03PS1) 10Legoktm: Configure jobs for NoBogusUserpages extension [integration/config] - 10https://gerrit.wikimedia.org/r/253277 [21:56:13] (03CR) 10Legoktm: [C: 032] Configure jobs for NoBogusUserpages extension [integration/config] - 10https://gerrit.wikimedia.org/r/253277 (owner: 10Legoktm) [21:59:23] (03Merged) 10jenkins-bot: Configure jobs for NoBogusUserpages extension [integration/config] - 10https://gerrit.wikimedia.org/r/253277 (owner: 10Legoktm) [22:03:54] !log deploying https://gerrit.wikimedia.org/r/253277 [23:54:53] PROBLEM - Puppet failure on pmcache is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [0.0]