[00:01:06] (03PS1) 10Dduvall: Display more build info and fix project/build navigation [integration/raita] - 10https://gerrit.wikimedia.org/r/216344 [00:01:38] (03CR) 10Dduvall: [C: 032] Collapse steps when filtering by status [integration/raita] - 10https://gerrit.wikimedia.org/r/216010 (owner: 10Dduvall) [00:01:48] (03Merged) 10jenkins-bot: Collapse steps when filtering by status [integration/raita] - 10https://gerrit.wikimedia.org/r/216010 (owner: 10Dduvall) [00:01:52] (03CR) 10Dduvall: [C: 032] Navigation/filtering by project [integration/raita] - 10https://gerrit.wikimedia.org/r/216026 (owner: 10Dduvall) [00:01:59] (03Merged) 10jenkins-bot: Navigation/filtering by project [integration/raita] - 10https://gerrit.wikimedia.org/r/216026 (owner: 10Dduvall) [00:02:01] (03CR) 10Dduvall: [C: 032] Display more build info and fix project/build navigation [integration/raita] - 10https://gerrit.wikimedia.org/r/216344 (owner: 10Dduvall) [00:02:08] (03Merged) 10jenkins-bot: Display more build info and fix project/build navigation [integration/raita] - 10https://gerrit.wikimedia.org/r/216344 (owner: 10Dduvall) [00:14:12] (03PS1) 10Dduvall: Fix issue where switching projects doesn't load recent build [integration/raita] - 10https://gerrit.wikimedia.org/r/216348 [00:15:29] (03CR) 10Dduvall: [C: 032] Fix issue where switching projects doesn't load recent build [integration/raita] - 10https://gerrit.wikimedia.org/r/216348 (owner: 10Dduvall) [00:15:41] (03Merged) 10jenkins-bot: Fix issue where switching projects doesn't load recent build [integration/raita] - 10https://gerrit.wikimedia.org/r/216348 (owner: 10Dduvall) [00:18:24] 10Beta-Cluster, 10Wikimedia-Logstash, 5Patch-For-Review, 15User-Bd808-Test: Build jessie based elasticsearch/logstash/kibana (ELK) host for beta testing - https://phabricator.wikimedia.org/T101541#1342884 (10bd808) Built host deployment-logstash2.deployment-prep.eqiad.wmflabs based on the labs jessie image... [00:21:05] 10Beta-Cluster, 10Wikimedia-Logstash, 5Patch-For-Review, 15User-Bd808-Test: Build jessie based elasticsearch/logstash/kibana (ELK) host for beta testing - https://phabricator.wikimedia.org/T101541#1342886 (10bd808) [01:55:26] Project browsertests-CentralNotice-en.m.wikipedia.beta.wmflabs.org-os_x_10.10-iphone-sauce build #92: FAILURE in 1 min 25 sec: https://integration.wikimedia.org/ci/job/browsertests-CentralNotice-en.m.wikipedia.beta.wmflabs.org-os_x_10.10-iphone-sauce/92/ [02:07:13] PROBLEM - Puppet staleness on deployment-elastic07 is CRITICAL 100.00% of data above the critical threshold [43200.0] [02:25:35] Project browsertests-CentralNotice-en.m.wikipedia.beta.wmflabs.org-linux-android-sauce build #123: FAILURE in 3 min 34 sec: https://integration.wikimedia.org/ci/job/browsertests-CentralNotice-en.m.wikipedia.beta.wmflabs.org-linux-android-sauce/123/ [02:35:33] Yippee, build fixed! [02:35:34] Project browsertests-WikiLove-en.wikipedia.beta.wmflabs.org-linux-firefox-sauce build #594: FIXED in 2 min 33 sec: https://integration.wikimedia.org/ci/job/browsertests-WikiLove-en.wikipedia.beta.wmflabs.org-linux-firefox-sauce/594/ [03:24:08] Project browsertests-MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-firefox-sauce build #710: FAILURE in 42 min: https://integration.wikimedia.org/ci/job/browsertests-MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-firefox-sauce/710/ [04:32:41] Project browsertests-MultimediaViewer-en.wikipedia.beta.wmflabs.org-windows_7-internet_explorer-9-sauce build #461: FAILURE in 40 min: https://integration.wikimedia.org/ci/job/browsertests-MultimediaViewer-en.wikipedia.beta.wmflabs.org-windows_7-internet_explorer-9-sauce/461/ [06:37:48] PROBLEM - Puppet failure on integration-zuul-server is CRITICAL 40.00% of data above the critical threshold [0.0] [06:43:41] RECOVERY - Free space - all mounts on deployment-videoscaler01 is OK All targets OK [07:07:49] RECOVERY - Puppet failure on integration-zuul-server is OK Less than 1.00% above the threshold [0.0] [08:18:37] PROBLEM - Puppet staleness on deployment-videoscaler01 is CRITICAL 100.00% of data above the critical threshold [43200.0] [10:03:08] Project browsertests-Flow-en.wikipedia.beta.wmflabs.org-linux-chrome-monobook-sauce build #454: FAILURE in 42 min: https://integration.wikimedia.org/ci/job/browsertests-Flow-en.wikipedia.beta.wmflabs.org-linux-chrome-monobook-sauce/454/ [11:22:42] 10Beta-Cluster, 6Labs: Make it possible to run public queries against databases on beta cluster - https://phabricator.wikimedia.org/T99456#1343204 (10Glaisher) >>! In T99456#1327335, @hashar wrote: > Beta contains private data such as users IP addresses and emails. That is covered by the https://wikitech.wikim... [11:34:44] PROBLEM - Free space - all mounts on deployment-videoscaler01 is CRITICAL deployment-prep.deployment-videoscaler01.diskspace._var.byte_percentfree (<50.00%) [11:34:50] 10Beta-Cluster, 6Labs: Make it possible to run public queries against databases on beta cluster - https://phabricator.wikimedia.org/T99456#1343206 (10Multichill) I understand the background of this request, but it could probably be formulated better. You don't want access the databases in beta. You want to hav... [12:04:02] 10Beta-Cluster, 6Labs: Make it possible to run public queries against databases on beta cluster - https://phabricator.wikimedia.org/T99456#1343246 (10Glaisher) I was trying to reproduce a bug on the beta cluster (specifically there because it had to be done with Wikimedia-specific config and not on production... [12:36:46] PROBLEM - Free space - all mounts on deployment-bastion is CRITICAL deployment-prep.deployment-bastion.diskspace._var.byte_percentfree (<10.00%) [13:03:34] Project browsertests-MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-chrome-sauce build #674: FAILURE in 31 min: https://integration.wikimedia.org/ci/job/browsertests-MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-chrome-sauce/674/ [13:40:09] 10Beta-Cluster, 6Labs: Make sure labs ENC knows about cert changes - https://phabricator.wikimedia.org/T101124#1343314 (10Andrew) 5Open>3Resolved [14:56:45] PROBLEM - Free space - all mounts on deployment-bastion is CRITICAL deployment-prep.deployment-bastion.diskspace._var.byte_percentfree (<20.00%) [19:46:51] 6Release-Engineering, 10Wikimedia-Git-or-Gerrit: https://github.com/wikimedia/mediawiki/ release tags vanished - https://phabricator.wikimedia.org/T100409#1343611 (10Ricordisamoa) [21:01:19] (03PS1) 10Legoktm: Add composer-test jobs for at-ease repo [integration/config] - 10https://gerrit.wikimedia.org/r/216500 [21:03:29] (03CR) 10Legoktm: [C: 032] Add composer-test jobs for at-ease repo [integration/config] - 10https://gerrit.wikimedia.org/r/216500 (owner: 10Legoktm) [21:05:04] (03Merged) 10jenkins-bot: Add composer-test jobs for at-ease repo [integration/config] - 10https://gerrit.wikimedia.org/r/216500 (owner: 10Legoktm) [21:05:34] !log deploying https://gerrit.wikimedia.org/r/216500 [21:05:38] Logged the message, Master [21:08:08] Yippee, build fixed! [21:08:09] Project browsertests-Flow-en.wikipedia.beta.wmflabs.org-linux-chrome-sauce build #662: FIXED in 42 min: https://integration.wikimedia.org/ci/job/browsertests-Flow-en.wikipedia.beta.wmflabs.org-linux-chrome-sauce/662/ [23:31:20] PROBLEM - Puppet failure on deployment-pdf01 is CRITICAL 100.00% of data above the critical threshold [0.0] [23:31:24] PROBLEM - Puppet staleness on deployment-urldownloader is CRITICAL 100.00% of data above the critical threshold [43200.0] [23:31:44] PROBLEM - Puppet failure on deployment-cache-text02 is CRITICAL 100.00% of data above the critical threshold [0.0]