[00:01:27] <wikibugs>	 10Beta-Cluster, 10Sentry: Integrate Sentry with beta cluster - https://phabricator.wikimedia.org/T106920#1481667 (10Tgr) 3NEW
[00:01:43] <wikibugs>	 10Beta-Cluster, 10Sentry: Integrate Sentry with beta cluster - https://phabricator.wikimedia.org/T106920#1481675 (10Tgr)
[00:03:27] <wikibugs>	 10Beta-Cluster, 10Sentry, 10Wikimedia-Logstash: Channel PHP errors from Logstash to Sentry on the beta cluster - https://phabricator.wikimedia.org/T85239#1481680 (10Tgr)
[00:03:29] <wikibugs>	 6Release-Engineering, 6Reading-Infrastructure-Team, 10Sentry, 5Patch-For-Review, and 2 others: Create basic puppet role for Sentry - https://phabricator.wikimedia.org/T84956#1481681 (10Tgr)
[00:03:31] <wikibugs>	 10Beta-Cluster, 10Sentry: Integrate Sentry with beta cluster - https://phabricator.wikimedia.org/T106920#1481667 (10Tgr)
[00:04:37] <wikibugs>	 10Beta-Cluster, 10Sentry: Integrate Sentry with beta cluster - https://phabricator.wikimedia.org/T106920#1481688 (10Tgr) p:5Triage>3Normal
[00:04:59] <wikibugs>	 6Release-Engineering, 6Reading-Infrastructure-Team, 10Sentry, 5Patch-For-Review, and 2 others: Create basic puppet role for Sentry - https://phabricator.wikimedia.org/T84956#1481690 (10Tgr) p:5Normal>3High
[00:25:39] <James_F>	 greg-g: We totally need https://secure.phabricator.com/fund/ installed for WMF Phabricator. It would be totally rational. ;-)
[00:27:05] <JohnFLewis>	 James_F: move all fundraising to phabricator :)
[00:28:51] <James_F>	 JohnFLewis: No no no. Do all current fundraising to do what we're doing anyway, plus PhabricatorFunding for community-angst bugs we don't care about. ;-)
[00:29:16] <JohnFLewis>	 smart idea ;)
[00:31:34] <JohnFLewis>	 James_F: first one has to be called 'Outsource people to solve https://phabricator.wikimedia.org/T2001'
[00:31:37] <James_F>	 E.g. https://phabricator.wikimedia.org/T2006
[00:31:42] <James_F>	 JohnFLewis: Meh.
[00:31:49] <James_F>	 T2001 is a neverending task.
[00:31:55] <James_F>	 T2006 is an actual feature request.
[00:33:10] <JohnFLewis>	 2001 is neverending so will mean I1 is never done, which syncs with the first bugzilla task never being finished
[00:33:25] * James_F grins.
[00:35:19] <shinken-wm>	 PROBLEM - Free space - all mounts on deployment-bastion is CRITICAL deployment-prep.deployment-bastion.diskspace._var.byte_percentfree (<11.11%)
[01:40:21] <shinken-wm>	 RECOVERY - Free space - all mounts on deployment-bastion is OK All targets OK
[01:48:30] <grrrit-wm>	 (03PS1) 10Dduvall: Expose client cookies [ruby/api] - 10https://gerrit.wikimedia.org/r/226949 
[01:49:23] <grrrit-wm>	 (03PS1) 10Dduvall: WIP Login helper for fast API-based authentication [selenium] - 10https://gerrit.wikimedia.org/r/226950 
[01:49:47] <grrrit-wm>	 (03CR) 10jenkins-bot: [V: 04-1] WIP Login helper for fast API-based authentication [selenium] - 10https://gerrit.wikimedia.org/r/226950 (owner: 10Dduvall)
[01:50:45] <grrrit-wm>	 (03CR) 10Dduvall: "recheck" [selenium] - 10https://gerrit.wikimedia.org/r/226950 (owner: 10Dduvall)
[02:35:41] <wmf-insecte>	 Project browsertests-WikiLove-en.wikipedia.beta.wmflabs.org-linux-firefox-sauce build #643: FAILURE in 2 min 40 sec: https://integration.wikimedia.org/ci/job/browsertests-WikiLove-en.wikipedia.beta.wmflabs.org-linux-firefox-sauce/643/
[03:01:41] <wikibugs>	 6Release-Engineering, 10Gerrit-Migration, 10Gitblit-Deprecate: Import all gerrit.wikimedia.org repositories with Diffusion - https://phabricator.wikimedia.org/T616#1481914 (10demon) >>! In T616#1480368, @mmodell wrote: > Our callsign naming conventions make no sense and limiting callsigns to 4 characters ser...
[03:25:54] <wikibugs>	 6Release-Engineering, 10Gerrit-Migration, 10Gitblit-Deprecate: Import all gerrit.wikimedia.org repositories with Diffusion - https://phabricator.wikimedia.org/T616#1481922 (10mmodell) >>! In T616#1481914, @demon wrote: >>>! In T616#1480368, @mmodell wrote: >> Our callsign naming conventions make no sense and...
[06:27:33] <wmf-insecte>	 Yippee, build fixed!
[06:27:33] <wmf-insecte>	 Project browsertests-Core-en.wikipedia.beta.wmflabs.org-linux-firefox-sauce build #691: FIXED in 8 min 32 sec: https://integration.wikimedia.org/ci/job/browsertests-Core-en.wikipedia.beta.wmflabs.org-linux-firefox-sauce/691/
[07:00:34] <shinken-wm>	 RECOVERY - Free space - all mounts on deployment-videoscaler01 is OK All targets OK
[08:21:22] <wmf-insecte>	 Project browsertests-CirrusSearch-en.wikipedia.beta.wmflabs.org-linux-firefox-sauce build #653: FAILURE in 1 min 22 sec: https://integration.wikimedia.org/ci/job/browsertests-CirrusSearch-en.wikipedia.beta.wmflabs.org-linux-firefox-sauce/653/
[09:22:27] <shinken-wm>	 PROBLEM - Puppet failure on deployment-mx is CRITICAL 100.00% of data above the critical threshold [0.0]
[09:51:28] <wikibugs>	 6Release-Engineering, 6Commons, 10MediaWiki-File-management, 10MediaWiki-Tarball-Backports, and 7 others: InstantCommons broken by switch to HTTPS - https://phabricator.wikimedia.org/T102566#1482066 (10Tau) Finnally I managed to get the logging enabled.  1) I did  `chmod -R a+rw /var/log/mediawiki` - still...
[12:24:28] <wikibugs>	 6Release-Engineering, 6Commons, 10MediaWiki-File-management, 10MediaWiki-Tarball-Backports, and 7 others: InstantCommons broken by switch to HTTPS - https://phabricator.wikimedia.org/T102566#1482218 (10Nemo_bis) > BUT no such phrase as ForeignAPIRepo is included in it. How to get it?  Have you tried loadin...
[12:59:41] <wmf-insecte>	 Project browsertests-MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-chrome-sauce build #727: SUCCESS in 27 min: https://integration.wikimedia.org/ci/job/browsertests-MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-chrome-sauce/727/
[13:56:30] <shinken-wm>	 PROBLEM - Free space - all mounts on deployment-videoscaler01 is CRITICAL deployment-prep.deployment-videoscaler01.diskspace._var.byte_percentfree (<10.00%)
[15:23:28] <shinken-wm>	 PROBLEM - Puppet failure on deployment-cache-bits01 is CRITICAL 100.00% of data above the critical threshold [0.0]
[16:27:35] <grrrit-wm>	 (03PS1) 10Paladox: Update Apex tests [integration/config] - 10https://gerrit.wikimedia.org/r/226994 
[16:27:49] <grrrit-wm>	 (03PS2) 10Paladox: Update Apex tests [integration/config] - 10https://gerrit.wikimedia.org/r/226994 
[16:28:53] <grrrit-wm>	 (03PS3) 10Paladox: Update Apex tests [integration/config] - 10https://gerrit.wikimedia.org/r/226994 
[16:31:47] <grrrit-wm>	 (03PS1) 10Paladox: Add extension-unittests-generic to metrolook [integration/config] - 10https://gerrit.wikimedia.org/r/226995 
[16:31:57] <grrrit-wm>	 (03PS2) 10Paladox: Add extension-unittests-generic to metrolook [integration/config] - 10https://gerrit.wikimedia.org/r/226995 
[18:07:49] <shinken-wm>	 PROBLEM - Free space - all mounts on deployment-fluorine is CRITICAL deployment-prep.deployment-fluorine.diskspace.root.byte_percentfree (<100.00%)
[20:23:50] <shinken-wm>	 PROBLEM - Puppet staleness on deployment-apertium01 is CRITICAL 100.00% of data above the critical threshold [43200.0]
[20:31:43] <shinken-wm>	 PROBLEM - Puppet staleness on deployment-fluorine is CRITICAL 100.00% of data above the critical threshold [43200.0]
[20:46:21] <shinken-wm>	 PROBLEM - Free space - all mounts on deployment-bastion is CRITICAL deployment-prep.deployment-bastion.diskspace._var.byte_percentfree (<22.22%)
[21:18:27] <shinken-wm>	 PROBLEM - Puppet failure on deployment-parsoidcache02 is CRITICAL 100.00% of data above the critical threshold [0.0]
[21:20:35] <shinken-wm>	 PROBLEM - Free space - all mounts on integration-slave-trusty-1015 is CRITICAL integration.integration-slave-trusty-1015.diskspace._mnt.byte_percentfree (<100.00%)
[21:26:15] <shinken-wm>	 PROBLEM - Puppet failure on deployment-cache-text03 is CRITICAL 100.00% of data above the critical threshold [0.0]
[21:38:46] <shinken-wm>	 PROBLEM - Puppet staleness on deployment-restbase01 is CRITICAL 100.00% of data above the critical threshold [43200.0]
[23:42:27] <wikibugs>	 10Beta-Cluster, 10Continuous-Integration-Config, 10Math: beta-recompile-math-texvc-eqiad job fails with "/usr/local/bin/scap-recompile: No such file or directory" - https://phabricator.wikimedia.org/T91191#1482905 (10Physikerwelt)
[23:46:43] <wikibugs>	 10Beta-Cluster, 10Continuous-Integration-Config, 10Math: beta-recompile-math-texvc-eqiad job fails with "/usr/local/bin/scap-recompile: No such file or directory" - https://phabricator.wikimedia.org/T91191#1482909 (10Physikerwelt) by the way I agree on low priority of this task. Following the argumentation o...