[00:00:49] greg-g: that gdash thing only took a bit over a year to fix [00:00:57] * bd808 hangs his head [00:02:08] bd808: yeah :( it was a hot potato [00:07:20] (03PS1) 10BryanDavis: Switch beta udp2log host to deployment-fluorine [tools/scap] - 10https://gerrit.wikimedia.org/r/209830 (https://phabricator.wikimedia.org/T98289) [00:10:22] !log Cherry-picked https://gerrit.wikimedia.org/r/#/c/209830 to deployment-bastion:/srv/deployment/scap/scap and deployed with trebuchet [00:10:25] Logged the message, Master [00:10:38] (03CR) 10BryanDavis: "cherry-picked and deployed in beta" [tools/scap] - 10https://gerrit.wikimedia.org/r/209830 (https://phabricator.wikimedia.org/T98289) (owner: 10BryanDavis) [00:23:49] (03CR) 10Yuvipanda: [C: 031] Switch beta udp2log host to deployment-fluorine [tools/scap] - 10https://gerrit.wikimedia.org/r/209830 (https://phabricator.wikimedia.org/T98289) (owner: 10BryanDavis) [00:56:45] PROBLEM - Free space - all mounts on deployment-bastion is CRITICAL deployment-prep.deployment-bastion.diskspace._var.byte_percentfree (<33.33%) [01:08:20] 10Beta-Cluster, 6Labs, 5Patch-For-Review: Move logs off NFS on beta - https://phabricator.wikimedia.org/T98289#1274035 (10bd808) a:3bd808 I might as well take this at this point. :) [05:49:52] 10Deployment-Systems, 6Release-Engineering, 7Epic: Rethinking mediawiki deployment process - https://phabricator.wikimedia.org/T89945#1049275 (10mmodell) ok I updated the title to clarify that this was about mediawiki deployment, and even more specifically, it's more about the process than the tooling (tooli... [07:01:46] RECOVERY - Free space - all mounts on deployment-bastion is OK All targets OK [15:46:46] greg-g: the "operations-puppet-tox-py27" check keeps failing causing jenkins to -1 patches (don't know directly who to poke so) [16:17:50] PROBLEM - Free space - all mounts on deployment-bastion is CRITICAL deployment-prep.deployment-bastion.diskspace._var.byte_percentfree (<44.44%) [19:00:27] PROBLEM - Free space - all mounts on deployment-eventlogging02 is CRITICAL deployment-prep.deployment-eventlogging02.diskspace._var.byte_percentfree (<100.00%) [23:31:20] PROBLEM - Puppet failure on deployment-pdf01 is CRITICAL 100.00% of data above the critical threshold [0.0] [23:31:24] PROBLEM - Puppet staleness on deployment-urldownloader is CRITICAL 100.00% of data above the critical threshold [43200.0] [23:31:44] PROBLEM - Puppet failure on deployment-cache-text02 is CRITICAL 100.00% of data above the critical threshold [0.0]