[01:00:44] <wikibugs>	 10serviceops, 10Parsoid: Request for additional disk space on testreduce1001 - https://phabricator.wikimedia.org/T296051 (10ssastry)
[01:04:46] <wikibugs>	 10serviceops, 10Parsoid: Request for additional disk space on testreduce1001 - https://phabricator.wikimedia.org/T296051 (10Dzahn) this is about testreduce1001, not scandium, ack?
[01:06:23] <wikibugs>	 10serviceops, 10Parsoid: Request for additional disk space on testreduce1001 - https://phabricator.wikimedia.org/T296051 (10ssastry) Yes. testreduce1001 has a local mysql db with the test set and test results .. and parsoid-rt* services run there.
[01:57:25] <wikibugs>	 10serviceops, 10decommission-hardware, 10Patch-For-Review: decommission thumbor200[12].codfw.wmnet - https://phabricator.wikimedia.org/T273141 (10ops-monitoring-bot) cookbooks.sre.hosts.decommission executed by legoktm@cumin1001 for hosts: `thumbor2001.codfw.wmnet` - thumbor2001.codfw.wmnet (**PASS**)   - Do...
[01:58:20] <wikibugs>	 10serviceops, 10decommission-hardware, 10Patch-For-Review: decommission thumbor200[12].codfw.wmnet - https://phabricator.wikimedia.org/T273141 (10Legoktm) 05Stalled→03Open
[09:03:29] <wikibugs>	 10serviceops, 10SRE, 10ops-codfw: decom mw2280 (was: mw2280 unresponsive to powercycle and hardreset) - https://phabricator.wikimedia.org/T290708 (10MoritzMuehlenhoff) >>! In T290708#7515390, @Dzahn wrote: > Regardless of the outcome we  would remove the existing broken one, I think.  Yeah, independent of a...
[10:43:59] <wikibugs>	 10serviceops, 10Service-Architecture: Standards and health score for existing and new services - https://phabricator.wikimedia.org/T88643 (10Aklapper) a:05wkandek→03None Removing inactive task assignee
[19:49:15] <wikibugs>	 10serviceops, 10SRE, 10ops-codfw, 10Patch-For-Review: decom mw2280 (was: mw2280 unresponsive to powercycle and hardreset) - https://phabricator.wikimedia.org/T290708 (10Dzahn) server was in zombie state. somehow already removed from puppetdb and icinga but still "found physical host" when I ran the decom c...
[19:50:14] <wikibugs>	 10serviceops, 10SRE, 10ops-codfw, 10Patch-For-Review: decom mw2280 (was: mw2280 unresponsive to powercycle and hardreset) - https://phabricator.wikimedia.org/T290708 (10Dzahn) ` Disable and reset vlan on asw-d3-codfw:ge-3/0/9 for local eno1 Delete IP 10.192.48.102/22 on eno1 Delete IP 2620:0:860:104:10:192...
[20:00:31] <wikibugs>	 10serviceops, 10SRE, 10ops-codfw, 10Patch-For-Review: decom mw2280 (was: mw2280 unresponsive to powercycle and hardreset) - https://phabricator.wikimedia.org/T290708 (10ops-monitoring-bot) cookbooks.sre.hosts.decommission executed by dzahn@cumin1001 for hosts: `mw2280.codfw.wmnet` - mw2280.codfw.wmnet (**F...
[20:03:43] <wikibugs>	 10serviceops, 10SRE, 10ops-codfw, 10Patch-For-Review: decom mw2280 (was: mw2280 unresponsive to powercycle and hardreset) - https://phabricator.wikimedia.org/T290708 (10Dzahn) As you can see above I ran the decom cookbook. Some things were somehow already removed. Others were not. It removed it from debmon...
[20:07:21] <wikibugs>	 10serviceops, 10SRE, 10ops-codfw, 10Patch-For-Review: decom mw2280 (was: mw2280 unresponsive to powercycle and hardreset) - https://phabricator.wikimedia.org/T290708 (10Dzahn) @Papaul This host can be recycled ;)
[20:20:30] <wikibugs>	 10serviceops, 10decommission-hardware, 10Patch-For-Review: decommission thumbor200[12].codfw.wmnet - https://phabricator.wikimedia.org/T273141 (10ops-monitoring-bot) cookbooks.sre.hosts.decommission executed by legoktm@cumin1001 for hosts: `thumbor2002.codfw.wmnet` - thumbor2002.codfw.wmnet (**PASS**)   - Do...
[20:21:33] <wikibugs>	 10serviceops, 10decommission-hardware, 10Patch-For-Review: decommission thumbor200[12].codfw.wmnet - https://phabricator.wikimedia.org/T273141 (10Legoktm)
[20:21:44] <wikibugs>	 10serviceops, 10decommission-hardware, 10ops-codfw, 10Patch-For-Review: decommission thumbor200[12].codfw.wmnet - https://phabricator.wikimedia.org/T273141 (10Legoktm)
[20:26:41] <wikibugs>	 10serviceops, 10Patch-For-Review: Productionise thumbor1005, thumbor1006, thumbor2005 and thumbor2006 - https://phabricator.wikimedia.org/T285477 (10Legoktm) 05Open→03Resolved Since the maintenance is taking longer than expected, I just went ahead with the codfw swap. Everything should be done now, the new...