[05:00:57] <wikibugs>	 10DBA, 10Operations: Predictive failures on disk S.M.A.R.T. status - https://phabricator.wikimedia.org/T208323 (10Marostegui)
[05:01:04] <wikibugs>	 10DBA, 10Operations, 10ops-eqiad: db1070 (s5 master) SMART-reported impending drive failure - https://phabricator.wikimedia.org/T234115 (10CDanis)
[05:01:28] <cdanis>	 lol marostegui
[05:01:33] <cdanis>	 I'll close my task then
[05:01:42] <cdanis>	 didn't realize we had so many of these
[05:01:57] <cdanis>	 happened to notice before going to bed and was like "oh, that could be bad"
[05:02:39] <marostegui>	 cdanis!!! :)
[05:02:42] <wikibugs>	 10DBA, 10Operations, 10ops-eqiad: db1070 (s5 master) SMART-reported impending drive failure - https://phabricator.wikimedia.org/T234115 (10CDanis)
[05:02:46] <wikibugs>	 10DBA, 10Operations: Predictive failures on disk S.M.A.R.T. status - https://phabricator.wikimedia.org/T208323 (10CDanis)
[05:03:00] <marostegui>	 cdanis: Yeah, for the smart alerts which don't create tasks, we just leave them to fail so the automatic raid task is created
[05:03:37] <cdanis>	 we should generalize the workflow to make tickets automatically
[05:03:56] <marostegui>	 The tickets are done for raid degraded
[05:03:59] <marostegui>	 Not for smart alerts
[05:04:07] <marostegui>	 Sometimes the smart alert can be there for months
[05:04:20] <marostegui>	 And the disk can be working normally
[05:04:26] <cdanis>	 yeah, I'm saying there should be automatic tickets for more things :)
[05:04:31] <cdanis>	 haha
[05:04:35] <cdanis>	 20% chance of rain
[05:04:54] <marostegui>	 Specially on old hosts, we've seen that
[05:05:27] <marostegui>	 db1070 is a master as well, that we need to replace, I should actually get it scheduled
[05:05:45] <marostegui>	 cdanis: I do appreciate that you were creating a task though - thanks :-)
[05:05:48] <marostegui>	 <3
[05:05:49] <cdanis>	 I look forward to setting new records for readonly time ;)
[05:05:51] <cdanis>	 <3
[05:06:06] <marostegui>	 cdanis: the new tip of using cumin2001 will help to be under 50 seconds I am sure
[05:08:01] <cdanis>	 'dbctl instance all get' runs in about 5.3sec on cumin1001, and about 0.75sec on cumin2001
[05:08:03] <cdanis>	 it is really a lot faster
[05:09:25] * marostegui looking forward to setting a new record
[05:09:55] <marostegui>	 going to get breakfast, thanks for caring about our DBs <3 o/
[05:11:29] <cdanis>	 yeah I'm going to bed <3