[09:47:22] <wikibugs>	 10DBA, 10Operations, 10Packaging: db2085 doesn't boot with 4.9.0-8-amd64 - https://phabricator.wikimedia.org/T214840 (10jcrespo) db2089 failed once when rebooted into `4.9.0-8-amd64`, worked a second time. Worried because it maybe a random thing?
[14:13:53] <wikibugs>	 10DBA, 10Operations, 10Packaging: db2085 doesn't boot with 4.9.0-8-amd64 - https://phabricator.wikimedia.org/T214840 (10Marostegui) I had a chat with Mortiz about this we he was not too sure it would be a kernel thing itself as in something really wrong with the kernel or maybe some sort of hardware thing or...
[14:15:37] <wikibugs>	 10DBA, 10Operations, 10Packaging: db2085 doesn't boot with 4.9.0-8-amd64 - https://phabricator.wikimedia.org/T214840 (10jcrespo) db2085 and db2089 come likely from the same batch, and no other batch showed those issues, so it may be happening only on those hosts.
[14:43:40] <wikibugs>	 10DBA, 10Operations, 10Packaging: db2085 doesn't boot with 4.9.0-8-amd64 - https://phabricator.wikimedia.org/T214840 (10MoritzMuehlenhoff) We could narrow this down further by enabling debug flags for the initrd, I don't remember the specific options out of the top of my head, but we can look into this next...
[17:46:39] <jynus>	 I've upgraded all codfw databases to 10.1.37 except db2044, which is still running the otrs backups
[21:55:53] <wikibugs>	 10DBA, 10Operations, 10ops-eqiad, 10Patch-For-Review: db1114 crashed - https://phabricator.wikimedia.org/T214720 (10Cmjohnson) @jcrespo  I can update f/w if you need but you will need to depool the host again
[22:58:59] <wikibugs>	 10DBA, 10Operations, 10ops-eqiad, 10Patch-For-Review, 10User-Marostegui: rack/setup/install db11[26-38].eqiad.wmnet - https://phabricator.wikimedia.org/T211613 (10Cmjohnson)