[06:12:20] <wikibugs>	 10DBA, 10Operations, 10Puppet, 10User-jbond: DB: perform rolling restart of mariadb deamons to pick up CA changes - https://phabricator.wikimedia.org/T239791 (10Marostegui)
[06:12:22] <wikibugs>	 10DBA: Switchover s8 primary database master db1109 -> db1104 - Date TBD - https://phabricator.wikimedia.org/T239238 (10Marostegui)
[06:12:24] <wikibugs>	 10DBA: Failover DB masters in row D - https://phabricator.wikimedia.org/T186188 (10Marostegui)
[06:12:26] <wikibugs>	 10Blocked-on-schema-change, 10DBA, 10Wikidata: Schema change on production for increase the size of wbt_text_in_lang.wbxl_language - https://phabricator.wikimedia.org/T237120 (10Marostegui)
[06:13:52] <wikibugs>	 10DBA: Remove partitions from revision table - https://phabricator.wikimedia.org/T239453 (10Marostegui)
[07:41:04] <wikibugs>	 10DBA: Enable replication codfw -> eqiad before the switchover - https://phabricator.wikimedia.org/T243373 (10Marostegui)
[07:41:16] <wikibugs>	 10DBA: Enable replication codfw -> eqiad before the switchover - https://phabricator.wikimedia.org/T243373 (10Marostegui) p:05Triage→03Normal
[07:41:33] <wikibugs>	 10DBA: Enable DB replication codfw -> eqiad before the switchover - https://phabricator.wikimedia.org/T243373 (10Marostegui)
[07:57:33] <wikibugs>	 10DBA: Enable DB replication codfw -> eqiad before the switchover - https://phabricator.wikimedia.org/T243373 (10Marostegui)
[08:05:46] <wikibugs>	 10DBA: Enable DB replication eqiad -> codfw before the switchover - https://phabricator.wikimedia.org/T243374 (10Marostegui)
[08:06:02] <wikibugs>	 10DBA: Enable DB replication eqiad -> codfw before the switchover - https://phabricator.wikimedia.org/T243374 (10Marostegui) p:05Triage→03Normal a:05RLazarus→03None
[08:24:58] <wikibugs>	 10DBA, 10Operations, 10ops-eqiad: (Needed by 31st January) eqiad: rack/setup/install  es102[0-5].eqiad.wmnet - https://phabricator.wikimedia.org/T241359 (10Marostegui) >>! In T241359#5809112, @Marostegui wrote: > You guys think this will be ready by 31st Jan? > Thanks.  Any ETA on when we can expect these ho...
[09:39:00] <wikibugs>	 10DBA: Compress new Wikibase tables - https://phabricator.wikimedia.org/T232446 (10Marostegui)
[15:22:34] <wikibugs>	 10DBA, 10Operations, 10ops-codfw: db2085 crashed - memory issues - https://phabricator.wikimedia.org/T243148 (10Papaul) a:05Papaul→03Marostegui Before ` BIOS Version  2.9.1 Firmware Version  2.61.60.60 ` After BIOS Version  2.11.0 Firmware Version  2.70.70.70  @Marostegui  FW upgrade complete
[15:29:40] <wikibugs>	 10DBA, 10Operations, 10ops-codfw: db2085 crashed - memory issues - https://phabricator.wikimedia.org/T243148 (10Marostegui) Thanks @Papaul - going to start mysql
[15:36:49] <wikibugs>	 10DBA, 10Operations, 10ops-codfw: db2085 crashed - memory issues - https://phabricator.wikimedia.org/T243148 (10Marostegui) For the record, we are also going to try to contact Dell with the OS logs to see if we can get a new DIMM before A3 goes from correctable to uncorrectable.
[16:08:49] <wikibugs>	 10DBA, 10Operations, 10ops-codfw, 10Patch-For-Review: db2085 crashed - memory issues - https://phabricator.wikimedia.org/T243148 (10Papaul)  Create Dispatch: Success You have successfully submitted request SR1011684731.
[16:10:14] <wikibugs>	 10DBA, 10Operations, 10ops-codfw, 10Patch-For-Review: db2085 crashed - memory issues - https://phabricator.wikimedia.org/T243148 (10Marostegui) >>! In T243148#5823376, @Papaul wrote: >  > Create Dispatch: Success > You have successfully submitted request SR1011684731.  Thank you! Let's see what they say