[00:16:06] <wikibugs>	 10DBA, 10Data-Services, 10Goal, 10Patch-For-Review, 10cloud-services-team (FY2017-18): Migrate all users to new Wiki Replica cluster and decommission old hardware - https://phabricator.wikimedia.org/T142807#3842672 (10JJMC89)
[09:30:49] <wikibugs>	 10DBA, 10Patch-For-Review: run pt-tablechecksum on s5/s8 - https://phabricator.wikimedia.org/T161294#3842893 (10Marostegui) wikidatawiki.change_tag is finished.  Tomorrow I will re-import tag_summary on all the hosts that failed yesterday and continue with the next wikidata tables. Once everything is done, I w...
[13:17:20] <wikibugs>	 10Blocked-on-schema-change, 10MediaWiki-Database, 10Patch-For-Review: Add a primary key to l10n_cache - https://phabricator.wikimedia.org/T146591#2665708 (10Lyrixn) For whatever reason running update.php stalls on "Renaming index lc_lang_key into PRIMARY to table l10n_cache" and crashes the mysql server if n...
[14:50:54] <wikibugs>	 10DBA, 10Patch-For-Review: run pt-tablechecksum on s5/s8 - https://phabricator.wikimedia.org/T161294#3843160 (10jcrespo) Also db1100 and dbstore1001.
[14:53:44] <wikibugs>	 10DBA, 10Patch-For-Review: run pt-tablechecksum on s5/s8 - https://phabricator.wikimedia.org/T161294#3843168 (10Marostegui) >>! In T161294#3843160, @jcrespo wrote: > Also db1100 and dbstore1001.  Yeah db1100 I wrote it down above -  right above the codfw hosts,  dbstore1001 I was expecting it to crash today :(
[17:19:52] <wikibugs>	 10DBA, 10Patch-For-Review: run pt-tablechecksum on s5/s8 - https://phabricator.wikimedia.org/T161294#3843257 (10Marostegui) I have fixed wikidataw.text
[17:43:42] <wikibugs>	 10DBA, 10Patch-For-Review: run pt-tablechecksum on s5/s8 - https://phabricator.wikimedia.org/T161294#3843286 (10Marostegui) wikidatawiki.wb_items_per_site done.
[18:38:49] <wikibugs>	 10Blocked-on-schema-change, 10MediaWiki-Database, 10Patch-For-Review: Add a primary key to l10n_cache - https://phabricator.wikimedia.org/T146591#3843312 (10Reedy) >>! In T146591#3843075, @Lyrixn wrote: > For whatever reason running update.php stalls on "Renaming index lc_lang_key into PRIMARY to table l10n_...
[20:48:33] <wikibugs>	 10Blocked-on-schema-change, 10MediaWiki-Database, 10Patch-For-Review: Add a primary key to l10n_cache - https://phabricator.wikimedia.org/T146591#3843382 (10Lyrixn) >>! In T146591#3843312, @Reedy wrote: >>>! In T146591#3843075, @Lyrixn wrote: >> For whatever reason running update.php stalls on "Renaming inde...
[20:49:14] <wikibugs>	 10Blocked-on-schema-change, 10MediaWiki-Database, 10Patch-For-Review: Add a primary key to l10n_cache - https://phabricator.wikimedia.org/T146591#3843383 (10Reedy) Truncate it first then.  We might want to add that to the patch...
[21:17:02] <wikibugs>	 10Blocked-on-schema-change, 10MediaWiki-Database, 10Patch-For-Review: Add a primary key to l10n_cache - https://phabricator.wikimedia.org/T146591#3843395 (10Lyrixn) Okay, truncating fixed it.