[03:08:24] 10DBA, 10MediaWiki-JobQueue, 10MediaWiki-extensions-Renameuser, 07Community-Wishlist-Survey-2016: Fix use of DB schema so RenameUser is trivial - https://phabricator.wikimedia.org/T33863#2909424 (10Liuxinyu970226) [03:08:58] 07Blocked-on-schema-change, 10DBA, 10Wikimedia-Site-requests, 06Wikisource, and 4 others: Schema change for page content language - https://phabricator.wikimedia.org/T69223#2909425 (10Liuxinyu970226) [09:08:03] 10DBA, 13Patch-For-Review: db2034: investigate its crash and reimage - https://phabricator.wikimedia.org/T149553#2909579 (10Marostegui) Excellent! Thanks. I will try to crash it on Tuesday! [09:28:58] 10DBA, 06Operations, 10ops-eqiad: Degraded RAID on db1033 - https://phabricator.wikimedia.org/T152214#2909583 (10Marostegui) [16:18:34] 10DBA, 06Labs, 10Labs-Infrastructure: Replication inconsistency - https://phabricator.wikimedia.org/T154398#2909863 (10Huji) [16:20:00] 10DBA, 06Labs, 10Labs-Infrastructure: Replication inconsistency - https://phabricator.wikimedia.org/T154398#2909876 (10Huji) PS: it used to be possible to connect to specific Labs DB instances using commands like `mysql -h labsdb1001 fawiki` (like T123985#1943926) but that does not work anymore. Can you plea... [18:41:03] 10DBA, 06Labs, 10Labs-Infrastructure: Replication inconsistency - https://phabricator.wikimedia.org/T154398#2909863 (10Krenair) Nope, production definitely matches I'm afraid: ```mysql:wikiadmin@db1086 [fawiki]> select * from pagelinks where pl_from = 3466098; Empty set (0.00 sec)``` Several other productio... [18:44:42] 10DBA, 06Labs, 10Labs-Infrastructure: Replication inconsistency - https://phabricator.wikimedia.org/T154398#2909992 (10Krenair) >>! In T154398#2909876, @Huji wrote: > PS: it used to be possible to connect to specific Labs DB instances using commands like `mysql -h labsdb1001 fawiki` (like T123985#1943926) bu... [21:21:24] 10DBA, 06Labs, 10Labs-Infrastructure: Replication inconsistency - https://phabricator.wikimedia.org/T154398#2910119 (10Huji) >>! In T154398#2909985, @Krenair wrote: > Nope, production definitely matches I'm afraid: > ```mysql:wikiadmin@db1086 [fawiki]> select * from pagelinks where pl_from = 3466098; > Empty... [21:53:50] 10DBA, 06Labs, 10Labs-Infrastructure: Replication inconsistency - https://phabricator.wikimedia.org/T154398#2910124 (10Krenair) I agree it's strange, it's just not a replication inconsistency.