[07:00:09] 10DBA, 10Operations, 10cloud-services-team, 10Patch-For-Review, 10Scoring-platform-team (Current): Labsdb* servers need to be rebooted - https://phabricator.wikimedia.org/T168584#3725569 (10Marostegui) Please check: T179464 labsdb1001 has crashed and the storage looks totally broken, hard to say if it is... [07:04:32] 10DBA, 10Operations, 10cloud-services-team, 10Patch-For-Review, 10Scoring-platform-team (Current): Labsdb* servers need to be rebooted - https://phabricator.wikimedia.org/T168584#3725571 (10Marostegui) We should consider labsdb1001 broken for good and decommission it - we need to decide whether we want... [07:40:52] 10DBA, 10Expiring-Watchlist-Items, 10MediaWiki-Watchlist, 10TCB-Team, and 9 others: Allow setting the watchlist table to read-only on a per-wiki basis - https://phabricator.wikimedia.org/T160062#3725619 (10Tobi_WMDE_SW) [08:29:41] 10DBA, 10Operations, 10cloud-services-team, 10Patch-For-Review, 10Scoring-platform-team (Current): Labsdb* servers need to be rebooted - https://phabricator.wikimedia.org/T168584#3725662 (10MoritzMuehlenhoff) >>! In T168584#3725571, @Marostegui wrote: > We should consider labsdb1001 broken for good and d... [08:31:33] 10DBA, 10Operations, 10cloud-services-team, 10Patch-For-Review, 10Scoring-platform-team (Current): Labsdb* servers need to be rebooted - https://phabricator.wikimedia.org/T168584#3725667 (10Marostegui) We are aiming for 13th Dec to retire these two hosts: T142807 and https://wikitech.wikimedia.org/wiki/W... [08:34:44] 10DBA, 10Operations, 10cloud-services-team, 10Patch-For-Review, 10Scoring-platform-team (Current): Labsdb* servers need to be rebooted - https://phabricator.wikimedia.org/T168584#3725668 (10MoritzMuehlenhoff) Let's just keep 1003 running w/o reboot then. [19:26:47] 10DBA, 10Wikidata: Migrate wb_items_per_site to using prefixed entity IDs instead of numeric IDs - https://phabricator.wikimedia.org/T114904#3727681 (10Multichill) p:05Triage>03High So wb_entity_per_page was killed: MariaDB [wikidatawiki_p]> SELECT * FROM wb_entity_per_page LIMIT 1; ERROR 1356 (HY000): Vi... [22:45:46] 10DBA, 10Data-Services, 10Goal, 10cloud-services-team (FY2017-18): Migrate all users to new Wiki Replica cluster and decommission old hardware - https://phabricator.wikimedia.org/T142807#3728236 (10eranroz)