[04:43:34] 10DBA, 06Operations, 10ops-codfw, 13Patch-For-Review: codfw rack/setup 22 DB servers - https://phabricator.wikimedia.org/T162159#3177374 (10Papaul) [15:02:29] 10DBA, 10MediaWiki-extensions-WikibaseClient, 10Wikidata, 15User-Daniel: Usage tracking: record which statement group is used - https://phabricator.wikimedia.org/T151717#3178511 (10hoo) @jcrespo Just to make this super clear: We want to collect //additional// information on one of these wikis for a while (... [18:27:19] 10DBA, 06Community-Tech, 06Labs, 10Tool-Labs: Fix Plagiabot DB corruption - https://phabricator.wikimedia.org/T162932#3179864 (10bd808) [18:30:42] 10DBA, 06Community-Tech, 06Labs, 10Tool-Labs: Fix Plagiabot DB corruption - https://phabricator.wikimedia.org/T162932#3179885 (10MusikAnimal) I changed the query in CopyPatrol and it is at least functional now: https://tools.wmflabs.org/copypatrol/en [18:36:39] hello DBAs! We have the database "s51306__copyright_p" on "enwiki.labsdb", and apparently today the indexing on the diff_timestamp column has become corrupted [18:36:53] we have created a ticket at https://phabricator.wikimedia.org/T162932 but writing here too in the off-chance you have free time to look at it [18:37:40] this breaks some of the WikiEd Dashboard functionality in addition to our own CopyPatrol tool [18:46:43] 10DBA, 06Community-Tech, 06Labs, 10Tool-Labs: Fix Plagiabot DB corruption - https://phabricator.wikimedia.org/T162932#3180146 (10MusikAnimal) [18:46:51] 10DBA, 06Community-Tech, 06Labs, 10Tool-Labs: Fix Plagiabot DB corruption - https://phabricator.wikimedia.org/T162932#3179794 (10MusikAnimal) [18:47:12] 10DBA, 06Community-Tech, 06Labs, 10Tool-Labs: Fix Plagiabot DB corruption - https://phabricator.wikimedia.org/T162932#3180172 (10MusikAnimal) [19:00:37] 10DBA, 06Community-Tech, 06Labs, 10Tool-Labs: Fix Plagiabot DB corruption - https://phabricator.wikimedia.org/T162932#3180313 (10MusikAnimal) Hmm seems to be working now? [19:02:11] 10DBA, 06Community-Tech, 06Labs, 10Tool-Labs: Fix Plagiabot DB corruption - https://phabricator.wikimedia.org/T162932#3180323 (10MusikAnimal) p:05High>03Normal [19:40:12] 10DBA, 06Community-Tech, 06Labs, 10Tool-Labs: Fix Plagiabot DB corruption - https://phabricator.wikimedia.org/T162932#3180659 (10Ragesoss) p:05Normal>03High Not any more. [20:45:22] 10DBA, 06Operations, 10netops, 10ops-codfw: db20[7-9][0-9] swith ports configuration - https://phabricator.wikimedia.org/T162944#3180944 (10Papaul) [20:45:56] 10DBA, 06Operations, 10netops, 10ops-codfw: db20[7-9][0-9] switch ports configuration - https://phabricator.wikimedia.org/T162944#3180963 (10Luke081515) [20:48:54] 10DBA, 06Operations, 10netops, 10ops-codfw: db20[7-9][0-9] swith ports configuration - https://phabricator.wikimedia.org/T162944#3180980 (10Papaul) [20:49:53] 10DBA, 06Operations, 10netops, 10ops-codfw: db20[7-9][0-9] switch ports configuration - https://phabricator.wikimedia.org/T162944#3180944 (10Papaul) [21:00:21] 10DBA, 06Operations, 10netops, 10ops-codfw: db20[7-9][0-9] switch ports configuration - https://phabricator.wikimedia.org/T162944#3181028 (10Papaul) [23:22:54] 10DBA, 10Icinga, 10Monitoring, 06Operations: tendril cert expiry alerts on dbmonitor hosts - https://phabricator.wikimedia.org/T162183#3181800 (10Dzahn) [23:46:21] 10DBA, 06Community-Tech, 06Labs, 10Tool-Labs: Fix Plagiabot DB corruption - https://phabricator.wikimedia.org/T162932#3181900 (10jcrespo) 05Open>03Invalid Cannot reproduce: ``` root@labsdb1001[s51306__copyright_p]> SELECT * FROM copyright_diffs ORDER BY diff_timestamp DESC LIMIT 1; +-------+---------...