[03:52:02] DBA, Labs, Patch-For-Review: Make watchlist table available on labs - https://phabricator.wikimedia.org/T59617#2392771 (MZMcBride) The production `watchlist` table contains (wl_namespace, wl_title) entries that do not currently have `page` table (page_namespace, page_title) entries. Can deleted/non-e... [03:54:11] DBA, Labs, Patch-For-Review: Make watchlist table available on labs - https://phabricator.wikimedia.org/T59617#2392772 (MZMcBride) Example: has 1,952 page watchers, but this page does not currently exist. [04:00:46] DBA, Labs, Patch-For-Review: Make watchlist table available on labs - https://phabricator.wikimedia.org/T59617#2392773 (MZMcBride) Hmmm, never mind. ``` MariaDB [enwiki_p]> select * from watchlist_count where wl_title = 'How_wikis_work' and wl_namespace in (0, 1); +----------+--------------+--------... [04:03:29] DBA, Labs, Patch-For-Review: Make watchlist table available on labs - https://phabricator.wikimedia.org/T59617#2392774 (MZMcBride) >>! In T59617#2392773, @MZMcBride wrote: > I guess my report changed for some other reason. There was a join with the `page` table due to page-move vandalism, presumably... [15:41:24] DBA, Labs, Tool-Labs, Tool-Labs-tools-Database-Queries: Run a Tool Labs query without Timing out - https://phabricator.wikimedia.org/T138111#2393905 (Soni) Just in case it helps, here's the output from a sample run of the Query - ``` SELECT page_id, page_title, first_rev_id -> FROM (SELEC... [15:53:43] DBA, Labs, Tool-Labs, Tool-Labs-tools-Database-Queries: Run a Tool Labs query without Timing out - https://phabricator.wikimedia.org/T138111#2393960 (jcrespo) Do not ever do `ORDER BY RAND()` on revision - you are literally reading all revisions, ordering all of them and then discarding the milli... [17:08:20] DBA, Operations: m1-master switch from db1001 to db1016 - https://phabricator.wikimedia.org/T106312#2394232 (jcrespo) After the clean up, these are the databases that are still there (aside from the mysql ones mysql, information_schema and performance schema): ``` bacula etherpadlite heartbeat librenms p... [17:23:36] DBA, Operations, ops-codfw: es2017 and es2019 crashed with no logs - https://phabricator.wikimedia.org/T130702#2394275 (jcrespo) I can confirm the error did not happen on both systems after BIOS update and restart. [17:30:35] DBA, Operations, ops-codfw: es2017 and es2019 crashed with no logs - https://phabricator.wikimedia.org/T130702#2394293 (jcrespo) CORRECTION: it is not happening on es2019, but it happened again on es2017- I would double check by rebooting once more that host (es2017)- the error was seconds before det... [17:33:19] DBA, Operations, ops-codfw: es2017 and es2019 crashed with no logs - https://phabricator.wikimedia.org/T130702#2394310 (jcrespo) Logs: ``` SUP0516: Updating firmware for PowerEdge BIOS to version 2.1.6. 2016-06-15T16:52:33-0500 Log Sequence Number: 273 Detailed Description: Do not turn off the sys... [17:36:54] DBA, Labs, Tool-Labs, Tool-Labs-tools-Database-Queries: Run a Tool Labs query without Timing out - https://phabricator.wikimedia.org/T138111#2394317 (Soni) Still getting an empty set. Not sure if the problem is with Query termination or the way the Query was framed :/ ``` MariaDB [enwiki_p]> USE... [17:43:44] DBA, Labs, Tool-Labs, Tool-Labs-tools-Database-Queries: Run a Tool Labs query without Timing out - https://phabricator.wikimedia.org/T138111#2394336 (jcrespo) `Empty set (16 min 47.81 sec)` on mysql command line client means that- no rows with the given filters. Your query is strange. This is th... [18:03:43] DBA, Operations: m1-master switch from db1001 to db1016 - https://phabricator.wikimedia.org/T106312#2394393 (jcrespo) @Akosiaris @MoritzMuehlenhoff @fgiunchedi @demon @Krenair @Dzahn I intend to perform the failover on Wednesday 22, 16:00 UTC. I do not really need you to do anything, and this should be... [18:04:25] DBA, Operations: m1-master switch from db1001 to db1016 - https://phabricator.wikimedia.org/T106312#1464530 (jcrespo) a:jcrespo [20:46:18] DBA, Analytics-Kanban, Editing-Analysis, Patch-For-Review: Reportupdater does not commit changes after each query - https://phabricator.wikimedia.org/T134950#2395067 (Nuria) Open>Resolved