[08:01:10] 10DBA, 10MediaWiki-Database, 07Performance: revision page_user_timestamp index problematic on large wikis - https://phabricator.wikimedia.org/T102532#2918830 (10Marostegui) >>! In T102532#2916607, @Anomie wrote: > For experimenting with the lack of the index you could also take the queries and add `IGNORE IN... [09:25:09] 10DBA, 06Labs, 10Tool-Labs: Spatial database for tool-labs - https://phabricator.wikimedia.org/T154497#2918930 (10Tobias1984) @akosiaris That would be great if I could get an account and the information on how to access the database from wmflabs. [10:29:42] 10DBA: run pt-table-checksum before decommissioning db1015, db1035,db1044,db1038 - https://phabricator.wikimedia.org/T154485#2919046 (10Marostegui) I have been doing a few tests with the `--recursion-method=dsn` to only check a selected number of hosts: ``` MariaDB [percona]> show create table dsns\G *********... [11:06:00] 10DBA, 06Labs, 10Tool-Labs: Spatial database for tool-labs - https://phabricator.wikimedia.org/T154497#2919157 (10akosiaris) >>! In T154497#2918930, @Tobias1984 wrote: > @akosiaris That would be great if I could get an account and the information on how to access the database from wmflabs. Sure, what's your... [11:35:47] 10DBA: Defragment db1038 - https://phabricator.wikimedia.org/T154465#2919228 (10jcrespo) a:05jcrespo>03Marostegui [11:48:38] 10DBA, 06Labs, 10Tool-Labs: Spatial database for tool-labs - https://phabricator.wikimedia.org/T154497#2919252 (10Tobias1984) Sorry. I forgot that I registered like this: https://wikitech.wikimedia.org/wiki/User:Tobias47n9e [14:55:58] 10DBA, 10MediaWiki-Database, 07Performance: revision page_user_timestamp index problematic on large wikis - https://phabricator.wikimedia.org/T102532#2919525 (10Anomie) >>! In T102532#2918830, @Marostegui wrote: > This one is not using `page_user_timestamp` with and without the `AND (rev_timestamp < '2015101... [15:01:42] 10DBA, 10MediaWiki-Database, 07Performance: revision page_user_timestamp index problematic on large wikis - https://phabricator.wikimedia.org/T102532#2919531 (10Marostegui) Indeed different behaviour with enwiki - I chose enwiki for no particular reason, but that is a good catch! ``` root@PRODUCTION s1[enwi... [15:35:05] 10DBA, 06Labs: page_lang column of the page table is not replicated to Labs - https://phabricator.wikimedia.org/T154355#2919584 (10chasemp) If I understand correctly this is not entirely a view issue but once it's fixed and replicated we still need to run maintain-views to establish them for the rest of the un... [15:36:54] 10DBA, 06Labs: page_lang column of the page table is not replicated to Labs - https://phabricator.wikimedia.org/T154355#2919601 (10jcrespo) The column is on all wikis, except on labsdb1001:enwiki, where it cannot be added, and will never be. [15:38:04] 10DBA, 10MediaWiki-Database, 07Performance: revision page_user_timestamp index problematic on large wikis - https://phabricator.wikimedia.org/T102532#2919605 (10jcrespo) > It looks like it is when I explain it: > Indeed different behaviour with enwiki Make sure you use the handler stats/profiler in addition... [15:45:46] 10DBA, 10MediaWiki-Database, 07Performance: revision page_user_timestamp index problematic on large wikis - https://phabricator.wikimedia.org/T102532#2919614 (10Anomie) >>! In T102532#2919605, @jcrespo wrote: > Make sure you use the handler stats/profiler in addition to explain- otherwise, you could get tric... [15:56:21] 10DBA, 06Labs, 10Tool-Labs: Provisioning MySQL replica users fails on tool labs - https://phabricator.wikimedia.org/T151014#2804720 (10chasemp) @yuvipanda can you let @marostegui know if this all ready for https://phabricator.wikimedia.org/T151014#2893169? [16:45:19] 10DBA, 10MediaWiki-Database, 07Performance: revision page_user_timestamp index problematic on large wikis - https://phabricator.wikimedia.org/T102532#2919807 (10jcrespo) >>! In T102532#2919614, @Anomie wrote: > I know about `SHOW STATUS like 'Hand%';` to see how many rows it actually touched and hint at the... [17:27:40] 10DBA, 10MediaWiki-Database, 07Performance: revision page_user_timestamp index problematic on large wikis - https://phabricator.wikimedia.org/T102532#2919955 (10Anomie) @jcrespo Thanks for all that! > root@db1071.eqiad.wmnet[sys]> SELECT * FROM statement_analysis LIMIT 1\G Unfortunately I don't seem to hav... [17:57:28] 10DBA, 10Gerrit, 06Operations, 13Patch-For-Review, 07Upstream: Gerrit shows HTTP 500 error when pasting extended unicode characters - https://phabricator.wikimedia.org/T145885#2920126 (10Paladox) @jcrespo this https://gerrit.wikimedia.org/r/#/c/330455/ patch should at least stop the 500 error's, the patc... [18:01:51] 10DBA, 06Analytics-Kanban: Sqoop doesn't run anymore - Seem related to a DB change (analytics store) - https://phabricator.wikimedia.org/T154685#2920146 (10JAllemandou) [18:02:05] 10DBA, 06Analytics-Kanban: Sqoop doesn't run anymore - Seem related to a DB change (analytics store) - https://phabricator.wikimedia.org/T154685#2920158 (10JAllemandou) p:05Triage>03High [18:03:33] 10DBA, 06Analytics-Kanban: Sqoop doesn't run anymore - Seem related to a DB change (analytics store) - https://phabricator.wikimedia.org/T154685#2920171 (10Nuria) Ping @jcrespo mmmm.. I guess i was totally wrong about letting the user limits on place as it seems like they are preventing us from running regula... [18:19:01] marostegui: hey! let me know if you wanna do https://phabricator.wikimedia.org/T151014#2804720 now (or whenever!). Just wanted to make sure I'll be around at the time to verify [18:20:15] 10DBA, 06Labs, 10Tool-Labs: Provisioning MySQL replica users fails on tool labs - https://phabricator.wikimedia.org/T151014#2920233 (10jcrespo) Check also on the other labs servers, just in case (1004, 5 and 9-11). [18:21:13] 10DBA, 10MediaWiki-Database, 07Performance: revision page_user_timestamp index problematic on large wikis - https://phabricator.wikimedia.org/T102532#2920238 (10jcrespo) >>! In T102532#2919955, @Anomie wrote: > @jcrespo Thanks for all that! > >> root@db1071.eqiad.wmnet[sys]> SELECT * FROM statement_analysis... [18:24:48] 10DBA, 06Labs, 10Tool-Labs: Provisioning MySQL replica users fails on tool labs - https://phabricator.wikimedia.org/T151014#2920254 (10yuvipanda) We're ready for it now, as long as I'm around to verify that things are working just fine :) could be now, could be later! [19:13:27] 10DBA, 06Analytics-Kanban: Sqoop doesn't run anymore - Seem related to a DB change (analytics store) - https://phabricator.wikimedia.org/T154685#2920470 (10jcrespo) I have eliminated the limits (I have actually set them to print, rather than kill), but I may have to put them back again for wikidata-related que...