[06:59:53] 10DBA, 10Patch-For-Review: Check GTID, consistency options, notifications across the fleet and db-eqiad.php weights - https://phabricator.wikimedia.org/T211973 (10Marostegui) 05Open→03Resolved I have reviewed db-eqiad.php and also db-codfw.php and all the servers that have to be pooled are pooled and the w... [07:00:00] 10DBA, 10Patch-For-Review: Check GTID, consistency options, notifications across the fleet and db-eqiad.php weights - https://phabricator.wikimedia.org/T211973 (10Marostegui) [07:03:06] 10DBA, 10Analytics, 10Analytics-Kanban, 10Patch-For-Review, 10User-Banyek: Migrate dbstore1002 to a multi instance setup on dbstore100[3-5] - https://phabricator.wikimedia.org/T210478 (10Marostegui) [07:03:26] 10DBA: Remove AFT tables from the analytics slaves - https://phabricator.wikimedia.org/T92739 (10Marostegui) [07:03:28] 10DBA, 10Analytics, 10Analytics-Kanban, 10Patch-For-Review, 10User-Banyek: Migrate dbstore1002 to a multi instance setup on dbstore100[3-5] - https://phabricator.wikimedia.org/T210478 (10Marostegui) [07:03:39] 10DBA: Remove AFT tables from the analytics slaves - https://phabricator.wikimedia.org/T92739 (10Marostegui) [07:03:42] 10DBA, 10Analytics, 10Analytics-Kanban, 10Patch-For-Review, 10User-Banyek: Migrate dbstore1002 to a multi instance setup on dbstore100[3-5] - https://phabricator.wikimedia.org/T210478 (10Marostegui) [07:13:57] 10DBA, 10Analytics, 10Analytics-Kanban, 10User-Elukey: Review dbstore1002's tables and decide which ones needs to be migrated to the new multi instance setup - https://phabricator.wikimedia.org/T212487 (10elukey) p:05Triage→03High [07:16:14] elukey: Tables or databases? :) [07:18:50] 10DBA, 10Analytics, 10Analytics-Kanban, 10User-Elukey: Review dbstore1002's tables and decide which ones needs to be migrated to the new multi instance setup - https://phabricator.wikimedia.org/T212487 (10Marostegui) Crossposting my comment from: T210478#4794533 `ops` doesn't need to be migrated. I believ... [07:19:25] 10DBA, 10Analytics, 10Analytics-Kanban, 10Patch-For-Review, 10User-Banyek: Migrate dbstore1002 to a multi instance setup on dbstore100[3-5] - https://phabricator.wikimedia.org/T210478 (10elukey) A couple of updates: * I created T212487 to review and decide what tables to migrate to dbstore100[3-5] among... [07:40:15] 10DBA, 10Data-Services, 10Tracking: Wikireplica service for tools and labs - issues and missing available views (tracking) - https://phabricator.wikimedia.org/T150767 (10Marostegui) [07:40:23] 10DBA, 10Data-Services, 10Patch-For-Review, 10cloud-services-team (Kanban): `pr_index` to be replicated to Labs public databases - https://phabricator.wikimedia.org/T113842 (10Marostegui) 05Open→03Resolved a:03jcrespo This is all done and it is available on all the wikisources on the labs hosts: `lin... [07:47:23] 10DBA, 10MediaWiki-Database, 10Wikidata, 10TestMe: IndexPager::buildQueryInfo (contributions page unfiltered) query needs tuning - https://phabricator.wikimedia.org/T189026 (10Marostegui) I believe this is not happening anymore, I haven't found this on logs. Can this be closed? [07:51:04] elukey: https://phabricator.wikimedia.org/T212487  shouldn't that be s/tables/databases ? [07:51:40] 10DBA, 10Analytics, 10Analytics-Kanban, 10User-Elukey: Review dbstore1002's non-wiki databases and decide which ones needs to be migrated to the new multi instance setup - https://phabricator.wikimedia.org/T212487 (10elukey) [07:51:44] done sorry :) [07:52:33] Don't be sorry! I just wanted to make sure I understood it correctly! :) [07:54:17] 10DBA, 10Patch-For-Review: Drop valid_tag table - https://phabricator.wikimedia.org/T212254 (10Marostegui) No errors so far, so I think we can start dropping this table after holidays (after checking for errors, of course) [08:00:58] 10DBA, 10Operations, 10ops-codfw: Issues with mgmt interface on es2001 host - https://phabricator.wikimedia.org/T204928 (10Marostegui) 05Open→03Resolved This got fixed by itself - maybe it was fixed with the last reboot? ` ssh es2001.mgmt.codfw.wmnet -lroot root@es2001.mgmt.codfw.wmnet's password: /admin... [09:17:19] 10DBA, 10Analytics, 10Analytics-Kanban, 10User-Elukey: Review dbstore1002's non-wiki databases and decide which ones needs to be migrated to the new multi instance setup - https://phabricator.wikimedia.org/T212487 (10elukey) `datasets` seems indeed not useful, I propose to just mysqldump it and save it in... [09:18:34] I thought there was more garbage on dbstore1002 --^ [09:25:18] We used to, specially grants [09:25:22] That'll be fun XD [09:32:55] 10DBA, 10Analytics, 10Analytics-Kanban, 10User-Elukey: Review dbstore1002's non-wiki databases and decide which ones needs to be migrated to the new multi instance setup - https://phabricator.wikimedia.org/T212487 (10Marostegui) >>! In T212487#4839932, @elukey wrote: > > `flowdb` replication from X1 was re... [09:34:24] 10DBA, 10Analytics, 10Analytics-Kanban, 10Patch-For-Review, 10User-Banyek: Migrate dbstore1002 to a multi instance setup on dbstore100[3-5] - https://phabricator.wikimedia.org/T210478 (10Marostegui) >>! In T210478#4794536, @Banyek wrote: > If the tables mentioned in https://phabricator.wikimedia.org/T210... [09:48:27] 10DBA, 10Analytics, 10Analytics-Kanban, 10Patch-For-Review, 10User-Banyek: Migrate dbstore1002 to a multi instance setup on dbstore100[3-5] - https://phabricator.wikimedia.org/T210478 (10Banyek) >>! In T210478#4839959, @Marostegui wrote: > ` > root@cumin1001:~# mysql.py -hdbstore1002 -e "show all slaves... [09:52:29] 10DBA, 10Analytics, 10Analytics-Kanban, 10Patch-For-Review, 10User-Banyek: Migrate dbstore1002 to a multi instance setup on dbstore100[3-5] - https://phabricator.wikimedia.org/T210478 (10elukey) Looks good, one little question - would it be possible to add a staging-like db on every instance if needed in... [09:58:41] 10DBA, 10Analytics, 10Analytics-Kanban, 10Patch-For-Review, 10User-Banyek: Migrate dbstore1002 to a multi instance setup on dbstore100[3-5] - https://phabricator.wikimedia.org/T210478 (10Banyek) >>! In T210478#4839966, @elukey wrote: > Looks good, one little question - would it be possible to add a stagi... [10:02:36] 10DBA, 10Analytics, 10Analytics-Kanban, 10Patch-For-Review, 10User-Banyek: Migrate dbstore1002 to a multi instance setup on dbstore100[3-5] - https://phabricator.wikimedia.org/T210478 (10Marostegui) Apart from what @Banyek commented, I have a further question: do you mean adding the current stagingdb to... [10:05:47] 10DBA, 10Analytics, 10Analytics-Kanban, 10Patch-For-Review, 10User-Banyek: Migrate dbstore1002 to a multi instance setup on dbstore100[3-5] - https://phabricator.wikimedia.org/T210478 (10Banyek) >>! In T210478#4839973, @Marostegui wrote: > Apart from what @Banyek commented, I have a further question: do... [10:05:55] 10DBA, 10Analytics, 10Analytics-Kanban, 10Patch-For-Review, 10User-Banyek: Migrate dbstore1002 to a multi instance setup on dbstore100[3-5] - https://phabricator.wikimedia.org/T210478 (10elukey) Yes correct an empty staging-like db, and we could call it as we want. I am 99% sure that we will not need it,... [10:07:21] marostegui: ah snap grants, should we open a subtask for them? [10:07:25] so we can review etc.. [10:07:37] Ideally we could also deprecate that horrible 'research' user [10:08:28] 10DBA, 10Analytics, 10Analytics-Kanban, 10Patch-For-Review, 10User-Banyek: Migrate dbstore1002 to a multi instance setup on dbstore100[3-5] - https://phabricator.wikimedia.org/T210478 (10Marostegui) However, the original stagingdb is still needed, right? Maybe we should move that discussion to {T212487}? [10:09:09] 10DBA, 10Analytics, 10Analytics-Kanban, 10Patch-For-Review, 10User-Banyek: Migrate dbstore1002 to a multi instance setup on dbstore100[3-5] - https://phabricator.wikimedia.org/T210478 (10elukey) Yeah staging is still needed, I'll comment in the subtask. [10:09:39] 10DBA, 10Analytics, 10Analytics-Kanban, 10User-Elukey: Review dbstore1002's non-wiki databases and decide which ones needs to be migrated to the new multi instance setup - https://phabricator.wikimedia.org/T212487 (10elukey) The `staging` database is still needed and it is sufficient to copy it to a single... [10:14:16] 10DBA, 10Analytics, 10Analytics-Kanban, 10User-Elukey: Review dbstore1002's non-wiki databases and decide which ones needs to be migrated to the new multi instance setup - https://phabricator.wikimedia.org/T212487 (10Marostegui) >>! In T212487#4839980, @elukey wrote: > The `staging` database is still neede... [10:16:22] 10DBA, 10Analytics, 10Analytics-Kanban, 10User-Elukey: Review dbstore1002's non-wiki databases and decide which ones needs to be migrated to the new multi instance setup - https://phabricator.wikimedia.org/T212487 (10elukey) >>! In T212487#4839988, @Marostegui wrote: >>>! In T212487#4839980, @elukey wrote:... [14:43:42] marostegui: hey, is logging table partitioned on wikidatawiki? I was looking at innodb buffer pool, got things like "`wikidatawiki`.`logging` /* Partition `p1000000` */" It used to have 700M rows, now it's only 7M [14:44:04] Amir1: He's gone for christmas, so might not get a reply [14:44:22] Reedy: oh, thanks [17:20:19] 10DBA, 10MediaWiki-Database, 10Wikidata, 10TestMe: IndexPager::buildQueryInfo (contributions page unfiltered) query needs tuning - https://phabricator.wikimedia.org/T189026 (10Anomie) 05Open→03Resolved a:03Anomie Yes. I left it open back in March because of concern that it might reoccur when we start...