[04:58:33] 10DBA, 10Performance-Team, 10Reading-Infrastructure-Team-Backlog, 10WikimediaEditorTasks, and 2 others: Performance review of Extension:WikimediaEditorTasks - https://phabricator.wikimedia.org/T218087 (10aaron) >>! In T218087#5055353, @Mholloway wrote: > @aaron How are we doing on this? Do you expect for t... [05:59:16] 10DBA, 10Wikidata, 10Wikidata wb_terms Trailblazing: Send the schema to DBAs and follow up with their review - https://phabricator.wikimedia.org/T219142 (10Marostegui) p:05Triage→03Normal [07:01:23] doing some schema changes on sanitariums? [07:01:30] yep [07:01:34] I see labs lagging [07:01:36] thanks [07:01:59] yes, I logged it so people are aware if they see lag on s1 [07:02:03] (specially cloud users) [07:02:33] yeah, it is just not easy to stop if you came later [07:02:37] *spot [07:04:30] yeah, faster to ask :) [07:10:32] 10DBA, 10cloud-services-team (Kanban): DB planning: include a misc cluster in codfw - https://phabricator.wikimedia.org/T218570 (10jcrespo) a:05jcrespo→03None I am not working on this. [07:12:25] 10DBA, 10cloud-services-team (Kanban): Openstack codfw DBs: move to m5-master.eqiad.wmnet - https://phabricator.wikimedia.org/T218569 (10jcrespo) a:05jcrespo→03None I am not working on this (and cannot be part of your Kanban or planning because I am not a member of your team). [07:22:53] ERROR - We could not find the existing statistics for the finished dump [07:23:42] real? [07:23:45] or code bug? [07:23:56] well, not intended [07:24:14] what I mean is, the stats are not present or it is there but it wasn't found [07:24:15] the funny thing is that I think that error no longer exists on the code [07:24:21] haha [07:24:41] the equivalent new error says: We could not find one stat entry for an ongoing backup [07:25:05] but the stats are there? or they aren't on the db? [07:25:43] the backup logged finished ok, but it didn't gather the detailed statistics [07:25:55] (per-file ones) [07:26:32] ah, I see it is a different error [07:26:42] I fixed one, but a similar one was somewhere else [07:27:33] I fixed set_status, but gather_metrics is broken [08:07:20] 10DBA, 10MediaWiki-Database, 10WikimediaEditorTasks, 10Patch-For-Review, 10Reading-Infrastructure-Team-Backlog (Kanban): Choose DB/Cluster for WikimediaEditorTasks tables - https://phabricator.wikimedia.org/T218302 (10Marostegui) >>! In T218302#5055972, @Mholloway wrote: >> >> If possible, I would narro... [08:08:11] 10Blocked-on-schema-change, 10MediaWiki-Database, 10MW-1.32-notes (WMF-deploy-2018-07-17 (1.32.0-wmf.13)), 10Schema-change: Add index log_type_action - https://phabricator.wikimedia.org/T51199 (10Marostegui) [08:09:18] 10DBA, 10Data-Services: Discrepancies with logging table on different wikis - https://phabricator.wikimedia.org/T71127 (10Marostegui) [08:22:04] 10DBA, 10Data-Services: Discrepancies with logging table on different wikis - https://phabricator.wikimedia.org/T71127 (10Marostegui) s2 eqiad progress [] labsdb1012 [] labsdb1011 [] labsdb1010 [] labsdb1009 [] dbstore1004 [] db1125 [] db1122 [] db1105 [] db1103 [] db1095 [] db1090 [] db1076 [] db1074 [] db1066 [08:22:08] 10Blocked-on-schema-change, 10MediaWiki-Database, 10MW-1.32-notes (WMF-deploy-2018-07-17 (1.32.0-wmf.13)), 10Schema-change: Add index log_type_action - https://phabricator.wikimedia.org/T51199 (10Marostegui) s2 eqiad progress [] labsdb1012 [] labsdb1011 [] labsdb1010 [] labsdb1009 [] dbstore1004 [] db1125... [08:32:12] I am glad we have codfw in RO on a mysql level. https://logstash.wikimedia.org/goto/4d61a0362efe777f0a9cb5267677efea [08:37:00] 10DBA, 10Data-Services: Discrepancies with logging table on different wikis - https://phabricator.wikimedia.org/T71127 (10Marostegui) [08:37:08] 10Blocked-on-schema-change, 10MediaWiki-Database, 10MW-1.32-notes (WMF-deploy-2018-07-17 (1.32.0-wmf.13)), 10Schema-change: Add index log_type_action - https://phabricator.wikimedia.org/T51199 (10Marostegui) [10:16:14] 10DBA, 10cloud-services-team (Kanban): DB planning: include a misc cluster in codfw - https://phabricator.wikimedia.org/T218570 (10aborrero) >>! In T218570#5056959, @jcrespo wrote: > I am not working on this. OK, but please do soon :-) If possible, we would like to know and ETA for this project to be accompl... [10:19:29] 10DBA, 10cloud-services-team (Kanban): DB planning: include a misc cluster in codfw - https://phabricator.wikimedia.org/T218570 (10jcrespo) > OK, but please do soon :-) > > If possible, we would like to know and ETA for this project to be accomplished. At the moment, I think no DBA has an idea of what you ne... [10:25:07] 10DBA, 10cloud-services-team (Kanban): DB planning: include a misc cluster in codfw - https://phabricator.wikimedia.org/T218570 (10aborrero) >>! In T218570#5057210, @jcrespo wrote: > > At the moment, I think no DBA has an idea of what you need or want to do, so please explain that first. We would like to hav... [13:21:01] 10DBA, 10MediaWiki-Database, 10WikimediaEditorTasks, 10Patch-For-Review, 10Reading-Infrastructure-Team-Backlog (Kanban): Choose DB/Cluster for WikimediaEditorTasks tables - https://phabricator.wikimedia.org/T218302 (10Mholloway) Thanks, @Marostegui, that makes sense. In that case it would be best to get... [14:46:01] 10DBA, 10cloud-services-team (Kanban): DB planning: include a misc cluster in codfw - https://phabricator.wikimedia.org/T218570 (10Marostegui) See my questions at: T218569#5057575 [14:47:55] 10DBA, 10cloud-services-team (Kanban): DB planning: include a misc cluster in codfw - https://phabricator.wikimedia.org/T218570 (10Marostegui) We should probably rename this task as we already have a misc cluster in codfw (which replicates from eqiad - https://dbtree.wikimedia.org/) and this is an specific _ne... [15:04:37] 10DBA, 10cloud-services-team (Kanban): DB planning: include a misc cluster in codfw - https://phabricator.wikimedia.org/T218570 (10Andrew) >>! In T218570#5058338, @Marostegui wrote: > We should probably rename this task as we already have a misc cluster in codfw (which replicates from eqiad - https://dbtree.wi... [17:48:27] 10DBA, 10Performance-Team, 10Reading-Infrastructure-Team-Backlog, 10WikimediaEditorTasks, and 2 others: Performance review of Extension:WikimediaEditorTasks - https://phabricator.wikimedia.org/T218087 (10aaron) 05Open→03Resolved [17:52:42] 10DBA, 10Performance-Team, 10Reading-Infrastructure-Team-Backlog, 10WikimediaEditorTasks, and 2 others: Performance review of Extension:WikimediaEditorTasks - https://phabricator.wikimedia.org/T218087 (10Mholloway) Thanks for the review and the improvements, @aaron! [18:43:51] 10DBA, 10Operations, 10decommission, 10ops-eqiad: Decommission parsercache hosts: pc1004.eqiad.wmnet pc1005.eqiad.wmnet pc1006.eqiad.wmnet - https://phabricator.wikimedia.org/T210969 (10RobH) Please note these systems still need their SSDs securely erased per https://wikitech.wikimedia.org/wiki/Dc-operatio... [22:13:57] 10DBA, 10MediaWiki-Database, 10WikimediaEditorTasks, 10Patch-For-Review, 10Reading-Infrastructure-Team-Backlog (Kanban): Choose DB/Cluster for WikimediaEditorTasks tables - https://phabricator.wikimedia.org/T218302 (10Mholloway) The tables are created and the extension is live on testwikidatawiki. Howev... [23:08:20] So the analytics mysql replicas are now split into different s groups. Which is all cool. I was wondering if it would be possible to replicate the centralauth db to all the analytics db replicas, because it makes ad-hoc queries much easier if i can join against tables in that database [23:08:40] And I assume that db is relatively small, because it basically only has global user management stuff