[06:31:19] 10DBA, 10Patch-For-Review, 10Schema-change: Schema change to drop default from externallinks.el_index_60 - https://phabricator.wikimedia.org/T197891 (10Marostegui) [06:31:22] 10DBA, 10Patch-For-Review, 10Schema-change: Schema change: Add unique index on archive.ar_rev_id - https://phabricator.wikimedia.org/T196379 (10Marostegui) [06:31:35] 10Blocked-on-schema-change, 10MediaWiki-Database, 10Patch-For-Review: Add a primary key to l10n_cache - https://phabricator.wikimedia.org/T146591 (10Marostegui) [06:58:00] 10DBA, 10Wikidata: Optimize recentchanges and wbc_entity_usage table across wikis - https://phabricator.wikimedia.org/T187521 (10Marostegui) [09:23:46] 10DBA, 10Performance, 10Security: Deploy access to performance_schema/sys for the administrative mediawiki account (mediawiki deployers) - https://phabricator.wikimedia.org/T195578 (10jcrespo) @Security-team Do you see any blocker or reason not to enable this on all hosts? This was already available for root... [10:00:07] protip- always check processlist before shutting down a server [10:00:15] I wrongly depooled db1086 [10:01:16] ah yeah, I see your commit [10:01:31] That has happened to me a few times, so I indeed always wait for a clean processlist :( [10:01:55] and I also do a grep for the host I depool too [10:02:05] to make sure I have commented out all the lines it appears on [10:02:26] hopefully this will not be needed anymore soon~ish [10:02:39] indeed [10:05:17] Unexpected Teal'C [10:27:08] 10DBA, 10JADE, 10Operations, 10Scoring-platform-team (Current), 10User-Joe: Extension:JADE scalability concerns due to creating a page per revision - https://phabricator.wikimedia.org/T196547 (10jcrespo) I think the proposed plan ha deep architecture problems at storage layer, so we should discuss in dep... [11:38:26] 10DBA, 10Operations, 10Scap: "sql wikishared" doesn't work on mwmaint1001 - https://phabricator.wikimedia.org/T199316 (10Amire80) [14:27:47] https://grafana.wikimedia.org/dashboard/db/mysql?panelId=11&fullscreen&orgId=1&var-dc=eqiad%20prometheus%2Fops&var-server=labsdb1005&var-port=9104&from=now-1h&to=now [14:27:49] 10Blocked-on-schema-change, 10MediaWiki-Database, 10Schema-change: Add index type_action - https://phabricator.wikimedia.org/T51199 (10Marostegui) After all the changes on the logging table related to the actor refactoring, what should we do with this ticket? Is this still needed? I cannot find the gerrit c... [14:28:01] oh wow [14:28:06] what's up with labsdb1005! [14:28:11] not easy to solve witout controlling the data [14:28:19] I killed older transactions [14:28:35] but we may have still many unpurged rows [14:32:00] it helped a bit: https://grafana.wikimedia.org/dashboard/db/mysql?panelId=11&fullscreen&orgId=1&var-dc=eqiad%20prometheus%2Fops&var-server=labsdb1005&var-port=9104&from=now-1h&to=now [14:32:37] oh yeah [14:32:43] for how long were they running for? [14:33:58] quite long, days [14:34:25] hi, I noticed that in hieradata/role/common/cache/[misc|text].yaml the dbtree tree backend still points to terbium, is that correct or should that also use mwmaint1001 by now? [14:34:27] but we may need to do some table optimizations on a replica [14:35:01] moritzm: honestly, first time I see that [14:35:15] 10Blocked-on-schema-change, 10MediaWiki-Database, 10Schema-change: Add index type_action - https://phabricator.wikimedia.org/T51199 (10Reedy) >>! In T51199#4415964, @Marostegui wrote: > After all the changes on the logging table related to the actor refactoring, what should we do with this ticket? > Is this... [14:35:46] jynus: ok, I'll try to poke a little in puppet to see what it's used for later on [14:36:09] I don't think dbtree should be on terbium, but on dbmonitor [14:36:28] but maybe it depends on mediawiki-config, who knows [14:50:48] 10Blocked-on-schema-change, 10MediaWiki-Database, 10Patch-For-Review, 10Schema-change: Add index type_action - https://phabricator.wikimedia.org/T51199 (10Reedy) >>! In T51199#4416018, @Marostegui wrote: > SVN!! \o/ > So the correct one is this one?: > ``` > CREATE INDEX /*i*/log_type_action ON /*_*/loggin... [14:50:52] going down already https://grafana.wikimedia.org/dashboard/db/mysql?panelId=11&fullscreen&orgId=1&var-dc=eqiad%20prometheus%2Fops&var-server=labsdb1005&var-port=9104&from=now-1h&to=now [14:52:56] 10Blocked-on-schema-change, 10MediaWiki-Database, 10Patch-For-Review, 10Schema-change: Add index type_action - https://phabricator.wikimedia.org/T51199 (10Anomie) >>! In T51199#4415964, @Marostegui wrote: > After all the changes on the logging table related to the actor refactoring, what should we do with... [14:59:28] 10Blocked-on-schema-change, 10MediaWiki-Database, 10Patch-For-Review, 10Schema-change: Add index type_action - https://phabricator.wikimedia.org/T51199 (10Reedy) >>! In T51199#4416095, @Marostegui wrote: >>>! In T51199#4416069, @Reedy wrote: >> >> You'll want to drop type_action at the same time if it exi... [17:49:47] moritzm: take my comment as "change it as you want, not something that worries me much, as long as it is up, I guess" [19:33:15] jynus: ok, I'll dig into this a little deeper tomorrow anyway [19:38:47] 10Blocked-on-schema-change, 10MediaWiki-Database, 10Schema-change: Add index log_type_action - https://phabricator.wikimedia.org/T51199 (10Reedy) Merged into master, good to go now! :) [19:59:13] 10DBA, 10MediaWiki-Database, 10Patch-For-Review, 10PostgreSQL, 10Schema-change: Some tables lack unique or primary keys, may allow confusing duplicate data - https://phabricator.wikimedia.org/T17441 (10Reedy) [20:02:00] 10DBA, 10Schema-change: Convert UNIQUE INDEX to PK in Production - https://phabricator.wikimedia.org/T199368 (10Reedy) p:05Triage>03Normal [20:20:36] 10DBA, 10Schema-change: Convert UNIQUE INDEX to PK in Production - https://phabricator.wikimedia.org/T199368 (10Marostegui) Great! More PKs!! :) [22:41:28] 10DBA, 10Core-Platform-Team, 10Patch-For-Review, 10Schema-change: Schema change to make archive.ar_rev_id NOT NULL - https://phabricator.wikimedia.org/T191316 (10CCicalese_WMF) [22:43:48] 10DBA, 10Core-Platform-Team, 10Patch-For-Review, 10Schema-change: Fix WMF schemas to not break when comment store goes WRITE_NEW - https://phabricator.wikimedia.org/T187089 (10CCicalese_WMF) [23:09:17] 10DBA, 10Core-Platform-Team, 10MediaWiki-Database, 10Performance-Team (Radar), 10Wikimedia-Incident: Change pt-heartbeat model to not use super-user, avoid SPOF and switch automatically to the real master without puppet dependency - https://phabricator.wikimedia.org/T172497 (10CCicalese_WMF)