[05:41:16] 10DBA, 10MediaWiki-extensions-WikibaseClient, 10Wikidata: Find test wiki(s) for new description usage and enable there - https://phabricator.wikimedia.org/T177155#3652909 (10Marostegui) >>! In T177155#3652067, @hoo wrote: >>>! In T177155#3649787, @Marostegui wrote: >> ``` >> wc -l ./dblists/small.dblist >> 5... [05:42:59] 10Blocked-on-schema-change, 10DBA, 10Patch-For-Review: Drop now redundant indexes from pagelinks and templatelinks - https://phabricator.wikimedia.org/T174509#3652921 (10Marostegui) [05:43:24] 10Blocked-on-schema-change, 10DBA, 10Patch-For-Review: Drop now redundant indexes from pagelinks and templatelinks - https://phabricator.wikimedia.org/T174509#3579021 (10Marostegui) [05:47:05] 10DBA, 10Operations, 10ops-codfw: db2044 HW RAID failure - https://phabricator.wikimedia.org/T174764#3652923 (10Marostegui) 05Open>03Resolved Thank you I have upgraded the server and as everything looked good, I have started MySQL again. Also cleaned HW logs so we can start fresh. MySQL is catching up n... [06:00:00] 10Blocked-on-schema-change, 10DBA, 10Readers-Community-Engagement, 10Community-Liaisons (Oct-Dec 2017): Help communicate read-only time for Commons for schema change required by adding 3D filetype - https://phabricator.wikimedia.org/T176883#3652945 (10Marostegui) >>! In T176883#3651271, @CKoerner_WMF wrote... [06:04:09] 10DBA, 10Analytics: Drop MoodBar tables from all wikis - https://phabricator.wikimedia.org/T153033#3652947 (10Marostegui) I like Jaime's solution :-) Placing them on the staging database would work pretty well for me too, as we could simple issue the drop on the master and replication will not touch them for t... [06:09:15] 10DBA, 10cloud-services-team: Provide a new sanitarium host for s8 - https://phabricator.wikimedia.org/T177274#3652960 (10Marostegui) [06:31:01] 10DBA, 10Operations, 10ops-eqiad: Degraded RAID on db1092 - https://phabricator.wikimedia.org/T177264#3652981 (10Marostegui) [06:31:15] 10DBA, 10Operations, 10ops-eqiad: Degraded RAID on db1092 - https://phabricator.wikimedia.org/T177264#3652772 (10Marostegui) @Cmjohnson feel free to change this disk whenever you can Thanks! [06:31:52] 10DBA, 10Operations, 10ops-eqiad: Degraded RAID on db1092 - https://phabricator.wikimedia.org/T177264#3652772 (10Marostegui) p:05Triage>03Normal [06:57:16] 10Blocked-on-schema-change, 10DBA, 10Patch-For-Review: Drop now redundant indexes from pagelinks and templatelinks - https://phabricator.wikimedia.org/T174509#3653016 (10Marostegui) [06:57:28] 10Blocked-on-schema-change, 10DBA, 10Patch-For-Review: Drop now redundant indexes from pagelinks and templatelinks - https://phabricator.wikimedia.org/T174509#3579566 (10Marostegui) s7 got the duplicated index cleaned up [06:59:06] 10Blocked-on-schema-change, 10DBA, 10Patch-For-Review: Drop now redundant indexes from pagelinks and templatelinks - https://phabricator.wikimedia.org/T174509#3653018 (10Marostegui) [07:51:17] 10Blocked-on-schema-change, 10DBA, 10Patch-For-Review: Drop now redundant indexes from pagelinks and templatelinks - https://phabricator.wikimedia.org/T174509#3653064 (10Marostegui) I am going to start dropping the keys from s3 in codfw, it will be a bit of a pain :) [07:55:45] 10Blocked-on-schema-change, 10DBA, 10Patch-For-Review: Drop now redundant indexes from pagelinks and templatelinks - https://phabricator.wikimedia.org/T174509#3653066 (10Marostegui) Looks like T163912 was only applied to eqiad but not to codfw. I will take care of it [07:56:58] 10DBA, 10Epic, 10Patch-For-Review, 10codfw-rollout: Database maintenance scheduled while eqiad datacenter is non primary (after the DC switchover) - https://phabricator.wikimedia.org/T155099#3653069 (10Marostegui) [07:57:03] 10Blocked-on-schema-change, 10DBA: Convert unique keys into primary keys for some wiki tables on s3-eqiad - https://phabricator.wikimedia.org/T163912#3214233 (10Marostegui) 05Resolved>03Open [07:57:05] 10DBA, 10MediaWiki-Database, 10Patch-For-Review, 10PostgreSQL, 10Schema-change: Some tables lack unique or primary keys, may allow confusing duplicate data - https://phabricator.wikimedia.org/T17441#3653070 (10Marostegui) [07:57:14] 10Blocked-on-schema-change, 10DBA: Convert unique keys into primary keys for some wiki tables on s3-eqiad and s3-codfw - https://phabricator.wikimedia.org/T163912#3214233 (10Marostegui) [07:57:39] 10Blocked-on-schema-change, 10DBA: Convert unique keys into primary keys for some wiki tables on s3-eqiad and s3-codfw - https://phabricator.wikimedia.org/T163912#3214233 (10Marostegui) I will apply the same procedure to codfw master (db2018) [07:57:57] 10Blocked-on-schema-change, 10DBA: Convert unique keys into primary keys for some wiki tables on s3-eqiad and s3-codfw - https://phabricator.wikimedia.org/T163912#3653074 (10Marostegui) a:05jcrespo>03Marostegui [08:09:58] 10Blocked-on-schema-change, 10DBA: Convert unique keys into primary keys for some wiki tables on s3-eqiad and s3-codfw - https://phabricator.wikimedia.org/T163912#3653079 (10Marostegui) This has started in a screen on db2018 called: `alter` [08:49:15] 10DBA, 10Patch-For-Review: Deploy gtid_domain_id flag in our mysql hosts - https://phabricator.wikimedia.org/T149418#3653125 (10Marostegui) >>! In T149418#3004834, @Marostegui wrote: > I was doing some tests to refresh my mind and play with the new versions (10.1.21) as this is a critical change and I have fil... [09:21:07] 10DBA, 10Cloud-Services, 10Toolforge: What would be the preferred way to run a series of read queries on DB replica, each on two *_p databases ? - https://phabricator.wikimedia.org/T124805#1966479 (10Marostegui) Hi @Alphos I hope you are well. I was wondering if this task is still needed? [09:51:20] 10DBA, 10Operations, 10ops-eqiad: Test reliability of RAID configuration/database hosts on single disk failure - https://phabricator.wikimedia.org/T174054#3653239 (10Marostegui) a:03Marostegui [09:51:56] 10DBA, 10Operations, 10ops-eqiad: Test reliability of RAID configuration/database hosts on single disk failure - https://phabricator.wikimedia.org/T174054#3549516 (10Marostegui) Once depooled I will start mydumper threads to generate some read load to try to simulate a similar environment to what happened to... [12:20:05] marostegui: good morning :] Is there any policy to add a table to a wiki? I gotta add a Shorturl table to hiwikiversity [12:20:38] https://github.com/wikimedia/mediawiki-extensions-ShortUrl/blob/master/schemas/shorturls.sql a straightforward one luckily [12:26:57] hashar: assuming that table is public as in it doesn't need to be filtered in labs, you can just go ahead and create it [12:27:44] marostegui: yeah I dont think it has to be filtered out [12:27:51] doing the creation [12:27:56] good :) [12:27:57] !log does it work? [12:27:58] hashar: Not expecting to hear !log here [12:28:02] ;D [12:28:07] nope, only in operations [12:28:12] will do there [12:28:15] thank you ! [12:33:12] marostegui: turns out the table was already around :] [12:33:25] haha [13:23:28] 10Blocked-on-schema-change, 10DBA, 10Patch-For-Review: Drop now redundant indexes from pagelinks and templatelinks - https://phabricator.wikimedia.org/T174509#3653494 (10Marostegui) db2023 (s5 master) has finished the optimize, so the last alters are getting replicated in codfw. [13:24:04] 10Blocked-on-schema-change, 10DBA, 10Patch-For-Review: Drop now redundant indexes from pagelinks and templatelinks - https://phabricator.wikimedia.org/T174509#3653495 (10Marostegui) [14:01:26] 10DBA, 10Patch-For-Review: Decommission db2010 and move m1 codfw to db2078 - https://phabricator.wikimedia.org/T175685#3653603 (10Marostegui) Can db2010 be decommissioned? [14:25:13] 10DBA, 10Patch-For-Review: Decommission db2010 and move m1 codfw to db2078 - https://phabricator.wikimedia.org/T175685#3653656 (10jcrespo) Yes. [16:01:56] 10DBA, 10Analytics: Drop MoodBar tables from all wikis - https://phabricator.wikimedia.org/T153033#3653939 (10Nuria) @marostegui: let's put them on a mediawiki-archive database, the staging database (if I am not mistaken) has open permits for everyone to delete /update. If that is possible i think that would... [18:04:43] * AaronSchulz chuckles at https://www.facebook.com/MySQLatFacebook/posts/10154971839996696 [18:27:30] 10Blocked-on-schema-change, 10DBA, 10Readers-Community-Engagement, 10Community-Liaisons (Oct-Dec 2017): Help communicate read-only time for Commons for schema change required by adding 3D filetype - https://phabricator.wikimedia.org/T176883#3654530 (10CKoerner_WMF) @Marostegui Thanks for the edits. I don'... [18:45:05] 10DBA, 10Operations, 10ops-eqiad: Degraded RAID on db1056 - https://phabricator.wikimedia.org/T177171#3654609 (10Cmjohnson) Disk replaced and rebuilding Firmware state: Online, Spun Up Firmware state: Online, Spun Up Firmware state: Online, Spun Up Firmware state: Online, Spun Up Firmware state: Online, Spu... [20:28:55] 10DBA, 10Community-Tech, 10cloud-services-team, 10Security: Create core ip_changes view for replicas - https://phabricator.wikimedia.org/T173891#3655053 (10Bawolff) >>! In T173891#3645059, @MusikAnimal wrote: > The table is now live and populated on all wikis, so I've repurposed this ticket for creating th... [21:47:14] 10DBA, 10Community-Tech, 10MW-1.30-release-notes, 10MW-1.31-release-notes (WMF-deploy-2017-09-26 (1.31.0-wmf.1)), 10Patch-For-Review: Issue with maintenance script: SELECTing revisions with high rev_id is painfully slow - https://phabricator.wikimedia.org/T175962#3655223 (10DannyH) [23:01:25] 10DBA, 10Operations, 10Availability (Multiple-active-datacenters), 10Performance-Team (Radar): Make client certs available for apache/maintenance hosts for TLS connections to mariadb - https://phabricator.wikimedia.org/T175672#3655525 (10aaron) >>! In T175672#3635865, @aaron wrote: >>>! In T175672#3635140,... [23:53:17] * AaronSchulz stares at https://bugs.php.net/bug.php?id=74445