[01:12:38] 10DBA, 10MediaWiki-Platform-Team, 10MediaWiki-extensions-Linter, 10Wikimedia-Extension-setup, and 3 others: Review and deploy Linter extension to Wikimedia wikis - https://phabricator.wikimedia.org/T148609#3381045 (10Legoktm) 05Open>03Resolved I left this open just in case something bad happened and we... [04:50:17] 10DBA, 10Operations, 10Wikimedia-Site-requests: Global rename of Green Cardamom → GreenC: supervision needed - https://phabricator.wikimedia.org/T168776#3381145 (10Marostegui) >>! In T168776#3379913, @alanajjar wrote: > @Marostegui can we start now? Sorry - I was not online at the time, as I am based in Eur... [04:56:06] 10DBA, 10Operations, 10Wikimedia-Language-setup, 10Wikimedia-Site-requests: Reopen Wikinews Dutch - https://phabricator.wikimedia.org/T168764#3376111 (10Marostegui) >>! In T168764#3378717, @Urbanecm wrote: > > I really think that **real** deleting of the wiki database from all db servers (and recreating,... [05:01:32] 10DBA, 10Operations, 10Wikimedia-Site-requests: Global rename of Green Cardamom → GreenC: supervision needed - https://phabricator.wikimedia.org/T168776#3381153 (10alanajjar) @Marostegui Don' mind, I'm based in Africa, Egypt (until 10 June). Aha yes, I think we should arrange a time or day! I think it's no... [05:02:20] 10DBA, 10Operations, 10Wikimedia-Site-requests: Global rename of Green Cardamom → GreenC: supervision needed - https://phabricator.wikimedia.org/T168776#3381154 (10Marostegui) >>! In T168776#3381153, @alanajjar wrote: > @Marostegui Don't mind, I'm based in Africa, Egypt (until 10 June). > > Aha yes, I think... [05:03:20] 10DBA, 10Operations, 10Wikimedia-Site-requests: Global rename of Green Cardamom → GreenC: supervision needed - https://phabricator.wikimedia.org/T168776#3381155 (10alanajjar) >>! In T168776#3380408, @Luke081515 wrote: > @alanajjar I guess it would make more sense to ping him at IRC, so if there is a problem,... [05:05:30] 10Blocked-on-schema-change, 10DBA, 10Patch-For-Review: Convert unique keys into primary keys for some wiki tables on s7 - https://phabricator.wikimedia.org/T166208#3381160 (10Marostegui) [05:07:17] 10DBA, 10Operations, 10Wikimedia-Site-requests: Global rename of Green Cardamom → GreenC: supervision needed - https://phabricator.wikimedia.org/T168776#3381161 (10alanajjar) >>! In T168776#3381154, @Marostegui wrote: >>>! In T168776#3381153, @alanajjar wrote: >> @Marostegui Don't mind, I'm based in Africa,... [05:07:41] 10DBA, 10Operations, 10Wikimedia-Site-requests: Global rename of Green Cardamom → GreenC: supervision needed - https://phabricator.wikimedia.org/T168776#3381162 (10Marostegui) >>! In T168776#3381155, @alanajjar wrote: >>>! In T168776#3380408, @Luke081515 wrote: >> @alanajjar I guess it would make more sense... [05:08:00] 10DBA, 10Operations, 10Wikimedia-Site-requests: Global rename of Green Cardamom → GreenC: supervision needed - https://phabricator.wikimedia.org/T168776#3381163 (10Marostegui) >>! In T168776#3381161, @alanajjar wrote: >>>! In T168776#3381154, @Marostegui wrote: >>>>! In T168776#3381153, @alanajjar wrote: >>>... [05:20:12] 10DBA, 10Operations, 10Wikimedia-Site-requests: Global rename of Green Cardamom → GreenC: supervision needed - https://phabricator.wikimedia.org/T168776#3381169 (10alanajjar) Finished. Thanks @Marostegui [05:21:15] 10DBA, 10Operations, 10Wikimedia-Site-requests: Global rename of Green Cardamom → GreenC: supervision needed - https://phabricator.wikimedia.org/T168776#3381170 (10Marostegui) Great! Thanks for your cooperation! :-) [06:21:03] 10DBA, 10Operations, 10Wikimedia-Site-requests: Global rename of Green Cardamom → GreenC: supervision needed - https://phabricator.wikimedia.org/T168776#3381184 (10alanajjar) 05Open>03Resolved [06:47:59] 10Blocked-on-schema-change, 10DBA, 10Patch-For-Review: Convert unique keys into primary keys for some wiki tables on s7 - https://phabricator.wikimedia.org/T166208#3381201 (10Marostegui) #cloud-services-team I am going to start the alter table on labsdb1001, so s7 will get delayed around a day. [07:16:42] 10DBA, 10ArchCom-RfC, 10RESTBase-API, 10Reading List Service, and 4 others: RfC: Reading List service - https://phabricator.wikimedia.org/T164990#3381254 (10jcrespo) > Any final requests regarding the DB schema? Not really, as long as the https://www.mediawiki.org/wiki/Development_policy#Database_policy i... [08:04:25] 10DBA, 10Operations, 10Wikimedia-Language-setup, 10Wikimedia-Site-requests: Reopen Wikinews Dutch - https://phabricator.wikimedia.org/T168764#3381334 (10Urbanecm) In that case I think the requestor (or somebody else) should delete all pages and import new pages from incubator. I'll create a patch for reope... [08:32:26] 10Blocked-on-schema-change, 10DBA: Apply schema change to add 3D filetype for STL files - https://phabricator.wikimedia.org/T168661#3381427 (10Marostegui) [09:24:09] https://gerrit.wikimedia.org/r/361456 [12:11:45] 10Blocked-on-schema-change, 10DBA: Apply schema change to add 3D filetype for STL files - https://phabricator.wikimedia.org/T168661#3381897 (10Marostegui) [12:22:05] 10Blocked-on-schema-change, 10DBA: Apply schema change to add 3D filetype for STL files - https://phabricator.wikimedia.org/T168661#3381922 (10Marostegui) [12:49:08] 10Blocked-on-schema-change, 10DBA: Apply schema change to add 3D filetype for STL files - https://phabricator.wikimedia.org/T168661#3382044 (10Marostegui) Due to the bug that triggers a rebuild the massive tables will not be able to be altered on the master without a master switchover. ie: image table on s4 is... [12:58:18] 10DBA, 10MediaWiki-Parser, 10MediaWiki-Platform-Team: WMF ParserCache disk space exhaustion - https://phabricator.wikimedia.org/T167784#3382056 (10jcrespo) 05Resolved>03Open a:05tstarling>03jcrespo I do not think this is resolved, but ongoing (based on disk space trends). [13:03:34] 10DBA, 10Operations, 10ops-eqiad, 10Patch-For-Review: x1 master db1031: Faulty BBU - https://phabricator.wikimedia.org/T166108#3382080 (10Marostegui) 05Open>03stalled I have changed it to stalled as I don't think we are replacing its BBU anytime soon - it is a master. [13:21:38] 10DBA, 10MediaWiki-Parser, 10MediaWiki-Platform-Team, 10Patch-For-Review: WMF ParserCache disk space exhaustion - https://phabricator.wikimedia.org/T167784#3382148 (10jcrespo) a:05jcrespo>03tstarling [13:50:44] 10DBA: Drop localisation and localisation_file_hash tables, l10nwiki databases too - https://phabricator.wikimedia.org/T119811#1836334 (10Marostegui) Current status: s1: ``` -rw-rw---- 1 mysql mysql 1.0M Mar 22 2013 ./enwiki/localisation_file_hash.ibd ``` s2: ``` -rw-rw---- 1 mysql mysql 1.0M Sep 25 2013 ./l1... [13:53:11] 10DBA: Drop localisation and localisation_file_hash tables, l10nwiki databases too - https://phabricator.wikimedia.org/T119811#3382250 (10Marostegui) a:03Marostegui I have renamed the table on db1089 and will leave it there for a few days to make sure nothing breaks: ``` root@db1089[enwiki]> set session sql_lo... [14:14:58] 10DBA: Drop localisation and localisation_file_hash tables, l10nwiki databases too - https://phabricator.wikimedia.org/T119811#3382331 (10Marostegui) p:05Triage>03Normal I have taken a backup of these (mostly totally empty) tables on: ``` dbstore1001:/srv/tmp/T119811 root@dbstore1001:/srv/tmp/T119811# du -sh... [14:18:04] 10DBA, 10Epic, 10Tracking: Database tables to be dropped on Wikimedia wikis and other WMF databases (tracking) - https://phabricator.wikimedia.org/T54921#3382335 (10Marostegui) @tstarling As a background task for myself I am slowly cleaning up all the tables listed here to be removed, so they don't pile up m... [14:27:12] 10DBA, 10Labs, 10Patch-For-Review: Fix broken views in labs DB "ERROR 1356 -- references invalid table(s) or column(s)" - https://phabricator.wikimedia.org/T153213#3382376 (10chasemp) >>! In T153213#3377614, @Marostegui wrote: > I have cleaned up the views, the only pending thing would be to merge: https://g... [14:28:31] 10DBA, 10Labs, 10Patch-For-Review: Fix broken views in labs DB "ERROR 1356 -- references invalid table(s) or column(s)" - https://phabricator.wikimedia.org/T153213#3382386 (10Marostegui) Oh thank you @chasemp! I didn't know that - next time I will clean it up with the script :-) [14:37:47] 10DBA, 10Labs, 10Patch-For-Review: Fix broken views in labs DB "ERROR 1356 -- references invalid table(s) or column(s)" - https://phabricator.wikimedia.org/T153213#3382413 (10chasemp) A run post merge on labsdb1009: > sudo puppet agent --test (updates the repo) > time maintain-views --all-databases --clean... [14:56:18] 10DBA, 10Operations, 10Wikimedia-Language-setup, 10Wikimedia-Site-requests: Reopen Wikinews Dutch - https://phabricator.wikimedia.org/T168764#3382535 (10Luke081515) I would prefer, if we do the reopen first, otherwise, if there is a lag between import and reopen, changes at incubator can get missed. We can... [15:09:38] 10DBA, 10Operations, 10Wikimedia-Language-setup, 10Wikimedia-Site-requests: Reopen Wikinews Dutch - https://phabricator.wikimedia.org/T168764#3382585 (10MF-Warburg) >>! In T168764#3381334, @Urbanecm wrote: > In that case I think the requestor (or somebody else) should delete all pages and import new pages... [15:10:17] 10DBA, 10Operations, 10Wikimedia-Language-setup, 10Wikimedia-Site-requests: Reopen Wikinews Dutch - https://phabricator.wikimedia.org/T168764#3382612 (10MF-Warburg) >>! In T168764#3382535, @Luke081515 wrote: > We can add .* to the TBL after removed from closed lists to prevent new pages before import finis... [16:06:30] 10DBA, 10Operations, 10Wikimedia-Language-setup, 10Wikimedia-Site-requests, 10User-Urbanecm: Reopen Wikinews Dutch - https://phabricator.wikimedia.org/T168764#3382914 (10Urbanecm) a:03Urbanecm >>! In T168764#3382585, @MF-Warburg wrote: >>>! In T168764#3381334, @Urbanecm wrote: >> In that case I think t... [17:21:43] 10DBA, 10Operations, 10cloud-services-team: Labsdb* servers need to be rebooted - https://phabricator.wikimedia.org/T168584#3383543 (10madhuvishy) Thanks for the detailed explanation @jcrespo. For labsdb1001 and 1003, I'll check with Chris and schedule the dns switchover and the reboots to happen this week/e... [17:24:16] 10DBA, 10Operations, 10cloud-services-team: Labsdb* servers need to be rebooted - https://phabricator.wikimedia.org/T168584#3383577 (10madhuvishy) @Cmjohnson Hi! We are looking at rebooting labsdb1001 and 1003, and it seems like these boxes may not come up automatically on reboot. Jaime recommended that it w... [19:14:53] 10DBA, 10Operations, 10cloud-services-team: Labsdb* servers need to be rebooted - https://phabricator.wikimedia.org/T168584#3384109 (10jcrespo) > it would be easier to just reboot the boxes I am ok with that if you are ok with that. Announcement should be done, though- on last upgrade people got upset even... [19:18:57] 10Blocked-on-schema-change, 10DBA, 10Patch-For-Review: Convert unique keys into primary keys for some wiki tables on s7 - https://phabricator.wikimedia.org/T166208#3384120 (10jcrespo) db1034 seems to be having physical disk issues-lots of errors (I have not created a ticket yet). Consider not pooling it back... [19:29:53] 10Blocked-on-schema-change, 10DBA, 10Patch-For-Review: Convert unique keys into primary keys for some wiki tables on s7 - https://phabricator.wikimedia.org/T166208#3384145 (10Marostegui) Oh - thanks for the heads up. I will take a look tomorrow