[01:07:59] 10DBA, 10Wikimedia-General-or-Unknown, 10User-Reedy, 10Wikimedia-maintenance-script-run: Run updateRestrictions.php on WMF wikis - https://phabricator.wikimedia.org/T166184#3451044 (10Reedy) Should just be a jfdi one this. enwiki has 4109... I can't imagine many wikis having many more rows to run [01:26:49] 10DBA, 10Operations: Evaluate how hard would be to get aa(wikibooks|wiktionary) and howiki databases deleted - https://phabricator.wikimedia.org/T169928#3451129 (10MF-Warburg) Does "I would rather get mediawiki handle its deleting and all the related checks to be honest." mean you would like to have a function... [01:55:10] 10DBA, 10Operations: Evaluate how hard would be to get aa(wikibooks|wiktionary) and howiki databases deleted - https://phabricator.wikimedia.org/T169928#3413499 (10Legoktm) What exactly is the purpose of deleting wikis? It provides no benefit and is more likely to break things. [03:43:32] 10DBA, 10CheckUser, 10Patch-For-Review: The "show ip" action should also provide a distinct list of user-agents for each IP - https://phabricator.wikimedia.org/T170508#3451249 (10Huji) Adding DBA so they can review the query and approve of it. I think the use cases are infrequent enough, and the existing ind... [04:05:25] 10DBA, 10Data-Services, 10WMF-Legal, 10Patch-For-Review: Expose ar_content_format and ar_content_model columns of archive table on Labs replicas - https://phabricator.wikimedia.org/T89741#3451264 (10ZhouZ) Speaking for legal, we clear this change as well. [07:15:39] 10DBA, 10Commons, 10MW-1.30-release-notes, 10MediaWiki-Special-pages, and 3 others: Special:ShortPages does not load in Wikimedia Commons: "Read timeout is reached" - https://phabricator.wikimedia.org/T168010#3451413 (10jcrespo) 05Open>03Resolved a:03Anomie AFAIK @Jcb @Josve05a your (more than reason... [08:00:12] 10DBA, 10Epic, 10Tracking: Database tables to be dropped on Wikimedia wikis and other WMF databases (tracking) - https://phabricator.wikimedia.org/T54921#3451451 (10Marostegui) [08:08:38] 10DBA, 10Analytics-Kanban, 10Patch-For-Review: Inconsistent default charset for analytics slaves - https://phabricator.wikimedia.org/T170952#3448710 (10Marostegui) Could that be that db1047 was using utf8 just for historic reasons and dbstore1002 got the template from the dbstore servers that uses binary? [08:09:15] 10DBA: Truncate table "interwiki" on all wmf sites - https://phabricator.wikimedia.org/T169376#3451465 (10Marostegui) a:03Marostegui [08:23:55] 10DBA, 10Wikimedia-Language-setup: Deletion of als Wiktionary, Wikibooks and Wikiquote? - https://phabricator.wikimedia.org/T169450#3451493 (10Urbanecm) Yes, if there is a reason for it. [08:23:58] 10DBA: Truncate table "interwiki" on all wmf sites - https://phabricator.wikimedia.org/T169376#3451494 (10Marostegui) 05Open>03Resolved The current situation is the ideal situation :-) : s1 - table is empty s2 - table is empty s3 - table is empty in all the wikis where it exists from the s3.dblist. s4 - tab... [08:24:00] 10DBA, 10Epic, 10Tracking: Database tables to be dropped on Wikimedia wikis and other WMF databases (tracking) - https://phabricator.wikimedia.org/T54921#3451496 (10Marostegui) [09:50:59] 10Blocked-on-schema-change, 10DBA, 10Patch-For-Review: Convert unique keys into primary keys for some wiki tables on s1 - https://phabricator.wikimedia.org/T166204#3451647 (10Marostegui) db1065 is done: ``` root@neodymium:/home/marostegui# for i in `cat s1_tables`; do echo $i; mysql --skip-ssl -hdb1065 enwik... [09:51:08] 10Blocked-on-schema-change, 10DBA, 10Patch-For-Review: Convert unique keys into primary keys for some wiki tables on s1 - https://phabricator.wikimedia.org/T166204#3451648 (10Marostegui) [10:33:18] 10DBA, 10Analytics-Kanban, 10Patch-For-Review: Inconsistent default charset for analytics slaves - https://phabricator.wikimedia.org/T170952#3451799 (10elukey) >>! In T170952#3451463, @Marostegui wrote: > Could that be that db1047 was using utf8 just for historic reasons and dbstore1002 got the template from... [10:43:04] 10DBA, 10Analytics-Kanban, 10Patch-For-Review: Inconsistent default charset for analytics slaves - https://phabricator.wikimedia.org/T170952#3451817 (10Marostegui) Keep in mind that altering the database will not change the existing data, it will just change the default so the new tables will get the new def... [10:50:25] 10DBA, 10Analytics-Kanban, 10Patch-For-Review: Inconsistent default charset for analytics slaves - https://phabricator.wikimedia.org/T170952#3451829 (10elukey) >>! In T170952#3451817, @Marostegui wrote: > Keep in mind that altering the database will not change the existing data, it will just change the defau... [10:52:17] 10DBA, 10Analytics-Kanban, 10Patch-For-Review: Inconsistent default charset for analytics slaves - https://phabricator.wikimedia.org/T170952#3451831 (10Marostegui) So what we can do is: ``` alter database log DEFAULT CHARACTER SET binary; ``` So the new tables will be binary at least, and if you feel some... [10:57:30] 10DBA, 10Analytics-Kanban, 10Patch-For-Review: Inconsistent default charset for analytics slaves - https://phabricator.wikimedia.org/T170952#3448710 (10jcrespo) A char with binary collation is essentially a binary field- mysql translates it automaticaly if you explicitly or implicitly define somethin as CHAR... [11:34:31] 10DBA, 10Operations: Global rename of user Moros - https://phabricator.wikimedia.org/T170941#3451982 (10Steinsplitter) 05Open>03Resolved [14:06:01] 10DBA, 10Analytics, 10Analytics-EventLogging, 10Contributors-Analysis, and 2 others: Add index to mediawiki_page_create_1 table - https://phabricator.wikimedia.org/T170990#3452501 (10Ottomata) We can add extra indexes to MySQL tables, but they'll be one offs. That is, other EventBus event tables that we m... [14:31:51] 10DBA, 10Operations: Set up backup strategy for es clusters - https://phabricator.wikimedia.org/T79922#3452586 (10fgiunchedi) [16:51:07] 10DBA, 10Operations, 10Performance-Team, 10Availability (Multiple-active-datacenters): Perform testing for TLS effect on connection rate - https://phabricator.wikimedia.org/T171071#3453087 (10aaron) [17:05:00] 10DBA, 10Operations, 10Performance-Team, 10Availability (Multiple-active-datacenters): Apache <=> mariadb SSL/TLS for cross-datacenter writes - https://phabricator.wikimedia.org/T134809#3453151 (10aaron) Roll-out should probably be something like: a) DB_MASTER connections for testwiki/mediawikiwiki (group... [17:11:49] jynus: deployment-prep is on 10.0.23-MariaDB-log. Were you saying there were TLS blockers fixed sometime between that version and 10.0.30-MariaDB ? [17:13:06] well that and 10.0.28 (I see prod is running that too) [17:13:24] for what I see, they were already upgraded [17:13:40] so they actually just need to enable tls [17:13:48] I thought it was in a worse state [17:14:43] so it is not enabled, but it would just need a puppet change + a restart, so easy [17:14:55] I was wrong [17:15:24] can I ask you something AaronSchulz [17:15:43] I am not sure what changes are needed in code to enable tls connections, is it easy? [17:16:21] 10DBA, 10Analytics, 10Analytics-EventLogging, 10Contributors-Analysis, and 2 others: Add index to mediawiki_page_create_1 table - https://phabricator.wikimedia.org/T170990#3453181 (10kaldari) >We can add extra indexes to MySQL tables, but they'll be one offs @Ottomata: All of the existing EventLogging tabl... [17:16:22] I know it is easy on php, I just do not know which driver is used on hhvm [17:16:31] or in mediawiki config [17:17:08] the deployment of keys/and certs on our side should be easy [17:17:38] 10DBA: Truncate table "interwiki" on all wmf sites - https://phabricator.wikimedia.org/T169376#3453187 (10demon) >>! In T169376#3451494, @Marostegui wrote: > s3 - table is empty in all the wikis where it exists from the s3.dblist. We aren't gonna create it where it's missing? [17:18:25] specially if it is enabled conditionally first [17:18:51] jynus: mysqli, and the MediaWiki driver supports passing the SSL flag and overriding ca paths and the like if needed [17:19:23] that was added a few quarters back [17:19:25] cool [17:19:58] so from my side, I would make sure to deploy keys (for now, the default large ones) to terbium [17:20:10] and I will ask your help to enable it there? [17:20:16] sounds like a plan? [17:20:21] and we do some testing, ok? [17:20:57] I may need support from app server people, as sometimes I get lost with the security model of different users [17:21:46] 10DBA, 10Analytics, 10Analytics-EventLogging, 10Contributors-Analysis, and 2 others: Add index to mediawiki_page_create_1 table - https://phabricator.wikimedia.org/T170990#3453226 (10Ottomata) > All of the existing EventLogging tables (not from EventBus) have wiki, timestamp 2-column indexes ```KEY `wiki... [17:22:24] jynus: ok [17:42:56] 10DBA, 10Wikimedia-General-or-Unknown, 10User-Reedy, 10Wikimedia-maintenance-script-run: Run updateRestrictions.php on WMF wikis - https://phabricator.wikimedia.org/T166184#3453305 (10Reedy) 42634455 pages on enwiki, 4109 `page_restrictions != ""` pages. Batch increased ten fold in https://gerrit.wikimedi... [18:06:31] 10DBA: Truncate table "interwiki" on all wmf sites - https://phabricator.wikimedia.org/T169376#3453433 (10Marostegui) >>! In T169376#3453187, @demon wrote: >>>! In T169376#3451494, @Marostegui wrote: >> s3 - table is empty in all the wikis where it exists from the s3.dblist. > > We aren't gonna create it where... [18:17:58] 10DBA: Truncate table "interwiki" on all wmf sites - https://phabricator.wikimedia.org/T169376#3453513 (10demon) Okie dokie, misunderstood :) [20:21:23] 10DBA, 10Wikimedia-General-or-Unknown, 10User-Reedy, 10Wikimedia-maintenance-script-run: Run updateRestrictions.php on WMF wikis - https://phabricator.wikimedia.org/T166184#3454184 (10Reedy) It's going a lot faster now on those other wikis [20:23:20] 10DBA, 10Wikimedia-General-or-Unknown, 10User-Reedy, 10Wikimedia-maintenance-script-run: Run updateRestrictions.php on WMF wikis - https://phabricator.wikimedia.org/T166184#3454208 (10Reedy) 05Open>03Resolved a:03Reedy And it's done. [21:29:59] 10DBA: dbstore1001 mysql crashed with: semaphore wait has lasted > 600 seconds - https://phabricator.wikimedia.org/T169050#3454451 (10jcrespo) 05Resolved>03Open dbstore1001 is completely broken. It is okay to close this, but declare "At least the two shards that broke are now fixed." would be a falsehood. F...