[05:51:40] <wikibugs>	 10DBA: Relocate "old" s4 hosts - https://phabricator.wikimedia.org/T253217 (10Marostegui)
[05:56:04] <wikibugs>	 10DBA, 10Patch-For-Review, 10Upstream, 10cloud-services-team (Kanban): Reimage labsdb1011 to Buster and MariaDB 10.4 - https://phabricator.wikimedia.org/T249188 (10Marostegui) db1141 finally crashed (it is not pooled) In order to have that host up-to-date in case we need to temporarily place it for a few m...
[07:16:48] <wikibugs>	 10DBA, 10Upstream: Investigate possible memory leak on db1115 - https://phabricator.wikimedia.org/T231769 (10Marostegui) After 4 days since I stopped the event scheduler, the memory never grew. I have filed this upstream: https://jira.mariadb.org/browse/MDEV-22809
[07:23:05] <wikibugs>	 10DBA, 10CheckUser, 10Trust-and-Safety, 10WMF-Legal, and 2 others: Set wgCheckUserLogLogins to true on WMF wikis to log successful and unsuccessful login attempts in CheckUser - https://phabricator.wikimedia.org/T253802 (10Marostegui) >>! In T253802#6190788, @Huji wrote: >>>! In T253802#6190510, @Ladsgroup...
[07:28:06] <wikibugs>	 10DBA, 10CheckUser, 10Trust-and-Safety, 10WMF-Legal, and 2 others: Set wgCheckUserLogLogins to true on WMF wikis to log successful and unsuccessful login attempts in CheckUser - https://phabricator.wikimedia.org/T253802 (10Urbanecm) This is possible to be turned on/off at any moment. We can also test this...
[07:29:46] <wikibugs>	 10DBA, 10CheckUser, 10Trust-and-Safety, 10WMF-Legal, and 2 others: Set wgCheckUserLogLogins to true on WMF wikis to log successful and unsuccessful login attempts in CheckUser - https://phabricator.wikimedia.org/T253802 (10Marostegui) >>! In T253802#6195306, @Urbanecm wrote: > This is possible to be turned...
[08:39:52] <wikibugs>	 10DBA: Upgrade m1 to Buster and Mariadb 10.4 - https://phabricator.wikimedia.org/T254556 (10Marostegui)
[08:40:03] <wikibugs>	 10DBA: Upgrade m1 to Buster and Mariadb 10.4 - https://phabricator.wikimedia.org/T254556 (10Marostegui) p:05Triage→03Medium
[08:46:56] <jynus>	 FileNotFoundError: [Errno 2] No such file or directory: '/opt/wmf-mariadb101/bin/mariabackup': '/opt/wmf-mariadb101/bin/mariabackup'
[08:47:20] <jynus>	 I think there is a couple of scripts with hardcoded paths
[08:51:52] <kormat>	 heh
[08:57:08] <jynus>	 on my defense, the line had this:
[08:57:25] <jynus>	 xtrabackup_path = '/opt/wmf-mariadb101/bin/mariabackup'  # FIXME for global path after upgrade
[08:58:42] <kormat>	 :)
[09:30:24] <jynus>	 retrying the snapshot again- we had fixed the transfer, but the prepare was left
[12:01:12] <wikibugs>	 10DBA, 10Growth-Team, 10MediaWiki-Recent-changes, 10Schema-change: recentchanges table indexes: tmp1, tmp2 and tmp3 - https://phabricator.wikimedia.org/T206103 (10Marostegui)
[12:22:50] <Urbanecm>	 Hello everyone, where can I read about backgrounds of doing a schema change (ie. what DBA have to do to perform an ALTER)?
[12:23:43] <marostegui>	 Urbanecm: Not sure what you exactly mean?
[12:24:01] <marostegui>	 https://wikitech.wikimedia.org/wiki/Schema_changes
[12:24:02] <marostegui>	 this?
[12:28:01] <Urbanecm>	 marostegui: I mean, once you actually run the alters, I'm curious if that happens only on master, or if you do it everywhere manually. 
[12:29:01] <marostegui>	 Urbanecm: Unless the schema change is on a very small and not super used tables, we do not run them on the master with replication enabled
[12:29:29] <marostegui>	 Urbanecm: we normally run them on the slaves, and once done if the schema change can be done online (ie: adding an index or a column) we then run it on the master without replication enabled
[12:29:45] <Urbanecm>	 I see, thanks marostegui
[12:29:49] <marostegui>	 if it cannot be done online (ie: modiying data type on a column) we have to switchover the master and once it is on a slave, we do it
[12:30:18] <marostegui>	 some tables cannot even run onliune schema changes, due to high much activity they have like image table on commonswiki or revision on enwiki
[13:33:41] <kormat>	 marostegui: \o/ re: https://gerrit.wikimedia.org/r/601761. i want to wait for moritzm to do another pass before submitting, then i can test it with something like db1077
[13:34:50] <marostegui>	 kormat: sounds good, I have stopped my tests on db1077 for the events leak
[13:34:53] <marostegui>	 so you can test on it
[14:10:57] <jynus>	 prepare worked ok this time
[14:11:22] <jynus>	 so only packaging is left, meaning the backup workflow is now ready for 10.4
[14:11:50] <jynus>	 should I test backups of 10.1 with a 10.4 xtrabackup, or we won't support that?
[14:12:19] <jynus>	 (we tested that for dumps, but not for xtrabackup)
[14:27:11] <wikibugs>	 10DBA, 10CheckUser, 10Trust-and-Safety, 10WMF-Legal, and 2 others: Set wgCheckUserLogLogins to true on WMF wikis to log successful and unsuccessful login attempts in CheckUser - https://phabricator.wikimedia.org/T253802 (10Huji) >>! In T253802#6195306, @Urbanecm wrote: > This is possible to be turned on/of...
[14:47:56] <wikibugs>	 10DBA, 10Gerrit: Get a writable reviewdb clone to test Gerrit upgrade with - https://phabricator.wikimedia.org/T254516 (10jcrespo) Thanks for the ticket, otherwise we would surely forget about the request with so many things going on.  I can take care fully of this, but @Marostegui should be on the loop becaus...
[14:51:02] <wikibugs>	 10DBA, 10Gerrit: Get a writable reviewdb clone to test Gerrit upgrade with - https://phabricator.wikimedia.org/T254516 (10jcrespo) p:05Triage→03Medium
[15:31:33] <jynus>	 name: snapshot.s1-104.2020-06-05--09-28-28
[15:31:38] <jynus>	 status: finished
[19:03:25] <wikibugs>	 10DBA, 10Gerrit: Get a writable reviewdb clone to test Gerrit upgrade with - https://phabricator.wikimedia.org/T254516 (10QChris) >>! In T254516#6196583, @jcrespo wrote: > I can take care fully of this, but @Marostegui should be on the loop because of new db and grants will be needed and he should be aware of...