[00:10:25] 10DBA, 10Operations, 10ops-codfw: (codfw):rack/setup/install db213[2-5] - https://phabricator.wikimedia.org/T237702 (10Papaul) [00:10:55] 10DBA, 10Operations, 10ops-codfw: (codfw):rack/setup/install db213[2-5] - https://phabricator.wikimedia.org/T237702 (10Papaul) p:05Triage→03High [08:38:40] 10DBA, 10Operations, 10ops-codfw: (codfw):rack/setup/install db213[2-5] - https://phabricator.wikimedia.org/T237702 (10jcrespo) Yes, the rack proposal seems ok. [09:16:32] 10DBA, 10Operations: Switchover s1 primary database master db1067 -> db1083 - 14th Nov 05:00 - 05:30 UTC - https://phabricator.wikimedia.org/T234800 (10jcrespo) Hi, a reminder this was scheduled well in advance, provably announcement was already done, but I thought it was worth giving a reminder here one week... [09:53:49] 10DBA, 10Operations: Reboot, upgrade firmware and kernel of db1096-db1106, db2071-db2092 - https://phabricator.wikimedia.org/T216240 (10jcrespo) db2072 got stuck on `Loading initial ramdisk ...` [13:27:09] root@sangai:~# ls -lha /opt/wmf-percona-server80/bin/mysqld ~>-rwxr-xr-x 1 root root 67M Nov 7 21:40 /opt/wmf-percona-server80/bin/mysqld [13:27:19] ^ moritzm start so far... [13:28:08] great! is that with the stock boost from buster? [13:28:25] it is with 1.67 [13:28:30] but no code changes [13:28:41] (just patched the makefile) [13:29:01] maybe it is a case of "not supported" but doesn't break [13:29:12] I will ask devels what they think [13:29:44] I wonder if my research will be helpful for debian maintainers? [13:32:37] I'm not aware of anyone packaging Percona Server for Debian and mysql is still at 5.7 [13:32:51] or does that also affect latest mariadb branches? [13:32:52] well, it is very similar to mysql [13:33:10] I'm not sure about the status of 8 so far [13:33:20] the 5.7 packages are maintained by Oracle staff even [13:33:21] I just went for percona because rocksdb and a few things that gap mariadb enhancements [13:34:10] I will also have to check xtrabackup [13:34:45] as I know it requires compiling the server, but unlike mariadb it is not part of the regular package [13:35:15] also, just to be clear, this is pure experimentation [13:35:36] but we need a path forward I think toghether with buster [13:36:29] maybe Lars Tangvald is interested in your findings, he's the one maintaining 5.7 and if they ever provide 8, it will be relevant to them [13:46:39] only one question, moritzm- percona repackages mysql and create a "release", e.g. _8.0.17-8 [13:47:07] given I patch over their patches, I called mine _8.0.17-1, etc [13:47:21] or should I call it _8.0.17-8-1 ? [13:47:51] .17-1 fine, you effectively treat their release as the upstream version [13:48:00] cool, thanks [13:48:27] if we'd continually rebase to changes from percona (like Ubuntu does to Debian), it would be a different, but here it's just fine [13:55:58] well, super-experimetally, there it is: https://grafana.wikimedia.org/d/000000273/mysql?var-dc=eqiad prometheus%2Fops&var-server=db1114 [13:56:09] well, super-experimetally, there it is: https://grafana.wikimedia.org/d/000000273/mysql?var-dc=eqiad%20prometheus%2Fops&var-server=db1114 [13:56:32] I just have to wait now for it to crash :-) [13:59:13] I just realized percona offers buster packages, I wonder if they do the same patches than me [14:23:28] 10DBA, 10Goal: Address Database infrastructure blockers on datacenter switchover & multi-dc deployment - https://phabricator.wikimedia.org/T220170 (10jcrespo) [14:23:30] 10DBA, 10Operations, 10ops-codfw: (codfw):rack/setup/install db213[2-5] - https://phabricator.wikimedia.org/T237702 (10jcrespo) [14:45:36] 10DBA, 10Operations, 10serviceops, 10Goal, 10Patch-For-Review: Strengthen backup infrastructure and support - https://phabricator.wikimedia.org/T229209 (10jcrespo) [17:28:32] 10DBA, 10Operations, 10serviceops, 10Goal, 10Patch-For-Review: Strengthen backup infrastructure and support - https://phabricator.wikimedia.org/T229209 (10Papaul) [19:15:44] 10DBA, 10Goal: Address Database infrastructure blockers on datacenter switchover & multi-dc deployment - https://phabricator.wikimedia.org/T220170 (10Papaul) [21:49:16] 10DBA, 10wikitech.wikimedia.org: Rename database 'labswiki' to 'wikitechwiki' - https://phabricator.wikimedia.org/T171570 (10Andrew)