[04:53:51] 10DBA: Recompress special slaves across eqiad and codfw - https://phabricator.wikimedia.org/T235599 (10Marostegui) [06:46:43] 10DBA, 10DC-Ops, 10decommission, 10Goal, 10Patch-For-Review: Decommission dbstore1001, dbstore2001, dbstore2002 - https://phabricator.wikimedia.org/T220002 (10ops-monitoring-bot) cookbooks.sre.hosts.decommission executed by marostegui@cumin1001 for hosts: `dbstore2002.codfw.wmnet` - dbstore2002.codfw.wm... [07:09:21] 10DBA, 10Core Platform Team, 10MW-1.34-notes (1.34.0-wmf.24; 2019-09-24), 10Performance Issue, 10mariadb-optimizer-bug: Review special replica partitioning of certain tables by `xx_user` - https://phabricator.wikimedia.org/T223151 (10Marostegui) So far nothing has shown up on db1089 ( enwiki.revision` no... [07:39:11] 10DBA, 10conftool: specify group (api/vslow/etc) weights in terms of 0..100 instead of 0..1 - https://phabricator.wikimedia.org/T231018 (10Marostegui) [07:52:00] 10DBA, 10conftool: specify group (api/vslow/etc) weights in terms of 0..100 instead of 0..1 - https://phabricator.wikimedia.org/T231018 (10Marostegui) [08:23:15] 10DBA, 10conftool: specify group (api/vslow/etc) weights in terms of 0..100 instead of 0..1 - https://phabricator.wikimedia.org/T231018 (10Marostegui) [08:24:20] 10DBA, 10conftool: specify group (api/vslow/etc) weights in terms of 0..100 instead of 0..1 - https://phabricator.wikimedia.org/T231018 (10Marostegui) 05Open→03Resolved a:03Marostegui All the weights have been migrated to x100, so we can now warm up api,vslow,dump,rc hosts [10:02:30] regarding the dbstores, I thought they had an array of disks expansion, but I don't see it on netbox? [10:03:16] no, we just bought bigger disks if I remember correctly [10:03:23] and just swapped them and reimage [10:03:43] cool, so then it was only the old labsdbs maybe? [10:03:50] or some other hosts? [10:04:02] I think it was the old labsdb [10:04:38] ah, and the dbprov are 1U [10:05:08] I wonder if some of the power issues come from the density increase [10:05:29] I just saw what you retweeded about the debian package hahahaha [10:07:15] did you attend the mariadb IAMA on monday? [10:07:29] Nop [10:07:30] DId you? [10:08:07] I read they said it was going to be focused on mostly technical bits, so... [10:09:48] no, i didn't [10:46:19] 10DBA, 10Operations, 10Traffic, 10WMF-Legal, and 3 others: dbtree loads third party resources (from jquery.com and google.com) - https://phabricator.wikimedia.org/T96499 (10jcrespo) [12:28:58] 10DBA, 10Core Platform Team, 10MW-1.34-notes (1.34.0-wmf.24; 2019-09-24), 10Performance Issue, 10mariadb-optimizer-bug: Review special replica partitioning of certain tables by `xx_user` - https://phabricator.wikimedia.org/T223151 (10Marostegui) I have removed db1130 from s5 special groups and left it ba... [13:57:06] 10DBA, 10Core Platform Team, 10MW-1.34-notes (1.34.0-wmf.24; 2019-09-24), 10Performance Issue, 10mariadb-optimizer-bug: Review special replica partitioning of certain tables by `xx_user` - https://phabricator.wikimedia.org/T223151 (10jcrespo) Addendum, there is also logging of long running queries killed... [15:32:01] 10DBA, 10Core Platform Team, 10MW-1.34-notes (1.34.0-wmf.24; 2019-09-24), 10Performance Issue, 10mariadb-optimizer-bug: Review special replica partitioning of certain tables by `xx_user` - https://phabricator.wikimedia.org/T223151 (10Marostegui) The first analysis of the slow query log on a non partition... [15:52:20] 10DBA, 10Cloud-VPS, 10cloud-services-team (Kanban): CloudVPS: m5-master databases for openstack may require re-encoding - https://phabricator.wikimedia.org/T234830 (10aborrero) [16:59:44] 10DBA, 10Product-Infrastructure-Team-Backlog, 10Schema-change, 10Wikipedia-Android-App-Backlog (Android-app-release-v2.7.29x-N-Nanaimo-Bar): Remove "targets" from Suggested Edits API. - https://phabricator.wikimedia.org/T235908 (10Mholloway) [18:45:07] 10DBA, 10Wikimedia-Rdbms, 10Goal, 10Performance-Team (Radar), and 2 others: FY18/19 TEC1.6 Q4: Improve or replace the usage of GTID_WAIT with pt-heartbeat in MW - https://phabricator.wikimedia.org/T221159 (10WDoranWMF)