[09:41:44] jynus: let me know when you'd like to start giving the new mysql exporter a try btw, probably the messier issue would be to add new flags only for a subset of hosts [09:43:40] but is it only a package update, right? [09:44:21] what I mean is that we can upgrade without changing config on selected hosts, or does it need configuration changes? [09:54:42] no configuration changes no, but enabling the new stats requires additional commandline flags afaict [09:56:35] ok, we can upgrade first, then change the configuration [10:24:59] yep, so the package is on copper, I haven't uploaded it yet, how you'd like to proceed? jessie only heh but I can build it for trusty too [10:25:29] I do not think we need trusty [10:25:49] I would upload the new jessie package [10:26:19] test the upgrade progressively (e.g upgrade all of codfw jessies) [10:26:28] then do a progressive config change [10:26:44] keep the old package around, just in case [10:30:00] ok, is there a machine in codfw I can test the upgrade manually by installing the package? [10:51:54] 10DBA, 06Community-Tech, 10MediaWiki-User-management: Do test queries for range contributions to gauge performance of using different tables - https://phabricator.wikimedia.org/T156318#3262487 (10jcrespo) I've run the following on db2048: ``` root@db2048.codfw.wmnet[enwiki]> CREATE TABLE ip_changes2 like ip_... [10:53:03] 10DBA, 06Community-Tech, 10MediaWiki-User-management: Do test queries for range contributions to gauge performance of using different tables - https://phabricator.wikimedia.org/T156318#3262489 (10jcrespo) [10:58:05] I want to do that, but it is not a priority right now - we can upgrade though [11:06:10] yeah just to check if it is ok to upload the package and upgrading won't actually cause more/less metrics [11:07:48] yes [11:08:09] we will do the other necesary changes with time [11:09:05] I think fixing thing that are broken like the list generation or the backups blocking stuff will take precedence [11:09:14] and even affect you too [11:09:29] but the upgrade that takes no time can be done now [11:11:00] *nod* what would be a machine in codfw I could use? [11:11:15] oh, we can do all of codfw at a time [11:11:25] take db2048 for starting [11:11:41] then we can do all of codfw with cumin [11:12:12] ok thanks! [11:21:55] LGTM, I downgraded back again since the db is trusty so it won't stay installed because of init-system-helpers shenanigans [11:22:04] oh, sorry [11:22:08] I didn't realize [11:22:19] the connection name is interesting [11:22:30] let's try on one with multi source [11:22:36] to see how much it changes [11:23:13] dbstore2001 should be jessie and with multi-source [11:23:29] I will try that [11:25:17] oh, you have not uploaded it yet. I will wait [13:27:37] 10DBA, 06Labs: Labs database replica drift - https://phabricator.wikimedia.org/T138967#2415416 (10-jem-) I have found six eswiki deleted articles which still appear in the page table in Labs, located by using this trial-and-error query after one of them was detected in my Labs tool: ``` MariaDB [eswiki_p]> se... [13:46:31] 10DBA, 10RESTBase, 10Reading List Service, 06Reading-Infrastructure-Team-Backlog (Kanban), and 2 others: Investigate requirements for MySQL access in RESTBase - https://phabricator.wikimedia.org/T164805#3263061 (10Tgr) Come to think of it, MySQL access in RESTBase will be necessary anyway for push notifica... [14:02:40] 10DBA, 06Labs: Labs database replica drift - https://phabricator.wikimedia.org/T138967#3263120 (10jcrespo) Fixed: ``` root@labsdb1003[eswiki_p]> select page_title from page where page_is_new = 1 and page_touched like '2015061%' and page_namespace = 0 and page_is_redirect = 0 and page_touched = page_links_updat... [14:03:01] 10DBA, 10RESTBase, 10Reading List Service, 06Reading-Infrastructure-Team-Backlog (Kanban), and 2 others: Investigate requirements for MySQL access in RESTBase - https://phabricator.wikimedia.org/T164805#3263121 (10mobrovac) >>! In T164805#3263061, @Tgr wrote: > Come to think of it, MySQL access in RESTBase... [15:39:06] 10DBA, 10RESTBase, 10Reading List Service, 06Reading-Infrastructure-Team-Backlog (Kanban), and 2 others: Investigate requirements for MySQL access in RESTBase - https://phabricator.wikimedia.org/T164805#3263711 (10Fjalapeno) @mobrovac @tgr not to muddy the waters, but I have been doing some research in reg... [16:45:06] 10DBA, 06Operations: Adapt wmf-mariadb10 package for jessie or puppetize differently its service to adapt it to systemd - https://phabricator.wikimedia.org/T116903#3263938 (10jcrespo) we will repurpose this for stretch, we'll keep probably 10.0 on jesssie using inet.d. [16:46:15] 10DBA, 06Operations: Adapt wmf-mariadb101 package for stretch and adapt its service to systemd - https://phabricator.wikimedia.org/T116903#3263939 (10jcrespo) [16:50:05] 10DBA: Set up and package wmfmariadbpy helper scripts so they can easily be deployed to all database server and client hosts - https://phabricator.wikimedia.org/T165358#3263988 (10jcrespo) [20:10:10] 10DBA, 10Gerrit, 06Operations, 06Release-Engineering-Team, 13Patch-For-Review: Gerrit shows HTTP 500 error when pasting extended unicode characters - https://phabricator.wikimedia.org/T145885#3265015 (10Paladox) Not sure if we should bother doing this as I found problems when upgrading a gerrit install f...