[06:43:34] jayme: db1077 is set as read only (took me a while to figure out as the errors from otrs weren't helpful at all). I 'd like to set it to read write to do the schema upgrades and open it up to volunteer agents to test. Objections? [06:43:56] sigh [06:44:07] too early in the morning, wrong ping sorry jayme [06:44:15] jynus: db1077 is set as read only (took me a while to figure out as the errors from otrs weren't helpful at all). I 'd like to set it to read write to do the schema upgrades and open it up to volunteer agents to test. Objections? [06:44:47] np, just about to start scratching my head as that seemed a bit out of the blue :-) [06:44:58] :-) [06:46:02] akosiaris: I can do that for you if you like [06:46:31] akosiaris: For the volunteer agents, we can set grants just for that DB, is that already done? [06:47:07] is the RO blocking you right now? I can set it up to RW to unblock you, but I would like to wait for jaime for the rest as he's been handling that [06:47:20] marostegui: oh no worries, I am at the prompt with set global read_only=off; I can do it [06:47:26] Basically to avoid stepping into each other's toes :) [06:47:34] sure I can wait [06:47:53] AFAICT jaime has created grants for just that DB. I can't see any other in show databases [06:48:07] akosiaris: You have my +1 for read_only=off sure [06:48:38] I forgot you are really a DBA even if you deny it [06:48:45] nice try :P [07:11:46] akosiaris: sure, my mistake [07:11:52] let me set it on puppet too [07:16:46] https://gerrit.wikimedia.org/r/c/operations/puppet/+/616012 [07:18:30] that will avoid the ongoing crit: CRIT: read_only: "False", expected "True" [07:18:34] thanks! [07:18:39] +1ed [07:25:31] OK: read_only: False [07:28:18] should I deploy this, marostegui https://gerrit.wikimedia.org/r/c/operations/puppet/+/523702 ? [07:28:27] not sure what is the state of gerrit right now [07:28:33] deleted/renamed? [07:29:26] jynus: gerrit is dropped :) [07:29:39] so I deploy that? [07:29:46] +1 [07:36:38] I think that change is already deployed, at least it tells me there is not change compared to HEAD [07:38:37] https://phabricator.wikimedia.org/rOPUP1983742a0ff711f39a5cd5857c10f42460f4dd94 [07:38:51] Authored by Marostegui on Sep 5 2019, 09:38 ? [07:38:56] wat? [07:39:29] https://phabricator.wikimedia.org/T231539 [07:39:55] I don't know, sept 2019 is like ancient rome to me [07:40:02] XDD [07:40:14] "I always like the great work well done" [07:40:20] "but if you have done nothing!" [07:41:01] https://www.youtube.com/watch?v=VnTpl93q3Bc [08:25:33] 10DBA, 10MediaWiki-extensions-OAuthRateLimiter, 10Patch-For-Review, 10Platform Team Initiatives (API Gateway): Review request for a new database table for OAuthRateLimiter - https://phabricator.wikimedia.org/T258711 (10Marostegui) p:05Triage→03Medium [09:56:08] 10DBA, 10Google-Summer-of-Code (2020), 10Patch-For-Review: GSoC 2020 Proposal: Improve the framework to transfer files over the LAN - https://phabricator.wikimedia.org/T248256 (10jcrespo) I have updated a few things that were outadated at https://wikitech.wikimedia.org/wiki/Transfer.py Don't worry too much a... [10:02:12] marostegui: good news! our cloud project has working puppetmaster+puppetdb+cumin nodes [10:02:27] cooooooool! [10:02:28] the config is in the `sandbox/kormat/pontoon-mariadb104-test` branch on the puppet repo [10:02:40] we'll keep it rebased on `production` [10:02:53] and both of us (well, anyone in ops, really) can force-push to it to keep it updated [10:03:10] if it has cumin like production, does it mean they will contain transferpy too? [10:03:44] jynus: i had to cut some things out so it would work, currently transferpy is one of them [10:04:02] that can probably be fixed [10:04:08] ok, was asking [10:04:11] I don't need it at the time [10:04:16] ack [10:23:34] 10DBA, 10MediaWiki-extensions-OAuthRateLimiter, 10Patch-For-Review, 10Platform Team Initiatives (API Gateway): Review request for a new database table for OAuthRateLimiter - https://phabricator.wikimedia.org/T258711 (10Kormat) a:03Kormat @Pchelolo: the filtering is now in place. Let's keep the task open,... [10:24:03] 10DBA, 10MediaWiki-extensions-OAuthRateLimiter, 10Patch-For-Review, 10Platform Team Initiatives (API Gateway), 10User-Kormat: Review request for a new database table for OAuthRateLimiter - https://phabricator.wikimedia.org/T258711 (10Kormat) [10:32:17] kormat: if at some point you want to learn more about mysql table design, I have a tutorial at: https://www.slideshare.net/jynus/mysql-schema-design-in-practice [10:32:40] the use cases are for mediawiki [10:32:46] just a brief 118 slides! [10:32:53] (that's cool, thank you :) [10:33:12] ah, that is because you haven't seen the 200 ones for query optimization! https://www.slideshare.net/jynus/query-optimization-with-mysql-80-and-mariadb-103-the-basics [10:33:20] (the basics) [10:33:23] "the basics" [10:33:28] indeed [10:34:58] it will be much more applied that whatever percona plans to do [10:35:02] *than [10:40:30] 10DBA: pl_namespace index on pagelinks is unique only in s8 - https://phabricator.wikimedia.org/T256685 (10Marostegui) [13:38:20] some hot meme to end the weekend: https://i.imgflip.com/49a5km.jpg [13:39:05] perfect 👌 [13:40:26] *for the/to end the week [13:46:05] jynus: today's example of that: https://github.com/wikimedia/puppet/blob/production/modules/mariadb/manifests/heartbeat.pp#L20 [13:47:39] what's the issue, the comment is all but true? [13:48:29] jynus: a "service" being run from puppet for >2 years makes me sad [13:48:55] now imagine being in charge of the basically the same setup on your own, no help, with lots of incoming requests, with 24/7 on call [13:49:15] jynus: 😱 [13:50:11] there is a lot of talks about "reducing technical debt" but the truth is that the only reason some things are up is because technical debt was borrowed at the time [13:51:09] do you think I took pleasure on it? [13:52:44] 14 hours working days, and normally a couple of outages during the weekend [13:52:57] jynus: i'm _not_ blaming anyone for the state. [13:53:07] I know, but I am explaining the context [13:53:18] at least you can now ask why some decisions were chosen [13:53:50] I didn't have the option, and barely could maintain what was already there [13:54:10] learning about unpuppetized script every week :-D [13:54:28] my largest contribution was to puppetize what already existed [13:54:37] I really didn't have the time to refactor it [13:54:49] you should now have that time, and we thank you for it [13:55:56] * kormat nods [14:08:39] maybe we will be able to run faster with the new manager [19:47:49] 10DBA, 10MediaWiki-extensions-OAuthRateLimiter, 10Patch-For-Review, 10Platform Team Initiatives (API Gateway), and 2 others: Review request for a new database table for OAuthRateLimiter - https://phabricator.wikimedia.org/T258711 (10WDoranWMF)