[06:22:17] <wikibugs>	 10DBA, 10Operations, 10Wikimedia-Site-requests: Global rename of JeanBono → Rexcornot: supervision needed - https://phabricator.wikimedia.org/T181170#3787772 (10Marostegui) I am now online
[06:27:57] <wikibugs>	 10Blocked-on-schema-change, 10DBA, 10Data-Services, 10Dumps-Generation, and 2 others: Schema change for refactored comment storage - https://phabricator.wikimedia.org/T174569#3787775 (10Marostegui) I am going to start deploying this change in s2. I will keep updating this comment with the servers in eqiad...
[06:46:10] <wikibugs>	 10DBA, 10Operations, 10hardware-requests, 10ops-eqiad: Decommission db1021 - https://phabricator.wikimedia.org/T181378#3787781 (10Marostegui)
[07:09:37] <wikibugs>	 10DBA, 10Operations, 10hardware-requests, 10ops-eqiad, 10Patch-For-Review: Decommission db1021 - https://phabricator.wikimedia.org/T181378#3787811 (10Marostegui)
[07:10:32] <wikibugs>	 10DBA, 10Operations, 10hardware-requests, 10ops-eqiad, 10Patch-For-Review: Decommission db1021 - https://phabricator.wikimedia.org/T181378#3787781 (10Marostegui)
[07:13:23] <wikibugs>	 10DBA, 10Operations, 10hardware-requests, 10ops-eqiad, 10Patch-For-Review: Decommission db1021 - https://phabricator.wikimedia.org/T181378#3787814 (10Marostegui) a:05Marostegui>03Cmjohnson This server is now ready for @Cmjohnson to take over and fully decommission it. Thanks!
[07:33:41] <wikibugs>	 10DBA, 10Operations, 10Wikimedia-Site-requests: Global rename of JeanBono → Rexcornot: supervision needed - https://phabricator.wikimedia.org/T181170#3787833 (10alanajjar) @Marostegui I'll start now?
[07:35:58] <wikibugs>	 10DBA, 10Operations, 10Wikimedia-Site-requests: Global rename of JeanBono → Rexcornot: supervision needed - https://phabricator.wikimedia.org/T181170#3787835 (10alanajjar) [[https://meta.wikimedia.org/wiki/Special:GlobalRenameProgress/Rexcornot|The progress]] ..
[07:39:16] <wikibugs>	 10DBA, 10Operations, 10Wikimedia-Site-requests: Global rename of JeanBono → Rexcornot: supervision needed - https://phabricator.wikimedia.org/T181170#3787837 (10Marostegui) Thanks!
[07:57:30] <wikibugs>	 10DBA, 10Operations, 10Wikimedia-Site-requests: Global rename of JeanBono → Rexcornot: supervision needed - https://phabricator.wikimedia.org/T181170#3787839 (10alanajjar) Done.  Thanks @Marostegui
[07:57:50] <wikibugs>	 10DBA, 10Operations, 10Wikimedia-Site-requests: Global rename of JeanBono → Rexcornot: supervision needed - https://phabricator.wikimedia.org/T181170#3787840 (10alanajjar) 05Open>03Resolved
[09:08:22] <wikibugs>	 10DBA, 10Operations, 10ops-eqiad: db1016 m1 master: Possibly faulty BBU - https://phabricator.wikimedia.org/T166344#3787886 (10Marostegui) db1056 will be freed up during this week - we can use it to replace this host.
[09:52:57] <wikibugs>	 10DBA, 10Data-Services: Consider granting `CREATE TEMPORARY TABLES` to labsdbuser - https://phabricator.wikimedia.org/T179628#3788031 (10jcrespo) @SamB Replica databases are supposed to be read only, and only replication (or an admin for administration purpose only-not data handling) can write there. CREATE TE...
[10:59:01] <elukey>	 hello people
[10:59:46] <elukey>	 tomorrow morning we (as analytics) would like to proceed with our plan to get rid of the log database on dbstore1002
[10:59:52] <marostegui>	 \o/
[11:00:00] <elukey>	 (it has been announced extensively in engineering@ etc..)
[11:00:07] <elukey>	 now, if you are ok, I'd proceed with https://gerrit.wikimedia.org/r/#/c/393238/
[11:00:17] <elukey>	 to remove all the eventlogging automation from dbstore1002
[11:00:27] <elukey>	 and then drop the db tomorrow (with your support if you have time)
[11:01:35] <marostegui>	 sure, we can help
[12:11:58] <marostegui>	 going to take db1109 (depooled) to test the rename
[12:12:55] <jynus>	 that is more s8 than depooled
[12:13:12] <marostegui>	 what?
[12:13:14] <jynus>	 we should remove s8 references from s5
[12:13:18] <jynus>	 on eqiad.php
[12:13:47] <marostegui>	 yes, but I mean it is depooled, so I can test the rename there, so I don't have to depool another one
[12:13:51] <jynus>	 we are going to do that anyway
[12:13:58] <jynus>	 with the eqiad setup
[12:14:02] <jynus>	 so no problem
[12:14:04] <marostegui>	 yep
[12:41:43] <marostegui>	 https://gerrit.wikimedia.org/r/#/c/393588/
[12:59:49] <wikibugs>	 10DBA, 10Operations, 10ops-codfw, 10Patch-For-Review: Move some masters away from B6 - https://phabricator.wikimedia.org/T169501#3788542 (10Marostegui)
[12:59:52] <wikibugs>	 10DBA, 10Operations, 10ops-codfw, 10Patch-For-Review: Move some masters away from B6 - https://phabricator.wikimedia.org/T169501#3400000 (10Marostegui) db2023 and db2016 aren't masters anymore, so they can be decommissioned. We will create a decommission task when ready
[13:51:25] <elukey>	 all right I should have cleaned up dbstore1002 from eventlogging-related automation
[13:51:36] <elukey>	 and I am fixing the documentation on wikitech 
[13:52:00] <elukey>	 last step would be the actual drop db, that we can do tomorrow morning? (date announced )
[14:01:24] <marostegui>	 yep
[14:01:26] <marostegui>	 I can help
[14:01:29] <marostegui>	 Ping me when you are online
[14:10:54] <mark>	 hey guys
[14:11:07] <mark>	 is there any technical reason why it would be better/safer to do the migration earlier than january?
[14:11:18] <mark>	 your emails said it's fine to wait, but what are the tradeoffs?
[14:11:43] <marostegui>	 the only tradeoff is having s5 master as row based replication
[14:11:46] <marostegui>	 which is not a big big deal
[14:12:40] <mark>	 yeah I can't judge that
[14:12:47] <marostegui>	 that means that some schema changes cannot be done on s5, but we have all the other shards pending to be done anyways
[14:13:01] <mark>	 and probably we should be careful with schema changes during the last weeks of december anyway
[14:13:05] <marostegui>	 exactly
[14:13:08] <mark>	 yeah ok
[14:13:13] <mark>	 then i think we should probably wait until january
[14:13:15] <mark>	 that's fine
[14:13:52] <marostegui>	 ok
[14:14:00] <mark>	 can you guys look at dates that work well for you?
[14:14:12] <marostegui>	 for Jan?
[14:14:14] <mark>	 yes
[14:14:18] <mark>	 there's all hands etc
[14:14:24] <mark>	 there's always something ;)
[14:14:35] <marostegui>	 yep, I will check with Jaime so we can at least create the ticket to announce it
[14:14:38] <mark>	 perfect
[14:14:53] <mark>	 and then later this week we'll work with community liaisons to announce it
[14:15:10] <marostegui>	 last time we did this: https://phabricator.wikimedia.org/T176883#3658963
[14:15:25] <marostegui>	 is it ok to talk create a ticket and ping him?
[14:15:41] <marostegui>	 once we know the dates we'd like to go for?
[14:15:56] <mark>	 let's first check the actual date together when you have it
[14:15:58] <mark>	 but after that, yeah
[14:16:01] <marostegui>	 sounds good
[14:16:08] <marostegui>	 we'll get back to you with a date proposal
[14:16:11] <mark>	 perfect
[14:16:12] <mark>	 thanks :)
[14:16:24] <marostegui>	 bedankt
[14:23:22] <wikibugs>	 10DBA, 10Patch-For-Review: Support multi-instance on core hosts - https://phabricator.wikimedia.org/T178359#3788745 (10Marostegui)
[15:20:01] <wikibugs>	 10DBA, 10Operations, 10ops-codfw: Degraded RAID on db2055 - https://phabricator.wikimedia.org/T181266#3788894 (10Papaul) Dear Mr Papaul Tshibamba,  Thank you for contacting Hewlett Packard Enterprise for your service request. This email confirms your request for service and the details are below.  Your reque...
[15:24:21] <wikibugs>	 10DBA, 10Operations, 10ops-codfw: Degraded RAID on db2055 - https://phabricator.wikimedia.org/T181266#3788907 (10Papaul) I am will be receiving the replacement drive tomorrow.
[16:00:02] <wikibugs>	 10DBA, 10Operations, 10ops-codfw: Degraded RAID on db2055 - https://phabricator.wikimedia.org/T181266#3789060 (10Marostegui) Thanks!
[18:00:05] <volans>	 jynus: I forgot to mention, when you were in vacation (I think) I've deployed a new "fancy" alias for connecting to MySQL, in case you might be interested to use is too
[18:00:11] <volans>	 https://github.com/wikimedia/puppet/commit/45aa87f9f6fd1db2e1bcb44be007c8e97d806af1
[18:00:29] <volans>	 *personal alias
[18:00:45] <jynus>	 I saw it on the reviews
[18:01:06] <jynus>	 I was thinking about it for other ops
[18:01:19] <jynus>	 I will either copy it with changes or something
[18:01:44] <jynus>	 but I want to remove the socket migration first
[18:01:49] <jynus>	 *finish
[18:01:57] <wikibugs>	 10DBA, 10Data-Services: Make Dispenser's principle_links table accessible in new Wiki replica cluster - https://phabricator.wikimedia.org/T180636#3789567 (10bd808)
[18:02:20] <volans>	 sure, makes sense
[18:04:32] <hoo>	 jynus: https://phabricator.wikimedia.org/T179010 Can we schedule this for early Wednesday (early meaning maybe 10/11 UTC)
[22:02:20] <wikibugs>	 10Blocked-on-schema-change, 10DBA, 10Data-Services, 10Dumps-Generation, and 2 others: Schema change for refactored comment storage - https://phabricator.wikimedia.org/T174569#3790605 (10Anomie) I'll leave the final decision to you, but I'll note that getting the schema change done on testwiki, test2wiki, a...