[06:50:14] <wikibugs>	 10DBA: Remove partitions from revision table - https://phabricator.wikimedia.org/T239453 (10Marostegui)
[08:32:26] <marostegui>	 I would like to failover m1 proxy: https://gerrit.wikimedia.org/r/#/c/operations/dns/+/570580/
[08:34:20] <wikibugs>	 10DBA, 10Patch-For-Review: Productionize dbproxy101[2-7].eqiad.wmnet and dbproxy200[1-4] - https://phabricator.wikimedia.org/T202367 (10Marostegui)
[09:04:00] <jynus>	 ok
[09:04:27] <marostegui>	 if you are good with it, I am going to proceed
[09:04:31] <jynus>	 ok
[09:04:39] <jynus>	 what should I check?
[09:04:47] <jynus>	 m1 services?
[09:05:08] <marostegui>	 I am going to monitor them too, but another pair of eyes will definitely help :)
[09:05:14] <marostegui>	 Let me ping the other channel too
[09:05:27] <jynus>	 what's on m1 these days?
[09:06:21] <marostegui>	 bacula, librenms, rt, etherpad, rt, rddmarc, racktables
[09:06:54] <marostegui>	 I will not kill connections, I will leave it failover gracefully 
[09:08:16] <marostegui>	 dns merged and deployed
[09:09:41] <marostegui>	 I see a new connection to bacula
[09:09:44] <marostegui>	 using the new proxy
[09:09:49] <marostegui>	 to bacula9
[09:10:11] <marostegui>	 librenms now
[09:10:24] <jynus>	 yeah, we better not kill connections are there are backups running right now
[09:10:28] <jynus>	 *as
[09:10:30] <marostegui>	 rt also working fine
[09:10:57] <jynus>	 I am seeing a backup error, unrelated
[09:11:04] <jynus>	 will check it later
[09:11:20] <marostegui>	 librenms, rt and bacula seem to be working
[09:16:52] <marostegui>	 etherpad working fine thru the new proxy
[09:20:50] <wikibugs>	 10DBA: Decommission dbproxy1001.eqiad.wmnet - https://phabricator.wikimedia.org/T244463 (10Marostegui)
[09:21:40] <wikibugs>	 10DBA: Decommission dbproxy1001.eqiad.wmnet - https://phabricator.wikimedia.org/T244463 (10Marostegui) p:05Triage→03Medium Not yet ready. This host has stopped being the active m1 proxy master, so let's give it a few days before starting its decommissioning. We should also test dbproxy1012 first to make sure...
[09:26:19] <wikibugs>	 10DBA, 10Patch-For-Review: Decommission dbproxy1001.eqiad.wmnet - https://phabricator.wikimedia.org/T244463 (10Marostegui)
[09:53:52] <jynus>	 I wonder if I should test dbprov eventual upgrade to buster on a extra non-production host?
[09:54:28] <marostegui>	 what do you mean with extra non production host?
[09:54:43] <jynus>	 as in, not touching yet the 4 dbprov* hosts
[09:54:47] <jynus>	 a vm or something
[09:54:59] <marostegui>	 ah that's a good idea
[09:55:05] <jynus>	 or a temporary spare
[09:55:05] <marostegui>	 I am about to test buster+10.4 oin production
[09:55:10] <jynus>	 oh!
[09:55:11] <marostegui>	 I need to send an email and finish a few things yet
[09:55:17] <marostegui>	 but will likely start next week :)
[09:55:26] <jynus>	 I don't what to do it early
[09:55:32] <jynus>	 but I don't want to fall behind
[09:55:49] <marostegui>	 do we have some old host we could use?
[09:56:02] <marostegui>	 to simulate a dbprov?
[09:56:08] <jynus>	 for dbprov or source? I have nothing in mind
[09:56:20] <marostegui>	 dbprov
[09:56:22] <jynus>	 but I think a small vm should be enough for functional testing
[09:56:26] <marostegui>	 I think source is more similar to a core host
[09:56:30] <jynus>	 yeah
[09:57:20] <jynus>	 e.g. my intention is just to check python dependencies, packages and logic
[09:57:47] <marostegui>	 yeah, exactly, that's why I was saying that it would make more sense dbprov, as that has more different stuff
[09:57:50] <marostegui>	 than a source
[09:58:07] <jynus>	 yes, that was in response to needing a full host
[09:58:24] <marostegui>	 ah, I see what you mean
[09:58:35] <marostegui>	 you can just create a test DB in a vmware but with all the dbprov logic
[09:58:43] <jynus>	 vmware???
[09:58:55] <jynus>	 lol
[09:59:16] <marostegui>	 I meant vm, but my brain completed to vmware :)
[09:59:22] <jynus>	 (i got you, just was funny)
[09:59:41] <marostegui>	 vmware helped a lot in the past!
[09:59:55] <jynus>	 were you thinking of any spare host?
[10:00:14] <jynus>	 we have some decom hosts, but I would prefer to just get rid of those asap
[10:00:24] <marostegui>	 oh, we have a spare host
[10:00:26] <marostegui>	 dbproxy2004
[10:00:39] <marostegui>	 would that work?
[10:00:39] <jynus>	 ah, that is a new one, right?
[10:00:43] <marostegui>	 correct
[10:00:57] <jynus>	 it could, but I almost prefer to not touch it
[10:01:03] <jynus>	 if we have vm space
[10:01:05] <marostegui>	 I am not going to touch it
[10:01:13] <marostegui>	 in a near future
[10:01:17] <jynus>	 I know, it just doesn't seem right
[10:01:22] <marostegui>	 up to you :)
[10:01:47] <jynus>	 when the 2 new people come in and fix all our issues, they could get confused!
[14:04:23] <wikibugs>	 10DBA, 10DC-Ops, 10Operations, 10ops-eqiad, 10Patch-For-Review: es1019: reseat IPMI - https://phabricator.wikimedia.org/T243963 (10Marostegui) @Cmjohnson es1019 is off. Once you are done, just start it back and I will it from there.  Thank you!
[14:04:34] <wikibugs>	 10DBA, 10Operations, 10ops-eqiad, 10Patch-For-Review: (Needed by 31st January) eqiad: rack/setup/install  es102[0-5].eqiad.wmnet - https://phabricator.wikimedia.org/T241359 (10Marostegui) @Jclark-ctr @wiki_willy @Cmjohnson any rough estimation on when we can expect these hosts to be online? As I said, I am...
[15:41:42] <wikibugs>	 10DBA: Remove partitions from revision table - https://phabricator.wikimedia.org/T239453 (10Marostegui)
[18:46:15] <wikibugs>	 10DBA, 10Expiring-Watchlist-Items, 10Community-Tech (Kanban-Q3-2019-20), 10Core Platform Team Workboards (Clinic Duty Team): Create required table for new Watchlist Expiry feature - https://phabricator.wikimedia.org/T240094 (10aezell) Is there anything else we need to discuss before getting this change on...
[18:57:37] <wikibugs>	 10DBA, 10Expiring-Watchlist-Items, 10Community-Tech (Kanban-Q3-2019-20), 10Core Platform Team Workboards (Clinic Duty Team): Create required table for new Watchlist Expiry feature - https://phabricator.wikimedia.org/T240094 (10Marostegui) >>! In T240094#5857330, @aezell wrote: > Is there anything else we n...
[19:31:31] <wikibugs>	 10DBA, 10Expiring-Watchlist-Items, 10Community-Tech (Kanban-Q3-2019-20), 10Core Platform Team Workboards (Clinic Duty Team): Create required table for new Watchlist Expiry feature - https://phabricator.wikimedia.org/T240094 (10aezell) @Marostegui Yes, it can be replicated as long as the watchlist table is...
[20:05:23] <wikibugs>	 10DBA, 10Expiring-Watchlist-Items, 10Community-Tech (Kanban-Q3-2019-20), 10Core Platform Team Workboards (Clinic Duty Team): Create required table for new Watchlist Expiry feature - https://phabricator.wikimedia.org/T240094 (10Reedy) Watchlist isn't replicated/exposed in a view  So I guess replicating this...
[20:06:39] <wikibugs>	 10DBA, 10Expiring-Watchlist-Items, 10Community-Tech (Kanban-Q3-2019-20), 10Core Platform Team Workboards (Clinic Duty Team): Create required table for new Watchlist Expiry feature - https://phabricator.wikimedia.org/T240094 (10MusikAnimal) The `watchlist` table is not replicated, so indeed we don't need to...
[20:18:57] <wikibugs>	 10DBA, 10Expiring-Watchlist-Items, 10Community-Tech (Kanban-Q3-2019-20), 10Core Platform Team Workboards (Clinic Duty Team): Create required table for new Watchlist Expiry feature - https://phabricator.wikimedia.org/T240094 (10aezell) Thanks for clarifying that, y'all.