[00:08:14] 10DBA, 10Operations, 10ops-codfw, 10Patch-For-Review: rack/setup/install (5) codfw dedicated dump slaves - https://phabricator.wikimedia.org/T219463 (10Papaul) [00:08:40] 10DBA, 10Operations, 10ops-codfw, 10Patch-For-Review: rack/setup/install db2102.codfw.wmnet as a testing host for codfw backups - https://phabricator.wikimedia.org/T219461 (10Papaul) [01:21:49] 10DBA, 10MediaWiki-Maintenance-scripts, 10MediaWiki-Page-deletion, 10Operations: Create maintenance script to delete pages with empty histories - https://phabricator.wikimedia.org/T220570 (10GeoffreyT2000) [01:25:50] 10DBA, 10MediaWiki-Maintenance-scripts, 10MediaWiki-Page-deletion, 10Operations: Create maintenance script to delete pages with empty histories - https://phabricator.wikimedia.org/T220570 (10GeoffreyT2000) [04:54:06] 10DBA: Productionize eqiad and codfw source backup hosts & codfw backup test host - https://phabricator.wikimedia.org/T220572 (10Marostegui) [04:54:58] 10DBA, 10Operations, 10ops-codfw, 10Patch-For-Review: rack/setup/install (5) codfw dedicated dump slaves - https://phabricator.wikimedia.org/T219463 (10Marostegui) [04:55:02] 10DBA: Productionize eqiad and codfw source backup hosts & codfw backup test host - https://phabricator.wikimedia.org/T220572 (10Marostegui) [04:55:04] 10DBA, 10Operations, 10ops-codfw, 10Patch-For-Review: rack/setup/install db2102.codfw.wmnet as a testing host for codfw backups - https://phabricator.wikimedia.org/T219461 (10Marostegui) [04:55:06] 10DBA, 10Operations, 10ops-eqiad, 10Patch-For-Review: rack/setup/install db1139|db1140.eqiad.wmnet (2 dump slaves) - https://phabricator.wikimedia.org/T218985 (10Marostegui) [06:47:40] 10DBA, 10Operations, 10ops-codfw, 10Patch-For-Review: rack/setup/install db2102.codfw.wmnet as a testing host for codfw backups - https://phabricator.wikimedia.org/T219461 (10jcrespo) Note that despite this host being separate than T219463 for setup because it will have a different puppet role, hardware wi... [06:50:39] parsercache still impacted https://grafana.wikimedia.org/d/000000106/parser-cache?orgId=1&from=now-2d&to=now [06:51:13] yeah, checked it in the morning [06:51:16] 10DBA, 10Operations, 10ops-codfw, 10Patch-For-Review: rack/setup/install db2102.codfw.wmnet as a testing host for codfw backups - https://phabricator.wikimedia.org/T219461 (10Marostegui) It is set as spare for now so the installation can go through: https://gerrit.wikimedia.org/r/#/c/operations/puppet/+/49... [07:42:29] hey our DBAs, some people are really eager to mess with PK in our tables. (More context: https://phabricator.wikimedia.org/T220432#5098837 ) Do you think it's okay to do this? like insert with PK defined [07:48:02] Amir1: you can jump over ids with no problem, what you cannot do is insert values with lower than the last insert id, if you are doing that you should not use autoinc [07:50:39] Thanks for the note [07:50:43] consider this a non-canonical comment, but if I were you, I would not reserve any code, start from 1 [07:50:44] let me write this [07:51:11] because that conversation seems non-productive [07:53:18] jynus: I hope you don't mind I put your comment there: https://phabricator.wikimedia.org/T220432#5100206 [07:53:31] that is ok [07:55:15] There's a reason It's called Easter egg and not pierogi, because it can [07:55:26] *can't make everyone happy [07:56:07] that is why I would literally remove everything if nobody is going to be happy [07:56:23] I have been in those conversations before, they are not worth spending the time [07:57:07] yeah, indeed [07:57:08] I desubscribed because I don't want to even touch that [07:58:13] I honestly have better ways to use my time like creating backups and keeping things up [07:58:54] Sure. No issue. Same for me, my big concern is to make the big thing deployed that was stalled for four years, I don't care about Easter Eggs [07:59:55] +1 [08:53:40] 10DBA, 10Data-Services, 10Operations, 10cloud-services-team (Kanban): Prepare and check storage layer for hywwiki - https://phabricator.wikimedia.org/T212625 (10Bstorm) a:03Bstorm [08:56:54] Amir1: the other wikis you mentioned in your email to ops past week were not created right? only hywwiki? Just asking to make sure I haven't missed any sanitization as there were no activity on those tickets (or maybe I missed it). Not that I am pushing you to create them, just checking that our side (DBA) is all good [08:57:21] marostegui: yeah, the hywwiki took all of the energy and time [08:57:40] Amir1: haha, get some rest :) [08:57:46] I will give hiwikisource next week since this week I'm deploying url shortener [08:58:08] Thanks <3 [08:58:22] Amir1: sure, again, not pushing you, just making sure nothing is pending any sanitization [08:58:34] no worries [13:18:23] 10Blocked-on-schema-change, 10Notifications, 10Patch-For-Review, 10Schema-change: Remove event_page_namespace and event_page_title - https://phabricator.wikimedia.org/T136427 (10Marostegui) So I have altered the first 10 wikis: ` aawiki aawikibooks aawiktionary abwiki abwiktionary acewiki advisorswiki advi... [13:25:15] 10DBA, 10Operations, 10ops-codfw: Degraded RAID on db2054 - https://phabricator.wikimedia.org/T220607 (10Marostegui) p:05Triage→03Normal a:03Papaul Can we replace this disk? Thanks! [13:46:56] for the host at https://phabricator.wikimedia.org/T219461 I guess we can give it the core_test role for now like the one in eqiad, no? [13:47:09] "for now" == once it is installed [14:12:20] sure [14:58:29] 10DBA, 10Operations, 10ops-codfw: Degraded RAID on db2054 - https://phabricator.wikimedia.org/T220607 (10Papaul) a:05Papaul→03Marostegui complete [14:59:18] 10DBA, 10Operations, 10ops-codfw: Degraded RAID on db2054 - https://phabricator.wikimedia.org/T220607 (10Marostegui) Thanks! ` physicaldrive 1I:1:12 (port 1I:box 1:bay 12, SAS, 600 GB, Rebuilding) ` [16:25:56] jynus: I will be here tomorrow earlier than 05:00UTC for the pre-steps of the failover [16:26:11] yeah, I guees me too [16:26:15] So if you arrive at 04:55 UTC that's fine, so you can enjoy your sleep longer! [16:26:34] will you lead it like last time? [16:26:41] yep! [17:07:19] 10DBA, 10Operations, 10ops-codfw: Degraded RAID on db2054 - https://phabricator.wikimedia.org/T220607 (10Marostegui) All good! Thanks! ` root@db2054:~# hpssacli controller all show config Smart Array P420i in Slot 0 (Embedded) (sn: 0014380337FE1C0) Port Name: 1I Port Name: 2I Gen8 ServBP 12+... [17:08:53] 10DBA, 10Operations, 10ops-codfw: Degraded RAID on db2054 - https://phabricator.wikimedia.org/T220607 (10Marostegui) 05Open→03Resolved [17:09:07] 10DBA, 10Operations, 10ops-codfw: Degraded RAID on db2054 - https://phabricator.wikimedia.org/T220607 (10Marostegui) a:05Marostegui→03Papaul [17:32:35] 10DBA, 10Operations, 10ops-codfw, 10Patch-For-Review: rack/setup/install db2102.codfw.wmnet as a testing host for codfw backups - https://phabricator.wikimedia.org/T219461 (10Papaul) ` papaul@asw-c-codfw> show interfaces ge-5/0/12 descriptions Interface Admin Link Description ge-5/0/12 up... [17:33:00] 10DBA, 10Operations, 10ops-codfw, 10Patch-For-Review: rack/setup/install db2102.codfw.wmnet as a testing host for codfw backups - https://phabricator.wikimedia.org/T219461 (10Papaul) [18:04:57] 10DBA, 10Data-Services, 10Operations, 10cloud-services-team (Kanban): Prepare and check storage layer for hywwiki - https://phabricator.wikimedia.org/T212625 (10Bstorm) 05Open→03Resolved All set from WMCS end. Confirmed I can run queries from Toolforge. [19:44:40] 10DBA, 10TechCom-RFC: MediaWiki database policy and/or guidelines (2019) - https://phabricator.wikimedia.org/T220056 (10daniel) Moving this to the RFC blacklog, per @jcrespo's propsed workflow. [23:54:38] 10DBA, 10Operations, 10ops-codfw, 10Patch-For-Review: rack/setup/install db2102.codfw.wmnet as a testing host for codfw backups - https://phabricator.wikimedia.org/T219461 (10Papaul) @Marostegui while installing db2102 I am getting [!!] Partition disks ├─────────────┐ │...