[10:29:10] <wikibugs>	 10DBA, 10Operations, 10ops-codfw: db2140 crashed due to HW memory errors - https://phabricator.wikimedia.org/T271084 (10MoritzMuehlenhoff) 05Resolved→03Open
[10:29:13] <wikibugs>	 10DBA, 10Operations, 10ops-codfw: db2140 crashed due to HW memory errors - https://phabricator.wikimedia.org/T271084 (10MoritzMuehlenhoff) The server went down again:   ` Record:      1 Date/Time:   01/04/2021 15:42:11 Source:      system Severity:    Ok Description: Log cleared. ----------------------------...
[10:43:37] <wikibugs>	 10DBA, 10Operations, 10ops-codfw: db2140 crashed due to HW memory errors - https://phabricator.wikimedia.org/T271084 (10MoritzMuehlenhoff) Given the flaky state of the hardware I'm not powering up the server again,  db2140 was depooled with dbctl.   @papaul: Since the faulty DIMM moved around we should be el...
[13:20:11] <wikibugs>	 10DBA, 10Data-Services: Prepare and check storage layer for trwikivoyage - https://phabricator.wikimedia.org/T271261 (10LSobanski) p:05Triage→03Medium Thanks, let us know when the database is created, so we can sanitize it.
[14:49:14] <wikibugs>	 10DBA: New database request: sockpuppet - https://phabricator.wikimedia.org/T268505 (10gmodena) Hi @Marostegui; we would like to attempt a new import today (2021-01-06) at 1700CET. Same volumes as the previous one, we'll tune throttling and batch sizes as you suggested.
[15:02:10] <wikibugs>	 10DBA: New database request: sockpuppet - https://phabricator.wikimedia.org/T268505 (10LSobanski) @gmodena Manuel is not around today, could we postpone this?
[15:04:56] <wikibugs>	 10DBA: New database request: sockpuppet - https://phabricator.wikimedia.org/T268505 (10gmodena) @LSobanski would sometime tomorrow after 1300CET work? Otherwise, could you maybe suggest timeslots that would work for you?
[15:46:38] <wikibugs>	 10DBA, 10Data-Services, 10User-Kormat, 10cloud-services-team (Kanban): Parametrize wmf-pt-kill so it can connect to different sockets - https://phabricator.wikimedia.org/T260511 (10Bstorm) I'll give @jcrespo 's approach a go today. Looking at the package code it would likely be pretty simple to use puppet...
[16:56:20] <wikibugs>	 10DBA, 10Sustainability (Incident Followup): Redefine mysql GRANTs for wikiadmin - https://phabricator.wikimedia.org/T249683 (10LSobanski)
[17:31:24] <wikibugs>	 10DBA: New database request: sockpuppet - https://phabricator.wikimedia.org/T268505 (10LSobanski) @gmodena Manuel will be around tomorrow, we can sync up on exact timing then. Will that work?
[17:47:07] <wikibugs>	 10DBA: New database request: sockpuppet - https://phabricator.wikimedia.org/T268505 (10gmodena) Hey @LSobanski that should definitely work. Many thanks!
[19:46:57] <wikibugs>	 10DBA, 10Growth-Team, 10MediaWiki-Watchlist, 10MW-1.36-notes (1.36.0-wmf.25; 2021-01-05), 10Wikimedia-production-error: ClearUserWatchlistJob/WatchedItemStore::removeWatchBatchForUser bad database peformance on enwiki and others, causing database lag - https://phabricator.wikimedia.org/T270481 (10MusikAni...