[00:10:52] 10DBA, 10Operations: Decommission db2043-db2069 - https://phabricator.wikimedia.org/T228258 (10Papaul) [00:11:32] 10DBA: Decommission old coredb machines (<=db2042) - https://phabricator.wikimedia.org/T221533 (10Papaul) [08:44:17] 10DBA, 10Core Platform Team, 10Epic, 10Tracking-Neverending: Tracking task for mariadb optimizer misbehaviours - https://phabricator.wikimedia.org/T233579 (10Marostegui) 05Open→03Declined Closing this and will use #mariadb-optimizer-bug tag to mark the affected tasks. [08:44:52] 10DBA, 10MediaWiki-API, 10Performance Issue, 10User-Marostegui, 10mariadb-optimizer-bug: list=logevents slow for users with last log action long time ago - https://phabricator.wikimedia.org/T71222 (10Marostegui) [08:45:11] 10DBA, 10Core Platform Team, 10MW-1.34-notes (1.34.0-wmf.24; 2019-09-24), 10Performance Issue, 10mariadb-optimizer-bug: Review special replica partitioning of certain tables by `xx_user` - https://phabricator.wikimedia.org/T223151 (10Marostegui) [08:46:05] 10DBA, 10Wikidata, 10Wikimedia-Rdbms, 10TestMe, 10mariadb-optimizer-bug: IndexPager::buildQueryInfo (contributions page unfiltered) query needs tuning - https://phabricator.wikimedia.org/T189026 (10Marostegui) [12:09:50] today I have learned our database are backed up (via jynus ) https://www.slideshare.net/jynus/backing-up-wikipedia-databases ,) [12:10:51] better link: https://wikitech.wikimedia.org/wiki/File:Backing_up_Wikipedia_Databases.pdf [12:11:35] I still dont get how just two people are enough to maintain that massive piece of the infrastructure [12:11:55] one for databases, one for backups [12:12:07] yeah sounds easy [12:13:33] for reference, that has made laugh all the folks at my coworking place [12:18:10] jynus: marostegui: great slides thank you! [12:26:16] hashar: we are hiring! :) [12:31:33] 10Blocked-on-schema-change, 10DBA, 10AbuseFilter: Add abuse_filter_log.afl_filter_id and afl_global columns - https://phabricator.wikimedia.org/T234052 (10Daimona) 05Stalled→03Open [12:41:43] 10Blocked-on-schema-change, 10DBA, 10AbuseFilter, 10Patch-For-Review: Add abuse_filter_log.afl_filter_id and afl_global columns - https://phabricator.wikimedia.org/T234052 (10Marostegui) [12:45:40] 10Blocked-on-schema-change, 10DBA, 10AbuseFilter, 10Patch-For-Review: Add abuse_filter_log.afl_filter_id and afl_global columns - https://phabricator.wikimedia.org/T234052 (10Marostegui) [12:58:38] :-) [13:08:21] 10DBA, 10Goal: Address Database infrastructure blockers on datacenter switchover & multi-dc deployment - https://phabricator.wikimedia.org/T220170 (10Marostegui) [13:33:22] 10DBA, 10Wikimedia-Rdbms, 10Core Platform Team (Needs Cleaning - Security, stability, performance, and scalability (TEC1)), 10Core Platform Team Workboards (Done with CPT), and 3 others: Slow query ApiQueryRevisions on enwiki - https://phabricator.wikimedia.org/T224017 (10Anomie) [13:35:31] 10DBA, 10MediaWiki-API, 10Patch-For-Review, 10mariadb-optimizer-bug: Slow query "ApiQueryLogEvents::execute" after actor rollout - https://phabricator.wikimedia.org/T220999 (10Anomie) [13:35:53] 10DBA, 10MediaWiki-Logging, 10Operations, 10Wikimedia-Rdbms, and 5 others: Special:Log on commons -- entire web request took longer than 60 seconds and timed out - https://phabricator.wikimedia.org/T221458 (10Anomie) [13:40:30] 10DBA, 10ChangeProp, 10MediaWiki-API, 10Operations, and 6 others: Investigate slow transcludedin query - https://phabricator.wikimedia.org/T145079 (10Anomie) [13:41:18] 10DBA, 10MediaWiki-API, 10Patch-For-Review, 10Upstream, 10mariadb-optimizer-bug: API database error on continue with generator=categorymembers and prop=linkshere - https://phabricator.wikimedia.org/T139056 (10Anomie) [13:42:47] 10DBA, 10MediaWiki-API, 10Pywikibot, 10Patch-For-Review, and 2 others: allpages filterlanglinks DBQueryError - https://phabricator.wikimedia.org/T78276 (10Anomie) [13:50:49] 10DBA, 10MediaWiki-API, 10Patch-For-Review, 10Upstream, 10mariadb-optimizer-bug: API database error on continue with generator=categorymembers and prop=linkshere - https://phabricator.wikimedia.org/T139056 (10Marostegui) This query (T139056#2418184) seems to be using the right index now on MariaDB 10.1.3... [17:14:42] 10DBA, 10conftool, 10Performance-Team (Radar): #dbctl: manage 'externalLoads' data - https://phabricator.wikimedia.org/T229686 (10CDanis) @Marostegui please give me some input on the UI -- what would you like dbctl to call the section that will represent "everything that refers to `$wmgOldExtTemplate`"? For... [17:17:08] 10DBA, 10conftool, 10Performance-Team (Radar): #dbctl: manage 'externalLoads' data - https://phabricator.wikimedia.org/T229686 (10CDanis) @Krinkle @aaron -- could one of you please find some time soon to make sure I'm understanding things correctly as I state them below? >>! In T229686#5454294, @CDanis wrot...