[02:12:21] 10DBA, 10Data-Services, 10fixcopyright.wikimedia.org: Prepare and check storage layer for fixcopyright.wikimedia.org - https://phabricator.wikimedia.org/T202820 (10Legoktm) [05:13:41] 10DBA, 10Operations, 10monitoring, 10Patch-For-Review: HAproxy on dbproxy hosts lack enough logging - https://phabricator.wikimedia.org/T201021 (10Marostegui) Using `crit` instead of `info` give us when a server goes down but it doesn't log every single health check request. So we get to know when the fail... [08:59:27] 10DBA, 10Operations, 10Patch-For-Review: Prepare mysql hosts for stretch - https://phabricator.wikimedia.org/T168356 (10jcrespo) [08:59:30] 10DBA, 10Operations, 10Patch-For-Review: Cleanup or remove mysql puppet module; repurpose mariadb module to cover misc use cases - https://phabricator.wikimedia.org/T162070 (10jcrespo) [08:59:38] 10DBA, 10Cloud-Services, 10Community-Wikimetrics, 10Icinga, and 2 others: Evaluate future of wmf puppet module "mysql" - https://phabricator.wikimedia.org/T165625 (10jcrespo) 05Open>03Resolved a:03jcrespo This has been evaluate, mysql will disappear, leaving this for historical documentation, forces... [09:06:41] 10DBA, 10Operations, 10monitoring, 10Patch-For-Review: HAproxy on dbproxy hosts lack enough logging - https://phabricator.wikimedia.org/T201021 (10Marostegui) 05Open>03Resolved I have reloaded haproxy everywhere and it is now under control and not logging every single second :-). Also purged all the l... [09:26:45] Something is going on with labsdb1005 [09:29:17] Ah, looks like it is just one user [09:29:27] Who is creating issues only for itself [09:34:19] link? [09:34:54] I am seeing it on tendril [09:35:16] oh [09:35:17] ok [09:35:27] I will create a task to record this [09:36:04] double check if user quering and db is the same [09:36:20] sometimes people query/lock other people's dbs [09:36:25] yeah, it is always the same user and the same db [09:36:27] when they hav eaccess [09:36:32] ok, so low priority [09:36:42] yeah, that is why I said it is only hurting itself [09:36:44] if anything, you can send a ticket/email for performance resons [09:36:50] That is the idea [09:36:57] thanks, marostegui [09:39:22] 10Blocked-on-schema-change, 10MediaWiki-Change-tagging, 10MediaWiki-Database, 10Wikidata-Campsite, 10User-Ladsgroup: Schema change for adding indexes of ct_tag_id - https://phabricator.wikimedia.org/T203709 (10Ladsgroup) [10:13:13] 10DBA, 10Data-Services, 10Toolforge, 10Tracking: Certain tools users create multiple long running queries that take all memory and/or CPU from labsdb hosts, slowing it down and potentially crashing (tracking) - https://phabricator.wikimedia.org/T119601 (10Marostegui) [10:28:40] 10DBA, 10Operations, 10Epic, 10Patch-For-Review: DB meta task for next DC failover issues - https://phabricator.wikimedia.org/T189107 (10akosiaris) [10:29:05] 10DBA, 10Operations, 10Epic, 10Patch-For-Review: DB meta task for next DC failover issues - https://phabricator.wikimedia.org/T189107 (10akosiaris) [10:29:51] 10DBA, 10Operations, 10Epic, 10Patch-For-Review: DB meta task for next DC failover issues - https://phabricator.wikimedia.org/T189107 (10akosiaris) [18:20:57] 10DBA, 10Data-Services, 10Toolforge, 10Tracking: Certain tools users create multiple long running queries that take all memory and/or CPU from labsdb hosts, slowing it down and potentially crashing (tracking) - https://phabricator.wikimedia.org/T119601 (10Marostegui) [18:31:20] 10DBA, 10Analytics, 10Growth-Team, 10Notifications: Purge all Schema:Echo data after 90 days - https://phabricator.wikimedia.org/T128623 (10Marostegui) What should we do with this task? [18:33:53] 10DBA, 10Growth-Team, 10MediaWiki-Database, 10MediaWiki-Recent-changes: Error: 2013 Lost connection to MySQL server during query on NewFilesPager (again) - https://phabricator.wikimedia.org/T141765 (10Marostegui) After all the MySQL upgrades and all that, this bug is still valid and the two reported URLs a...