[07:51:42] <moritzm>	 good morning DBAs, not sure if you've seen it yet, db1054 has an Icinga alert for "must have write cache policy WriteBack, currently using: WriteThrough"
[07:52:20] <marostegui>	 moritzm: yeah, we are aware
[07:52:24] <marostegui>	 we have planned a failover for it
[07:52:31] <marostegui>	 it is s2 primary master
[07:52:34] <marostegui>	 the BBU is broken
[07:52:56] <moritzm>	 ok, sorry for the noise :-)
[07:53:07] <marostegui>	 no, thank you for double checking if we noticed it!
[09:00:42] <wikibugs_>	 10Blocked-on-schema-change, 10DBA, 10Multi-Content-Revisions, 10Patch-For-Review, 10User-Addshore: Change DEFAULT 0 for rev_text_id on production DBs - https://phabricator.wikimedia.org/T190148#4235714 (10Marostegui)
[09:01:03] <wikibugs_>	 10Blocked-on-schema-change, 10DBA, 10Multi-Content-Revisions, 10Patch-For-Review, 10User-Addshore: Change DEFAULT 0 for rev_text_id on production DBs - https://phabricator.wikimedia.org/T190148#4209452 (10Marostegui) 05Open>03Resolved This is all done
[09:06:51] <wikibugs_>	 10Blocked-on-schema-change, 10DBA, 10Patch-For-Review, 10User-Ladsgroup, 10Wikidata-Ministry-Of-Magic: Schema change for rc_namespace_title_timestamp index - https://phabricator.wikimedia.org/T191519#4235733 (10Marostegui)
[09:07:11] <wikibugs_>	 10Blocked-on-schema-change, 10DBA, 10Patch-For-Review, 10User-Ladsgroup, 10Wikidata-Ministry-Of-Magic: Schema change for rc_namespace_title_timestamp index - https://phabricator.wikimedia.org/T191519#4209570 (10Marostegui) This is all done
[09:07:19] <wikibugs_>	 10Blocked-on-schema-change, 10DBA, 10Patch-For-Review, 10User-Ladsgroup, 10Wikidata-Ministry-Of-Magic: Schema change for rc_namespace_title_timestamp index - https://phabricator.wikimedia.org/T191519#4235735 (10Marostegui) 05Open>03Resolved
[09:10:55] <wikibugs_>	 10Blocked-on-schema-change, 10DBA, 10MediaWiki-Platform-Team (MWPT-Q4-Apr-Jun-2018), 10Patch-For-Review: Schema change for refactored actor storage - https://phabricator.wikimedia.org/T188299#4209552 (10Marostegui)
[09:11:54] <wikibugs_>	 10Blocked-on-schema-change, 10DBA, 10MediaWiki-Platform-Team (MWPT-Q4-Apr-Jun-2018), 10Patch-For-Review: Schema change for refactored actor storage - https://phabricator.wikimedia.org/T188299#4209571 (10Marostegui) Only the master is now pending, which will be done probably on Wednesday EU morning. I have...
[13:12:22] <_joe_>	 jynus, marostegui so regarding the multi-dc goal, did you need my feedback on something specific or just on the overall current architecture?
[13:12:41] <_joe_>	 (re: connection pooling)
[13:13:19] <jynus>	 you saud you wanted to comment
[16:23:51] <wikibugs_>	 10DBA, 10Operations, 10Goal, 10Patch-For-Review: Convert all sanitarium hosts to multi-instance and increase its reliability/redundancy - https://phabricator.wikimedia.org/T190704#4236872 (10Marostegui) The definitive hardware for codfw is now in place and replicating:  db2094: s1, s3, s5, s8 db2095: s2, s...
[16:24:12] <wikibugs_>	 10DBA, 10Operations, 10Goal, 10Patch-For-Review: Convert all sanitarium hosts to multi-instance and increase its reliability/redundancy - https://phabricator.wikimedia.org/T190704#4236873 (10Marostegui)
[16:26:24] <wikibugs_>	 10DBA, 10Operations, 10Goal, 10Patch-For-Review: Convert all sanitarium hosts to multi-instance and increase its reliability/redundancy - https://phabricator.wikimedia.org/T190704#4236874 (10Marostegui)
[17:43:47] <addshore>	 Is doing things such as /*+ MAX_EXECUTION_TIME(1000) */ in our sql statements a possible option?
[17:44:09] <addshore>	 is that allows? / does it even work on mariadb?
[17:47:25] <addshore>	 or something similar.
[17:49:00] <addshore>	 it looks like you can do something similar, SET STATEMENT max_statement_time=100 FOR (STATEMENT HERE...), in 10.1.2 of mariadb
[17:49:39] <addshore>	 and it actually works, ooooh
[17:49:50] <addshore>	 (thinking about wb_terms table here)
[18:16:02] <wikibugs_>	 10DBA, 10MediaWiki-Database: Create Mediawiki DB abstraction for individual query timeouts - https://phabricator.wikimedia.org/T195792#4237149 (10Addshore)
[18:16:08] <addshore>	 ^^ :)
[19:21:06] <wikibugs_>	 10DBA, 10MediaWiki-Database: Create Mediawiki DB abstraction for individual query timeouts - https://phabricator.wikimedia.org/T195792#4237149 (10jcrespo) This is a duplicate (sort of) T149421 T64615 T60985 T113552 which in the past, I got a lot of push back.  > In WMF production we appear to be using mariadb...