[12:59:19] <shinken-wm>	 PROBLEM - English Wikipedia Main page on beta-cluster is CRITICAL: HTTP CRITICAL: HTTP/1.1 500 Internal Server Error - string 'Wikipedia' not found on 'https://en.wikipedia.beta.wmflabs.org:443/wiki/Main_Page?debug=true' - 1164 bytes in 0.072 second response time
[13:01:16] <shinken-wm>	 PROBLEM - English Wikipedia Mobile Main page on beta-cluster is CRITICAL: HTTP CRITICAL: HTTP/1.1 500 Internal Server Error - string 'Wikipedia' not found on 'https://en.m.wikipedia.beta.wmflabs.org:443/wiki/Main_Page?debug=true' - 1164 bytes in 0.072 second response time
[13:01:18] <shinken-wm>	 PROBLEM - App Server Main HTTP Response on deployment-mediawiki04 is CRITICAL: HTTP CRITICAL: HTTP/1.1 500 Internal Server Error - string 'Wikipedia' not found on 'http://en.wikipedia.beta.wmflabs.org:80/wiki/Main_Page?debug=true' - 728 bytes in 0.075 second response time
[13:04:18] <wmf-insecte>	 Project selenium-Math » chrome,beta,Linux,contintLabsSlave && UbuntuTrusty build #215: 04FAILURE in 17 sec: https://integration.wikimedia.org/ci/job/selenium-Math/BROWSER=chrome,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=Linux,label=contintLabsSlave%20&&%20UbuntuTrusty/215/
[13:04:19] <wmf-insecte>	 Project selenium-Math » firefox,beta,Linux,contintLabsSlave && UbuntuTrusty build #215: 04FAILURE in 17 sec: https://integration.wikimedia.org/ci/job/selenium-Math/BROWSER=firefox,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=Linux,label=contintLabsSlave%20&&%20UbuntuTrusty/215/
[13:20:48] <grrrit-wm>	 (03PS1) 10Paladox: Update test-requirements.txt to use jessie and not precise [integration/config] - 10https://gerrit.wikimedia.org/r/322500 
[13:21:23] <grrrit-wm>	 (03CR) 10jenkins-bot: [V: 04-1] Update test-requirements.txt to use jessie and not precise [integration/config] - 10https://gerrit.wikimedia.org/r/322500 (owner: 10Paladox) 
[13:23:57] <grrrit-wm>	 (03PS2) 10Paladox: Update test-requirements.txt to use jessie and not precise [integration/config] - 10https://gerrit.wikimedia.org/r/322500 
[13:45:27] <wmf-insecte>	 Project selenium-VisualEditor » firefox,beta,Linux,contintLabsSlave && UbuntuTrusty build #219: 04FAILURE in 1 min 27 sec: https://integration.wikimedia.org/ci/job/selenium-VisualEditor/BROWSER=firefox,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=Linux,label=contintLabsSlave%20&&%20UbuntuTrusty/219/
[14:32:23] <wmf-insecte>	 Project selenium-WikiLove » firefox,beta,Linux,contintLabsSlave && UbuntuTrusty build #215: 04FAILURE in 23 sec: https://integration.wikimedia.org/ci/job/selenium-WikiLove/BROWSER=firefox,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=Linux,label=contintLabsSlave%20&&%20UbuntuTrusty/215/
[15:38:06] <wmf-insecte>	 Project selenium-MobileFrontend » firefox,beta,Linux,contintLabsSlave && UbuntuTrusty build #234: 04FAILURE in 16 min: https://integration.wikimedia.org/ci/job/selenium-MobileFrontend/BROWSER=firefox,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=Linux,label=contintLabsSlave%20&&%20UbuntuTrusty/234/
[16:01:29] <wmf-insecte>	 Project selenium-CentralNotice » chrome,beta,Windows 7,contintLabsSlave && UbuntuTrusty build #218: 04FAILURE in 28 sec: https://integration.wikimedia.org/ci/job/selenium-CentralNotice/BROWSER=chrome,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=Windows%207,label=contintLabsSlave%20&&%20UbuntuTrusty/218/
[16:01:30] <wmf-insecte>	 Project selenium-CentralNotice » chrome,beta,Linux,contintLabsSlave && UbuntuTrusty build #218: 04FAILURE in 29 sec: https://integration.wikimedia.org/ci/job/selenium-CentralNotice/BROWSER=chrome,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=Linux,label=contintLabsSlave%20&&%20UbuntuTrusty/218/
[16:01:35] <wmf-insecte>	 Project selenium-CentralNotice » firefox,beta,Linux,contintLabsSlave && UbuntuTrusty build #218: 04FAILURE in 34 sec: https://integration.wikimedia.org/ci/job/selenium-CentralNotice/BROWSER=firefox,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=Linux,label=contintLabsSlave%20&&%20UbuntuTrusty/218/
[16:01:42] <wmf-insecte>	 Project selenium-CentralNotice » firefox,beta,Windows 7,contintLabsSlave && UbuntuTrusty build #218: 04FAILURE in 42 sec: https://integration.wikimedia.org/ci/job/selenium-CentralNotice/BROWSER=firefox,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=Windows%207,label=contintLabsSlave%20&&%20UbuntuTrusty/218/
[16:01:55] <wmf-insecte>	 Project selenium-CentralNotice » chrome,beta,OS X 10.9,contintLabsSlave && UbuntuTrusty build #218: 04FAILURE in 54 sec: https://integration.wikimedia.org/ci/job/selenium-CentralNotice/BROWSER=chrome,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=OS%20X%2010.9,label=contintLabsSlave%20&&%20UbuntuTrusty/218/
[16:02:14] <wmf-insecte>	 Project selenium-CentralNotice » firefox,beta,OS X 10.9,contintLabsSlave && UbuntuTrusty build #218: 04FAILURE in 1 min 14 sec: https://integration.wikimedia.org/ci/job/selenium-CentralNotice/BROWSER=firefox,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=OS%20X%2010.9,label=contintLabsSlave%20&&%20UbuntuTrusty/218/
[16:28:24] <shinken-wm>	 PROBLEM - Puppet run on integration-slave-docker-1000 is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [0.0]
[17:35:51] <paladox>	 A user has reported in -labs that the beta cluster is down
[17:38:54] <Sagan>	 yup, for me too
[17:39:09] <Sagan>	 according to the errors earlier, it looks like it is a bit longer down
[17:39:11] <Sagan>	 I will create a task
[17:39:36] <paladox>	 Yep
[17:39:41] <paladox>	 <shinken-wm> PROBLEM - English Wikipedia Main page on beta-cluster is CRITICAL: HTTP CRITICAL: HTTP/1.1 500 Internal Server Error - string 'Wikipedia' not found on 'https://en.wikipedia.beta.wmflabs.org:443/wiki/Main_Page?debug=true' - 1164 bytes in 0.072 second response time
[17:39:45] <paladox>	 Sagan ^^
[17:40:08] <wikibugs_>	 10Beta-Cluster-Infrastructure, 06Release-Engineering-Team: The Beta-Cluster is down - https://phabricator.wikimedia.org/T151159#2809241 (10Luke081515)
[17:40:20] <wikibugs>	 10Beta-Cluster-Infrastructure, 06Release-Engineering-Team: The Beta-Cluster is down - https://phabricator.wikimedia.org/T151159#2809253 (10Luke081515) p:05Triage>03Unbreak!
[17:41:24] <wikibugs_>	 10Beta-Cluster-Infrastructure, 06Release-Engineering-Team: The Beta-Cluster is down - https://phabricator.wikimedia.org/T151159#2809255 (10Paladox) shinken-wm reported problem first happening at 12:59 pm utc + 0 time.  <shinken-wm> PROBLEM - English Wikipedia Main page on beta-cluster is CRITICAL: HTTP CRITICA...
[17:41:37] <wikibugs>	 10Beta-Cluster-Infrastructure, 06Release-Engineering-Team: The Beta-Cluster is down - https://phabricator.wikimedia.org/T151159#2809256 (10Luke081515) deployment & de show a different message, zh shows the same as at en.
[17:41:53] <Sagan>	 two wikibugs?
[17:42:08] <Sagan>	 ah, a good idea to prevent flood
[17:42:38] <paladox>	 Sagan could you report two wikibugs in -labs please?
[17:42:44] <paladox>	 they need restarting
[17:42:59] <paladox>	 Sagan i now get http 500 error
[17:43:12] <Sagan>	 do they? actually there is not a problem isn't it? They don't send every message twice
[17:43:35] <paladox>	 Sagan if there are two wikibugs it is likly it will say the message twice
[17:44:07] <Sagan>	 it looks like they have access to the same queue
[17:44:18] <Sagan>	 so they can send more messages at once, but won't sent a message twice
[17:44:24] <paladox>	 Oh
[17:44:34] <Sagan>	 so I'm not sure if that effect is expected, but it's not a negative effect
[17:45:20] <paladox>	 Oh
[18:24:22] <shinken-wm>	 PROBLEM - Host integration-puppetmaster is DOWN: CRITICAL - Host Unreachable (10.68.16.42)
[20:38:03] <Reedy>	 The last Puppet run was at Tue Oct 18 02:21:12 UTC 2016 (48616 minutes ago). 
[20:38:21] <Reedy>	 no logs on fluorine
[20:39:40] <Reedy>	 No logs on fluorine?
[20:39:45] <Reedy>	 helpful
[20:43:33] <wmf-insecte>	 Project selenium-Echo » chrome,beta,Linux,contintLabsSlave && UbuntuTrusty build #217: 04FAILURE in 2 min 32 sec: https://integration.wikimedia.org/ci/job/selenium-Echo/BROWSER=chrome,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=Linux,label=contintLabsSlave%20&&%20UbuntuTrusty/217/
[20:43:39] <wmf-insecte>	 Project selenium-Echo » firefox,beta,Linux,contintLabsSlave && UbuntuTrusty build #217: 04FAILURE in 2 min 38 sec: https://integration.wikimedia.org/ci/job/selenium-Echo/BROWSER=firefox,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=Linux,label=contintLabsSlave%20&&%20UbuntuTrusty/217/
[20:48:48] <shinken-wm>	 PROBLEM - Puppet run on deployment-fluorine02 is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [0.0]
[20:49:29] <Reedy>	 Error: Failed to apply catalog: Could not find dependent Service[ganglia-monitor] for File[/usr/lib/ganglia/python_modules/udp_stats.py] at /etc/puppet/modules/ganglia/manifests/plugin/python.pp:28
[20:57:31] <paladox>	 Reedy https://github.com/wikimedia/operations-puppet/blob/e959321aa620b77403cc9379db2e86080323c6e8/modules/ganglia/manifests/monitor/decommission.pp
[20:57:43] <paladox>	 it should not be available in labs
[21:01:50] <Reedy>	 All of the error logs are empty on the apaches
[21:01:57] <Reedy>	 What is this shit, seriously?
[21:02:13] <paladox>	 Reedy enable that debug thing for mw?
[21:02:26] <Reedy>	 It's enabled
[21:02:33] <Reedy>	 I think I filed a bug for this one before
[21:02:53] <paladox>	 Oh
[21:03:12] <paladox>	 Reedy is the bug the one where it woulden debug mediawiki updater?
[21:03:16] <paladox>	 I thought it was fixed
[21:04:46] <Reedy>	 I don't think so
[21:05:53] <paladox>	 Oh
[21:07:10] <paladox>	 Reedy try http://stackoverflow.com/questions/17693391/500-internal-server-error-for-php-file-not-for-html ?
[21:07:17] <paladox>	 ini_set('display_errors', 1);
[21:07:22] <Reedy>	 no
[21:07:28] <Reedy>	 the API is fine if you browse it
[21:07:46] <paladox>	 oh
[21:07:57] <Reedy>	 load.php gives 503
[21:08:06] <paladox>	 Reedy https://en.wikipedia.beta.wmflabs.org/api.php dosent load for me
[21:08:08] <paladox>	 i get 404
[21:08:15] <Reedy>	 w/api.php
[21:08:17] <Reedy>	 as it always is
[21:08:19] <paladox>	 oh thanks
[21:08:42] <paladox>	 Reedy maybe it is an extension?
[21:08:49] <Reedy>	 Why?
[21:09:09] <paladox>	 Because api.php is working
[21:09:22] <Reedy>	 https://phabricator.wikimedia.org/T148957
[21:09:27] <Reedy>	 That makes no sense
[21:10:28] <paladox>	 Reedy https://github.com/wikimedia/mediawiki/commit/eeb382e3c7addd13ee70a58542412628e884f8ec
[21:10:29] <paladox>	 ?
[21:10:35] <paladox>	 that shows a 500 status code
[21:10:42] <Reedy>	 That's not a new commit
[21:11:13] <paladox>	 Nope, but it seems that the config has been broken a while
[21:12:30] <paladox>	 Reedy but the $wgShowExceptionDetails config is set in that file
[21:12:52] <Reedy>	 It's set in DefaultSettings
[21:12:57] <Reedy>	 And it's true in eval.php
[21:13:13] <paladox>	 Reedy https://github.com/wikimedia/mediawiki/blob/eeb382e3c7addd13ee70a58542412628e884f8ec/includes/exception/MWException.php#L106
[21:13:25] <shinken-wm>	 PROBLEM - Long lived cherry-picks on puppetmaster on deployment-puppetmaster02 is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [0.0]
[21:13:30] <Reedy>	 yeah, and?
[21:13:36] <Reedy>	 that's not setting anything
[21:13:58] <paladox>	 Oh
[21:22:18] <paladox>	 Reedy it seems like it is related to the change done in https://github.com/wikimedia/mediawiki/commit/00bee029718f3215396e984d04b9450bc3872503
[21:29:54] <paladox>	 Reedy should we make this https://phabricator.wikimedia.org/T148957 hi priority? Since if you carn't debug your wiki's then how can someone fix something they carn't find broken?
[21:30:07] <Reedy>	 well, if it logged to the error logs, it'd be alright
[21:30:14] <Reedy>	 but it doesn't do that either
[21:30:49] <paladox>	 Reedy i get errors to my log
[21:30:56] <Reedy>	 That doesn't help
[21:30:59] <Reedy>	 There's non on beta
[21:31:02] <paladox>	 Oh
[21:33:20] <Reedy>	 it doesn't even get to the place it uses that
[21:33:36] <paladox>	 Oh
[21:44:11] <Reedy>	 paladox: Did you link those commits on that task?
[21:44:20] <paladox>	 Nope
[21:44:36] <Reedy>	 Original exception: [WDIZMQpEE4AAAEoeUxYAAAAG] /wiki/?foobar DBQueryError from line 1054 of /srv/mediawiki/php-master/includes/libs/rdbms/database/Database.php: A database query error has occurred. Did you forget to run your application's database schema updater after upgrading? 
[21:44:39] <Reedy>	 Query: SHOW SLAVE STATUS
[21:44:41] <Reedy>	 Function: DatabaseMysqlBase::getLagFromSlaveStatus
[21:44:43] <Reedy>	 Error: 1227 Access denied; you need (at least one of) the SUPER, REPLICATION CLIENT privilege(s) for this operation (10.68.18.35)
[21:44:59] <paladox>	 Oh
[21:45:11] <paladox>	 Where did you get that?
[21:45:14] <Reedy>	 Krenair: ^ Haven't you touched this recently?
[21:45:15] <Reedy>	 By hacking it
[21:45:53] <wikibugs_>	 10Beta-Cluster-Infrastructure, 06Release-Engineering-Team: The Beta-Cluster is down - https://phabricator.wikimedia.org/T151159#2809241 (10Reedy) Various hacking to get this done  ``` MediaWiki internal error.  Original exception: [WDIZMQpEE4AAAEoeUxYAAAAG] /wiki/?foobar DBQueryError from line 1054 of /srv/med...
[21:46:27] <paladox>	 Reedy what hacks did you do to get ^^ working
[21:46:35] <Reedy>	 Commenting out some stuff
[21:46:38] <paladox>	 Oh
[21:46:42] <Reedy>	 to force the backtraces to be written out
[21:46:48] <paladox>	 Oh :)
[21:47:36] <paladox>	 Reedy would you be able to do a paste please? I would be interested to see the stuff you crossed out that got it working
[21:47:41] <paladox>	 we could link it to the task
[21:47:45] <Reedy>	 I already did
[21:47:48] <Reedy>	 oh
[21:48:25] <paladox>	 I meant the code changes
[21:48:30] <Krenair>	 I did change some grants around
[21:49:01] <paladox>	 I think i hit the same errors as you described but i thought it was fixed as my wiki started working after updating it again
[21:49:06] <paladox>	 to a version i forgot
[21:49:07] <Krenair>	 I thought the ones I did were close to production's
[21:51:14] <Krenair>	 Reedy, so it seems wikiadmin can do 'show slave status' but not wikiuser
[21:52:22] <Krenair>	 so
[21:52:24] <Krenair>	 prod has this
[21:52:27] <Krenair>	 GRANT PROCESS, REPLICATION CLIENT ON *.* TO 'wikiuser'@'10.64.%' IDENTIFIED BY PASSWORD
[21:52:34] <wikibugs_>	 10Beta-Cluster-Infrastructure, 06Release-Engineering-Team: deployment-fluorine02 puppet broken - https://phabricator.wikimedia.org/T151169#2809529 (10Reedy)
[21:52:53] <Krenair>	 and we do not
[21:52:56] <Krenair>	 so I'll fix that
[21:53:11] <Reedy>	 thanks
[21:53:17] <paladox>	 Reedy i get this error
[21:53:18] <paladox>	 [20-Nov-2016 21:28:00 Europe/London] PHP Fatal error:  Call to undefined method OutputPage::setContext() in /home/randomwi/public_html/en/includes/OutputPage.php on line 312
[21:53:28] <Reedy>	 That's nice
[21:53:31] <Reedy>	 File a task?
[21:53:35] <paladox>	 Ok
[21:53:50] <Krenair>	 Reedy, try now
[21:54:04] <Reedy>	 yup, that fixes it, ta
[21:54:06] <paladox>	 Reedy strange thing though, it hasent said that error for 40+ mins now
[21:54:21] <shinken-wm>	 RECOVERY - English Wikipedia Main page on beta-cluster is OK: HTTP OK: HTTP/1.1 200 OK - 44599 bytes in 1.523 second response time
[21:56:17] <shinken-wm>	 RECOVERY - English Wikipedia Mobile Main page on beta-cluster is OK: HTTP OK: HTTP/1.1 200 OK - 17430 bytes in 2.277 second response time
[21:56:19] <shinken-wm>	 RECOVERY - App Server Main HTTP Response on deployment-mediawiki04 is OK: HTTP OK: HTTP/1.1 200 OK - 44165 bytes in 1.342 second response time
[21:58:04] <Krenair>	 I just ran `GRANT PROCESS, REPLICATION CLIENT ON *.* TO 'wikiuser'@'10.%';` as mysql root on deployment-db03
[21:58:37] <wmf-insecte>	 Project selenium-Core » firefox,beta,Linux,contintLabsSlave && UbuntuTrusty build #225: 04FAILURE in 6 min 36 sec: https://integration.wikimedia.org/ci/job/selenium-Core/BROWSER=firefox,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=Linux,label=contintLabsSlave%20&&%20UbuntuTrusty/225/
[21:59:05] <Reedy>	 Krenair: Mind commenting it on the task? https://phabricator.wikimedia.org/T151159
[22:01:25] <wikibugs>	 10Beta-Cluster-Infrastructure: deployment-fluorine02 does not have logs - https://phabricator.wikimedia.org/T146723#2669408 (10Reedy) Puppet is rather busted on this server too... T151169
[22:01:30] <Krenair>	 ok
[22:01:53] <wikibugs_>	 10Beta-Cluster-Infrastructure, 06Release-Engineering-Team: The Beta-Cluster is down - https://phabricator.wikimedia.org/T151159#2809561 (10Krenair) 05Open>03Resolved a:03Krenair This was probably due to my messing with the grants etc. - beta used to use wikiadmin for *everything*, after fixing up the gra...
[22:04:20] <wikibugs_>	 10Beta-Cluster-Infrastructure, 07Puppet, 07Tracking: Deployment-prep hosts with puppet errors (tracking) - https://phabricator.wikimedia.org/T132259#2809567 (10Krenair)
[22:04:21] <wikibugs>	 10Beta-Cluster-Infrastructure, 06Release-Engineering-Team: deployment-fluorine02 puppet broken - https://phabricator.wikimedia.org/T151169#2809566 (10Krenair)
[22:04:55] <wikibugs_>	 10Beta-Cluster-Infrastructure, 06Release-Engineering-Team: deployment-fluorine02 puppet broken - https://phabricator.wikimedia.org/T151169#2809529 (10Krenair) see also T134808
[22:06:37] <wikibugs>	 10Beta-Cluster-Infrastructure, 05Goal, 07Puppet: Remove all ::beta roles in puppet - https://phabricator.wikimedia.org/T86644#973295 (10Krenair) I've been doing some of this recently: https://gerrit.wikimedia.org/r/#/c/322403/ - role::beta::uploadservice https://gerrit.wikimedia.org/r/#/c/322404/ - role::bet...
[22:06:48] <paladox>	 Reedy i noticed that in installHandler
[22:06:56] <paladox>	 it's calling non exiting functions
[22:06:56] <paladox>	 like
[22:06:57] <paladox>	 		set_exception_handler( 'MWExceptionHandler::handleException' );
[22:06:57] <paladox>	 		set_error_handler( 'MWExceptionHandler::handleError' );
[22:06:57] <paladox>	 		// Reserve 16k of memory so we can report OOM fatals
[22:06:58] <paladox>	 		self::$reservedMemory = str_repeat( ' ', 16384 );
[22:06:58] <paladox>	 		register_shutdown_function( 'MWExceptionHandler::handleFatalError' );
[22:07:16] <paladox>	 Never mind
[22:07:22] <paladox>	 I was loking at it wrong
[22:07:44] <wikibugs>	 10Beta-Cluster-Infrastructure, 06Release-Engineering-Team: hhvm error logs on beta showing no errors when cluster down - https://phabricator.wikimedia.org/T151171#2809575 (10Reedy)
[22:11:14] <wikibugs>	 10Beta-Cluster-Infrastructure, 10Staging, 07Wikimedia-Incident: Rework beta apache config - https://phabricator.wikimedia.org/T1256#2809595 (10Krenair) I've uploaded some patches recently to bring beta closer to prod in this area: * https://gerrit.wikimedia.org/r/#/c/322413/ - mediawiki: move redirects site...
[22:16:41] <wikibugs>	 10Beta-Cluster-Infrastructure, 10Staging, 07Wikimedia-Incident: Rework beta apache config - https://phabricator.wikimedia.org/T1256#2809598 (10Krenair) Or we could go the other way: Turn production's config files into templates, make them work with beta then get rid of beta's ones. (except for the one or two...
[22:19:34] <paladox>	 Reedy this https://github.com/wikimedia/mediawiki/commit/00bee029718f3215396e984d04b9450bc3872503 deffitly broke it
[22:19:38] <paladox>	 by looking at it
[22:19:49] <paladox>	 it changes all the calls from a config to calling a function
[22:20:17] <Reedy>	 what?
[22:21:40] <paladox>	 Reedy breaking the config that helps debug
[22:21:55] <Reedy>	 Why is calling a function bad?
[22:22:01] <Reedy>	 Why don't you try testing it?
[22:22:13] <paladox>	 I did, but i have nothing broken to test
[22:22:17] <Reedy>	 Do something that should be handled, check it isn't, then git revert that patch
[22:22:26] <paladox>	 Oh
[22:22:38] <paladox>	 I have found this function showBackTrace
[22:22:45] <Reedy>	 I don't think it was lost
[22:22:50] <Reedy>	 I think you can just throw an MWException in a random place
[22:23:01] <paladox>	 Which does, return ($wgShowExceptionDetails &&( !( $e instanceof DBError ) || $wgShowDBErrorBacktrace ) );
[23:05:17] <wikibugs>	 10Beta-Cluster-Infrastructure, 10Staging, 07Wikimedia-Incident: Rework beta apache config - https://phabricator.wikimedia.org/T1256#2809655 (10Krenair) Actually I prefer the other way, uploading patches for that.