[00:00:16] 10Continuous-Integration-Config, 10MediaWiki-Debug-Logger, 10Patch-For-Review: Log suppressed errors with level=DEBUG - https://phabricator.wikimedia.org/T193472 (10Krinkle) @Tgr The task as written appears to be working as expected. We currently, and have for years, collect the "suppressed errors" in produc... [00:00:16] 10Continuous-Integration-Config, 10MediaWiki-Debug-Logger, 10Patch-For-Review: Log suppressed errors with level=DEBUG - https://phabricator.wikimedia.org/T193472 (10Krinkle) @Tgr The task as written appears to be working as expected. We currently, and have for years, collect the "suppressed errors" in produc... [06:27:41] PROBLEM - English Wikipedia Main page on beta-cluster is CRITICAL: CRITICAL - Socket timeout after 10 seconds [06:27:41] PROBLEM - English Wikipedia Main page on beta-cluster is CRITICAL: CRITICAL - Socket timeout after 10 seconds [06:28:20] PROBLEM - English Wikipedia Mobile Main page on beta-cluster is CRITICAL: (Service Check Timed Out) [06:28:20] PROBLEM - English Wikipedia Mobile Main page on beta-cluster is CRITICAL: (Service Check Timed Out) [11:34:50] (03PS1) 10Umherirrender: Whitelist @after and @before phpunit annotations [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/478474 [11:34:51] (03PS1) 10Umherirrender: Whitelist @after and @before phpunit annotations [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/478474 [11:40:23] (03Abandoned) 10Umherirrender: Allow use of @type in code [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/472522 (https://phabricator.wikimedia.org/T203922) (owner: 10Umherirrender) [11:40:23] (03Abandoned) 10Umherirrender: Allow use of @type in code [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/472522 (https://phabricator.wikimedia.org/T203922) (owner: 10Umherirrender) [11:40:42] 10MediaWiki-Codesniffer, 10Patch-For-Review: Allow deprecated @type in MediaWiki.Commenting.FunctionAnnotations.UnrecognizedAnnotation - https://phabricator.wikimedia.org/T203922 (10Umherirrender) 05Open>03declined [11:40:42] 10MediaWiki-Codesniffer, 10Patch-For-Review: Allow deprecated @type in MediaWiki.Commenting.FunctionAnnotations.UnrecognizedAnnotation - https://phabricator.wikimedia.org/T203922 (10Umherirrender) 05Open>03declined [13:15:04] 10Phabricator (Upstream), 10Upstream: "Custom Policy" box could provide more informations - https://phabricator.wikimedia.org/T211498 (10MarcoAurelio) [13:15:04] 10Phabricator (Upstream), 10Upstream: "Custom Policy" box could provide more informations - https://phabricator.wikimedia.org/T211498 (10MarcoAurelio) [14:19:07] 10Phabricator (Upstream), 10Upstream: "Custom Policy" box could provide more informations - https://phabricator.wikimedia.org/T211498 (10Aklapper) {nav icon=certificate, name=Custom Policy} links to a Policy Details page. On that page, you mean the line`Can View: Custom Policy` should be more verbose? [14:19:07] 10Phabricator (Upstream), 10Upstream: "Custom Policy" box could provide more informations - https://phabricator.wikimedia.org/T211498 (10Aklapper) {nav icon=certificate, name=Custom Policy} links to a Policy Details page. On that page, you mean the line`Can View: Custom Policy` should be more verbose? [15:33:45] 10MediaWiki-Releasing, 10MediaWiki-Debian, 10MW-1.31-release, 10PHP 7.3 support: MediaWiki 1.31.x should be compatible with PHP 7.3 - https://phabricator.wikimedia.org/T206988 (10RazeSoldier) [15:33:45] 10MediaWiki-Releasing, 10MediaWiki-Debian, 10MW-1.31-release, 10PHP 7.3 support: MediaWiki 1.31.x should be compatible with PHP 7.3 - https://phabricator.wikimedia.org/T206988 (10RazeSoldier) [18:25:06] 10Continuous-Integration-Config, 10MediaWiki-Debug-Logger, 10Patch-For-Review: Log suppressed errors with level=DEBUG - https://phabricator.wikimedia.org/T193472 (10Tgr) Current WMF config discards error-json entirely. I see your point about this change being problematic with the default config (it does see... [18:25:06] 10Continuous-Integration-Config, 10MediaWiki-Debug-Logger, 10Patch-For-Review: Log suppressed errors with level=DEBUG - https://phabricator.wikimedia.org/T193472 (10Tgr) Current WMF config discards error-json entirely. I see your point about this change being problematic with the default config (it does see... [18:33:28] 10Continuous-Integration-Config, 10MediaWiki-Debug-Logger, 10Patch-For-Review: Log suppressed errors with level=DEBUG - https://phabricator.wikimedia.org/T193472 (10Krinkle) @Tgr That seems fine by me as a first step (separate channel). [18:33:29] 10Continuous-Integration-Config, 10MediaWiki-Debug-Logger, 10Patch-For-Review: Log suppressed errors with level=DEBUG - https://phabricator.wikimedia.org/T193472 (10Krinkle) @Tgr That seems fine by me as a first step (separate channel). [19:56:09] 10Phabricator (Upstream), 10Upstream: "Custom Policy" box could provide more informations - https://phabricator.wikimedia.org/T211498 (10MarcoAurelio) Yes, that's it. Thanks. [19:56:09] 10Phabricator (Upstream), 10Upstream: "Custom Policy" box could provide more informations - https://phabricator.wikimedia.org/T211498 (10MarcoAurelio) Yes, that's it. Thanks. [22:32:57] legoktm: http://talks.php.net/concat18#/phan3 - Phan "watch" mode for local development [22:32:57] legoktm: http://talks.php.net/concat18#/phan3 - Phan "watch" mode for local development [22:33:04] Also, DollarDollarPlugin, thoughts? [22:33:04] Also, DollarDollarPlugin, thoughts? [22:37:42] 10Beta-Cluster-Infrastructure: Unable to access en/ko.wikipedia.beta.wmflabs.org - https://phabricator.wikimedia.org/T211524 (10kostajh) [22:37:42] 10Beta-Cluster-Infrastructure: Unable to access en/ko.wikipedia.beta.wmflabs.org - https://phabricator.wikimedia.org/T211524 (10kostajh) [22:45:14] 10Beta-Cluster-Infrastructure: Unable to access en/ko.wikipedia.beta.wmflabs.org - https://phabricator.wikimedia.org/T211524 (10Quiddity) [22:45:14] 10Beta-Cluster-Infrastructure: Unable to access en/ko.wikipedia.beta.wmflabs.org - https://phabricator.wikimedia.org/T211524 (10Quiddity) [22:45:26] 10Beta-Cluster-Infrastructure: Unable to access en/ko.wikipedia.beta.wmflabs.org - https://phabricator.wikimedia.org/T211524 (10Quiddity) p:05Normal>03Triage [22:45:26] 10Beta-Cluster-Infrastructure: Unable to access en/ko.wikipedia.beta.wmflabs.org - https://phabricator.wikimedia.org/T211524 (10Quiddity) p:05Normal>03Triage [22:59:19] 10Beta-Cluster-Infrastructure, 10Discovery-Search: Notice: Undefined index: search-chi in /srv/mediawiki/wmf-config/CommonSettings.php on line 1672 - https://phabricator.wikimedia.org/T211526 (10Krinkle) [22:59:19] 10Beta-Cluster-Infrastructure, 10Discovery-Search: Notice: Undefined index: search-chi in /srv/mediawiki/wmf-config/CommonSettings.php on line 1672 - https://phabricator.wikimedia.org/T211526 (10Krinkle) [23:04:33] 10Beta-Cluster-Infrastructure, 10Discovery-Search, 10Patch-For-Review: Notice: Undefined index: search-chi in /srv/mediawiki/wmf-config/CommonSettings.php on line 1672 - https://phabricator.wikimedia.org/T211526 (10Krinkle) >>! In T211526#4808969, @gerritbot wrote: > Change 478569 had a related patch set upl... [23:04:33] 10Beta-Cluster-Infrastructure, 10Discovery-Search, 10Patch-For-Review: Notice: Undefined index: search-chi in /srv/mediawiki/wmf-config/CommonSettings.php on line 1672 - https://phabricator.wikimedia.org/T211526 (10Krinkle) >>! In T211526#4808969, @gerritbot wrote: > Change 478569 had a related patch set upl... [23:21:13] Krinkle: first we need to figure out how to upgrade phan to a modern version >.< [23:21:13] Krinkle: first we need to figure out how to upgrade phan to a modern version >.< [23:22:25] 10Beta-Cluster-Infrastructure, 10Operations: Unable to access en/ko.wikipedia.beta.wmflabs.org - https://phabricator.wikimedia.org/T211524 (10Quiddity) [23:22:25] 10Beta-Cluster-Infrastructure, 10Operations: Unable to access en/ko.wikipedia.beta.wmflabs.org - https://phabricator.wikimedia.org/T211524 (10Quiddity) [23:22:39] 10Beta-Cluster-Infrastructure, 10Operations: Unable to access beta cluster - https://phabricator.wikimedia.org/T211524 (10Quiddity) [23:22:39] 10Beta-Cluster-Infrastructure, 10Operations: Unable to access beta cluster - https://phabricator.wikimedia.org/T211524 (10Quiddity) [23:27:34] 10Beta-Cluster-Infrastructure: Unable to access beta cluster - https://phabricator.wikimedia.org/T211524 (10Krenair) [23:27:34] 10Beta-Cluster-Infrastructure: Unable to access beta cluster - https://phabricator.wikimedia.org/T211524 (10Krenair) [23:31:19] 10Beta-Cluster-Infrastructure: Unable to access beta cluster - https://phabricator.wikimedia.org/T211524 (10Krenair) interesting, API is up [23:31:19] 10Beta-Cluster-Infrastructure: Unable to access beta cluster - https://phabricator.wikimedia.org/T211524 (10Krenair) interesting, API is up [23:36:13] 10Beta-Cluster-Infrastructure: Unable to access beta cluster - https://phabricator.wikimedia.org/T211524 (10Krenair) According to the deployment-mediawiki-07 apache logs it last handled a request at 2018-12-09T06:24:49. Restarting apache has fixed it: `name=Apache status on deployment-mediawiki-07 root@deploymen... [23:36:13] 10Beta-Cluster-Infrastructure: Unable to access beta cluster - https://phabricator.wikimedia.org/T211524 (10Krenair) According to the deployment-mediawiki-07 apache logs it last handled a request at 2018-12-09T06:24:49. Restarting apache has fixed it: `name=Apache status on deployment-mediawiki-07 root@deploymen... [23:36:23] 10Beta-Cluster-Infrastructure: Unable to access beta cluster - https://phabricator.wikimedia.org/T211524 (10Krenair) a:03Krenair [23:36:23] 10Beta-Cluster-Infrastructure: Unable to access beta cluster - https://phabricator.wikimedia.org/T211524 (10Krenair) a:03Krenair [23:37:32] RECOVERY - English Wikipedia Main page on beta-cluster is OK: HTTP OK: HTTP/1.1 200 OK - 48434 bytes in 1.002 second response time [23:37:32] RECOVERY - English Wikipedia Main page on beta-cluster is OK: HTTP OK: HTTP/1.1 200 OK - 48434 bytes in 1.002 second response time [23:38:09] RECOVERY - English Wikipedia Mobile Main page on beta-cluster is OK: HTTP OK: HTTP/1.1 200 OK - 37246 bytes in 0.860 second response time [23:38:09] RECOVERY - English Wikipedia Mobile Main page on beta-cluster is OK: HTTP OK: HTTP/1.1 200 OK - 37246 bytes in 0.860 second response time [23:38:09] !log restarted apache on deployment-mediawiki-07 for T211524 [23:38:09] !log restarted apache on deployment-mediawiki-07 for T211524 [23:38:13] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [23:38:13] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [23:38:13] T211524: Unable to access beta cluster - https://phabricator.wikimedia.org/T211524 [23:38:13] T211524: Unable to access beta cluster - https://phabricator.wikimedia.org/T211524 [23:39:53] 10Beta-Cluster-Infrastructure: Unable to access beta cluster - https://phabricator.wikimedia.org/T211524 (10Krenair) 05Open>03Resolved Since this is seemingly rare, this sort of problem would be unlikely to cause such huge problems in the production environment, and it just requires a simple service restart,... [23:39:53] 10Beta-Cluster-Infrastructure: Unable to access beta cluster - https://phabricator.wikimedia.org/T211524 (10Krenair) 05Open>03Resolved Since this is seemingly rare, this sort of problem would be unlikely to cause such huge problems in the production environment, and it just requires a simple service restart,... [23:42:55] 10Beta-Cluster-Infrastructure: Unable to access beta cluster - https://phabricator.wikimedia.org/T211524 (10Quiddity) Thanks! [23:42:55] 10Beta-Cluster-Infrastructure: Unable to access beta cluster - https://phabricator.wikimedia.org/T211524 (10Quiddity) Thanks!