[01:55:54] (03CR) 10DannyS712: [C: 03+1] Test non-parenthesis branch in AssertCountSniff [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/673682 (owner: 10Umherirrender) [07:29:05] PROBLEM - Gerrit Health Check on gerrit.wikimedia.org is CRITICAL: CRITICAL - Socket timeout after 10 seconds https://gerrit.wikimedia.org/r/config/server/healthcheck%7Estatus [07:29:15] PROBLEM - Gerrit JSON on gerrit.wikimedia.org is CRITICAL: CRITICAL - Socket timeout after 10 seconds https://wikitech.wikimedia.org/wiki/Gerrit%23Monitoring [07:29:33] (03PS2) 10Umherirrender: internal: Avoid extra local var before adding sniff error or warning [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/665198 [07:30:32] gerrit down again? :/ [07:32:25] 10Gerrit, 10Release-Engineering-Team: Gerrit Apache out of workers - https://phabricator.wikimedia.org/T277127 (10Majavah) 05Resolved→03Open Re-opening, same thing happening again. [07:33:39] RECOVERY - Gerrit Health Check on gerrit.wikimedia.org is OK: HTTP OK: HTTP/1.1 200 OK - 904 bytes in 0.079 second response time https://gerrit.wikimedia.org/r/config/server/healthcheck%7Estatus [07:33:57] RECOVERY - Gerrit JSON on gerrit.wikimedia.org is OK: HTTP OK: HTTP/1.1 200 OK - 20885 bytes in 4.944 second response time https://wikitech.wikimedia.org/wiki/Gerrit%23Monitoring [07:43:45] PROBLEM - Gerrit Health Check on gerrit.wikimedia.org is CRITICAL: CRITICAL - Socket timeout after 10 seconds https://gerrit.wikimedia.org/r/config/server/healthcheck%7Estatus [07:43:59] PROBLEM - Gerrit JSON on gerrit.wikimedia.org is CRITICAL: CRITICAL - Socket timeout after 10 seconds https://wikitech.wikimedia.org/wiki/Gerrit%23Monitoring [07:45:59] RECOVERY - Gerrit Health Check on gerrit.wikimedia.org is OK: HTTP OK: HTTP/1.1 200 OK - 904 bytes in 0.456 second response time https://gerrit.wikimedia.org/r/config/server/healthcheck%7Estatus [07:46:19] RECOVERY - Gerrit JSON on gerrit.wikimedia.org is OK: HTTP OK: HTTP/1.1 200 OK - 20960 bytes in 5.850 second response time https://wikitech.wikimedia.org/wiki/Gerrit%23Monitoring [07:53:11] PROBLEM - Gerrit Health Check on gerrit.wikimedia.org is CRITICAL: CRITICAL - Socket timeout after 10 seconds https://gerrit.wikimedia.org/r/config/server/healthcheck%7Estatus [07:55:45] PROBLEM - Gerrit JSON on gerrit.wikimedia.org is CRITICAL: CRITICAL - Socket timeout after 10 seconds https://wikitech.wikimedia.org/wiki/Gerrit%23Monitoring [08:00:07] RECOVERY - Gerrit Health Check on gerrit.wikimedia.org is OK: HTTP OK: HTTP/1.1 200 OK - 904 bytes in 6.014 second response time https://gerrit.wikimedia.org/r/config/server/healthcheck%7Estatus [08:00:20] RECOVERY - Gerrit JSON on gerrit.wikimedia.org is OK: HTTP OK: HTTP/1.1 200 OK - 20991 bytes in 5.413 second response time https://wikitech.wikimedia.org/wiki/Gerrit%23Monitoring [08:23:30] 10Gerrit, 10Release-Engineering-Team: Gerrit Apache out of workers - https://phabricator.wikimedia.org/T277127 (10QChris) As Majavah said, it just happened again. I've restarted apache on gerrit1001, which again made the issue go away for now. https://wikitech.wikimedia.org/w/index.php?title=Server_Admin_Log... [08:25:14] (03CR) 10Ammarpad: [C: 04-1] "Please do not remove votes that you don't like" [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/665198 (owner: 10Umherirrender) [08:28:49] (03CR) 10Ammarpad: [C: 04-1] "> The vote was not really a -1. A -1 means "please improve". What should have been changed to make this patch acceptable?" [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/665198 (owner: 10Umherirrender) [09:00:07] 10Continuous-Integration-Config, 10Release-Engineering-Team (Unit & Int & System Tooling), 10Release-Engineering-Team-TODO, 10MediaWiki-Core-Testing, and 6 others: Reduce runtime of MW shared gate Jenkins jobs to 5 min - https://phabricator.wikimedia.org/T225730 (10Ammarpad) [09:25:49] 10Gerrit, 10Release-Engineering-Team: Gerrit Apache out of workers - https://phabricator.wikimedia.org/T277127 (10elukey) Suggestion for the next time that httpd maxes out its workers: we could use `gdb` with `thread apply all bt` (after attaching it to one of the httpd worker processes) to see the status of t... [10:11:17] PROBLEM - Gerrit Health Check on gerrit.wikimedia.org is CRITICAL: CRITICAL - Socket timeout after 10 seconds https://gerrit.wikimedia.org/r/config/server/healthcheck%7Estatus [10:11:31] PROBLEM - Gerrit JSON on gerrit.wikimedia.org is CRITICAL: CRITICAL - Socket timeout after 10 seconds https://wikitech.wikimedia.org/wiki/Gerrit%23Monitoring [10:13:31] RECOVERY - Gerrit Health Check on gerrit.wikimedia.org is OK: HTTP OK: HTTP/1.1 200 OK - 904 bytes in 2.933 second response time https://gerrit.wikimedia.org/r/config/server/healthcheck%7Estatus [10:13:41] RECOVERY - Gerrit JSON on gerrit.wikimedia.org is OK: HTTP OK: HTTP/1.1 200 OK - 20512 bytes in 0.504 second response time https://wikitech.wikimedia.org/wiki/Gerrit%23Monitoring [10:23:17] PROBLEM - Gerrit JSON on gerrit.wikimedia.org is CRITICAL: CRITICAL - Socket timeout after 10 seconds https://wikitech.wikimedia.org/wiki/Gerrit%23Monitoring [10:25:25] PROBLEM - Gerrit Health Check on gerrit.wikimedia.org is CRITICAL: CRITICAL - Socket timeout after 10 seconds https://gerrit.wikimedia.org/r/config/server/healthcheck%7Estatus [10:32:25] RECOVERY - Gerrit Health Check on gerrit.wikimedia.org is OK: HTTP OK: HTTP/1.1 200 OK - 905 bytes in 7.443 second response time https://gerrit.wikimedia.org/r/config/server/healthcheck%7Estatus [10:32:37] RECOVERY - Gerrit JSON on gerrit.wikimedia.org is OK: HTTP OK: HTTP/1.1 200 OK - 20528 bytes in 3.726 second response time https://wikitech.wikimedia.org/wiki/Gerrit%23Monitoring [10:34:52] 10Gerrit, 10Release-Engineering-Team: Gerrit Apache out of workers - https://phabricator.wikimedia.org/T277127 (10QChris) I've just taken such a backtrace dump and pushed it as P14957 [12:14:23] (03CR) 10Jdrewniak: "Was this submitted by accident?" [wikimedia/portals] (refs/meta/config) - 10https://gerrit.wikimedia.org/r/673120 (owner: 10Avula Shanmukhi) [12:32:19] (03PS1) 10Zabe: Add Sandyabhi in the CI whitelist [integration/config] - 10https://gerrit.wikimedia.org/r/673770 [12:34:21] (03PS2) 10Zabe: Add Sandeep Kumar Patel in the CI whitelist [integration/config] - 10https://gerrit.wikimedia.org/r/673770 [12:34:46] (03PS3) 10Zabe: Add Sandeep Kumar Patel in the CI whitelist [integration/config] - 10https://gerrit.wikimedia.org/r/673770 [12:34:53] 10Gerrit, 10Release-Engineering-Team: Gerrit Apache out of workers - https://phabricator.wikimedia.org/T277127 (10elukey) >>! In T277127#6932273, @QChris wrote: > I've just taken such a backtrace dump and pushed it as P14957 Really nice thanks! Before the next restart I'd also get the html of `http://localhos... [12:40:10] 10Continuous-Integration-Config, 10Gerrit: Make CI point to gerrit-replica instead of the main gerrit - https://phabricator.wikimedia.org/T278041 (10Ladsgroup) [13:20:29] (03PS1) 10Daimona Eaytoy: Add a PHPUnit sniff for deprecated MockBuilder::setMethods [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/673773 (https://phabricator.wikimedia.org/T278010) [13:21:29] (03PS2) 10Daimona Eaytoy: Add a PHPUnit sniff for deprecated MockBuilder::setMethods [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/673773 (https://phabricator.wikimedia.org/T278010) [13:23:47] (03CR) 10Zoranzoki21: [C: 03+1] "This should be okay." [integration/config] - 10https://gerrit.wikimedia.org/r/673770 (owner: 10Zabe) [14:01:46] 10Gerrit, 10Release-Engineering-Team: Gerrit Apache out of workers - https://phabricator.wikimedia.org/T277127 (10hashar) `http://localhost/server-status` that is more or less captured by our monitoring and reflects on the Apache scoreboard statuses graph https://grafana.wikimedia.org/d/L0-l1o0Mz/apache?orgId... [14:37:23] 10Release-Engineering-Team (Unit & Int & System Tooling), 10Pywikibot, 10Patch-For-Review, 10Pywikibot-tests: Lint test to match function signature and documentation - https://phabricator.wikimedia.org/T277396 (10Xqt) [14:57:52] (03CR) 10DannyS712: [C: 03+1] Add a PHPUnit sniff for deprecated MockBuilder::setMethods [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/673773 (https://phabricator.wikimedia.org/T278010) (owner: 10Daimona Eaytoy) [15:18:46] 10Release-Engineering-Team (Code Health), 10MediaWiki-extensions-FlaggedRevs, 10Code-Stewardship-Reviews, 10User-notice: Code stewardship review: FlaggedRevs - https://phabricator.wikimedia.org/T185664 (10Tacsipacsi) >>! In T185664#6928950, @Zache wrote: > "SimpleUI" will currently break the fiwikis page l... [15:27:01] 10Release-Engineering-Team (Code Health), 10MediaWiki-extensions-FlaggedRevs, 10Code-Stewardship-Reviews, 10User-notice: Code stewardship review: FlaggedRevs - https://phabricator.wikimedia.org/T185664 (10Ladsgroup) That will royally break in the new vector where the language links are being put (see https... [15:44:09] 10Release-Engineering-Team (Code Health), 10MediaWiki-extensions-FlaggedRevs, 10Code-Stewardship-Reviews, 10User-notice: Code stewardship review: FlaggedRevs - https://phabricator.wikimedia.org/T185664 (10Tacsipacsi) So one more reason to resolve T197912—if the box’s position is tied to the indicators, whe... [16:52:07] (03CR) 10DannyS712: "@Umherirrender I don't really understand your suggestion - would you mind uploading a patchset with how you envisioned this?" (033 comments) [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/661247 (https://phabricator.wikimedia.org/T273624) (owner: 10DannyS712) [17:19:00] 10Gerrit, 10Release-Engineering-Team: Gerrit Apache out of workers - https://phabricator.wikimedia.org/T277127 (10elukey) @hashar I am aware of the metrics, I meant to check what IPs were effectively causing busy workers.. :) [18:40:48] James_F for https://gerrit.wikimedia.org/r/c/mediawiki/core/+/673782 since a new patch set was uploaded after the +2, doesn't it need another comment from you (or someone else who gives a +2 to the patch) to retrigger Jenkins for the patch? I got in trouble last time I messed with the submitting of vendor patches, so not doing it myself [18:43:38] (03CR) 10DannyS712: [C: 03+2] Add newline test to IfElseStructureSniff [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/673640 (owner: 10Umherirrender) [18:44:20] (03CR) 10DannyS712: [C: 03+2] Test non-parenthesis branch in DirUsageSniff [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/673628 (owner: 10Umherirrender) [18:44:57] (03CR) 10DannyS712: [C: 03+2] Add newline test to WhiteSpaceBeforeFunction [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/673627 (owner: 10Umherirrender) [18:45:47] (03Merged) 10jenkins-bot: Add newline test to IfElseStructureSniff [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/673640 (owner: 10Umherirrender) [18:45:49] (03Merged) 10jenkins-bot: Test non-parenthesis branch in DirUsageSniff [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/673628 (owner: 10Umherirrender) [18:46:17] (03CR) 10DannyS712: [C: 04-1] Test ValidGlobalNameSniff with multi prefixes (031 comment) [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/673605 (owner: 10Umherirrender) [18:46:59] (03CR) 10DannyS712: [C: 04-1] Test PrefixedGlobalFunctionsSniff with ignore list (031 comment) [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/673609 (owner: 10Umherirrender) [18:47:04] (03Merged) 10jenkins-bot: Add newline test to WhiteSpaceBeforeFunction [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/673627 (owner: 10Umherirrender) [18:48:54] (03CR) 10DannyS712: [C: 03+2] Test non-parenthesis branch in DeprecatedPHPUnitMethodsSniff [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/673688 (owner: 10Umherirrender) [18:50:04] (03CR) 10DannyS712: [C: 04-1] Include class names in UnusedUse messages (031 comment) [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/666893 (owner: 10Lucas Werkmeister (WMDE)) [18:50:38] (03Merged) 10jenkins-bot: Test non-parenthesis branch in DeprecatedPHPUnitMethodsSniff [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/673688 (owner: 10Umherirrender) [18:51:34] (03CR) 10DannyS712: Fix error message for long array case in SpaceyParenthesisSniff (031 comment) [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/673626 (owner: 10Umherirrender) [18:57:45] DannyS712: Yes, I waited to check the Zuul results. [19:09:34] (03CR) 10DannyS712: [C: 04-1] "On second thought" (031 comment) [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/673689 (owner: 10Umherirrender) [19:32:44] (03CR) 10Umherirrender: "> Patch Set 2: Code-Review-1" [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/665198 (owner: 10Umherirrender) [19:37:11] (03PS2) 10Umherirrender: Test ValidGlobalNameSniff with multi prefixes [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/673605 [19:37:15] (03CR) 10Umherirrender: Test ValidGlobalNameSniff with multi prefixes (031 comment) [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/673605 (owner: 10Umherirrender) [19:38:09] (03PS3) 10Umherirrender: Test PrefixedGlobalFunctionsSniff with ignore list [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/673609 [19:38:12] (03CR) 10Umherirrender: Test PrefixedGlobalFunctionsSniff with ignore list (031 comment) [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/673609 (owner: 10Umherirrender) [19:45:44] (03CR) 10DannyS712: [C: 03+2] Test ValidGlobalNameSniff with multi prefixes (031 comment) [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/673605 (owner: 10Umherirrender) [19:46:06] (03PS3) 10Umherirrender: Fix error message for long array case in SpaceyParenthesisSniff [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/673626 [19:46:49] (03CR) 10Umherirrender: Fix error message for long array case in SpaceyParenthesisSniff (031 comment) [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/673626 (owner: 10Umherirrender) [19:48:00] (03Merged) 10jenkins-bot: Test ValidGlobalNameSniff with multi prefixes [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/673605 (owner: 10Umherirrender) [19:50:30] (03CR) 10Umherirrender: Test ValidGlobalNameSniff with multi prefixes (031 comment) [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/673605 (owner: 10Umherirrender) [19:52:54] (03CR) 10DannyS712: [C: 03+2] Test PrefixedGlobalFunctionsSniff with ignore list [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/673609 (owner: 10Umherirrender) [19:54:26] (03Merged) 10jenkins-bot: Test PrefixedGlobalFunctionsSniff with ignore list [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/673609 (owner: 10Umherirrender) [19:55:19] (03PS2) 10Umherirrender: Add test for ExtensionInfo util class [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/673689 [19:55:32] (03CR) 10Umherirrender: Add test for ExtensionInfo util class (031 comment) [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/673689 (owner: 10Umherirrender) [19:57:19] (03CR) 10DannyS712: "This change is ready for review." [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/673792 (owner: 10DannyS712) [19:57:51] (03CR) 10DannyS712: [C: 03+1] Add test for ExtensionInfo util class [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/673689 (owner: 10Umherirrender) [20:04:31] (03CR) 10Umherirrender: [C: 03+2] ValidGlobalNameSniff: fix quotes around expected names [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/673792 (owner: 10DannyS712) [20:06:06] (03Merged) 10jenkins-bot: ValidGlobalNameSniff: fix quotes around expected names [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/673792 (owner: 10DannyS712) [20:12:57] (03CR) 10Umherirrender: "> Patch Set 2:" [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/665198 (owner: 10Umherirrender) [20:30:55] (03PS4) 10Umherirrender: SpecificAssertionsSniff: fix order of assertStringContainsString parameters [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/661247 (https://phabricator.wikimedia.org/T273624) (owner: 10DannyS712) [20:31:08] (03CR) 10Umherirrender: "> Patch Set 3:" (032 comments) [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/661247 (https://phabricator.wikimedia.org/T273624) (owner: 10DannyS712) [20:34:17] (03CR) 10jerkins-bot: [V: 04-1] SpecificAssertionsSniff: fix order of assertStringContainsString parameters [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/661247 (https://phabricator.wikimedia.org/T273624) (owner: 10DannyS712) [20:38:49] (03PS5) 10Umherirrender: SpecificAssertionsSniff: fix order of assertStringContainsString parameters [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/661247 (https://phabricator.wikimedia.org/T273624) (owner: 10DannyS712) [21:28:25] (03CR) 10DannyS712: [C: 03+1] "> Patch Set 4:" (032 comments) [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/661247 (https://phabricator.wikimedia.org/T273624) (owner: 10DannyS712) [21:42:22] (03CR) 10DannyS712: [C: 03+2] Test non-parenthesis and complex value branch in SpecificAssertionsSniff [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/673686 (owner: 10Umherirrender) [21:43:30] (03CR) 10DannyS712: [C: 03+2] Test non-parenthesis and complex value branch in AssertionOrderSniff (031 comment) [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/673684 (owner: 10Umherirrender) [21:45:13] (03CR) 10DannyS712: [C: 03+1] Fix error message for long array case in SpaceyParenthesisSniff [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/673626 (owner: 10Umherirrender) [21:46:02] (03Merged) 10jenkins-bot: Test non-parenthesis and complex value branch in SpecificAssertionsSniff [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/673686 (owner: 10Umherirrender) [21:47:17] (03Merged) 10jenkins-bot: Test non-parenthesis and complex value branch in AssertionOrderSniff [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/673684 (owner: 10Umherirrender) [22:03:55] (03PS6) 10DannyS712: SpecificAssertionsSniff: fix order of assertStringContainsString parameters [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/661247 (https://phabricator.wikimedia.org/T273624) [22:04:12] (03CR) 10DannyS712: "PS6 is a manual rebase" [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/661247 (https://phabricator.wikimedia.org/T273624) (owner: 10DannyS712) [23:15:37] (03CR) 10DannyS712: [C: 03+2] Test non-parenthesis branch in AssertCountSniff [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/673682 (owner: 10Umherirrender) [23:17:06] (03Merged) 10jenkins-bot: Test non-parenthesis branch in AssertCountSniff [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/673682 (owner: 10Umherirrender)