[00:13:15] * paladox -> goes to watch the crown on netflix :) [00:20:57] 10Release-Engineering-Team (Kanban), 10Release Pipeline (Blubber): Blubber should implement a better file permissions convention - https://phabricator.wikimedia.org/T187372#3991509 (10dduvall) [00:27:09] !log deployed to BC [mobileapps/deploy@8ffb03b]: Update mobileapps to a1339a9 [00:27:15] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [00:44:28] 10Deployments, 10Release-Engineering-Team (Kanban), 10Operations, 10User-Addshore: cannot delete non-empty directory: php-1.29.0-wmf.3 messages on 'scap sync' on mwdebug1002 - https://phabricator.wikimedia.org/T157030#3991581 (10demon) So we think `--delete-excluded` will solve this. The patch above adds s... [00:44:39] 10Deployments, 10Release-Engineering-Team (Kanban), 10Operations, 10User-Addshore: cannot delete non-empty directory: php-1.29.0-wmf.3 messages on 'scap sync' on mwdebug1002 - https://phabricator.wikimedia.org/T157030#3991582 (10demon) p:05Triage>03Low [00:54:16] (03PS1) 10Brion VIBBER: Add xvfb package to deps for 3d2png tests [integration/config] - 10https://gerrit.wikimedia.org/r/413286 [00:56:45] hey, I'm trying to locate the kartotherian config file in production. Can anyone help? [00:58:04] (03CR) 10Jforrester: "Curl is required by core MediaWiki functionality though, as used by VE, which is tested in mwgate…" [integration/config] - 10https://gerrit.wikimedia.org/r/400002 (https://phabricator.wikimedia.org/T183643) (owner: 10Florianschmidtwelzow) [01:18:41] (03CR) 10Legoktm: "Will 3d2png automatically know to use xvfb? Or will it need to be started like we do in the npm-browser-test docker image?" [integration/config] - 10https://gerrit.wikimedia.org/r/413286 (owner: 10Brion VIBBER) [01:29:08] (03CR) 10Brion VIBBER: "It will know as of my latest patch to its package.json :)" [integration/config] - 10https://gerrit.wikimedia.org/r/413286 (owner: 10Brion VIBBER) [01:38:39] PROBLEM - Free space - all mounts on deployment-fluorine02 is CRITICAL: CRITICAL: deployment-prep.deployment-fluorine02.diskspace._srv.byte_percentfree (<22.22%) [04:41:24] 10Release-Engineering-Team, 10MediaWiki-Maintenance-scripts, 10Utilities-code-utils: Write some version of foreachwiki(indblist) that respects replag and/or has some --delay parameter between wikis - https://phabricator.wikimedia.org/T187852#3991813 (10Krinkle) >>! In T187852#3990065, @EddieGP wrote: >[..] m... [04:47:02] (03CR) 10Krinkle: "If this container is only used to fetch composer deps, but not to run any actual MediaWiki PHP code, then this change makes sense." [integration/config] - 10https://gerrit.wikimedia.org/r/400002 (https://phabricator.wikimedia.org/T183643) (owner: 10Florianschmidtwelzow) [04:54:30] PROBLEM - Mediawiki Error Rate on graphite-labs is CRITICAL: CRITICAL: 20.00% of data above the critical threshold [10.0] [05:14:32] PROBLEM - Mediawiki Error Rate on graphite-labs is CRITICAL: CRITICAL: 20.00% of data above the critical threshold [10.0] [06:48:39] RECOVERY - Free space - all mounts on deployment-fluorine02 is OK: OK: All targets OK [07:00:48] Yippee, build fixed! [07:00:49] Project mwext-phpunit-coverage-publish build #1280: 09FIXED in 35 sec: https://integration.wikimedia.org/ci/job/mwext-phpunit-coverage-publish/1280/ [08:28:11] RECOVERY - Puppet errors on integration-slave-jessie-1004 is OK: OK: Less than 1.00% above the threshold [0.0] [08:29:00] RECOVERY - Puppet errors on integration-slave-jessie-1001 is OK: OK: Less than 1.00% above the threshold [0.0] [08:49:10] PROBLEM - Puppet errors on integration-slave-jessie-1004 is CRITICAL: CRITICAL: 22.22% of data above the critical threshold [0.0] [08:54:59] PROBLEM - Puppet errors on integration-slave-jessie-1001 is CRITICAL: CRITICAL: 60.00% of data above the critical threshold [0.0] [09:27:00] (03CR) 10Brion VIBBER: [C: 031] Fix 3d2png repo name in Zuul configuration [integration/config] - 10https://gerrit.wikimedia.org/r/413269 (owner: 10Hashar) [09:30:15] (03PS2) 10Brion VIBBER: Add xvfb, xauth packages to deps for 3d2png tests [integration/config] - 10https://gerrit.wikimedia.org/r/413286 [09:37:43] (03PS3) 10Brion VIBBER: Add xvfb, xauth packages to deps for 3d2png tests [integration/config] - 10https://gerrit.wikimedia.org/r/413286 [09:40:17] (03CR) 10Hashar: Add xvfb, xauth packages to deps for 3d2png tests (031 comment) [integration/config] - 10https://gerrit.wikimedia.org/r/413286 (owner: 10Brion VIBBER) [09:40:22] (03PS4) 10Hashar: Add xvfb, xauth packages to deps for 3d2png tests [integration/config] - 10https://gerrit.wikimedia.org/r/413286 (owner: 10Brion VIBBER) [09:41:27] (03CR) 10Hashar: [C: 032] "Lets see what happen. I will get the Docker container build on the CI machine then will update the job." [integration/config] - 10https://gerrit.wikimedia.org/r/413286 (owner: 10Brion VIBBER) [09:42:14] 10Project-Admins: Requests for addition to the #acl*Project-Admins group (in comments) - https://phabricator.wikimedia.org/T706#2976270 (10RazShuty) Hey all, can you please add me so that I can create projects / sprints for WMDE teams. Thanks! [09:43:00] (03Merged) 10jenkins-bot: Add xvfb, xauth packages to deps for 3d2png tests [integration/config] - 10https://gerrit.wikimedia.org/r/413286 (owner: 10Brion VIBBER) [09:43:29] !log Building docker-registry.discovery.wmnet/releng/npm-test-3d2png:0.1.1 for https://gerrit.wikimedia.org/r/#/c/413286/ [09:43:35] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [10:19:03] (03PS1) 10Brion VIBBER: Add libgl1-mesa-dri, libgl1-mesa-glx packages for 3d2png docker test [integration/config] - 10https://gerrit.wikimedia.org/r/413336 [10:21:02] (03PS2) 10Hashar: Add libgl1-mesa-dri, libgl1-mesa-glx packages for 3d2png docker test [integration/config] - 10https://gerrit.wikimedia.org/r/413336 (owner: 10Brion VIBBER) [10:21:22] (03CR) 10Hashar: [C: 032] Add libgl1-mesa-dri, libgl1-mesa-glx packages for 3d2png docker test [integration/config] - 10https://gerrit.wikimedia.org/r/413336 (owner: 10Brion VIBBER) [10:21:29] ah good catch [10:22:40] (03Merged) 10jenkins-bot: Add libgl1-mesa-dri, libgl1-mesa-glx packages for 3d2png docker test [integration/config] - 10https://gerrit.wikimedia.org/r/413336 (owner: 10Brion VIBBER) [10:23:09] !log Building docker-registry.discovery.wmnet/releng/npm-test-3d2png:0.1.2 for https://gerrit.wikimedia.org/r/#/c/413336/ [10:23:12] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [10:23:21] 10Phabricator-Sprint-Extension: "persistent chat" prevents e.g. burndown chart from loading - https://phabricator.wikimedia.org/T187988#3992230 (10martin.s.weber) [11:10:06] (03PS1) 10Phedenskog: WebPageTest: Use new Linux instance name [integration/config] - 10https://gerrit.wikimedia.org/r/413347 (https://phabricator.wikimedia.org/T165626) [12:01:05] 10Scap, 10ORES, 10Operations, 10Scoring-platform-team: Use external dsh group to list pooled ORES nodes - https://phabricator.wikimedia.org/T179501#3992511 (10akosiaris) [12:21:28] 10Project-Admins: Requests for addition to the #acl*Project-Admins group (in comments) - https://phabricator.wikimedia.org/T706#3992543 (10Aklapper) @RazShuty: done [12:21:54] 10Phabricator-Sprint-Extension: "persistent chat" prevents e.g. burndown chart from loading - https://phabricator.wikimedia.org/T187988#3992544 (10Aklapper) p:05Triage>03Lowest [13:08:43] 10Continuous-Integration-Infrastructure (shipyard), 10Android-app-Bugs, 10Wikipedia-Android-App-Backlog: java-mwapi fails to run gradle 3.4 with java7: java.security.InvalidKeyException: EC parameters error - https://phabricator.wikimedia.org/T187995#3992611 (10hashar) [13:20:08] 10Continuous-Integration-Infrastructure (shipyard), 10Release-Engineering-Team (Kanban): Migrate leftover Nodepool jobs to Docker - https://phabricator.wikimedia.org/T187797#3992627 (10hashar) [13:31:13] 10Continuous-Integration-Infrastructure (shipyard), 10Android-app-Bugs, 10Wikipedia-Android-App-Backlog: java-mwapi fails to run gradle 3.4 with java7: java.security.InvalidKeyException: EC parameters error - https://phabricator.wikimedia.org/T187995#3992611 (10Dbrant) > But maybe that repository is obsolete... [14:50:51] (03PS1) 10Hashar: docker: tox with mariadb [integration/config] - 10https://gerrit.wikimedia.org/r/413374 [14:51:51] 10Continuous-Integration-Infrastructure (shipyard), 10Release-Engineering-Team (Kanban): Migrate leftover Nodepool jobs to Docker - https://phabricator.wikimedia.org/T187797#3992802 (10hashar) [14:52:36] (03CR) 10Hashar: [C: 032] docker: tox with mariadb [integration/config] - 10https://gerrit.wikimedia.org/r/413374 (owner: 10Hashar) [14:54:04] (03Merged) 10jenkins-bot: docker: tox with mariadb [integration/config] - 10https://gerrit.wikimedia.org/r/413374 (owner: 10Hashar) [14:58:51] !log build docker-registry.discovery.wmnet/releng/tox-mysqld:0.1.0 | https://gerrit.wikimedia.org/r/#/c/413374/ [14:58:57] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [15:07:23] (03PS1) 10Hashar: Fix container name in fundraising-tools-tox-docker [integration/config] - 10https://gerrit.wikimedia.org/r/413379 [15:08:52] (03PS1) 10Hashar: Migrate fundraising-tools-tox to Docker [integration/config] - 10https://gerrit.wikimedia.org/r/413380 [15:10:27] (03CR) 10Hashar: [C: 032] Fix container name in fundraising-tools-tox-docker [integration/config] - 10https://gerrit.wikimedia.org/r/413379 (owner: 10Hashar) [15:11:43] (03Merged) 10jenkins-bot: Fix container name in fundraising-tools-tox-docker [integration/config] - 10https://gerrit.wikimedia.org/r/413379 (owner: 10Hashar) [15:11:55] (03CR) 10Hashar: [C: 032] Migrate fundraising-tools-tox to Docker [integration/config] - 10https://gerrit.wikimedia.org/r/413380 (owner: 10Hashar) [15:13:25] (03Merged) 10jenkins-bot: Migrate fundraising-tools-tox to Docker [integration/config] - 10https://gerrit.wikimedia.org/r/413380 (owner: 10Hashar) [15:27:43] PROBLEM - Puppet errors on deployment-redis01 is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [0.0] [15:33:42] PROBLEM - Puppet errors on deployment-redis02 is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [0.0] [15:34:33] (03PS1) 10Hashar: Migrate integration-composer-check-php55 to Docker [integration/config] - 10https://gerrit.wikimedia.org/r/413388 [15:34:58] 10Continuous-Integration-Infrastructure (shipyard), 10Release-Engineering-Team (Kanban): Migrate leftover Nodepool jobs to Docker - https://phabricator.wikimedia.org/T187797#3992880 (10hashar) [15:35:32] (03CR) 10Hashar: [C: 032] Migrate integration-composer-check-php55 to Docker [integration/config] - 10https://gerrit.wikimedia.org/r/413388 (owner: 10Hashar) [15:35:54] 10Continuous-Integration-Infrastructure (shipyard), 10Release-Engineering-Team (Kanban): Migrate leftover Nodepool jobs to Docker - https://phabricator.wikimedia.org/T187797#3986123 (10hashar) a:03hashar [15:37:05] (03Merged) 10jenkins-bot: Migrate integration-composer-check-php55 to Docker [integration/config] - 10https://gerrit.wikimedia.org/r/413388 (owner: 10Hashar) [15:56:06] 10Continuous-Integration-Infrastructure (shipyard), 10Release-Engineering-Team (Kanban): Migrate leftover Nodepool jobs to Docker - https://phabricator.wikimedia.org/T187797#3992987 (10hashar) [16:32:45] 10MediaWiki-Codesniffer, 10Patch-For-Review: FunctionCommentSniff fails on substr_compare - https://phabricator.wikimedia.org/T187575#3993131 (10Umherirrender) 05Open>03Resolved [16:40:11] no_justification lol @ me. I broke the tests a year ago. Apparently i forgot to replace manifests.update with manifests.edit in some places heh [16:40:20] i think i found the problem now [16:41:25] (03PS1) 10Hashar: Add a tox env to run JJB [integration/config] - 10https://gerrit.wikimedia.org/r/413402 [16:46:52] (03PS1) 10Hashar: Experimental integration-jjb-config-diff on Docker [integration/config] - 10https://gerrit.wikimedia.org/r/413404 [16:48:04] (03PS2) 10Hashar: Add a tox env to run JJB [integration/config] - 10https://gerrit.wikimedia.org/r/413402 [16:48:06] (03PS2) 10Hashar: Experimental integration-jjb-config-diff on Docker [integration/config] - 10https://gerrit.wikimedia.org/r/413404 [16:57:01] legoktm: when you're back, there's an issue with MassMessage not working on a wiki due to an imported edit I'd like to discuss with you, thanks. [17:10:33] T188014 [17:10:33] T188014: MassMessage doesn't work on dty.wikipedia - https://phabricator.wikimedia.org/T188014 [17:11:06] It'd help my investigation if somebody could paste on the task the Logstash trace of: [Wo72rApAMFQAAHYJKwsAAABG] 2018-02-22 16:58:20: Excepción grave de tipo "UnexpectedValueException" [17:11:42] Actually i never really considered the possibility of passing comments + projects to conduit.maniphestEdit which the test wants to do [17:26:07] Project mwext-phpunit-coverage-publish build #1292: 04FAILURE in 19 sec: https://integration.wikimedia.org/ci/job/mwext-phpunit-coverage-publish/1292/ [17:30:41] 10Continuous-Integration-Infrastructure: Add CI entry point to run MinusX on mediawiki/core - https://phabricator.wikimedia.org/T188022#3993506 (10Umherirrender) [18:14:59] (03CR) 10Umherirrender: [C: 031] "The CI config does not care, if there are errors or warnings. It always reports a failure, that is a possible reason why it was added as e" [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/413218 (owner: 10Thiemo Kreuz (WMDE)) [18:17:37] (03CR) 10Umherirrender: [C: 032] Remove unused code and function arguments from three sniffs [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/413221 (owner: 10Thiemo Kreuz (WMDE)) [18:18:28] (03Merged) 10jenkins-bot: Remove unused code and function arguments from three sniffs [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/413221 (owner: 10Thiemo Kreuz (WMDE)) [18:19:32] (03CR) 10jenkins-bot: Remove unused code and function arguments from three sniffs [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/413221 (owner: 10Thiemo Kreuz (WMDE)) [18:21:44] (03CR) 10Umherirrender: [C: 031] Fix SpaceBeforeControlStructureBraceSniff [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/413161 (owner: 10Thiemo Kreuz (WMDE)) [18:35:44] no_justification i am wondering is there a way to make one param that extends, ie i have [18:35:50] Strings actions; [18:36:16] but would like to be able to apply, comments and project add [18:36:24] at the same time without needing to add more params. [18:39:23] PROBLEM - Puppet errors on deployment-mx is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [0.0] [18:52:30] maybe hashmap will do the trick [18:56:02] no_justification ah i caught its-phabricator not writing on https://phabricator.wikimedia.org/T188019 . wondering could you take a look at the logs please? [18:56:17] I havent been able to track this bug down as i carn't seem to reproduce locally. [18:59:32] i filled T188033 [18:59:33] T188033: its-phabricaor sometimes not writing to tasks - https://phabricator.wikimedia.org/T188033 [19:02:12] Maybe the refactor i did broke things here. [19:05:29] RECOVERY - Mediawiki Error Rate on graphite-labs is OK: OK: Less than 1.00% above the threshold [1.0] [19:18:50] no_justification aha [19:18:53] i can reproduce now [19:19:04] reverting a change, seems to do it [19:19:32] ah [19:19:35] i have logs now [19:22:09] no_justification does this look like a bug in gerrit core https://phabricator.wikimedia.org/P6732 ? [19:22:33] carn't tell if it's its-base / its-phabricator or gerrit's core problem. [19:24:57] Yippee, build fixed! [19:24:57] Project mwext-phpunit-coverage-publish build #1293: 09FIXED in 34 sec: https://integration.wikimedia.org/ci/job/mwext-phpunit-coverage-publish/1293/ [19:36:04] 10Release-Engineering-Team (Kanban), 10Release, 10Train Deployments: 1.31.0-wmf.23 deployment blockers - https://phabricator.wikimedia.org/T183962#3994092 (10greg) a:03thcipriani [19:36:20] 10Release-Engineering-Team (Kanban), 10Release, 10Train Deployments: 1.31.0-wmf.24 deployment blockers - https://phabricator.wikimedia.org/T183963#3994098 (10greg) a:03thcipriani [19:47:21] 10Release-Engineering-Team (Kanban), 10Release, 10Train Deployments: 1.31.0-wmf.22 deployment blockers - https://phabricator.wikimedia.org/T183961#3994122 (10greg) [19:50:41] 10Continuous-Integration-Infrastructure, 10Release-Engineering-Team (Kanban), 10Zuul: Zuul no longer starts gate-and-submit when parent is in gate-and-submit pipeline - https://phabricator.wikimedia.org/T186949#3994126 (10Umherirrender) I am okay with reopen, when you have a example for hashar to look into [20:04:13] (03PS2) 10Krinkle: WebPageTest: Use new Linux instance name [integration/config] - 10https://gerrit.wikimedia.org/r/413347 (https://phabricator.wikimedia.org/T165626) (owner: 10Phedenskog) [20:09:29] (03PS1) 10Umherirrender: Rename BlueSpiceSmartlist to BlueSpiceSmartList [integration/config] - 10https://gerrit.wikimedia.org/r/413457 [20:39:00] PROBLEM - Puppet errors on deployment-mediawiki07 is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [0.0] [20:48:25] ok it traces back to [20:48:26] JsonElement callResult = conduitConnection.call("maniphest.edit", params); [20:51:30] (03PS3) 10Hashar: Experimental integration-jjb-config-diff on Docker [integration/config] - 10https://gerrit.wikimedia.org/r/413404 [20:55:33] ok this looks like a bug upstream [20:55:38] * paladox files a pr-1 bug [21:03:55] no_justification twentyafterfour filled issue upstream. https://bugs.chromium.org/p/gerrit/issues/detail?id=8432 [21:06:08] (03PS4) 10Hashar: Experimental integration-jjb-config-diff on Docker [integration/config] - 10https://gerrit.wikimedia.org/r/413404 [21:07:17] (03CR) 10Hashar: [C: 04-1] "That is going nowhere. I will rewrite it as an utility under /tests/ so we can just do something like:" [integration/config] - 10https://gerrit.wikimedia.org/r/413404 (owner: 10Hashar) [21:12:25] (03CR) 10Krinkle: [C: 032] "Generated/uploaded 1 jobs(s): 'performance-webpagetest-linux-wmf'" [integration/config] - 10https://gerrit.wikimedia.org/r/413347 (https://phabricator.wikimedia.org/T165626) (owner: 10Phedenskog) [21:15:21] (03Merged) 10jenkins-bot: WebPageTest: Use new Linux instance name [integration/config] - 10https://gerrit.wikimedia.org/r/413347 (https://phabricator.wikimedia.org/T165626) (owner: 10Phedenskog) [21:38:56] aha [21:39:36] no_justification i found the bug. [21:39:41] This reverts commit 48cedd2123eab70a0ab140797ddb6ebbbfb35cd9. [21:39:46] it's when it includes ^^ [21:42:32] hmm or [21:42:32] Revert "test" [21:47:58] no_justification oh, i think i know what it is now [21:51:36] (actually, i deffitly know what the issue is now [21:55:49] PROBLEM - Free space - all mounts on deployment-mediawiki04 is CRITICAL: CRITICAL: deployment-prep.deployment-mediawiki04.diskspace.root.byte_percentfree (<11.11%) [22:02:32] no_justification i've protected it with security tag. [22:03:45] I really don't have time to worry about its-phab right now [22:03:57] That's about #182198 on today's todo list [22:07:13] ok [22:51:54] Project mwext-phpunit-coverage-publish build #1327: 04FAILURE in 32 sec: https://integration.wikimedia.org/ci/job/mwext-phpunit-coverage-publish/1327/ [22:52:46] Yippee, build fixed! [22:52:47] Project mwext-phpunit-coverage-publish build #1328: 09FIXED in 51 sec: https://integration.wikimedia.org/ci/job/mwext-phpunit-coverage-publish/1328/ [23:06:44] I've found a fix [23:06:49] requires a change in its-base [23:22:42] 10Release-Engineering-Team: Sniff error for FunctionCommentSniff - https://phabricator.wikimedia.org/T188053#3994773 (10Smalyshev)