[00:38:18] thcipriani: no_justification: Can you verify that https://wikitech.wikimedia.org/wiki/How_to_deploy_code#Pre-deployment_testing_in_production is correct about the localisation thing? I just updated the section a bit, but would like a second pair of eyes to verify. [00:39:38] Scap pull updates l10n. A full scap skips l10n then does it as a solo step later [00:40:16] There's some scap pull param I'm forgetting the name of to differentiate [00:40:25] I'm also afk [01:52:02] 10Gerrit: Gerrit throws a 500 when I submit a review with an emoji - https://phabricator.wikimedia.org/T190118#4063493 (10Jdlrobson) [01:52:48] 10Gerrit: Gerrit throws a 500 when I submit a review with an emoji - https://phabricator.wikimedia.org/T190118#4063507 (10Jdlrobson) [01:52:52] 10Gerrit, 10Release-Engineering-Team (Someday), 10Operations, 10Patch-For-Review: Gerrit shows HTTP 500 error when pasting extended unicode characters - https://phabricator.wikimedia.org/T145885#4063505 (10Jdlrobson) [02:32:44] 10Release-Engineering-Team (Kanban), 10MediaWiki-extensions-PoolCounter, 10Patch-For-Review, 10Wikimedia-log-errors (Jenkins Failure): Fix tests of PoolCounter extension - https://phabricator.wikimedia.org/T178517#4063617 (10Krinkle) [04:18:46] no_justification: ack, I've updated the docs. Also I should've known this given T162207 [04:18:46] T162207: When "scap pull" does a (slow) CDB rebuild, it should tell me that that's what it's doing - https://phabricator.wikimedia.org/T162207 [05:15:47] 10Scap, 10Patch-For-Review: Support git-lfs - https://phabricator.wikimedia.org/T180627#4063759 (10mmodell) >>! In T180627#4062932, @awight wrote: > ``` > # git review > Username for 'https://gerrit.wikimedia.org': > .... > ``` @awight: After much googling, I couldn't find any evidence that gerrit supports a... [08:28:05] 10Continuous-Integration-Config, 10AbuseFilter, 10Upstream: stylelint issue on Abusefilter are meaningless. Just show dots and "1 problem" - https://phabricator.wikimedia.org/T190072#4063973 (10hashar) [08:50:09] PROBLEM - Puppet errors on integration-slave-jessie-1004 is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [0.0] [08:50:59] PROBLEM - Puppet errors on integration-slave-jessie-1001 is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [0.0] [08:52:13] 10Continuous-Integration-Config, 10AbuseFilter, 10Upstream: stylelint issue on Abusefilter are meaningless. Just show dots and "1 problem" - https://phabricator.wikimedia.org/T190072#4063991 (10hashar) stylelint doesn't show the issue (running it via .node_modules/.bin/stylelint) grunt-stylelint invokes `st... [09:14:04] PROBLEM - Puppet errors on deployment-mira is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [0.0] [09:18:37] PROBLEM - Puppet errors on deployment-tin is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [0.0] [09:20:21] oh shit [09:26:24] Error: /Stage[main]/Profile::Mediawiki::Deployment::Server/Scap::Source[scholarships/scholarships]/Scap_source[scholarships/scholarships]/ensure: change from absent to present failed: Execution of '/usr/bin/scap deploy --init' returned 1: [09:27:57] 10Scap, 10Patch-For-Review: Support git-lfs - https://phabricator.wikimedia.org/T180627#4064046 (10mmodell) To ease the annoyance of git password prompts, the use of git's credential store makes it fairly painless. For Gnome users, I found the `git-credential-gnome-keyring` helper, which works on recent versi... [09:33:25] (03PS1) 10Hashar: Remove maven templates based on Nodepool [integration/config] - 10https://gerrit.wikimedia.org/r/420662 (https://phabricator.wikimedia.org/T187797) [09:34:38] (03PS1) 10Hashar: Remove now unused '{name}-npm-run-{script}-node-6-jessie' [integration/config] - 10https://gerrit.wikimedia.org/r/420663 (https://phabricator.wikimedia.org/T187797) [09:36:41] (03CR) 10Hashar: [C: 032] "Noop in JJB as expected" [integration/config] - 10https://gerrit.wikimedia.org/r/420662 (https://phabricator.wikimedia.org/T187797) (owner: 10Hashar) [09:36:49] (03CR) 10Hashar: [C: 032] "Noop in JJB as expected" [integration/config] - 10https://gerrit.wikimedia.org/r/420663 (https://phabricator.wikimedia.org/T187797) (owner: 10Hashar) [09:37:51] (03Merged) 10jenkins-bot: Remove maven templates based on Nodepool [integration/config] - 10https://gerrit.wikimedia.org/r/420662 (https://phabricator.wikimedia.org/T187797) (owner: 10Hashar) [09:38:01] !log deployment-tin: deleted iegreview/scholarships files scap/checks.yaml (invalid yaml somehow), ran puppet and restore the files [09:38:02] (03Merged) 10jenkins-bot: Remove now unused '{name}-npm-run-{script}-node-6-jessie' [integration/config] - 10https://gerrit.wikimedia.org/r/420663 (https://phabricator.wikimedia.org/T187797) (owner: 10Hashar) [09:38:03] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [09:40:36] 10Continuous-Integration-Infrastructure (shipyard), 10Release-Engineering-Team (Kanban), 10releng-201718-q4, 10Discovery, 10Wikimedia-Portals: Migrate Jenkins job wikimedia-portals-build to Docker and to use an entry point (eg: npm builddeploy) - https://phabricator.wikimedia.org/T190073#4064067 (10hashar) [09:40:38] 10Continuous-Integration-Infrastructure (shipyard), 10Release-Engineering-Team (Kanban), 10releng-201718-q4, 10MW-1.31-release-notes (WMF-deploy-2018-03-13 (1.31.0-wmf.25)), 10Patch-For-Review: Migrate leftover Nodepool jobs to Docker - https://phabricator.wikimedia.org/T187797#4064066 (10hashar) [09:40:49] 10Release-Engineering-Team, 10Epic: Migrate all CI jobs from Nodepool, deprecate it's use - https://phabricator.wikimedia.org/T190097#4064068 (10hashar) [09:42:25] 10Release-Engineering-Team, 10Epic: Migrate all CI jobs from Nodepool, deprecate it's use - https://phabricator.wikimedia.org/T190097#4062944 (10hashar) [09:42:30] 10Continuous-Integration-Infrastructure (shipyard), 10Release-Engineering-Team (Kanban), 10releng-201718-q4, 10MW-1.31-release-notes (WMF-deploy-2018-03-13 (1.31.0-wmf.25)), 10Patch-For-Review: Migrate leftover Nodepool jobs to Docker - https://phabricator.wikimedia.org/T187797#4013025 (10hashar) 05Open... [09:44:15] 10Release-Engineering-Team (Kanban), 10Release Pipeline: Method for running e2e/smoke tests on deployments - https://phabricator.wikimedia.org/T184219#4064079 (10akosiaris) [09:44:20] 10Release-Engineering-Team (Kanban), 10Release Pipeline, 10Patch-For-Review: Build service-checker image for use with helm test - https://phabricator.wikimedia.org/T184220#4064077 (10akosiaris) 05Open>03Resolved This has been done. Resolving [09:48:26] 10Continuous-Integration-Infrastructure, 10Release-Engineering-Team (Kanban), 10Patch-For-Review: integration-slave-jessie-XXXX is out of disk space - https://phabricator.wikimedia.org/T189365#4064096 (10hashar) 05Open>03Resolved a:03hashar Solved by migrating to Nodepool the jobs that generate MediaWi... [09:48:36] RECOVERY - Puppet errors on deployment-tin is OK: OK: Less than 1.00% above the threshold [0.0] [09:58:26] !log deployment-mira: deleted iegreview/scholarships files scap/checks.yaml (invalid yaml somehow), ran puppet and restore the files [09:58:28] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [10:04:57] 10Release-Engineering-Team (Kanban), 10Release Pipeline: Verify functionality of the 'production' image in the context of an isolated k8s deployment - https://phabricator.wikimedia.org/T183165#4064115 (10akosiaris) [10:04:59] 10Release-Engineering-Team (Kanban), 10Release Pipeline: Installation method for Minikube on CI for k8s testing - https://phabricator.wikimedia.org/T184457#4064113 (10akosiaris) 05Open>03Resolved Aside from having to tag the release locally with `v0.25.0` so that gbp could generate the source and using bus... [10:09:06] RECOVERY - Puppet errors on deployment-mira is OK: OK: Less than 1.00% above the threshold [0.0] [10:17:25] 10Phabricator, 10Community-Liaisons, 10Developer-Relations, 10Developer-Wishlist (2017), 10Goal: Consolidate the many tech events calendars in Phabricator's calendar - https://phabricator.wikimedia.org/T1035#4064142 (10Aklapper) WMFR also worked on something on-wiki: https://en.wikipedia.org/w/index.php?... [10:35:40] !log stop eventlogging + mysql on deployment-eventlog05 for maintenance [10:35:42] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [10:35:52] let me know if this causes any trouble --^ [10:45:33] PROBLEM - Puppet errors on deployment-eventlog05 is CRITICAL: CRITICAL: 22.22% of data above the critical threshold [0.0] [10:55:33] RECOVERY - Puppet errors on deployment-eventlog05 is OK: OK: Less than 1.00% above the threshold [0.0] [11:09:38] 10Release-Engineering-Team (Kanban), 10MediaWiki-Core-Tests, 10MW-1.31-release-notes (WMF-deploy-2018-03-20 (1.31.0-wmf.26)), 10Patch-For-Review, and 2 others: Create selenium-MediaWiki-jessie daily Jenkins job - https://phabricator.wikimedia.org/T185011#4064249 (10zeljkofilipin) a:05zeljkofilipin>03None [11:12:21] 10Release-Engineering-Team (Kanban), 10MediaWiki-Core-Tests, 10MW-1.31-release-notes (WMF-deploy-2018-03-20 (1.31.0-wmf.26)), 10Patch-For-Review, and 2 others: Create selenium-MediaWiki-jessie daily Jenkins job - https://phabricator.wikimedia.org/T185011#4064266 (10zeljkofilipin) >>! In T185011#4057686, @K... [11:15:20] (03PS1) 10Hashar: VisualEditor use a simple rake job [integration/config] - 10https://gerrit.wikimedia.org/r/420675 [11:17:19] (03CR) 10Hashar: "The only thing it does is:" [integration/config] - 10https://gerrit.wikimedia.org/r/420675 (owner: 10Hashar) [11:18:01] zeljkof: hello :] Since the ruby browser tests got removed from VisualEditor we can use a simpler rake test job :D [11:18:19] namely one that does not need to setup mediawiki and have it exposed via apache [11:18:21] https://gerrit.wikimedia.org/r/#/c/420675/ ! :] [11:18:40] (03CR) 10Hashar: "And again with cached material https://integration.wikimedia.org/ci/job/mwgate-rake-docker/75/console It is even faster :]" [integration/config] - 10https://gerrit.wikimedia.org/r/420675 (owner: 10Hashar) [11:19:31] (03CR) 10Zfilipin: [C: 032] VisualEditor use a simple rake job [integration/config] - 10https://gerrit.wikimedia.org/r/420675 (owner: 10Hashar) [11:19:37] ;D [11:19:48] hashar: +2 [11:19:48] * hashar looks at Echo [11:19:59] 00:00:56.506 /usr/bin/ruby2.1 -S rspec tests/rspec/ [11:20:00] hehe [11:20:42] grr that needs a webhost [11:20:45] (03Merged) 10jenkins-bot: VisualEditor use a simple rake job [integration/config] - 10https://gerrit.wikimedia.org/r/420675 (owner: 10Hashar) [11:27:01] (03PS1) 10Hashar: mwext-ruby-jessie is only used by Echo [integration/config] - 10https://gerrit.wikimedia.org/r/420678 [11:27:03] (03PS1) 10Hashar: Inline ruby-nodepool macro in the sole job using it [integration/config] - 10https://gerrit.wikimedia.org/r/420679 [11:31:29] (03CR) 10Hashar: "The job setup mediawiki, expose it via apache and then runs rspec. It is probably better to switch to webdriver.io and drop it entirely." [integration/config] - 10https://gerrit.wikimedia.org/r/420678 (owner: 10Hashar) [11:32:05] 10Release-Engineering-Team (Kanban), 10User-greg: Create annual plan program slides - https://phabricator.wikimedia.org/T188704#4016781 (10greg) 05Open>03Resolved [11:37:12] 10Project-Admins: create new component project MediaWiki-extensions-AddPersonalUrls - https://phabricator.wikimedia.org/T190095#4064314 (10Aklapper) 05Open>03Resolved a:03Aklapper Requested public project #mediawiki-extensions-addpersonalurls has been created: https://phabricator.wikimedia.org/project/view... [11:46:36] 10Scap, 10Patch-For-Review: Support git-lfs - https://phabricator.wikimedia.org/T180627#4064325 (10Paladox) @mmodell see https://github.com/GerritCodeReview/plugins_lfs/blob/stable-2.14/src/main/resources/Documentation/config.md#section-lfs-2 Gerrit only supports lfs over https [11:47:21] 10Continuous-Integration-Infrastructure, 10Release-Engineering-Team (Kanban), 10Lexicographical data, 10Wikidata: CirrusSearch smoke selenium tests cause failures of mediawiki-core-qunit-selenium-jessie job for extensions - https://phabricator.wikimedia.org/T190039#4064326 (10zeljkofilipin) a:03zeljkofili... [11:47:35] 10Continuous-Integration-Infrastructure, 10Release-Engineering-Team (Kanban), 10Lexicographical data, 10Wikidata, 10User-zeljkofilipin: CirrusSearch smoke selenium tests cause failures of mediawiki-core-qunit-selenium-jessie job for extensions - https://phabricator.wikimedia.org/T190039#4064329 (10zeljkof... [11:47:48] 10Continuous-Integration-Infrastructure, 10Release-Engineering-Team (Kanban), 10Lexicographical data, 10Wikidata, 10User-zeljkofilipin: CirrusSearch smoke selenium tests cause failures of mediawiki-core-qunit-selenium-jessie job for extensions - https://phabricator.wikimedia.org/T190039#4060862 (10zeljkof... [11:56:18] (03CR) 10Zfilipin: [C: 032] Inline ruby-nodepool macro in the sole job using it [integration/config] - 10https://gerrit.wikimedia.org/r/420679 (owner: 10Hashar) [12:23:43] 10Phabricator (Upstream), 10Upstream: Upon edit, a task description which mentions a Phab user (re)adds that Phab user to CC/Subscribers field - https://phabricator.wikimedia.org/T96464#4064357 (10Aklapper) Current status, quoting upstream comment https://secure.phabricator.com/T11035#215569 from March 2017: >... [12:25:17] !log deployment-prep: added Muehlenhoff (moritzm) as a member [12:25:19] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [12:34:27] 10Scap, 10Patch-For-Review: Support git-lfs - https://phabricator.wikimedia.org/T180627#4064378 (10mmodell) Beginning to document the process: https://wikitech.wikimedia.org/wiki/Git-lfs [12:35:05] 10Scap, 10Patch-For-Review: Support git-lfs - https://phabricator.wikimedia.org/T180627#4064393 (10mmodell) [12:37:35] (03PS4) 10Hashar: Port mw-install-sqlite and mw-install-mysql to python [integration/quibble] - 10https://gerrit.wikimedia.org/r/419787 [13:36:34] PROBLEM - Puppet errors on deployment-eventlog05 is CRITICAL: CRITICAL: 33.33% of data above the critical threshold [0.0] [13:49:02] twentyafterfour hmm, lfs works for me as a anon [13:49:10] pulling from [13:49:11] https://gerrit.wikimedia.org/r/#/c/394125/ [13:49:23] file in that diff is a lfs file cat.bin [13:49:29] when looking at it with vim [13:49:38] it correctly shows the binary file [13:59:38] twentyafterfour aha [13:59:42] i know how to do it now [14:02:03] 10Scap, 10Patch-For-Review: Support git-lfs - https://phabricator.wikimedia.org/T180627#4064693 (10Paladox) Ok, i've figured out how to get this working now. 1. install git-lfs (apt-get install git-lfs) 2. run git lfs install 3. git clone the repo, either through anon https, https or ssh now this should wo... [14:03:00] i tested that on a labs instance + my own mac [14:36:26] (03CR) 10Zfilipin: [C: 032] mwext-ruby-jessie is only used by Echo [integration/config] - 10https://gerrit.wikimedia.org/r/420678 (owner: 10Hashar) [14:37:14] 10Scap, 10Patch-For-Review, 10Scoring-platform-team (Current): Support git-lfs - https://phabricator.wikimedia.org/T180627#4064880 (10awight) [14:37:45] (03Merged) 10jenkins-bot: mwext-ruby-jessie is only used by Echo [integration/config] - 10https://gerrit.wikimedia.org/r/420678 (owner: 10Hashar) [14:38:03] (03Merged) 10jenkins-bot: Inline ruby-nodepool macro in the sole job using it [integration/config] - 10https://gerrit.wikimedia.org/r/420679 (owner: 10Hashar) [14:40:22] error: RPC failed; HTTP 500 curl 22 The requested URL returned error: 500 Internal Server Error [14:40:23] fatal: The remote end hung up unexpectedly [14:40:27] twentyafterfour ^^ [14:40:45] paladox: where do you see that? [14:40:53] is that because we set post_max_size low [14:40:58] twentyafterfour when cloning a phab repo [14:41:00] * paladox gets the url [14:41:07] fatal: clone of 'https://phabricator.wikimedia.org/source/ores-deploy-wheels.git' into submodule path '/home/paladox/deploy/submodules/wheels' failed [14:41:15] and [14:41:18] fatal: clone of 'https://phabricator.wikimedia.org/source/editquality.git' into submodule path '/home/paladox/deploy/submodules/editquality' failed [14:42:14] zeljkof: i have deployed the zuul layout change [14:42:23] paladox: try it over ssh, that should work [14:42:29] ok [14:42:31] hashar: cool! [14:42:32] thanks [14:43:11] paladox: I use this in my .gitconfig [14:43:13] [url "ssh://vcs@git-ssh.wikimedia.org"] [14:43:16] pushInsteadOf = https://phabricator.wikimedia.org [14:43:19] oh [14:43:44] but that only affects pushes [14:43:59] insteadOf = ... would affect fetches as well [14:44:20] ah [14:48:09] awight it worked [14:48:28] submodule checked out 5d3147d4330c9c5caf3ce37fef6e9366639ed3a5 [14:48:30] and the file [14:48:32] shows binary [14:48:36] instead of lfs text [14:49:25] paladox: Nicely done! So I wonder what the differences are between your process and the scap deploy-local LFS steps used for ORES? [14:49:46] awight as long as you git lfs install on the host on the [14:49:49] it saves something [14:49:50] in [14:50:01] .gitconfig for the user ie /home//.gitconfig [14:50:19] so i guess add that in the step before syncing the repo [14:56:26] 10Scap, 10Patch-For-Review, 10Scoring-platform-team (Current): Support git-lfs - https://phabricator.wikimedia.org/T180627#4064926 (10Paladox) It works with submodules. [14:57:22] 10Scap, 10Packaging, 10Patch-For-Review: SCAP: Upload debian package version 3.7.7-1 - https://phabricator.wikimedia.org/T189306#4064929 (10fgiunchedi) 05Open>03Resolved a:03fgiunchedi Uploaded + deployed [14:57:25] 10Release-Engineering-Team (Watching / External), 10Operations, 10Patch-For-Review, 10Scoring-platform-team (Current), 10Wikimedia-Incident: [Blocked] Cache ORES virtualenv within versioned source - https://phabricator.wikimedia.org/T181071#4064932 (10fgiunchedi) [14:58:30] cc twentyafterfour (message above ^^) [15:10:44] 10Scap, 10Patch-For-Review, 10Scoring-platform-team (Current): Support git-lfs - https://phabricator.wikimedia.org/T180627#4064976 (10mmodell) `git lfs install` sets up the following in the current user's gitconfig: ``` [filter "lfs"] clean = git-lfs clean -- %f smudge = git-lfs smudge -- %f pro... [15:23:23] 10Scap, 10Patch-For-Review, 10Scoring-platform-team (Current): Support git-lfs - https://phabricator.wikimedia.org/T180627#4065029 (10Paladox) @mmodell possibly want to get scap to run git lfs install so that anyone installing it (without using the puppet class) will have lfs working for them. [15:27:45] PROBLEM - Puppet errors on deployment-redis01 is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [0.0] [15:30:43] no_justification do we intend to use this https://gerrit.wikimedia.org/r/#/admin/groups/571,info group? [15:30:56] (also we should change Owners of that group to admins) [15:31:04] otherwise members could just remove them selfs [15:33:42] PROBLEM - Puppet errors on deployment-redis02 is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [0.0] [15:34:11] (03PS1) 10Paladox: Modify access rules [extensions/MobileFrontend] (refs/meta/config) - 10https://gerrit.wikimedia.org/r/420736 [15:37:20] Project mwext-phpunit-coverage-publish build #2390: 04FAILURE in 1 min 43 sec: https://integration.wikimedia.org/ci/job/mwext-phpunit-coverage-publish/2390/ [15:39:43] paladox: I doubt it. I've removed the "make visible to all members" box [15:39:49] ok [15:39:50] thanks [15:42:00] no_justification i will have unmark https://gerrit-review.googlesource.com/c/plugins/its-base/+/161730 as private as it has been merged up [15:42:06] into 2.15 then master [15:42:32] (03Abandoned) 10Chad: Edit Project Config [All-Projects] (refs/meta/config) - 10https://gerrit.wikimedia.org/r/419606 (owner: 10Chad) [15:49:47] (03CR) 10Jdlrobson: "I'm not sure we want submit inside the repo. We removed it purposely as it was causing confusion on the UI (people submitting without lett" [extensions/MobileFrontend] (refs/meta/config) - 10https://gerrit.wikimedia.org/r/420736 (owner: 10Paladox) [15:50:12] (03CR) 10Paladox: "> I'm not sure we want submit inside the repo. We removed it" [extensions/MobileFrontend] (refs/meta/config) - 10https://gerrit.wikimedia.org/r/420736 (owner: 10Paladox) [15:53:36] Project beta-code-update-eqiad build #198378: 04FAILURE in 36 sec: https://integration.wikimedia.org/ci/job/beta-code-update-eqiad/198378/ [15:55:17] no_justification i can do the its-phab fix now in the puppet repo :) [15:58:44] PROBLEM - Puppet errors on integration-slave-jessie-1003 is CRITICAL: CRITICAL: 55.56% of data above the critical threshold [0.0] [15:58:54] scap failure was gerrit restarting, will self-resolve [16:01:13] 10Scap, 10Patch-For-Review, 10Scoring-platform-team (Current): Support git-lfs - https://phabricator.wikimedia.org/T180627#4065325 (10demon) Not using git-review will eliminate a few points of confusion I think :) [16:03:42] Yippee, build fixed! [16:03:42] Project beta-code-update-eqiad build #198379: 09FIXED in 41 sec: https://integration.wikimedia.org/ci/job/beta-code-update-eqiad/198379/ [16:04:44] 10Gerrit, 10Upstream: PolyGerrit has wrong URLs in links in "Your" menu - https://phabricator.wikimedia.org/T187347#4065347 (10Paladox) [16:04:46] 10Gerrit, 10Release-Engineering-Team (Next): Upgrade gerrit from 2.14.6 to 2.14.7 - https://phabricator.wikimedia.org/T186135#4065344 (10Paladox) 05Open>03Resolved a:03Paladox https://gerrit.wikimedia.org/r/#/c/418966/ [16:04:48] Yippee, build fixed! [16:04:49] Project mwext-phpunit-coverage-publish build #2391: 09FIXED in 2 min 4 sec: https://integration.wikimedia.org/ci/job/mwext-phpunit-coverage-publish/2391/ [16:04:55] 10Gerrit, 10Release-Engineering-Team (Next): Upgrade gerrit from 2.14.6 to 2.14.7 - https://phabricator.wikimedia.org/T186135#4065348 (10Paladox) a:05Paladox>03demon [16:05:19] 10Gerrit, 10Upstream: PolyGerrit has wrong URLs in links in "Your" menu - https://phabricator.wikimedia.org/T187347#3972513 (10Paladox) 05Open>03Resolved a:03Paladox [16:10:42] If anyone is suffering from T187347 it will take up to 10-15 mins for it to work (polygerrit will refresh it's caches and force the updated js to go through) [16:10:42] T187347: PolyGerrit has wrong URLs in links in "Your" menu - https://phabricator.wikimedia.org/T187347 [16:12:49] also depends on if you viewed pg before gerrit was upgraded. [16:16:37] (03CR) 10Jdlrobson: [C: 04-1] "Let's do that then. It looks like the other patches merged though.. is this still needed?" [extensions/MobileFrontend] (refs/meta/config) - 10https://gerrit.wikimedia.org/r/420736 (owner: 10Paladox) [16:17:18] (03Abandoned) 10Paladox: Modify access rules [extensions/MobileFrontend] (refs/meta/config) - 10https://gerrit.wikimedia.org/r/420736 (owner: 10Paladox) [16:33:45] RECOVERY - Puppet errors on integration-slave-jessie-1003 is OK: OK: Less than 1.00% above the threshold [0.0] [17:06:09] no_justification apparently the git clone url in gitiles is wrong lol. [17:06:22] Meh, low priority [17:27:01] !log deployed to BC: [mobileapps/deploy@fad1009]: Update mobileapps to 634a15f [17:27:03] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [17:33:35] (03PS1) 10Anomie: Trust Aryeh Gregor for Jenkins verified +2 [integration/config] - 10https://gerrit.wikimedia.org/r/420777 [17:36:01] (03Draft1) 10Paladox: Whitelist Aryeh Gregor [integration/config] - 10https://gerrit.wikimedia.org/r/420778 [17:36:03] (03PS2) 10Paladox: Whitelist Aryeh Gregor [integration/config] - 10https://gerrit.wikimedia.org/r/420778 [17:36:18] (03Abandoned) 10Paladox: Whitelist Aryeh Gregor [integration/config] - 10https://gerrit.wikimedia.org/r/420778 (owner: 10Paladox) [17:36:32] (03CR) 10Paladox: [C: 031] Trust Aryeh Gregor for Jenkins verified +2 [integration/config] - 10https://gerrit.wikimedia.org/r/420777 (owner: 10Anomie) [17:44:56] PROBLEM - Host integration-slave-k8s-1004 is DOWN: CRITICAL - Host Unreachable (10.68.21.3) [17:53:31] hasharAway: did you see my notice on 'editing'? [17:54:07] hasharAway: we don't get most patch verified any more since 1.5 weeks [17:54:22] hasharAway: example: https://gerrit.wikimedia.org/r/#/c/420735/ [17:55:54] 10Continuous-Integration-Infrastructure, 10OOUI: Firefox unit tests semi-consistently failing in CI with a timeout - https://phabricator.wikimedia.org/T190200#4065931 (10Jdforrester-WMF) p:05Triage>03High [18:01:19] no_justification: mind if I merge the trivial https://gerrit.wikimedia.org/r/#/c/420788/ even though we're a minute into the 'sanity break'? [18:03:17] That's...ok [18:03:27] Generally: why don't we put that in initialisesettings? [18:06:35] no_justification: I think because it's overriding a setting that's made late in the game [18:06:41] fair 'nuff [18:06:47] I'll even sync it for you [18:06:53] Follow up in #-operations [18:06:54] thanks! [18:32:20] (03PS1) 10MaxSem: Add GlobalPreferences [tools/release] - 10https://gerrit.wikimedia.org/r/420802 (https://phabricator.wikimedia.org/T184121) [18:39:22] PROBLEM - Puppet errors on deployment-mx is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [0.0] [18:39:52] PROBLEM - Host integration-slave-k8s-1005 is DOWN: CRITICAL - Host Unreachable (10.68.21.216) [18:51:13] (03PS1) 10Chad: Add Aryeh as trusted, duh [integration/config] - 10https://gerrit.wikimedia.org/r/420815 [18:53:14] (03CR) 10Bartosz Dziewoński: [C: 04-1] Add Aryeh as trusted, duh (031 comment) [integration/config] - 10https://gerrit.wikimedia.org/r/420815 (owner: 10Chad) [18:53:32] (03CR) 10Chad: Add Aryeh as trusted, duh (031 comment) [integration/config] - 10https://gerrit.wikimedia.org/r/420815 (owner: 10Chad) [18:53:39] (03CR) 10Anomie: "Same as Ic12de46f81b3aae745389b0d7db8b3d0402506dc ?" [integration/config] - 10https://gerrit.wikimedia.org/r/420815 (owner: 10Chad) [18:54:56] (03Abandoned) 10Chad: Add Aryeh as trusted, duh [integration/config] - 10https://gerrit.wikimedia.org/r/420815 (owner: 10Chad) [18:55:36] (03CR) 10Krinkle: [C: 032] Trust Aryeh Gregor for Jenkins verified +2 [integration/config] - 10https://gerrit.wikimedia.org/r/420777 (owner: 10Anomie) [18:56:16] (03CR) 10Krinkle: "Obsoleted by Ic12de46f81b3aae7, and I19e7b35f520b." [integration/config] - 10https://gerrit.wikimedia.org/r/420815 (owner: 10Chad) [18:57:03] (03Merged) 10jenkins-bot: Trust Aryeh Gregor for Jenkins verified +2 [integration/config] - 10https://gerrit.wikimedia.org/r/420777 (owner: 10Anomie) [19:04:38] !log Reloading Zuul to deploy https://gerrit.wikimedia.org/r/420777 [19:04:40] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [19:07:51] Volker_E: from https://integration.wikimedia.org/ci/job/oojs-ui-npm-run-jenkins-node-6-docker/200/console looks like some karma firefox test is taking too long / or it cant reach firefox somehow [19:09:05] Volker_E: on mediawiki/core I had karma to run with debug logging to help diagnostic. In gruntfile.js something like karma: { 'options': { logLevel: 'DEBUG' } } [19:10:12] Volker_E: ah yeah did that 15 days ago https://gerrit.wikimedia.org/r/#/c/416862/3/Gruntfile.js [19:13:01] 10Continuous-Integration-Infrastructure, 10OOUI: Firefox unit tests semi-consistently failing in CI with a timeout - https://phabricator.wikimedia.org/T190200#4066329 (10Jdforrester-WMF) High because we've worked around it for now, but not testing in FF is not good. :-( [19:16:15] 10Continuous-Integration-Infrastructure, 10OOUI: Firefox unit tests semi-consistently failing in CI with a timeout - https://phabricator.wikimedia.org/T190200#4065931 (10hashar) https://gerrit.wikimedia.org/r/#/c/416862/3/Gruntfile.js sets karma log level to DEBUG. Maybe that will make something more obvious?... [19:22:46] PROBLEM - Free space - all mounts on deployment-mediawiki05 is CRITICAL: CRITICAL: deployment-prep.deployment-mediawiki05.diskspace.root.byte_percentfree (<11.11%) [19:27:17] 10Scap, 10Patch-For-Review, 10Scoring-platform-team (Current): Support git-lfs - https://phabricator.wikimedia.org/T180627#4066362 (10mmodell) >>! In T180627#4065325, @demon wrote: > Not using git-review will eliminate a few points of confusion I think :) +1 [19:27:49] RECOVERY - Free space - all mounts on deployment-mediawiki05 is OK: OK: All targets OK [19:56:06] (03PS1) 10MusikAnimal: Add QUnit to CodeMirror [integration/config] - 10https://gerrit.wikimedia.org/r/420833 (https://phabricator.wikimedia.org/T169592) [19:57:23] (03CR) 10jerkins-bot: [V: 04-1] Add QUnit to CodeMirror [integration/config] - 10https://gerrit.wikimedia.org/r/420833 (https://phabricator.wikimedia.org/T169592) (owner: 10MusikAnimal) [19:59:25] (03PS2) 10MusikAnimal: Add QUnit to CodeMirror [integration/config] - 10https://gerrit.wikimedia.org/r/420833 (https://phabricator.wikimedia.org/T169592) [20:00:21] no_justification i think i found it where we should be looking for gitiles src/main/java/com/googlesource/gerrit/plugins/gitiles/HttpModule.java [20:00:29] i added a print thingy and i see [20:00:44] https://phabricator.wikimedia.org/P6867 [20:13:55] PROBLEM - Host integration-slave-k8s-1006 is DOWN: CRITICAL - Host Unreachable (10.68.22.84) [20:30:34] Yippee, build fixed! [20:30:35] Project selenium-Wikibase-chrome » chrome,beta,Linux,DebianJessie && contintLabsSlave build #152: 09FIXED in 43 min: https://integration.wikimedia.org/ci/job/selenium-Wikibase-chrome/BROWSER=chrome,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=Linux,label=DebianJessie%20&&%20contintLabsSlave/152/ [20:39:02] PROBLEM - Puppet errors on deployment-mediawiki07 is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [0.0] [20:40:48] PROBLEM - Free space - all mounts on deployment-mediawiki04 is CRITICAL: CRITICAL: deployment-prep.deployment-mediawiki04.diskspace.root.byte_percentfree (<10.00%) [20:50:50] RECOVERY - Free space - all mounts on deployment-mediawiki04 is OK: OK: All targets OK [21:04:30] PROBLEM - Host integration-slave-k8s-1007 is DOWN: CRITICAL - Host Unreachable (10.68.21.190) [21:06:04] 10Phabricator: Develop a custom herald condition for maniphest tasks: "projects include any subprojects of ___ " - https://phabricator.wikimedia.org/T144041#4066731 (10MBinder_WMF) Reviving this as the apps teams have reminded me that this would be far easier than asking me (or other authorized users) to update... [21:33:28] 10Continuous-Integration-Config, 10TestMe: fix or mark as inactive extensions currently failing CI - https://phabricator.wikimedia.org/T134090#4066833 (10Krinkle) [21:43:28] (03CR) 10MaxSem: [C: 032] Add GlobalPreferences [tools/release] - 10https://gerrit.wikimedia.org/r/420802 (https://phabricator.wikimedia.org/T184121) (owner: 10MaxSem) [21:43:59] (03Merged) 10jenkins-bot: Add GlobalPreferences [tools/release] - 10https://gerrit.wikimedia.org/r/420802 (https://phabricator.wikimedia.org/T184121) (owner: 10MaxSem) [21:46:08] 10Continuous-Integration-Infrastructure: Extension:CloseWikis phpunit tests fail due to missing "closedwikis" database - https://phabricator.wikimedia.org/T157815#4066874 (10Krinkle) [22:39:50] PROBLEM - Host integration-slave-k8s-1009 is DOWN: CRITICAL - Host Unreachable (10.68.19.63) [22:49:52] oh wow, i like the orange and blue in pg diff screen (this lets you tell you if it was a rebase) [22:54:00] (03PS5) 10Hashar: Port mw-install-sqlite and mw-install-mysql to python [integration/quibble] - 10https://gerrit.wikimedia.org/r/419787 [23:00:25] (03CR) 10Hashar: "Welcome back simetrical!!!!!!!!!!!!!!!!!!!!!!!" [integration/config] - 10https://gerrit.wikimedia.org/r/420777 (owner: 10Anomie) [23:31:38] Can anybody explain what this means: 23:29:19 - The requested package wikimedia/purtle ^1.0.7 is satisfiable by wikimedia/purtle[1.0.x-dev, v1.0.7] but these conflict with your requirements or minimum-stability. [23:32:11] I am not sure why CI doesn't think it has proper stability... locally it works fine and previous version was ok [23:32:44] Which patch? [23:32:53] Reedy: https://gerrit.wikimedia.org/r/c/413290/ [23:33:00] Reedy: https://integration.wikimedia.org/ci/job/mwext-Wikibase-repo-tests-sqlite-hhvm-jessie/5700/consoleFull [23:33:30] I suspect for some reason it tries to choose 1.0.x-dev but not sure why... my local composer doesn't do that [23:33:39] SMalyshev: Need bumping in mediawiki-vendor? [23:33:42] https://github.com/wikimedia/mediawiki-vendor/blob/master/composer.json#L123 ? [23:34:00] Reedy: ah, it still depends on mediawiki-vendor? I didn't know that [23:34:11] I thought it's independent. That explains it then [23:35:08] Reedy: thanks [23:35:08] I guess it's using mw core and vendor, then trying to merge stuf fin [23:35:22] So make a patch in vendor, bump that, depends-on on that wikibase patch :) [23:35:37] yeah I already did. I just didn't know it's necessary :) [23:35:46] heh [23:42:05] PROBLEM - Host deployment-maps02 is DOWN: CRITICAL - Host Unreachable (10.68.21.43)