[00:16:16] 10Gerrit, 06Release-Engineering-Team: Update gerrit to 2.13.7 - https://phabricator.wikimedia.org/T158946#3145614 (10Paladox) @demon Upstream have a performance patch in 2.13 (merged after 2.13.7 was released) Should we cherry pick that when we upgrade to 2.13.7? [00:20:07] PROBLEM - Puppet run on deployment-phab02 is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [0.0] [00:22:56] PROBLEM - Puppet run on deployment-phab01 is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [0.0] [02:05:15] Project mediawiki-core-code-coverage-jessie build #6: 15ABORTED in 9 min 30 sec: https://integration.wikimedia.org/ci/job/mediawiki-core-code-coverage-jessie/6/ [02:07:43] Project mediawiki-core-code-coverage-jessie build #7: 04FAILURE in 41 sec: https://integration.wikimedia.org/ci/job/mediawiki-core-code-coverage-jessie/7/ [04:50:33] 10Continuous-Integration-Config, 06Release-Engineering-Team, 13Patch-For-Review: Switch MediaWiki coverage job from Trusty/Zend PHP 5.5 to Jessie/Zend PHP 7.0 - https://phabricator.wikimedia.org/T147778#3145679 (10Krinkle) >>! In T147778#3142493, @Krinkle wrote: > * Build 5: Same as original config (PHPUnit... [06:20:10] Project selenium-Wikibase » chrome,test,Linux,BrowserTests build #316: 04FAILURE in 1 hr 40 min: https://integration.wikimedia.org/ci/job/selenium-Wikibase/BROWSER=chrome,MEDIAWIKI_ENVIRONMENT=test,PLATFORM=Linux,label=BrowserTests/316/ [06:57:32] Yippee, build fixed! [06:57:32] Project mediawiki-core-code-coverage-jessie build #8: 09FIXED in 2 hr 12 min: https://integration.wikimedia.org/ci/job/mediawiki-core-code-coverage-jessie/8/ [08:33:20] andre__: Guten Tag! Maybe I bother you for a phabricator sub project creation ? :] [08:34:14] PROBLEM - Puppet run on deployment-memc04 is CRITICAL: CRITICAL: 55.56% of data above the critical threshold [0.0] [08:34:17] hashar, You may. Though I'd love to have a slightly less tongue-in-cheek name for it :) [08:34:27] hehe [08:34:41] that is 'Untrusty Sprint' https://phabricator.wikimedia.org/T161800 [08:34:41] (I like it. But others may have problems to understand what it's about?) [08:34:45] and yeah could use a better name [08:34:56] the idea is to phase out the Ubuntu Trusty distribution from the CI infra [08:35:01] yeah, got it [08:35:08] we had a past one named phase-out-gallium [08:35:11] if you know Ubuntu codenames there's no issue I guess :P [08:35:34] so maybe 'Phase Out Trusty' [08:35:55] aight [08:36:05] hmm, milestone or subproject? :P [08:36:29] milestone I guess [08:36:31] both under https://phabricator.wikimedia.org/project/subprojects/401/ are milestones [08:36:33] alright, will do [08:36:37] yeah that is my assumption [08:36:45] use whatever has been used previously :] [08:38:23] there is another oddity I found is that the project page tell me I can create subprojects but the link is grayed out [08:38:41] PROBLEM - Puppet run on deployment-memc05 is CRITICAL: CRITICAL: 50.00% of data above the critical threshold [0.0] [08:39:34] 06Release-Engineering-Team, 06Project-Admins: Create a CI sub project: UnTrusty Sprint - https://phabricator.wikimedia.org/T161800#3145940 (10Aklapper) 05Open>03Resolved a:03Aklapper I went for a `phase-out-trusty` milestone after IRC conversation and "untrusty" additional hashtag (but you can rename) h... [08:39:38] hashar: here you go ^^ [08:40:08] 06Release-Engineering-Team, 06Project-Admins: Create a CI sub project: UnTrusty Sprint - https://phabricator.wikimedia.org/T161800#3145944 (10hashar) Danke! [08:40:15] andre__: super nice thanks a ton :] [08:40:18] hashar: de rien. toujours a votre service :) [08:43:34] 10Continuous-Integration-Infrastructure (phase-out-trusty): Install PHP5.5 on jessie CI instances - https://phabricator.wikimedia.org/T144959#3145958 (10hashar) [08:44:43] 10Continuous-Integration-Infrastructure (Little Steps Sprint): Merge extensions PHPUnit and QUnit jobs - https://phabricator.wikimedia.org/T88207#3145961 (10hashar) [08:45:52] 10Continuous-Integration-Infrastructure (phase-out-trusty), 13Patch-For-Review: mysql does not start when Trusty instances spawn - https://phabricator.wikimedia.org/T141450#3145963 (10hashar) [08:48:42] 10Continuous-Integration-Infrastructure (phase-out-trusty), 13Patch-For-Review: mysql does not start when Trusty instances spawn - https://phabricator.wikimedia.org/T141450#3145980 (10hashar) p:05High>03Low This task is for the permanent slaves, the remaining jobs running on Trusty are: ``` analytics-refin... [09:04:09] 10Continuous-Integration-Infrastructure, 07Technical-Debt: Automatically delete old jobs not (or no longer) managed by JJB - https://phabricator.wikimedia.org/T91410#3146030 (10hashar) [09:08:21] 10Continuous-Integration-Infrastructure: Continuous deployment for CI - https://phabricator.wikimedia.org/T91684#3146036 (10hashar) [09:08:22] 10Continuous-Integration-Infrastructure: Jenkins: Set up postmerge job to auto-deploy jenkins-job-builder configuration - https://phabricator.wikimedia.org/T49056#3146032 (10hashar) 05Open>03declined The automatic update sounds a bit scary. I would rather keep an extra manual step like for puppet change. T... [09:08:24] 10Continuous-Integration-Infrastructure: Continuous deployment for CI - https://phabricator.wikimedia.org/T91684#1093242 (10hashar) 05Open>03declined The automatic update sounds a bit scary. I would rather keep an extra manual step like for puppet change. T129357 is about migrating the CI config to scap3 w... [09:10:07] 10Continuous-Integration-Infrastructure, 10Scap (Scap3-Adoption-Phase1): Migrate Zuul deployment of integration/config to scap deploy - https://phabricator.wikimedia.org/T129357#2103265 (10hashar) rMSCAbede7516f18f3c72482b0f7407fe62b96412de33 adds reload support. The scap.cfg would have `service_reload: True`... [09:16:57] 10Continuous-Integration-Infrastructure, 10MediaWiki-Unit-tests, 07JavaScript, 07Tracking: Make QUnit tests run without installing MediaWiki - https://phabricator.wikimedia.org/T89433#3146048 (10hashar) I noticed the mobile team is using node-qunit which I guess is invoked by the `npm test`Jenkins job. An... [09:20:40] 10Continuous-Integration-Infrastructure, 10OOjs-UI, 13Patch-For-Review: OOjs UI's PHP docs should be auto-generated - https://phabricator.wikimedia.org/T74454#3146059 (10hashar) [09:20:45] 10Continuous-Integration-Infrastructure, 07Tracking: doc.wikimedia.org: Generate documentation for release tags (tracking) - https://phabricator.wikimedia.org/T73062#3146056 (10hashar) 05Open>03Resolved a:03hashar Documentation for tags is available as well as multiple release branches. So that got fixed... [09:24:46] 10Continuous-Integration-Infrastructure, 10Gerrit, 06Release-Engineering-Team: Investigate installing the zuul plugin for gerrit - https://phabricator.wikimedia.org/T158600#3146062 (10hashar) @demon can we look at installing that Gerrit plugin for Zuul? That parse the `Depends-On` in commit message. [09:24:57] 10Continuous-Integration-Infrastructure, 10Gerrit, 06Release-Engineering-Team: Investigate installing the zuul plugin for gerrit - https://phabricator.wikimedia.org/T158600#3041567 (10hashar) p:05Triage>03Normal [09:25:19] 10Continuous-Integration-Infrastructure, 13Patch-For-Review, 07Zuul: Freshly provisionned zuul fails connecting to Gerrit due to ssh key host - https://phabricator.wikimedia.org/T157912#3146065 (10hashar) [09:27:04] 06Release-Engineering-Team, 03releng-201617-q3, 10Release Pipeline: Gather requirements for new CI system - https://phabricator.wikimedia.org/T153270#3146070 (10hashar) Removing #continuous-integration-infrastructure , better tracked via the epic project #release_pipeline. [09:29:04] 10Continuous-Integration-Infrastructure, 06Release-Engineering-Team: Move from diskimage-builder to python-bootstrap-vz - https://phabricator.wikimedia.org/T156003#2961366 (10hashar) 05Open>03stalled I would like to get rid of Ubuntu Trusty first. That is the sub project #untrusty [09:29:34] 10Continuous-Integration-Infrastructure, 06Release-Engineering-Team, 07Jenkins: Install the blue ocean plugin alongside jenkins 2.x upgrade - https://phabricator.wikimedia.org/T155840#2956401 (10hashar) p:05Triage>03Normal [09:31:55] 10Continuous-Integration-Config, 10Continuous-Integration-Infrastructure (phase-out-trusty), 06Release-Engineering-Team, 13Patch-For-Review: Switch MediaWiki coverage job from Trusty/Zend PHP 5.5 to Jessie/Zend PHP 7.0 - https://phabricator.wikimedia.org/T147778#3146108 (10hashar) [09:38:18] 10Continuous-Integration-Infrastructure (phase-out-trusty): Migrate PHP5.5 jobs from Trusty to Jessie - https://phabricator.wikimedia.org/T161882#3146114 (10hashar) [09:38:32] 10Continuous-Integration-Infrastructure (phase-out-trusty): Install PHP5.5 on jessie CI instances - https://phabricator.wikimedia.org/T144959#2615500 (10hashar) [09:38:36] 10Continuous-Integration-Infrastructure (phase-out-trusty): Migrate PHP5.5 jobs from Trusty to Jessie - https://phabricator.wikimedia.org/T161882#3146140 (10hashar) [09:40:44] 10Continuous-Integration-Infrastructure (phase-out-trusty): Migrate NodeJS jobs from Trusty to Jessie - https://phabricator.wikimedia.org/T161884#3146145 (10hashar) [09:41:56] (03PS2) 10Hashar: Move fundraising dash from Node 0.10 to Node 6 [integration/config] - 10https://gerrit.wikimedia.org/r/345571 (https://phabricator.wikimedia.org/T99869) [09:41:58] (03PS2) 10Hashar: Drop node-0.10 support [integration/config] - 10https://gerrit.wikimedia.org/r/345577 (https://phabricator.wikimedia.org/T161884) [09:42:51] 10Continuous-Integration-Infrastructure (phase-out-trusty), 13Patch-For-Review: Migrate NodeJS jobs from Trusty to Jessie - https://phabricator.wikimedia.org/T161884#3146145 (10hashar) p:05Triage>03Normal [09:45:21] 10Continuous-Integration-Config, 05Continuous-Integration-Scaling, 10releng-201516-q3, 13Patch-For-Review, 07WorkType-NewFunctionality: [keyresult] Migrate as many misc CI jobs as possible to Nodepool - https://phabricator.wikimedia.org/T119140#3146188 (10hashar) [09:47:20] 10Continuous-Integration-Infrastructure (phase-out-trusty), 13Patch-For-Review: Migrate NodeJS Nodepool jobs from Trusty to Jessie - https://phabricator.wikimedia.org/T161884#3146191 (10hashar) [09:56:29] (03PS1) 10Hashar: Migrate some publish jobs to Jessie/Node 6 [integration/config] - 10https://gerrit.wikimedia.org/r/345813 (https://phabricator.wikimedia.org/T161884) [10:06:24] (03CR) 10Hashar: [C: 032] "Tested all three jobs and they pass :]" [integration/config] - 10https://gerrit.wikimedia.org/r/345813 (https://phabricator.wikimedia.org/T161884) (owner: 10Hashar) [10:07:38] (03Merged) 10jenkins-bot: Migrate some publish jobs to Jessie/Node 6 [integration/config] - 10https://gerrit.wikimedia.org/r/345813 (https://phabricator.wikimedia.org/T161884) (owner: 10Hashar) [10:10:37] 10Continuous-Integration-Infrastructure (phase-out-trusty), 13Patch-For-Review: Migrate NodeJS Nodepool jobs from Trusty to Jessie - https://phabricator.wikimedia.org/T161884#3146216 (10hashar) [10:12:58] (03PS1) 10Hashar: Move mwext-jsduck-publish to Jessie [integration/config] - 10https://gerrit.wikimedia.org/r/345815 (https://phabricator.wikimedia.org/T161884) [10:13:34] 10Continuous-Integration-Infrastructure (phase-out-trusty), 13Patch-For-Review: Migrate NodeJS Nodepool jobs from Trusty to Jessie - https://phabricator.wikimedia.org/T161884#3146220 (10hashar) [10:14:55] (03CR) 10Hashar: [C: 032] Move mwext-jsduck-publish to Jessie [integration/config] - 10https://gerrit.wikimedia.org/r/345815 (https://phabricator.wikimedia.org/T161884) (owner: 10Hashar) [10:16:26] (03Merged) 10jenkins-bot: Move mwext-jsduck-publish to Jessie [integration/config] - 10https://gerrit.wikimedia.org/r/345815 (https://phabricator.wikimedia.org/T161884) (owner: 10Hashar) [10:24:13] RECOVERY - Puppet run on deployment-memc04 is OK: OK: Less than 1.00% above the threshold [0.0] [10:28:39] RECOVERY - Puppet run on deployment-memc05 is OK: OK: Less than 1.00% above the threshold [0.0] [13:22:24] 10Continuous-Integration-Infrastructure (Little Steps Sprint), 10Wikidata: Revisit Jenkins jobs being triggered for Wikibase - https://phabricator.wikimedia.org/T160989#3146531 (10hashar) I wanted to check the overlaps between three different tests jobs, generic, client and repo: * mwext-Wikibase-repo-tests-s... [13:26:28] 10Continuous-Integration-Infrastructure (Little Steps Sprint): For MediaWiki extensions, merge composer test into mwext-textextension / mediawiki-extensions jobs - https://phabricator.wikimedia.org/T161895#3146544 (10hashar) [13:27:02] 10Continuous-Integration-Infrastructure (Little Steps Sprint): For MediaWiki extensions, merge composer test into mwext-textextension / mediawiki-extensions jobs - https://phabricator.wikimedia.org/T161895#3146533 (10hashar) [13:27:40] 10Continuous-Integration-Infrastructure (Little Steps Sprint), 10Wikidata: Revisit Jenkins jobs being triggered for Wikibase - https://phabricator.wikimedia.org/T160989#3146549 (10hashar) > Change: > * `mwext-testextension-php55-composer-trusty` include `composer test` (for lint/style) > * `mwext-testextension... [13:46:37] Yippee, build fixed! [13:46:38] Project selenium-VisualEditor » firefox,beta,Linux,BrowserTests build #353: 09FIXED in 2 min 36 sec: https://integration.wikimedia.org/ci/job/selenium-VisualEditor/BROWSER=firefox,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=Linux,label=BrowserTests/353/ [13:49:55] PROBLEM - Work requests waiting in Zuul Gearman server https://grafana.wikimedia.org/dashboard/db/zuul-gearman on contint1001 is CRITICAL: CRITICAL: 57.14% of data above the critical threshold [140.0] [13:53:48] looking [13:55:26] one time spike [14:03:02] RECOVERY - Work requests waiting in Zuul Gearman server https://grafana.wikimedia.org/dashboard/db/zuul-gearman on contint1001 is OK: OK: Less than 30.00% above the threshold [90.0] [15:39:06] 10Browser-Tests-Infrastructure, 10MediaWiki-General-or-Unknown, 07JavaScript, 05MW-1.29-release (WMF-deploy-2017-03-21_(1.29.0-wmf.17)), and 4 others: Port Selenium tests from Ruby to Node.js - https://phabricator.wikimedia.org/T139740#3146785 (10zeljkofilipin) [15:41:40] 10Browser-Tests-Infrastructure, 10MediaWiki-General-or-Unknown, 07JavaScript, 05MW-1.29-release (WMF-deploy-2017-03-21_(1.29.0-wmf.17)), and 4 others: Port Selenium tests from Ruby to Node.js - https://phabricator.wikimedia.org/T139740#3146800 (10zeljkofilipin) [15:49:38] 10Continuous-Integration-Infrastructure, 10Gerrit, 06Release-Engineering-Team: Investigate installing the zuul plugin for gerrit - https://phabricator.wikimedia.org/T158600#3146818 (10Paladox) The repo has the new bazel BUILD file so it can be installed when ever. [19:20:00] greg-g: can you help me get a deployment done today? https://phabricator.wikimedia.org/T161869 [19:20:35] * Reedy eyes MatmaRex [19:20:55] it's not my fault we roll out to the big wikis on thursdays. [19:24:16] Reedy: so, you wanna do it? [19:24:30] since we're apparently the last two people left alive [19:24:52] Collaboration folks are not responding on their channel either [19:25:08] So which patch? [19:25:31] Project mediawiki-core-code-coverage-jessie build #9: 04STILL FAILING in 57 sec: https://integration.wikimedia.org/ci/job/mediawiki-core-code-coverage-jessie/9/ [19:25:54] https://gerrit.wikimedia.org/r/345871 [19:26:15] (or a revert of https://gerrit.wikimedia.org/r/345176 , if that makes someone feel better) [19:26:40] The first is a simpler patch [19:26:49] indeed [19:27:25] picked to .18 and merging [19:52:26] RECOVERY - Long lived cherry-picks on puppetmaster on deployment-puppetmaster02 is OK: OK: Less than 100.00% above the threshold [0.0] [20:14:18] (03PS1) 10MaxSem: Enable Phan tests for GeoData [integration/config] - 10https://gerrit.wikimedia.org/r/345880 [20:19:14] (03CR) 10EBernhardson: "not sure which repo it goes in, but you also need the clone script to bring in CirrusSearch and Elastica for the analysis to see the class" [integration/config] - 10https://gerrit.wikimedia.org/r/345880 (owner: 10MaxSem) [20:19:43] Project mediawiki-core-code-coverage-jessie build #10: 04FAILURE in 38 min: https://integration.wikimedia.org/ci/job/mediawiki-core-code-coverage-jessie/10/ [20:33:32] 06Release-Engineering-Team (Deployment-Blockers), 05Release: MW-1.29.0-wmf.19 deployment blockers - https://phabricator.wikimedia.org/T160551#3147551 (10Krinkle) [20:34:49] Failing with [20:34:50] 20:19:42 Fatal error: Call to undefined method PHPUnit_Util_XML::findNodes() in /srv/jenkins-workspace/workspace/mediawiki-core-code-coverage-jessie/src/tests/phpunit/MediaWikiTestCase.php on line 1780 [20:35:54] Krinkle is working on it afaik [20:36:29] ok thanks [20:43:17] Reedy strange the static function exists https://github.com/sebastianbergmann/phpunit/blob/4.8/src/Util/XML.php#L497 [20:43:42] I see you did an update here https://github.com/wikimedia/mediawiki/commit/48026c4d498d4611db286ff52ec8d57de9fb75f2 [20:43:51] master branch dosen't include that class [20:44:13] Well, it's not using phpunit 4.8 [20:44:28] 19:41:02 + jq 'setpath(["require-dev","phpunit/phpunit"]; "5.7")' [20:44:35] ah yep just saw that [20:44:37] 19:41:28 - Installing phpunit/phpunit (5.7.0) [20:44:37] 19:41:28 Loading from cache [20:44:37] 19:41:28 Extracting archive [20:44:58] The test needs updating [20:46:19] The function was removed in https://github.com/sebastianbergmann/phpunit/commit/c0fbd3a136bdb6e09b14a1d892ee2b501a0f0d6f [20:48:44] Reedy https://github.com/sebastianbergmann/phpunit/issues/1292 (not sure if you saw that task) [20:48:48] So the problem is MW core needs to support PHPUnit 4.8 for PHP 5.5.9 support [20:49:07] But Krinkle is using newer phpunit for code coverage stuff, because it works a lot better [20:49:50] paladox: 'mediawiki-core-code-coverage-jessie' is not a voting job, it's just my draft experiment. [20:49:52] Ignore it :) [20:50:01] oh ok :) [21:22:26] PROBLEM - Puppet run on integration-slave-docker-1000 is CRITICAL: CRITICAL: 22.22% of data above the critical threshold [0.0] [22:02:27] RECOVERY - Puppet run on integration-slave-docker-1000 is OK: OK: Less than 1.00% above the threshold [0.0]