[00:16:57] James_F: :(( you can see when l10n cache building really kicks in and makes the beta scap slow via https://integration.wikimedia.org/ci/view/Beta/job/beta-scap-eqiad/buildTimeTrend [00:20:51] bd808: Yeah. :-( [00:22:10] bd808: I mentioned to Roan that maybe we should not build 280 of the languages, and so save time (BC only has 5 languages or whatever). [00:22:40] James_F: But I want to use $wiki with $nonWikiLang [00:23:01] Reedy: Then go to production. ;-) [00:23:18] * Reedy creates 280 wikis on beta [00:23:47] well, 275 [01:08:42] James_F: hmmm... rebuildLocalisationCache.php actually has a `--lang=a,b,c` option that could be used to limit that. scap would need a way to pass that information on in a per-cluster manner. [01:09:02] * James_F nods. [01:09:15] so only build the i18n cache for the content languages? [01:09:19] Getting a 'full' scap done in 10 minutes instead of 45 would make it saner. [01:09:37] Maybe do it for a couple of extra ones for testing, but not all 300? [01:13:12] it might be as simple as passing `lang='a,b,c'` here -- https://github.com/wikimedia/mediawiki-tools-scap/blob/master/scap/tasks.py#L547-L548 [01:13:44] we already use lang='en' when bootstrapping a new branch around line 513 in the same file [01:42:04] Should I create a task? [01:45:27] 10Beta-Cluster-Infrastructure: Consider only running the Beta Cluster localisation caches with the content languages to make scaps much faster - https://phabricator.wikimedia.org/T123997#1942837 (10Jdforrester-WMF) 3NEW [01:45:32] Done. [02:14:54] (03PS1) 10Catrope: Move browser tests for Echo out of experimental status [integration/config] - 10https://gerrit.wikimedia.org/r/264912 (https://phabricator.wikimedia.org/T109679) [02:16:08] (03CR) 10jenkins-bot: [V: 04-1] Move browser tests for Echo out of experimental status [integration/config] - 10https://gerrit.wikimedia.org/r/264912 (https://phabricator.wikimedia.org/T109679) (owner: 10Catrope) [03:04:47] Project beta-scap-eqiad build #86843: 04FAILURE in 0.41 sec: https://integration.wikimedia.org/ci/job/beta-scap-eqiad/86843/ [03:22:14] Yippee, build fixed! [03:22:14] Project beta-scap-eqiad build #86844: 09FIXED in 7 min 23 sec: https://integration.wikimedia.org/ci/job/beta-scap-eqiad/86844/ [03:33:01] Project browsertests-MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-firefox-sauce build #947: 04FAILURE in 51 min: https://integration.wikimedia.org/ci/job/browsertests-MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-firefox-sauce/947/ [03:39:00] (03CR) 10Jforrester: "recheck" [integration/config] - 10https://gerrit.wikimedia.org/r/264912 (https://phabricator.wikimedia.org/T109679) (owner: 10Catrope) [03:50:14] PROBLEM - App Server Main HTTP Response on deployment-mediawiki02 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [03:50:19] (03PS2) 10Legoktm: Move browser tests for Echo out of experimental status [integration/config] - 10https://gerrit.wikimedia.org/r/264912 (https://phabricator.wikimedia.org/T109679) (owner: 10Catrope) [03:55:04] RECOVERY - App Server Main HTTP Response on deployment-mediawiki02 is OK: HTTP OK: HTTP/1.1 200 OK - 39417 bytes in 1.367 second response time [03:57:21] (03PS1) 10Legoktm: Create zuul 'extension-selenium' template and use it [integration/config] - 10https://gerrit.wikimedia.org/r/264922 [03:57:36] (03CR) 10Legoktm: [C: 032] Move browser tests for Echo out of experimental status [integration/config] - 10https://gerrit.wikimedia.org/r/264912 (https://phabricator.wikimedia.org/T109679) (owner: 10Catrope) [03:57:42] (03CR) 10Legoktm: [C: 032] "no-op" [integration/config] - 10https://gerrit.wikimedia.org/r/264922 (owner: 10Legoktm) [03:58:50] (03Merged) 10jenkins-bot: Move browser tests for Echo out of experimental status [integration/config] - 10https://gerrit.wikimedia.org/r/264912 (https://phabricator.wikimedia.org/T109679) (owner: 10Catrope) [03:59:19] (03Merged) 10jenkins-bot: Create zuul 'extension-selenium' template and use it [integration/config] - 10https://gerrit.wikimedia.org/r/264922 (owner: 10Legoktm) [03:59:40] !log deploying https://gerrit.wikimedia.org/r/264912 and https://gerrit.wikimedia.org/r/264922 [03:59:43] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL, Master [07:11:21] (03PS4) 10Legoktm: build: Add and use phpcs.xml [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/263222 (https://phabricator.wikimedia.org/T116866) (owner: 10Haritha28) [07:16:37] (03CR) 10Legoktm: [C: 032] "Thanks!" [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/263222 (https://phabricator.wikimedia.org/T116866) (owner: 10Haritha28) [07:17:15] (03Merged) 10jenkins-bot: build: Add and use phpcs.xml [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/263222 (https://phabricator.wikimedia.org/T116866) (owner: 10Haritha28) [07:24:08] 10MediaWiki-Codesniffer, 7Easy, 5Patch-For-Review: Update mediawiki/tools/codesniffer repository to use phpcs.xml file - https://phabricator.wikimedia.org/T116866#1943203 (10Legoktm) 5Open>3Resolved [07:27:50] 10MediaWiki-Codesniffer: Codesniffer 0.5.1 now sniffs the .git folder - https://phabricator.wikimedia.org/T122738#1943205 (10Legoktm) Hmm, I can't reproduce: ``` km@km-tp ~/p/v/m/e/AbsenteeLandlord> ./vendor/bin/phpcs -v Registering sniffs in the standard... DONE (54 sniffs registered) Creating file list... D... [07:30:23] 10MediaWiki-Codesniffer: Codesniffer 0.5.1 now sniffs the .git folder - https://phabricator.wikimedia.org/T122738#1943207 (10Legoktm) Oh, no. I just had to create a .php file inside .git: ``` km@km-tp ~/p/s/AbsenteeLandlord> ./vendor/bin/phpcs -v Registering sniffs in the standard... DONE (54 sniffs registered... [07:38:49] 10MediaWiki-Codesniffer: Codesniffer 0.5.1 now sniffs the .git folder - https://phabricator.wikimedia.org/T122738#1943211 (10Legoktm) After further testing, it appears this isn't a new problem to 0.5.1. I can reproduce this issue going all the way back to 0.1.0. [07:39:22] 10MediaWiki-Codesniffer: MediaWiki-Codesniffer sniffs the .git folder - https://phabricator.wikimedia.org/T122738#1943212 (10Legoktm) [07:46:10] 10MediaWiki-Codesniffer: MediaWiki-Codesniffer sniffs the .git folder - https://phabricator.wikimedia.org/T122738#1943218 (10polybuildr) I'm guessing we just need to add it to the ignored patterns in `phpcs.xml`? [07:51:09] 10MediaWiki-Codesniffer: MediaWiki-Codesniffer sniffs the .git folder - https://phabricator.wikimedia.org/T122738#1943230 (10polybuildr) Sorry, while `phpcs.xml` works for individual repositories, we should probably be changing this in `ruleset.xml` using `` I think. [08:34:54] Yippee, build fixed! [08:34:55] Project browsertests-MultimediaViewer-en.wikipedia.beta.wmflabs.org-os_x_10.9-safari-sauce build #849: 09FIXED in 24 min: https://integration.wikimedia.org/ci/job/browsertests-MultimediaViewer-en.wikipedia.beta.wmflabs.org-os_x_10.9-safari-sauce/849/ [08:39:43] 5Release-Engineering-Epics, 10Browser-Tests-Infrastructure, 7Epic, 7Tracking: [EPIC] trigger browser tests from Gerrit (tracking) - https://phabricator.wikimedia.org/T55697#1943321 (10Legoktm) [09:32:27] (03PS1) 10Hashar: [ValueView] Delete untriggered Jenkins jobs [integration/config] - 10https://gerrit.wikimedia.org/r/264933 (https://phabricator.wikimedia.org/T123624) [09:35:12] (03CR) 10Hashar: [C: 032] [ValueView] Delete untriggered Jenkins jobs [integration/config] - 10https://gerrit.wikimedia.org/r/264933 (https://phabricator.wikimedia.org/T123624) (owner: 10Hashar) [09:38:02] (03Merged) 10jenkins-bot: [ValueView] Delete untriggered Jenkins jobs [integration/config] - 10https://gerrit.wikimedia.org/r/264933 (https://phabricator.wikimedia.org/T123624) (owner: 10Hashar) [09:40:00] !log Created github repo https://github.com/wikimedia/operations-debs-varnish4 [09:40:02] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL, Master [10:21:28] 10Continuous-Integration-Infrastructure, 6operations, 7HHVM, 7WorkType-Maintenance: HHVM Jenkins job throw: Unable to set CoreFileSize to 8589934592: Operation not permitted (1) - https://phabricator.wikimedia.org/T78799#1943428 (10hashar) >>! In T78799#1939272, @Nemo_bis wrote: > So in other words that's... [10:22:00] zeljkof: hi, around? [10:22:17] dcausse: he has been away for 5days+ :D [10:22:31] hashar: hi! :) [10:22:42] maybe I can help? [10:22:59] testing https://gerrit.wikimedia.org/r/#/c/257928/ [10:23:23] I have some troubles with it but not sure if it's a problem on my side [10:24:32] eeek [10:24:56] I think it's related to environment setup, we used a ugly bash script to setup the env, but it now it uses a cleaner environments.yml [10:25:33] yup that is the point of this patc [10:25:41] bump to mediawiki_selenium 1.x [10:25:48] I had to tweak some stuff in it but I still have some errors and I'm unsure what's wrong [10:25:50] which introduced env.yaml file [10:25:54] ah ok [10:26:04] iirc the basic smoke tests are working [10:26:13] but some others are failing when running them in mediawiki vagrant [10:26:34] seems zeljkof updated the task detail to report about them https://phabricator.wikimedia.org/T99653 [10:26:47] so the change is on hold until all scenarii are passing [10:27:34] dcausse: what kind of error do you encounter ? [10:27:53] the basic doc is https://doc.wikimedia.org/rubygems/mediawiki-selenium/#Running_Tests [10:28:32] I never tried to run the tests for that repo thought ;/ [10:29:21] first I had to update mw-vagrant-guest to include mediawiki_url_commons: [10:29:56] and now some tests fail with NotExists (MediawikiApi::LoginError) [10:30:11] sounds like a credential issue so :/ [10:30:29] are you hitting the beta cluster? [10:30:56] oh no sorry [10:30:59] that is against the localhost [10:31:31] yes trying to run tests on my vagrant machine [10:32:56] and I am unfamiliar with mw-vagrant unfortunately [10:33:03] hopefully it has logs somewhere that would help [10:35:34] yes, I think it's related to commons, will try to find what's wrong, thanks! [13:20:16] Project beta-update-databases-eqiad build #5909: 04FAILURE in 15 sec: https://integration.wikimedia.org/ci/job/beta-update-databases-eqiad/5909/ [13:29:25] dcausse: sorry, sleeping all day, jet lagged [13:30:48] zeljkof: np, me too I'm not fully recovered :) [14:21:23] Yippee, build fixed! [14:21:24] Project beta-update-databases-eqiad build #5910: 09FIXED in 1 min 22 sec: https://integration.wikimedia.org/ci/job/beta-update-databases-eqiad/5910/ [14:22:08] (03PS2) 10Hashar: [UpdateMediaWiki] Add jsonlint test [integration/config] - 10https://gerrit.wikimedia.org/r/264892 (owner: 10Paladox) [14:22:23] (03CR) 10Hashar: [C: 032] [UpdateMediaWiki] Add jsonlint test [integration/config] - 10https://gerrit.wikimedia.org/r/264892 (owner: 10Paladox) [14:23:16] (03Merged) 10jenkins-bot: [UpdateMediaWiki] Add jsonlint test [integration/config] - 10https://gerrit.wikimedia.org/r/264892 (owner: 10Paladox) [14:27:58] Yippee, build fixed! [14:27:58] Project browsertests-Echo-en.wikipedia.beta.wmflabs.org-linux-firefox-sauce build #759: 09FIXED in 1 min 57 sec: https://integration.wikimedia.org/ci/job/browsertests-Echo-en.wikipedia.beta.wmflabs.org-linux-firefox-sauce/759/ [14:30:27] (03PS2) 10Hashar: [SocialProfile] Remove vote no for extension SocialProfile, generic unit tests [integration/config] - 10https://gerrit.wikimedia.org/r/264756 (owner: 10Paladox) [14:30:31] (03PS3) 10Hashar: [SocialProfile] Remove vote no for extension SocialProfile, generic unit tests [integration/config] - 10https://gerrit.wikimedia.org/r/264756 (owner: 10Paladox) [14:31:02] (03CR) 10Hashar: [C: 032] "Excellent, thank you!" [integration/config] - 10https://gerrit.wikimedia.org/r/264756 (owner: 10Paladox) [14:33:33] (03Merged) 10jenkins-bot: [SocialProfile] Remove vote no for extension SocialProfile, generic unit tests [integration/config] - 10https://gerrit.wikimedia.org/r/264756 (owner: 10Paladox) [14:43:21] (03CR) 10Hashar: [C: 032] [BlockAndNuke] Update Jenkins tests [integration/config] - 10https://gerrit.wikimedia.org/r/264598 (owner: 10Paladox) [14:44:06] (03PS3) 10Hashar: [BlockAndNuke] Update Jenkins tests [integration/config] - 10https://gerrit.wikimedia.org/r/264598 (owner: 10Paladox) [14:45:08] (03PS4) 10Hashar: [BlockAndNuke] Update Jenkins tests [integration/config] - 10https://gerrit.wikimedia.org/r/264598 (owner: 10Paladox) [14:45:26] (03CR) 10Hashar: [C: 032] "Removed an unrelated change to ext CreateRedirect" [integration/config] - 10https://gerrit.wikimedia.org/r/264598 (owner: 10Paladox) [14:47:40] (03Merged) 10jenkins-bot: [BlockAndNuke] Update Jenkins tests [integration/config] - 10https://gerrit.wikimedia.org/r/264598 (owner: 10Paladox) [14:57:05] (03CR) 10Hashar: [C: 031] Update Android test target [integration/config] - 10https://gerrit.wikimedia.org/r/264209 (owner: 10Niedzielski) [14:58:02] (03PS3) 10Hashar: [MyVariables] Replace jslint with jsonlint and jshint [integration/config] - 10https://gerrit.wikimedia.org/r/263936 (owner: 10Paladox) [14:58:08] (03PS4) 10Hashar: [MyVariables] Replace jslint with jsonlint and jshint [integration/config] - 10https://gerrit.wikimedia.org/r/263936 (owner: 10Paladox) [14:58:29] (03CR) 10Hashar: [C: 032] [MyVariables] Replace jslint with jsonlint and jshint [integration/config] - 10https://gerrit.wikimedia.org/r/263936 (owner: 10Paladox) [15:00:20] (03Merged) 10jenkins-bot: [MyVariables] Replace jslint with jsonlint and jshint [integration/config] - 10https://gerrit.wikimedia.org/r/263936 (owner: 10Paladox) [15:04:23] (03PS1) 10Hashar: [CreateRedirect] switch to npm/composer [integration/config] - 10https://gerrit.wikimedia.org/r/264951 [15:04:57] (03PS2) 10Hashar: [CreateRedirect] switch to npm/composer [integration/config] - 10https://gerrit.wikimedia.org/r/264951 [15:05:18] (03CR) 10Hashar: [C: 032] [CreateRedirect] switch to npm/composer [integration/config] - 10https://gerrit.wikimedia.org/r/264951 (owner: 10Hashar) [15:08:26] (03Merged) 10jenkins-bot: [CreateRedirect] switch to npm/composer [integration/config] - 10https://gerrit.wikimedia.org/r/264951 (owner: 10Hashar) [15:43:20] (03CR) 10Paladox: "Thanks." [integration/config] - 10https://gerrit.wikimedia.org/r/263936 (owner: 10Paladox) [15:52:31] (03CR) 10Paladox: "recheck" [integration/config] - 10https://gerrit.wikimedia.org/r/264762 (owner: 10Paladox) [15:52:48] (03CR) 10jenkins-bot: [V: 04-1] [SocialProfile] Replace deprecated jslint test with npm and add composer-test test [integration/config] - 10https://gerrit.wikimedia.org/r/264762 (owner: 10Paladox) [15:55:17] (03PS2) 10Paladox: [SocialProfile] Replace deprecated jslint test with npm and add composer-test test [integration/config] - 10https://gerrit.wikimedia.org/r/264762 [15:57:27] 10Deployment-Systems, 6Release-Engineering-Team, 3Scap3, 7Blocked-on-Operations: Cleanup things we're not deploying anymore. - https://phabricator.wikimedia.org/T120157#1944116 (10greg) >>! In T120157#1928203, @demon wrote: > So we just need a root to `rm -R /srv/deployment{brrd,ishamel,mwprof,reporter,sca... [16:02:38] 10Deployment-Systems, 6Release-Engineering-Team, 3Scap3, 7Blocked-on-Operations: Cleanup things we're not deploying anymore. - https://phabricator.wikimedia.org/T120157#1944147 (10demon) Err, `scap.old`, ofc. [17:13:19] marxarelli: is there any chance of the eventbus extension going out on today's train? [17:25:31] (03PS1) 10Paladox: [SocialLogin] Replace jslint test with npm and add composer-test [integration/config] - 10https://gerrit.wikimedia.org/r/264967 [17:25:47] ostriches: marxarelli do you have any thoughts about the order of syncing this patch for the train today? https://gerrit.wikimedia.org/r/#/c/263797/1 [17:26:04] looking [17:26:30] we need the extension-list patch in place for l10nupdate to work, but IntialiseSettings.php needs to be there before CommonSettings.php otherwise there will be a distracting log spike [17:27:28] (03PS1) 10Paladox: [SmiteSpam] Add jshint and jsonlint for non-whitelisted users [integration/config] - 10https://gerrit.wikimedia.org/r/264968 [17:28:44] thcipriani: It doesn't require scap, you can just sync-dir wmf-config/. But I have an unanswered question or two on it (posting in a moment). [17:30:13] ostriches: kk, FWIW, the extension is already in make-wmf-branch/config.json [17:30:58] Ah missed that bit. So it'll be in today's branch, but not the old one unless we backport. [17:31:48] thcipriani: that patch includes IntialiseSettings as well. are you saying it should be split into two patches? [17:32:39] marxarelli: just trying to figure out if it should be sync'd out with a sync-file for InitialiseSettings.php before scap, or if that causes more problems. [17:32:50] i see [17:33:30] ostriches: there is a backport patch https://gerrit.wikimedia.org/r/#/c/263787/ because l10nupdate things. [17:33:43] k [17:50:58] so the branching aspect is OK? [17:51:08] (or will be?) [17:51:20] whoever is cutting the branch today: if https://gerrit.wikimedia.org/r/#/c/264407/ makes it in, https://gerrit.wikimedia.org/r/#/c/264878/ also needs to make it in [17:51:34] I just s/EventBus.php/extension.json/g fwiw [17:54:15] marxarelli, ^ [18:00:26] hmmm... how do we handle removing extensions now that we lost the ability to have per-branch extension-lists? [18:00:34] * bd808 grumbles about that [18:02:57] bd808: what are you trying to remove? [18:03:45] legoktm: RandomRootPage right? [18:04:28] I guess the empty extension.json kinda removes it [18:04:29] (03PS1) 10Paladox: [RandomRootPage] Archived extension [integration/config] - 10https://gerrit.wikimedia.org/r/264975 [18:04:52] and then we could drop it from the extension list next week [18:04:57] bd808: yeah, and once that branch is deployed everywhere, it can be removed [18:06:04] that's going to bite us when we remove an extension that hasn't been merged into core and is instead just not wanted on wikimedia sites [18:13:13] bd808: undeploy it from both branches then? [18:48:01] ostriches, thcipriani: is https://gerrit.wikimedia.org/r/#/c/263797/ good to merge now? [18:51:08] marxarelli: lgtm. I think the problems have been addressed. Also, be sure to get https://gerrit.wikimedia.org/r/#/c/263787/ before you scap. [18:51:46] 10Continuous-Integration-Config, 10MediaWiki-extensions-RelatedArticles: RelatedArticles browser tests should run on a commit basis - https://phabricator.wikimedia.org/T120715#1944718 (10bd808) [18:53:15] thcipriani: right-o. any harm in merging that now? [18:54:48] marxarelli: not that I can think of, should be fine to merge. [19:13:12] 10Differential, 6Developer-Relations, 10Gerrit: Add OpenStack esk welcomer bot to Gerrit - https://phabricator.wikimedia.org/T73357#1944859 (10Aklapper) >>! In T73357#1635192, @Qgil wrote: > Would there be any equivalent to this in Phabricator/Differential? I'd really love to know this too. Anyone having a... [19:24:55] (03PS1) 10Legoktm: Have php-composer-test job pass even if no composer.json exists [integration/config] - 10https://gerrit.wikimedia.org/r/264990 [19:30:39] I thought jjb let you delete jobs using a wildcard? [19:30:46] jenkins-jobs --conf etc/jenkins_jobs.ini delete "*zend*" [19:30:46] INFO:jenkins_jobs.builder:Removing jenkins job(s): *zend* [19:30:46] INFO:jenkins_jobs.builder:Cache saved [19:33:44] got it [19:33:46] jenkins-jobs --conf etc/jenkins_jobs.ini delete --path config "*zend*" [19:34:13] !log deleting all *zend* jobs from jenkins [19:34:15] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL, Master [20:02:53] (03PS1) 10Niedzielski: Preserve Android Spoon test output [integration/config] - 10https://gerrit.wikimedia.org/r/265009 (https://phabricator.wikimedia.org/T118100) [20:14:13] ostriches: Hi! I made this ticket https://phabricator.wikimedia.org/T124086, and I was wondering if I'm tagging the right project. Do you know if I am? [20:15:03] Probably also want to add [Project Creators] but otherwise looks ok [20:16:18] twentyafterfour: Hi could you create a mediawiki extension repo named OpenLayers in gerrit and pabricator please. Could the author of the extension be Yaron Koren and paladox please. [20:17:16] or any one else [20:17:31] Or could anyone else create the repo please. [20:18:07] I think there's a process for requesting repos [20:18:52] Krenair: Oh you mean this https://www.mediawiki.org/wiki/Git/New_repositories/Requests/Entries https://www.mediawiki.org/wiki/Git/New_repositories/Requests [20:19:41] "Also please update the phabricator redirection script with the new repos to redirect." [20:20:23] is that updating GerritProjectController in phabricator/extensions.git? [20:26:55] Krenair: Yes. [20:32:19] (03PS1) 10Paladox: [Metrolook] Add php53lint to test: too [integration/config] - 10https://gerrit.wikimedia.org/r/265099 [20:33:12] (03CR) 10jenkins-bot: [V: 04-1] [MinervaNeue] Add jenkins tests [integration/config] - 10https://gerrit.wikimedia.org/r/265098 (owner: 10Paladox) [20:34:57] (03PS2) 10Paladox: [MinervaNeue] Add jenkins tests [integration/config] - 10https://gerrit.wikimedia.org/r/265098 [20:38:11] twentyafterfour: Could you please create a repo in phabricator for MinervaNeue https://git.wikimedia.org/summary/mediawiki%2Fskins%2FMinervaNeue.git [20:50:52] 10Deployment-Systems, 6Release-Engineering-Team, 3Scap3, 7Blocked-on-Operations: Cleanup things we're not deploying anymore. - https://phabricator.wikimedia.org/T120157#1945570 (10Dzahn) ok. rm -rf /srv/deployment/scap .. :) no, just kidding ``` root@tin:/srv/deployment# file /srv/deployment/{brrd,isha... [20:51:13] 10Deployment-Systems, 6Release-Engineering-Team, 3Scap3, 7Blocked-on-Operations: Cleanup things we're not deploying anymore. - https://phabricator.wikimedia.org/T120157#1945574 (10Dzahn) 5Open>3Resolved a:3Dzahn [21:29:22] (03CR) 10Reedy: "CR -2" [tools/release] - 10https://gerrit.wikimedia.org/r/263897 (owner: 10Chad) [21:31:48] (03PS1) 10Reedy: Revert "Remove broken special_extensions behavior" [tools/release] - 10https://gerrit.wikimedia.org/r/265136 [21:40:43] thcipriani: when we discussed "steps" last week, the final one was the changeset to enable the EventBus extension after it was deployed, how goes the timing there? [21:41:32] when can/should that be done? [21:41:36] urandom: I would add a patch to evening swat (or morning SWAT if evening is full—haven't looked) to enable the extension. [21:41:49] Noting the deploy train is running late today [21:42:29] thcipriani: evening swat? [21:42:38] tomorrow? [21:43:40] Should be fine in the next SWAT slot AFAIK [21:43:43] urandom: https://wikitech.wikimedia.org/wiki/Deployments#Wednesday.2C.C2.A0January.C2.A020 (says tomorrow, UTC, it's at 4pm pacific) [21:43:59] how does one get a patch added to that queue? [21:44:27] edit the page :) [21:44:37] just edit the wikipage, it'll get reviewed by the deployer and sync'd out. [21:45:00] oh i see, that's the list in the last column [21:45:05] hi it seems that beta-mediawiki-config-update-eqiad job is currently stalled at https://integration.wikimedia.org/zuul/ [21:45:08] You need to make a patch ofc [21:45:09] https://integration.wikimedia.org/ci/job/beta-mediawiki-config-update-eqiad/ [21:45:16] right [21:49:16] i think that job beta-scap-eqiad is also stalled it is saying pending—Waiting for next available executor on deployment-bastion.eqiad [21:49:20] https://integration.wikimedia.org/ci/job/beta-scap-eqiad/ [21:49:56] it seems that https://integration.wikimedia.org/ci/computer/deployment-bastion.eqiad/ may me down. [21:52:18] !log following steps at https://www.mediawiki.org/wiki/Continuous_integration/Jenkins#Hung_beta_code.2Fdb_update for deployment-bastion [21:52:20] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL, Master [21:53:35] thanks. [21:54:02] seems to still be offline [21:54:20] Please wait more than a minute and a half [21:54:31] Reedy: Ok. [21:57:16] !log beta-scap-eqiad still can't find executor on deployment-bastion.eqiad [21:57:18] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL, Master [21:58:11] !log trying https://www.mediawiki.org/wiki/Continuous_integration/Jenkins#Hung_beta_code.2Fdb_update again [21:58:13] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL, Master [22:02:57] Should eventbus be enabled everywhere? [22:25:33] !log deleting *zend* workspaces on precise slaves [22:25:35] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL, Master [22:30:01] Reedy: i pushed another patch to exclude wikitech and private [22:31:12] Reedy: you're right about the subsequent stanza having the effect of disabling RestbaseUpdateJobs on those two [22:31:24] :) [22:31:33] Krenair just asked about loginwiki/votewiki too [22:31:42] But at least now, matches current config [22:31:49] I suspect restbase shouldn't be on those either [22:31:52] what are those? [22:32:00] login and vote? [22:32:23] votewiki is just used for securepoll stuff [22:32:30] login is just used for login stuff [22:32:49] https://login.wikimedia.org/wiki/Special:AllPages [22:32:56] https://vote.wikimedia.org/wiki/Special:AllPages [22:33:15] They'll have almost zero edits [22:34:07] So, I highly suspect it might aswell be disabled there too [22:34:27] Reedy: yeah, checking... [22:46:00] 10Beta-Cluster-Infrastructure: Requests to beta cluster with "X-Wikimedia-Security-Audit: 1" header are hanging - https://phabricator.wikimedia.org/T123007#1946043 (10greg) 5Open>3Resolved [22:48:17] legoktm: thanks again for doing that rename [22:48:30] :) [23:46:02] PROBLEM - App Server Main HTTP Response on deployment-mediawiki01 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [23:46:46] PROBLEM - English Wikipedia Mobile Main page on beta-cluster is CRITICAL: CRITICAL - Socket timeout after 10 seconds [23:46:46] PROBLEM - English Wikipedia Main page on beta-cluster is CRITICAL: CRITICAL - Socket timeout after 10 seconds [23:47:14] PROBLEM - App Server Main HTTP Response on deployment-mediawiki02 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [23:48:29] eh? [23:49:04] slow to load for me..... still waiting... [23:49:58] scap is still running... we'll see I guess https://integration.wikimedia.org/ci/job/beta-scap-eqiad/86929/console [23:51:23] homepage finally loaded, but without css [23:52:04] RECOVERY - App Server Main HTTP Response on deployment-mediawiki02 is OK: HTTP OK: HTTP/1.1 200 OK - 39391 bytes in 0.954 second response time [23:53:23] scap done... [23:56:37] RECOVERY - English Wikipedia Main page on beta-cluster is OK: HTTP OK: HTTP/1.1 200 OK - 39740 bytes in 0.514 second response time [23:56:37] RECOVERY - English Wikipedia Mobile Main page on beta-cluster is OK: HTTP OK: HTTP/1.1 200 OK - 31573 bytes in 0.473 second response time [23:57:12] loaded, i guess we'll wait for mw01 to come back according to shinken