[00:01:11] (03PS1) 10Jdlrobson: Disable mwext-MobileFrontend-qunit-mobile job [integration/config] - 10https://gerrit.wikimedia.org/r/229287 [00:02:49] (03CR) 10jenkins-bot: [V: 04-1] Disable mwext-MobileFrontend-qunit-mobile job [integration/config] - 10https://gerrit.wikimedia.org/r/229287 (owner: 10Jdlrobson) [00:03:48] (03PS2) 10Jdlrobson: Disable mwext-MobileFrontend-qunit-mobile job [integration/config] - 10https://gerrit.wikimedia.org/r/229287 [00:07:14] 10Beta-Cluster, 10MediaWiki-General-or-Unknown, 10VisualEditor: TypeError: Cannot read property 'split' of undefined - https://phabricator.wikimedia.org/T107968#1508664 (10Josve05a) 3NEW [00:08:30] 10Beta-Cluster, 10MediaWiki-General-or-Unknown, 10VisualEditor: TypeError: Cannot read property 'split' of undefined - https://phabricator.wikimedia.org/T107968#1508673 (10Josve05a) [00:10:17] (03PS3) 10Krinkle: Disable mwext-MobileFrontend-qunit-mobile job [integration/config] - 10https://gerrit.wikimedia.org/r/229287 (owner: 10Jdlrobson) [00:10:27] (03CR) 10Krinkle: [C: 032] Disable mwext-MobileFrontend-qunit-mobile job [integration/config] - 10https://gerrit.wikimedia.org/r/229287 (owner: 10Jdlrobson) [00:12:07] (03Merged) 10jenkins-bot: Disable mwext-MobileFrontend-qunit-mobile job [integration/config] - 10https://gerrit.wikimedia.org/r/229287 (owner: 10Jdlrobson) [00:12:53] !log Reloading Zuul to deploy https://gerrit.wikimedia.org/r/229287 [00:12:56] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL, Master [00:12:58] jdlrobson: ^ [00:13:12] Krinkle: thanks [00:17:43] bd808: is there a way to tell puppet to apply resource B immediately after resource A? [00:22:08] bd808: nvm, I think I don't actually need that [00:40:50] Krinkle: so this is the status quo - https://phabricator.wikimedia.org/T104362#1508950 157 mobile tests not being run. Keen to get https://gerrit.wikimedia.org/r/#/c/229268/ passing [00:40:57] i need to leave for the day but just wanted to update you [00:44:20] 10Beta-Cluster, 10VisualEditor, 5VisualEditor pre-2015 work: Beta Cluster: API PrefixSearch is taking a very long time to return, and returns nothing when it does - https://phabricator.wikimedia.org/T74332#1508994 (10Jdforrester-WMF) [01:01:05] 6Release-Engineering, 10VisualEditor: Fix browsertests-VisualEditor-language-screenshot-windows_8.1-firefox Jenkins job - https://phabricator.wikimedia.org/T76133#1509162 (10Jdforrester-WMF) [01:08:26] 10Beta-Cluster, 10VisualEditor: Search on the Beta Cluster is broken, and thus VE no longer shows suggestion list for Templates upon typing into Add template selector - https://phabricator.wikimedia.org/T89007#1509213 (10Jdforrester-WMF) [01:09:45] 10Browser-Tests, 6Release-Engineering, 10VisualEditor: Selenium bug with Firefox causes VE test failure - https://phabricator.wikimedia.org/T90651#1509234 (10Jdforrester-WMF) [01:09:56] 10Beta-Cluster, 10VisualEditor, 10VisualEditor-MediaWiki: On Beta Cluster, switching from VisualEditor to edit source mode intermittently loads the wikitext editor without any CSS - https://phabricator.wikimedia.org/T86624#1509240 (10Jdforrester-WMF) [01:16:51] 10Browser-Tests, 10Continuous-Integration-Infrastructure, 10VisualEditor: language screenshot job for Persian (fa) seems to run correctly, but marked as failure - https://phabricator.wikimedia.org/T93742#1509255 (10Jdforrester-WMF) [01:16:59] 10Continuous-Integration-Infrastructure, 10MediaWiki-extensions-WikiHiero, 10VisualEditor: Test failed for ResourcesTest::testMissingDependencies - https://phabricator.wikimedia.org/T93536#1509256 (10Jdforrester-WMF) [01:17:55] PROBLEM - Puppet failure on deployment-restbase01 is CRITICAL 100.00% of data above the critical threshold [0.0] [01:23:04] 10Continuous-Integration-Infrastructure, 6Editing-Department, 10VisualEditor, 7Regression: Submodule not being updated in Jenkins jobs - https://phabricator.wikimedia.org/T101105#1509312 (10Jdforrester-WMF) [01:24:57] 10Beta-Cluster, 10Analytics-EventLogging, 10VisualEditor: Beta cluster is sending VisualEditor events to production bits.wikimedia.org/statsv - https://phabricator.wikimedia.org/T98196#1509356 (10Jdforrester-WMF) [01:34:53] legoktm: I've put back Beta-Cluster badge on beta wiki for now. Testwiki, test2wiki and deployment.wikimedia.beta have had this for a while now. Makes sense to have it on enwiki.beta as well. It helps distinguish from production. Especially since the logo is the same (which makes sense and keeps config simple) [01:38:14] 10Browser-Tests, 10VisualEditor: add true internationalized content support to auto-screenshots - https://phabricator.wikimedia.org/T105466#1509400 (10Jdforrester-WMF) [02:40:46] 6Release-Engineering, 10Gitblit-Deprecate: A gerrit project's Access > "History:" links to gitblit - https://phabricator.wikimedia.org/T107981#1509517 (10Spage) Is this a blocker of {T752}? [02:59:20] heya, need help for WMF engineer Volker Eckl. He doesn't have +2 rights in mediawiki/skins/Blueprint. I stumbled around in project Access and groups, and it doesn't seem to have any special access rights. So maybe he never got the WMF engineering right? Access seems to end up at the "mediawiki" group that includes ldap/wmf, so maybe he needs to be in that. But I'm flailing in the dark :-) [03:04:33] spagewmf: Put a ticket in Phabricator asking for Volker to be added to the 'wmf' group in LDAP; assign it to RelEng and someone can do it in the morning. [03:06:19] James_F: thanks will do. BTW instead of stumbling around https://www.mediawiki.org/wiki/Gerrit/%2B2 mentions the ldap/wmf group ;) [03:13:01] spagewmf: It does? Good. [03:18:31] Project browsertests-MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-firefox-sauce build #775: FAILURE in 36 min: https://integration.wikimedia.org/ci/job/browsertests-MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-firefox-sauce/775/ [03:22:29] James_F: it also lists Damon :) [03:22:37] JohnFLewis: Meh. [03:22:53] JohnFLewis: Keeping all documentation current is not my fight. :-) [03:23:39] :) [03:30:11] Krinkle_: okay. Can it be shown for all users then, not just logged in ones? [03:34:33] JohnFLewis: FTFY -- https://www.mediawiki.org/w/index.php?title=Gerrit/%2B2&diff=1813740&oldid=1813703 [03:37:17] JohnFLewis: I noticed that too, but let sleeping dogs lie [03:39:32] 6Release-Engineering, 7LDAP: Add WMF engineer VolkerE to ldap/wmf group - https://phabricator.wikimedia.org/T107985#1509590 (10Spage) 3NEW [03:43:25] 6Release-Engineering, 7LDAP: Add WMF engineer VolkerE to ldap/wmf group - https://phabricator.wikimedia.org/T107985#1509599 (10Tnegrin) Approved (Volker's manager) [03:52:55] legoktm: looks like there's a little bug in the composer.lock check -- "wikimedia/ip-set: 1.0 installed, 1.0.0 required." -- https://integration.wikimedia.org/ci/job/mediawiki-extensions-hhvm/26035/console [03:54:22] heh [03:54:49] bd808: you can have the composer.json file say "1.0" or we could use the composer/semver library to make the version check not suck. [03:55:09] I was thinking about the first option for now [03:55:39] Looks like the tag is 1.0 -- https://github.com/wikimedia/mediawiki-vendor/blob/master/composer.lock#L670 [03:56:07] oh. there is a 1.0.0 now too [03:56:13] https://github.com/wikimedia/IPSet/releases [03:57:54] hrmmm... the hash in the lock file matches the 1.0.0 tag [04:04:10] o.O [04:04:16] ok so the weird part here comes from packagist apparently. It has the 1.0.0 tag's hash associated with the 1.0 tag [04:04:29] having the 1.0 tag probably confused it [04:05:01] I wonder if I can force that to update [04:05:31] I twould be easy enough to cut a 1.0.1 tag too I suppose [04:06:04] bd808: also, we no longer do the dependency check for repos that aren't mediawiki/vendor [04:06:51] grrr.. ori is the only maintainer of https://packagist.org/packages/wikimedia/ip-set [04:17:14] tasks filed [06:11:12] Q: If I merge patch for extension in wmf17 (which is going to deploy later tonight), It doesn't need submodule update? [06:11:17] (or I need SWAT)? [08:25:02] 10Browser-Tests, 10MediaWiki-extensions-MultimediaViewer, 6Multimedia: Fix failed MultimediaViewer browsertests Jenkins jobs - https://phabricator.wikimedia.org/T94157#1509944 (10Gilles) a:5Gilles>3None I haven't had spare cycles for this in a long time... Un-licking this cookie since I don't think I sho... [09:09:21] OK. added. https://wikitech.wikimedia.org/wiki/Deployments#Wednesday.2C.C2.A0August.C2.A005 [09:18:12] 6Release-Engineering, 6Commons, 10MediaWiki-File-management, 10MediaWiki-Tarball-Backports, and 7 others: InstantCommons broken by switch to HTTPS - https://phabricator.wikimedia.org/T102566#1510076 (10Tau) {F459729} Have some problems with running this patch... [09:35:27] 10Continuous-Integration-Infrastructure: Setup a web portal for Zuul - https://phabricator.wikimedia.org/T48116#1510103 (10Fayyazurrehman) hi Hashar, I am also trying to setup zuul webportal. I am a bit new in this area and need your guidance if possible. Currently the displayed zuul status url http://ci.marl... [10:08:59] 10Beta-Cluster, 10VisualEditor: TypeError: Cannot read property 'split' of undefined - https://phabricator.wikimedia.org/T107968#1510205 (10Aklapper) [10:52:22] 10Browser-Tests, 10MediaWiki-extensions-WikibaseRepository, 10Wikidata: investigate failing Wikidata browsertests on jenkins - https://phabricator.wikimedia.org/T92619#1510289 (10daniel) [10:52:58] 10Browser-Tests, 10MediaWiki-extensions-WikibaseRepository, 10Wikidata: investigate failing Wikidata browsertests on jenkins - https://phabricator.wikimedia.org/T92619#1116439 (10daniel) [11:02:54] 6Release-Engineering, 10Staging, 10Reading Web Planning, 7Epic: [EPIC] Create a development staging environment and branch. - https://phabricator.wikimedia.org/T104324#1510308 (10Jhernandez) We did a naive attempt at T104324 with the reading maintained extensions ( http://reading-web-staging.wmflabs.org/wi... [12:04:47] PROBLEM - Free space - all mounts on integration-slave-trusty-1014 is CRITICAL integration.integration-slave-trusty-1014.diskspace._mnt.byte_percentfree (<100.00%) [12:07:18] PROBLEM - Puppet failure on integration-slave-jessie-1001 is CRITICAL 100.00% of data above the critical threshold [0.0] [12:13:25] (03PS5) 10Paladox: Add BlogPage to testextension [integration/config] - 10https://gerrit.wikimedia.org/r/227217 [12:35:12] (03PS1) 10Tim Landscheidt: Temporarily disable beta-recompile-math-texvc-eqiad [integration/config] - 10https://gerrit.wikimedia.org/r/229376 (https://phabricator.wikimedia.org/T91191) [12:42:45] (03CR) 10Physikerwelt: "In the medium term texvc will be removed... to tell a long story short it basically depends on restbase therefore I'd just remove this lin" [integration/config] - 10https://gerrit.wikimedia.org/r/229376 (https://phabricator.wikimedia.org/T91191) (owner: 10Tim Landscheidt) [12:43:19] (03CR) 10Physikerwelt: [C: 04-1] Temporarily disable beta-recompile-math-texvc-eqiad [integration/config] - 10https://gerrit.wikimedia.org/r/229376 (https://phabricator.wikimedia.org/T91191) (owner: 10Tim Landscheidt) [12:54:48] Project browsertests-GettingStarted-en.wikipedia.beta.wmflabs.org-linux-firefox-sauce build #555: FAILURE in 47 sec: https://integration.wikimedia.org/ci/job/browsertests-GettingStarted-en.wikipedia.beta.wmflabs.org-linux-firefox-sauce/555/ [13:35:20] (03PS2) 10Tim Landscheidt: Disable beta-recompile-math-texvc-eqiad [integration/config] - 10https://gerrit.wikimedia.org/r/229376 (https://phabricator.wikimedia.org/T91191) [13:40:26] (03CR) 10Physikerwelt: [C: 031] "I hope texvc never needs to be recompiled again." [integration/config] - 10https://gerrit.wikimedia.org/r/229376 (https://phabricator.wikimedia.org/T91191) (owner: 10Tim Landscheidt) [13:45:07] (03CR) 10Physikerwelt: "I don't know enough about this config to see the problem. Currently everything works as expected. If it does not destroy existing function" [integration/config] - 10https://gerrit.wikimedia.org/r/228293 (owner: 10Paladox) [14:34:47] Project browsertests-Flow-en.wikipedia.beta.wmflabs.org-linux-firefox-sauce build #756: ABORTED in 24 min: https://integration.wikimedia.org/ci/job/browsertests-Flow-en.wikipedia.beta.wmflabs.org-linux-firefox-sauce/756/ [15:28:50] Project browsertests-Math-en.wikipedia.beta.wmflabs.org-linux-chrome-sauce build #616: FAILURE in 49 sec: https://integration.wikimedia.org/ci/job/browsertests-Math-en.wikipedia.beta.wmflabs.org-linux-chrome-sauce/616/ [16:07:52] 10Deployment-Systems: Remove (?) l10nupdate from !log'ing - https://phabricator.wikimedia.org/T107480#1511002 (10thcipriani) p:5Triage>3Normal [16:09:02] 10Deployment-Systems: Setup alerts for l10nupdate - https://phabricator.wikimedia.org/T107515#1511004 (10thcipriani) p:5Triage>3Normal [16:50:01] 10Beta-Cluster, 10MediaWiki-extensions-MwEmbedSupport, 10VisualEditor: TypeError: Cannot read property 'split' of undefined - https://phabricator.wikimedia.org/T107968#1511253 (10Jdforrester-WMF) [16:54:01] (03PS4) 10Paladox: Archive Mantle extension [integration/config] - 10https://gerrit.wikimedia.org/r/228877 [16:54:25] (03PS3) 10Paladox: Add npm to Translate extension [integration/config] - 10https://gerrit.wikimedia.org/r/228872 [16:54:33] (03PS3) 10Paladox: Update translate tests, Remove old phpcs test [integration/config] - 10https://gerrit.wikimedia.org/r/228871 [16:55:17] (03PS3) 10Paladox: Add jsonlint test to AccessControl extension [integration/config] - 10https://gerrit.wikimedia.org/r/228842 [17:01:58] (03PS11) 10Paladox: Always fail the vector extension [integration/config] - 10https://gerrit.wikimedia.org/r/228133 [17:03:10] (03PS12) 10Paladox: Allow skins to also be tested like extensions can [integration/config] - 10https://gerrit.wikimedia.org/r/228470 (https://phabricator.wikimedia.org/T107748) [17:12:12] 10Browser-Tests, 3Reading-Web: Failed Jenkins job sets Sauce Labs job to passed - https://phabricator.wikimedia.org/T105589#1511362 (10dduvall) [17:12:13] 10Browser-Tests: Inconsistent reports on sauce labs and integration.wikimedia.org - https://phabricator.wikimedia.org/T106390#1511361 (10dduvall) [17:12:37] (03PS1) 10Dduvall: Test SauceLabs job status annotation [selenium] - 10https://gerrit.wikimedia.org/r/229417 (https://phabricator.wikimedia.org/T105589) [17:13:50] 10Browser-Tests, 5Patch-For-Review, 3Reading-Web: Failed Jenkins job sets Sauce Labs job to passed - https://phabricator.wikimedia.org/T105589#1511369 (10dduvall) p:5Triage>3Normal [17:21:33] 10Browser-Tests, 10MediaWiki-extensions-WikibaseRepository, 10Wikidata: investigate failing Wikidata browsertests on jenkins - https://phabricator.wikimedia.org/T92619#1511443 (10thiemowmde) [17:46:28] 10Browser-Tests, 10MediaWiki-extensions-WikibaseRepository, 10Wikidata: investigate failing Wikidata browsertests on jenkins - https://phabricator.wikimedia.org/T92619#1511575 (10daniel) [17:47:47] 10Beta-Cluster, 10Traffic, 6operations, 5Patch-For-Review: Upgrade beta-cluster caches to jessie - https://phabricator.wikimedia.org/T98758#1511579 (10demon) [17:48:14] 10Beta-Cluster, 10Traffic, 6operations, 5Patch-For-Review: Upgrade beta-cluster caches to jessie - https://phabricator.wikimedia.org/T98758#1276698 (10demon) All seems working, just need to verify purges, make sure browser tests are still ok, and then decom the old instances. [17:50:03] thcipriani: yay we'll be able to just use jessie in staging. [17:50:07] no disparity anymore [17:50:10] (for caches) [17:50:26] I saw your emails just now—awesome! [17:55:27] 10Beta-Cluster, 10MediaWiki-extensions-MwEmbedSupport, 10VisualEditor: TypeError: Cannot read property 'split' of undefined - https://phabricator.wikimedia.org/T107968#1511635 (10Jdforrester-WMF) p:5Triage>3Unbreak! [18:08:54] legoktm: " Can it be shown for all users then, not just logged in ones?" Can what be shown? [18:08:59] legoktm: The logo badge? Already done. [18:09:04] 10Beta-Cluster, 10MediaWiki-extensions-MwEmbedSupport, 10VisualEditor: TypeError: Cannot read property 'split' of undefined - https://phabricator.wikimedia.org/T107968#1511698 (10greg) (Is this a bug in EmbedSupport or VE or Beta Cluster?) [18:09:05] Krinkle: ok, thanks [18:09:41] greg-g: It's one of 4+ UBN bugs caused by the RL async change in MW, probably. [18:11:23] 6Release-Engineering, 6Analytics-Backlog, 6operations, 7Varnish: Verify traffic to static resources from past branches does indeed drain - https://phabricator.wikimedia.org/T102991#1511716 (10Krinkle) [18:11:26] 10Deployment-Systems, 10Traffic, 6operations: Varnish cache busting desired for /static/$VERSION/ resources which change within the lifetime of a WMF release branch - https://phabricator.wikimedia.org/T99096#1511715 (10Krinkle) [18:11:40] James_F: kk, ty [18:12:07] manually applying puppet on deployment-cache-text02 is giving me "Could not retrieve catalog from remote server: Error 400 on SERVER: Could not find class role::tlsproxy::ssl::beta for deployment-cache-text02.deployment-prep.eqiad.wmflabs on node deployment-cache-text02.deployment-prep.eqiad.wmflabs" [18:12:20] greg-g: Lots of work to do to ensure that next Tuesday isn't a complete disaster. :-( [18:12:30] duly noted [18:13:37] 10Beta-Cluster, 10MediaWiki-extensions-MwEmbedSupport, 10VisualEditor: TypeError: Cannot read property 'split' of undefined - https://phabricator.wikimedia.org/T107968#1511734 (10Josve05a) >>! In T107968#1511698, @greg wrote: > (Is this a bug in EmbedSupport or VE or Beta Cluster?) I Ithink it is a bug in #... [18:22:24] marxarelli: probably part of https://gerrit.wikimedia.org/r/#/c/222124/ ? [18:23:51] thcipriani: oof. yeah, maybe [18:24:09] man, i hate puppet's reporting [18:24:28] it always seems to give you way too much info where you don't need it, and too little where you do [18:25:34] marxarelli: well, it looks like neither of manifests/role/protoproxy.pp nor manifests/role/tlsproxy.pp exist on deployment-puppetmaster so it's at least accurate... [18:29:03] thcipriani: puppet apologist :P [18:30:00] more general likely: techno-apologist [18:31:13] 6Release-Engineering, 6Commons, 10MediaWiki-File-management, 10MediaWiki-Tarball-Backports, and 7 others: InstantCommons broken by switch to HTTPS - https://phabricator.wikimedia.org/T102566#1511799 (10Tgr) It sounds like you already had that commit locally. How did you install MediaWiki, tarballs or a git... [18:32:07] marxarelli: well, this would be why that file doesn't exist: https://gerrit.wikimedia.org/r/#/c/227404/ [18:33:00] sure does! "D manifests/role/tlsproxy.pp" [18:33:43] thcipriani: so can we safely remove rol::tlsproxy::ssl::beta from the cache nodes? [18:34:06] the changes to staging.yaml suggest so https://gerrit.wikimedia.org/r/#/c/227404/3/nodes/labs/staging.yaml [18:35:59] marxarelli: sure, also this may be moot with ostriches recent work on jessie caches [18:40:59] Yeah [18:41:13] That stuff's wrapped in properly into the jessie manifests now, those roles are obsolete. [18:41:34] where do statsd request from the beta cluster end up? [18:42:21] ostriches: great. i'll disable em! [18:44:58] ostriches: worked, but getting some new puppet failures [18:45:12] "Error: /Stage[main]/Role::Cache::Statsd::Frontend/Varnish::Logging::Xcps[xcps]/Base::Service_unit[varnishxcps]/Service[varnishxcps]: Could not evaluate: Could not find init script or upstart conf file for 'varnishxcps'" [18:45:16] On which nodes now? [18:45:24] deployment-cache-text02 [18:45:32] We can probably decom today [18:45:34] I wouldn't worry [18:45:41] We're already pointing at 04s. [18:46:29] Just need to confirm purges are working and that browser tests are ok [18:46:39] alrighty [18:47:04] labmon1001 apparently, but how does one access that? [18:48:49] Yippee, build fixed! [18:48:49] Project browsertests-MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-firefox-sauce build #776: FIXED in 36 min: https://integration.wikimedia.org/ci/job/browsertests-MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-firefox-sauce/776/ [18:50:25] tgr: this is all I really know about labmon1001: https://graphite.wmflabs.org/ [18:57:00] hello releng [18:57:06] https://wikitech.wikimedia.org/wiki/Nova_Resource:Quality-assurance was Chris' project, can it be killed now? [18:57:10] it's got lucid instances going on eugh [18:57:15] so most can't be ssh'd in anyway [18:57:15] thcipriani: yeah, I found that one, but it does not seem to contain metrics recorded via RequestContext::getStats() in MediaWiki [18:58:45] greg-g: ^ [18:59:31] bd808: any clue where to look for records from https://phabricator.wikimedia.org/T91701 on labs? [19:01:21] YuviPanda: email QA list [19:02:37] greg-g: good point, let me [19:02:48] :) [19:03:39] 6Release-Engineering, 6Labs: Cleanup quaity-assurance labs project - https://phabricator.wikimedia.org/T108087#1511967 (10yuvipanda) 3NEW [19:05:37] greg-g: done :) do you know if chris is still around at wikimedia doing stuff as a volunteer? I haven't seen him in ages [19:05:53] YuviPanda: he's replied on list once or twice, but that's it [19:06:47] ok [19:07:48] 10Continuous-Integration-Infrastructure: Provide a way to have a demo directory alongside the documentation on doc.wikimedia.org - https://phabricator.wikimedia.org/T62143#1511982 (10Krinkle) [19:07:52] 10Continuous-Integration-Infrastructure, 10OOjs-UI, 5Patch-For-Review, 7developer-notice: Publish the JS and PHP demos for OOjs UI on doc.wikimedia.org - https://phabricator.wikimedia.org/T102316#1511985 (10Krinkle) [19:07:54] 10Continuous-Integration-Infrastructure: Provide a way to have a demo directory alongside the documentation on doc.wikimedia.org - https://phabricator.wikimedia.org/T62143#1511984 (10Krinkle) 5Open>3Resolved [19:08:47] 6Release-Engineering, 6Labs: Cleanup quaity-assurance labs project - https://phabricator.wikimedia.org/T108087#1511987 (10dduvall) I don't //think// it's used, but @zeljkofilipin might know better. [19:21:01] Jenkins phpunit issues? https://integration.wikimedia.org/ci/job/mwext-testextension-zend/5912/console [19:26:03] Yippee, build fixed! [19:26:04] Project browsertests-MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-chrome-sauce build #741: FIXED in 28 min: https://integration.wikimedia.org/ci/job/browsertests-MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-chrome-sauce/741/ [19:26:55] AndyRussG: that instance rebooted today, guessing mysql was supposed to come up and didn't [19:28:58] 6Release-Engineering, 6Analytics-Backlog, 6operations, 7Varnish: Verify traffic to static resources from past branches does indeed drain - https://phabricator.wikimedia.org/T102991#1512047 (10Krinkle) Raising priority and adding to #Performance-Team workboard. The fact that our front ends seem to be servin... [19:29:10] 6Release-Engineering, 6Performance-Team, 6operations, 7Varnish: Verify traffic to static resources from past branches does indeed drain - https://phabricator.wikimedia.org/T102991#1512048 (10Krinkle) p:5Triage>3High [19:30:41] tgr: I was wondering about that myself. I'm not sure that we have a graphite server in beta cluster at all right now [19:31:23] I think I deleted it when labmon1001 came online [19:31:27] I might not have, don't remember [19:33:44] * bd808 hunts around on https://graphite.wmflabs.org/dashboard/ [19:38:34] tgr: Looks like beta clsuter doesn't override $wgStatsdServer [19:38:53] so the packets get thrown towards prod and lost in the either right now [19:39:13] Looks like ci slaves are having problems. getting false failures about mediawiki not being able to connect to MySQL [19:39:34] Krinkle: yeah, it's precise-1012 [19:39:42] Affecting precise slaves [19:39:42] it was rebooted, didn't come up quite right [19:39:43] what happened [19:39:49] So depool? [19:39:54] should be temp offline [19:39:56] Thx [19:40:04] thanks for the heads-up [19:40:06] thcipriani: thx also [19:40:11] YuviPanda: so should beta cluster be pointing at labmon1001 as a statsd server? [19:40:19] yup [19:40:23] labmon1001.eqiad.wmnet [19:40:26] AndyRussG: good looking-out :) [19:40:26] k [19:41:47] not much to it! ;p [19:41:56] 10Beta-Cluster: Configure beta cluster to use labmon1001.eqiad.wmnet as statsd server - https://phabricator.wikimedia.org/T108091#1512088 (10bd808) 3NEW a:3bd808 [19:42:08] 10Beta-Cluster: Configure beta cluster to use labmon1001.eqiad.wmnet as statsd server - https://phabricator.wikimedia.org/T108091#1512097 (10bd808) [20:00:03] !log restarting integration puppetmaster memory usage way high [20:00:09] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL, Master [20:43:55] !log marking integration-slave-precise-1012 back online, elasticsearch hung up on starting because /var/run/elasticsearch wasn't a directory :( [20:44:01] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL, Master [20:51:26] (03PS1) 10Cscott: Add job templates to publish Parsoid docs to doc.wikimedia.org [integration/config] - 10https://gerrit.wikimedia.org/r/229558 [21:14:08] 10Continuous-Integration-Infrastructure, 6Release-Engineering: automatically build and commit mediawiki/vendor (composer) - https://phabricator.wikimedia.org/T101123#1512379 (10csteipp) >>! In T101123#1493285, @JanZerebecki wrote: >>>! In T101123#1493245, @csteipp wrote: >> (pulled down with git, or some other... [21:19:01] 6Release-Engineering: Include links to unit testing (Emphasize testing documentation on mediawiki.org) - https://phabricator.wikimedia.org/T108105#1512410 (10ggellerman) 3NEW a:3dduvall [21:19:42] 6Release-Engineering: Guides for initializing a test suite: unit testing & browser testing - https://phabricator.wikimedia.org/T108107#1512426 (10ggellerman) 3NEW a:3dduvall [21:20:22] 6Release-Engineering: Improve documentation around running/writing (with lots of examples) browser tests - https://phabricator.wikimedia.org/T108108#1512435 (10ggellerman) 3NEW a:3dduvall [21:21:13] 6Release-Engineering: Improve browser testing page with templates : Emphasize testing documentation on mediawiki.org - https://phabricator.wikimedia.org/T108110#1512449 (10ggellerman) 3NEW a:3dduvall [21:21:30] 6Release-Engineering: Improve documentation around running/writing (with lots of examples) browser tests - https://phabricator.wikimedia.org/T108108#1512435 (10ggellerman) See: https://www.mediawiki.org/wiki/How_to_contribute [21:22:29] 6Release-Engineering: Improve documentation around running/writing (with lots of examples) browser tests - https://phabricator.wikimedia.org/T108108#1512459 (10dduvall) The existing landing page for browser tests (from "How to contribute") is https://www.mediawiki.org/wiki/Quality_Assurance/Browser_testing. I th... [21:24:49] 6Release-Engineering: Include links to unit testing (Emphasize testing documentation on mediawiki.org) - https://phabricator.wikimedia.org/T108105#1512474 (10ggellerman) see: https://www.mediawiki.org/wiki/How_to_contribute [21:33:49] 6Release-Engineering, 7Testing Initiative 2015: Improve browser testing page with templates : Emphasize testing documentation on mediawiki.org - https://phabricator.wikimedia.org/T108110#1512508 (10dduvall) [21:34:23] 6Release-Engineering, 7Testing Initiative 2015: Improve documentation around running/writing (with lots of examples) browser tests - https://phabricator.wikimedia.org/T108108#1512512 (10dduvall) [21:34:33] 6Release-Engineering, 7Testing Initiative 2015: Guides for initializing a test suite: unit testing & browser testing - https://phabricator.wikimedia.org/T108107#1512514 (10dduvall) [21:34:40] 6Release-Engineering, 7Testing Initiative 2015: Include links to unit testing (Emphasize testing documentation on mediawiki.org) - https://phabricator.wikimedia.org/T108105#1512516 (10dduvall) [21:37:39] 10Browser-Tests, 6Release-Engineering, 7Testing Initiative 2015: Improve documentation around running/writing (with lots of examples) browser tests - https://phabricator.wikimedia.org/T108108#1512533 (10greg) [21:37:48] 10Browser-Tests, 6Release-Engineering, 7Testing Initiative 2015: Improve browser testing page with templates : Emphasize testing documentation on mediawiki.org - https://phabricator.wikimedia.org/T108110#1512534 (10greg) [21:46:11] 6Release-Engineering, 6Team-Practices, 7Testing Initiative 2015: Talk to Greg and Arthur about Onboarding's role in establishing good testing practices/habits - https://phabricator.wikimedia.org/T108121#1512594 (10ggellerman) 3NEW a:3ggellerman [21:50:12] 6Release-Engineering, 6Team-Practices, 7Testing Initiative 2015: Follow up workshop & brown bag ideas from Testing: Where does it hurt? - https://phabricator.wikimedia.org/T108122#1512611 (10ggellerman) 3NEW [21:50:22] 6Release-Engineering, 6Team-Practices, 7Testing Initiative 2015: Talk to Greg and Arthur about Onboarding's role in establishing good testing practices/habits - https://phabricator.wikimedia.org/T108121#1512617 (10Awjrichards) A good person to bring this up with is @ALantz - I know she's working on stuff in... [21:52:25] 6Release-Engineering, 7Testing Initiative 2015: Ideas for future meetings like the "Testing: where does it hurt?" initiative - https://phabricator.wikimedia.org/T108125#1512640 (10ggellerman) 3NEW [22:13:03] 6Release-Engineering, 6Zero, 6operations, 7Mobile, 7Technical-Debt: Pull WikipediaMobileFirefoxOS from mediawiki-config - https://phabricator.wikimedia.org/T107172#1512747 (10jhobs) I was on vacation last week and am thus just getting to this now. I have a meeting with the Zero team tomorrow and I'll bri... [22:19:07] 6Release-Engineering, 6Team-Practices, 7Testing Initiative 2015: Follow up workshop & brown bag ideas from Testing: Where does it hurt? - https://phabricator.wikimedia.org/T108122#1512768 (10dduvall) [22:35:34] 6Release-Engineering, 6Zero, 6operations, 7Mobile, 7Technical-Debt: Pull WikipediaMobileFirefoxOS from mediawiki-config - https://phabricator.wikimedia.org/T107172#1512863 (10MaxSem) >>! In T107172#1489893, @demon wrote: >> is that actually receiving traffic? > > Good question. I hope not. ``` hive (d... [22:38:41] 10Continuous-Integration-Infrastructure, 6Release-Engineering: automatically build and commit mediawiki/vendor (composer) - https://phabricator.wikimedia.org/T101123#1512869 (10bd808) >>! In T101123#1493245, @csteipp wrote: > So let's make sure the process and review checkpoints are correct, and then we can fi... [22:41:30] Project browsertests-Flow-en.wikipedia.beta.wmflabs.org-linux-firefox-sauce build #757: STILL FAILING in 30 min: https://integration.wikimedia.org/ci/job/browsertests-Flow-en.wikipedia.beta.wmflabs.org-linux-firefox-sauce/757/ [23:00:15] 10Continuous-Integration-Infrastructure, 6Release-Engineering: automatically build and commit mediawiki/vendor (composer) - https://phabricator.wikimedia.org/T101123#1512932 (10csteipp) >>! In T101123#1512869, @bd808 wrote: > Does step 1 in this process rule out 3rd party libraries? Today I see 9 3rd party lib... [23:02:21] 10Deployment-Systems: [scap] New command to sync all of the files touched in a given commit - https://phabricator.wikimedia.org/T108132#1512954 (10bd808) 3NEW [23:09:47] bd808, would you have to worry about the order it ends up syncing each file in? [23:10:10] It could do them all at once, like sync-dir [23:10:22] we have the technology under the hood [23:10:26] jsut not in the UI [23:10:32] I've always wondered how sync-dir manages these problems as well to be honest [23:11:05] inode order most likely [23:12:16] (how you make the web server ignore all changes until the sync is fully completed, etc.) [23:23:42] Krenair: update-after (or whatever it is) in rsync, partly [23:23:58] ie: it copies all the data to a temp dir first, then, when it has it all, does a quick mv into place [23:26:26] that sounds like it greatly reduces the time window for issues, but does not completely solve it? [23:40:08] Krenair: without marking the server as offline, waiting for connections to drain, update, then repool, nope. [23:41:20] greg-g: Is that (depool/drain/update/repool) on the cards? [23:42:15] James_F|Away: medium-long term, yeah [23:43:19] James_F|Away: for the record, it's really useful for the services team, which is why it's part of our ongoing work right now [23:45:55] 6Release-Engineering, 10Continuous-Integration-Config, 3Mobile-App-Sprint-63-Android-Europium, 3Wikipedia-Android-App: Create jenkins slave instance dedicated to Android runs - https://phabricator.wikimedia.org/T107336#1513175 (10Niedzielski) @thcipriani, thanks for picking this up! > sudo mv /mnt/jenkins... [23:47:01] 6Release-Engineering, 10Continuous-Integration-Config, 3Mobile-App-Sprint-63-Android-Europium, 3Wikipedia-Android-App: Create jenkins slave instance dedicated to Android runs - https://phabricator.wikimedia.org/T107336#1513179 (10Niedzielski) I forgot to link to the build output earlier. Here's one example...