[00:15:56] 10Deployment-Systems, 3Scap3: (Re)implement logging output for scap targets - https://phabricator.wikimedia.org/T115137#1727009 (10dduvall) [00:26:38] 10MediaWiki-Releasing, 6Release-Engineering-Team, 7Security-Other: Add patch support to make-release - https://phabricator.wikimedia.org/T115493#1727044 (10csteipp) That sounds nice. My only suggestion would be to have the branch name significant in the filename, so we can have a directory of all the patche... [00:34:20] 10MediaWiki-Releasing, 6Release-Engineering-Team, 7Security-Other: Add patch support to make-release - https://phabricator.wikimedia.org/T115493#1727078 (10demon) Will do. I figured originally you'd just have a tree per release but that makes even more sense. [00:55:38] PROBLEM - Puppet staleness on integration-dev is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [43200.0] [02:58:29] PROBLEM - Free space - all mounts on deployment-bastion is CRITICAL: CRITICAL: deployment-prep.deployment-bastion.diskspace._var.byte_percentfree (<40.00%) [03:41:35] 10MediaWiki-Codesniffer: Using context variable when usable instead of globals - https://phabricator.wikimedia.org/T115433#1727257 (10TasneemLo) [04:19:22] !log Freed 290M on deployment-bastion:/var by deleting old pacct files [04:19:32] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL, Master [04:23:29] Yippee, build fixed! [04:23:29] Project browsertests-MultimediaViewer-en.wikipedia.beta.wmflabs.org-windows_7-internet_explorer-9-sauce build #592: 09FIXED in 31 min: https://integration.wikimedia.org/ci/job/browsertests-MultimediaViewer-en.wikipedia.beta.wmflabs.org-windows_7-internet_explorer-9-sauce/592/ [04:28:26] RECOVERY - Free space - all mounts on deployment-bastion is OK: OK: All targets OK [04:34:15] !log freed another 258M on deployment-bastion by forcing an early rotation of /var/log/account/pacct and deleting the archived copy [04:34:18] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL, Master [05:26:13] Project browsertests-MultimediaViewer-en.wikipedia.beta.wmflabs.org-windows_7-internet_explorer-11-sauce build #572: 04FAILURE in 24 min: https://integration.wikimedia.org/ci/job/browsertests-MultimediaViewer-en.wikipedia.beta.wmflabs.org-windows_7-internet_explorer-11-sauce/572/ [06:17:14] 7Blocked-on-RelEng, 10Deployment-Systems, 3Scap3, 6Discovery: Create deployment for wikimedia/portals - https://phabricator.wikimedia.org/T114694#1727350 (10EBernhardson) For our planning purposes, what kind of timeline should we plan for to be able to deploy the portal via scap3? [07:54:17] 10Continuous-Integration-Infrastructure, 10Wikimedia-Fundraising-CiviCRM: CI for Civi: provision and run tests under Jenkins/Zuul - https://phabricator.wikimedia.org/T86103#1727426 (10hashar) A left over task is {T91911} it has a pull request with upstream. @awight let us know if you need any more support / t... [08:18:19] 10Continuous-Integration-Infrastructure, 6Commons, 6Multimedia, 10UploadWizard: UploadWizard API smoke tests falling because Selenium_user has been blocked on commons.wikimedia.org - https://phabricator.wikimedia.org/T115465#1727459 (10hashar) > I disagree. If we can't use Beta Cluster / Staging to tell us... [08:32:58] Project browsertests-MultimediaViewer-en.wikipedia.beta.wmflabs.org-os_x_10.9-safari-sauce build #752: 04FAILURE in 22 min: https://integration.wikimedia.org/ci/job/browsertests-MultimediaViewer-en.wikipedia.beta.wmflabs.org-os_x_10.9-safari-sauce/752/ [08:54:02] 10Browser-Tests, 10MediaWiki-extensions-WikibaseRepository, 10Wikidata, 3Wikidata-Sprint-2015-10-13: failed Description with a too long value - https://phabricator.wikimedia.org/T115499#1727478 (10Tobi_WMDE_SW) I've executed the test from my local machine and tested beta.wikidata, but that worked for me. [08:56:00] (03PS1) 10Hashar: Drop ruby1.9.3 linter [integration/config] - 10https://gerrit.wikimedia.org/r/246669 [08:56:30] (03CR) 10Hashar: "I have deleted the left over jobs:" [integration/config] - 10https://gerrit.wikimedia.org/r/246669 (owner: 10Hashar) [08:57:59] (03CR) 10Hashar: [C: 032] Drop ruby1.9.3 linter [integration/config] - 10https://gerrit.wikimedia.org/r/246669 (owner: 10Hashar) [08:58:56] (03Merged) 10jenkins-bot: Drop ruby1.9.3 linter [integration/config] - 10https://gerrit.wikimedia.org/r/246669 (owner: 10Hashar) [10:11:06] 10Continuous-Integration-Config, 6Commons, 6Multimedia, 10UploadWizard: Adjust UploadWizard API test suite to match commons.wikimedia.org policy for bots - https://phabricator.wikimedia.org/T115469#1727595 (10Steinsplitter) p:5Normal>3High Please fix this ASAP: The Sellenium account is editing again. [11:06:54] (03CR) 10Zfilipin: [C: 031] "Looks good to me in general. Just to make it clear, the rake-jessie job will fail if a repo does not have rake in Gemfile and Rakefile, ri" [integration/config] - 10https://gerrit.wikimedia.org/r/246268 (https://phabricator.wikimedia.org/T114860) (owner: 10Hashar) [12:19:04] 10Continuous-Integration-Config, 6Commons, 6Multimedia, 10UploadWizard: Adjust UploadWizard API test suite to match commons.wikimedia.org policy for bots - https://phabricator.wikimedia.org/T115469#1727842 (10Luke081515) Maybe T115370 is also about this. [12:26:46] 10Beta-Cluster-Infrastructure, 10Browser-Tests: Give selenium users botflags at beta-cluster to allow them to hide their edits at the recent-changes - https://phabricator.wikimedia.org/T115370#1727877 (10zeljkofilipin) [12:38:28] 10Beta-Cluster-Infrastructure, 10ContentTranslation-Deployments, 10Wikimedia-Site-Requests, 5Patch-For-Review: Put beta eswiki to read-only mode - https://phabricator.wikimedia.org/T109157#1727903 (10Luke081515) 5Resolved>3Open > 15. Okt. 2015, 08:43:27‎ 23.105.150.137 (Diskussion | Sperren)‎ . . (3.40... [12:41:26] 10Beta-Cluster-Infrastructure, 10ContentTranslation-Deployments, 10Wikimedia-Site-Requests, 5Patch-For-Review: Put beta eswiki to read-only mode - https://phabricator.wikimedia.org/T109157#1727915 (10Luke081515) There are account creations too [12:44:08] 10Continuous-Integration-Config, 6Commons, 6Multimedia, 10UploadWizard: Adjust UploadWizard API test suite to match commons.wikimedia.org policy for bots - https://phabricator.wikimedia.org/T115469#1727927 (10Steinsplitter) >>! In T115469#1727842, @Luke081515 wrote: > T115370 is about this problem too. Th... [12:49:57] (03PS5) 10Addshore: Sniff to check assignment in while & if [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/237902 (https://phabricator.wikimedia.org/T92744) (owner: 10TasneemLo) [12:55:17] 10Beta-Cluster-Infrastructure: closed-labs.dblist no longer read as 'closed' tag - https://phabricator.wikimedia.org/T115584#1727961 (10Luke081515) 3NEW a:3ori [12:56:42] 10Beta-Cluster-Infrastructure, 10ContentTranslation-Deployments, 10Wikimedia-Site-Requests, 5Patch-For-Review: Put beta eswiki to read-only mode - https://phabricator.wikimedia.org/T109157#1727971 (10Luke081515) [12:56:44] 10Beta-Cluster-Infrastructure: closed-labs.dblist no longer read as 'closed' tag - https://phabricator.wikimedia.org/T115584#1727970 (10Luke081515) [12:56:52] 10Beta-Cluster-Infrastructure: closed-labs.dblist no longer read as 'closed' tag - https://phabricator.wikimedia.org/T115584#1727961 (10Luke081515) [12:56:54] 10Beta-Cluster-Infrastructure, 10ContentTranslation-Deployments, 10Wikimedia-Site-Requests, 5Patch-For-Review: Put beta eswiki to read-only mode - https://phabricator.wikimedia.org/T109157#1541866 (10Luke081515) [12:57:09] 10Beta-Cluster-Infrastructure: closed-labs.dblist no longer read as 'closed' tag - https://phabricator.wikimedia.org/T115584#1727961 (10Luke081515) [12:57:11] 10Beta-Cluster-Infrastructure, 10ContentTranslation-Deployments, 10Wikimedia-Site-Requests, 5Patch-For-Review: Put beta eswiki to read-only mode - https://phabricator.wikimedia.org/T109157#1541866 (10Luke081515) [12:57:19] wrong direction... [12:57:29] 10Beta-Cluster-Infrastructure, 10ContentTranslation-Deployments, 10Wikimedia-Site-Requests, 5Patch-For-Review: Put beta eswiki to read-only mode - https://phabricator.wikimedia.org/T109157#1727977 (10Krenair) 5Open>3Resolved [12:57:37] 10Beta-Cluster-Infrastructure: closed-labs.dblist no longer read as 'closed' tag - https://phabricator.wikimedia.org/T115584#1727979 (10Krenair) [12:57:40] 10Beta-Cluster-Infrastructure, 10ContentTranslation-Deployments, 10Wikimedia-Site-Requests, 5Patch-For-Review: Put beta eswiki to read-only mode - https://phabricator.wikimedia.org/T109157#1541866 (10Krenair) [12:57:51] 10MediaWiki-Codesniffer, 10Possible-Tech-Projects, 3Outreachy-Round-11: Outreachy proposal for : Improving static analysis tools for MediaWiki - https://phabricator.wikimedia.org/T115585#1727980 (10TasneemLo) 3NEW [14:44:13] 6Release-Engineering-Team, 6operations: Monitor Phabricator and Gerrit availability - https://phabricator.wikimedia.org/T115611#1728229 (10ori) 3NEW [14:58:29] (03PS3) 10Paladox: [SacredText] Update Jenkins tests [integration/config] - 10https://gerrit.wikimedia.org/r/245967 [14:58:46] (03PS3) 10Paladox: [ArticleComments] Update Jenkins tests [integration/config] - 10https://gerrit.wikimedia.org/r/246170 [14:59:53] (03PS3) 10Paladox: [Flow] Update Jenkins tests [integration/config] - 10https://gerrit.wikimedia.org/r/246426 [15:02:11] (03CR) 10Paladox: "Qunit test passes it is this one." [integration/config] - 10https://gerrit.wikimedia.org/r/245493 (owner: 10Paladox) [15:28:43] bd808: Our stats worked for hhvm bucket. Guess we have no OOMs to track yet. [15:29:25] logstash.rate.hhvm.{FATAL,NOTICE,WARNING} all have stats on wmflabs graphite. [15:29:33] hmm... can we trigger some with video transcodes? [15:30:46] Could do it even easier with eval.php [15:30:57] Set memory_limit() to something absurdly low, do anything :p [15:31:09] It would be good to see some get classified I think [15:31:26] We won't get to deploy before Monday anyway [15:32:42] > ini_set('memory_limit','1K'); [15:32:42] > $foo = array_fill( 0, 100000, 'fooooooooooo' ); [15:32:42] Fatal error: Allowed memory size of 262144 bytes exhausted (tried to allocate 1048576 bytes) in /mnt/srv/mediawiki-staging/php-master/maintenance/eval.php(78) : eval()'d code on line 1 [15:32:44] lol [15:33:32] Hmm nerp [15:34:37] what host did you do that on? [15:34:51] I'm not sure that deployment-bastion is running hhvm [15:34:58] actually I'm pretty sure that it is not [15:35:18] Yeah, that was bast [15:35:35] do the same from one of the mw hosts [15:38:01] eval.php doesn't wanna start on hhvm, ouch. [15:38:26] https://phabricator.wikimedia.org/P2204 [15:38:50] try sudo as www-data [15:39:03] that should be the owner of the the shared hhbc cache [15:39:27] Ah much better [15:39:38] mwscript told me to use 'apache' [15:39:39] :p [15:39:48] old version [15:40:06] we stopped provisioning mwscript on w nodes [15:40:18] but we didn't clean up the old crap verison [15:40:32] I ran it directly out of multiversion [15:40:37] I knew it wasn't in $PATH anymore [15:41:49] I got no OOM in logstash or graphite, hrm [15:45:41] 10Browser-Tests, 10reading-web-sprint-58-The-Sixth-Sense: QA: Page diff test failing on integration.wikimedia.org but not on merge - https://phabricator.wikimedia.org/T115486#1728349 (10Jdlrobson) a:3Jdlrobson [16:03:14] PROBLEM - Puppet failure on integration-slave-jessie-1001 is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [0.0] [16:03:14] PROBLEM - Puppet failure on deployment-parsoidcache02 is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [0.0] [16:06:48] 10Browser-Tests, 5Patch-For-Review, 10reading-web-sprint-58-The-Sixth-Sense: QA: Page diff test failing on integration.wikimedia.org but not on merge - https://phabricator.wikimedia.org/T115486#1728403 (10Jdlrobson) [16:07:48] 10Browser-Tests, 5Patch-For-Review, 10reading-web-sprint-58-The-Sixth-Sense: QA: Page diff test failing on integration.wikimedia.org but not on merge - https://phabricator.wikimedia.org/T115486#1725428 (10Jdlrobson) Before debugging some more, and not being able to find anything obvious, I've triggered a new... [16:16:32] 10Gerrit-Migration, 6Release-Engineering-Team, 10Diffusion: Have Phabricator take over replication to Github - https://phabricator.wikimedia.org/T115624#1728437 (10demon) 3NEW [16:56:28] Yippee, build fixed! [16:56:28] Project browsertests-Wikidata-WikidataTests-linux-firefox-sauce-T110510 build #4: 09FIXED in 45 sec: https://integration.wikimedia.org/ci/job/browsertests-Wikidata-WikidataTests-linux-firefox-sauce-T110510/4/ [16:58:36] Yippee, build fixed! [16:58:36] Project browsertests-MobileFrontend-SmokeTests-linux-chrome-sauce build #293: 09FIXED in 8 min 14 sec: https://integration.wikimedia.org/ci/job/browsertests-MobileFrontend-SmokeTests-linux-chrome-sauce/293/ [16:59:11] 6Release-Engineering-Team: [EPIC] Enforce "no increase in log errors" during deployments - https://phabricator.wikimedia.org/T115629#1728598 (10greg) 3NEW [17:00:11] 6Release-Engineering-Team: Reduce production log errors to zero* - https://phabricator.wikimedia.org/T115630#1728605 (10greg) 3NEW [17:00:34] 6Release-Engineering-Team: Implement "WMF Log Errors count" KPI - https://phabricator.wikimedia.org/T108749#1728614 (10greg) [17:00:35] 6Release-Engineering-Team: Reduce production log errors to zero* - https://phabricator.wikimedia.org/T115630#1728605 (10greg) [17:03:56] 6Release-Engineering-Team: Proposal: Reroute all requests from WMF Office IPs to mw1017 - https://phabricator.wikimedia.org/T115631#1728630 (10greg) 3NEW [17:04:10] ^^ outcome of morning chatting in the office [17:07:08] 6Release-Engineering-Team, 6operations: Proposal: Reroute all requests from WMF Office IPs to mw1017 - https://phabricator.wikimedia.org/T115631#1728646 (10Krenair) [17:08:31] 10Beta-Cluster-Infrastructure, 6Release-Engineering-Team: Proposal: Force any WARNINGs on Beta Cluster to fail completely - https://phabricator.wikimedia.org/T115633#1728651 (10greg) 3NEW [17:10:13] 6Release-Engineering-Team, 6operations: Proposal: Reroute all requests from WMF Office IPs to mw1017 - https://phabricator.wikimedia.org/T115631#1728662 (10MaxSem) While defnitely interesting, this idea has its own downsides that need to be weightened - namely, that if something goes out of sync between mw1017... [17:11:36] 6Release-Engineering-Team, 6operations: Proposal: Reroute all requests from WMF Office IPs to mw1017 - https://phabricator.wikimedia.org/T115631#1728667 (10greg) [17:12:31] 10Browser-Tests, 10Wikidata, 5Patch-For-Review, 3Wikidata-Sprint-2015-10-13: [Bug] fix negative argument (ArgumentError) in browsertests - https://phabricator.wikimedia.org/T110510#1728681 (10dduvall) @zeljkofilipin and I paired on this today and discovered that commenting out `RAITA_URL` avoids the bug, s... [17:13:28] 6Release-Engineering-Team, 6operations: Proposal: Reroute all requests from WMF Office IPs to mw1017 - https://phabricator.wikimedia.org/T115631#1728630 (10greg) [17:20:35] 6Release-Engineering-Team, 6operations: Proposal: Reroute all requests from WMF Office IPs to mw1017 - https://phabricator.wikimedia.org/T115631#1728699 (10Joe) I think this has way more downsides than upsides. I strongly recommend against this. [17:21:12] 6Release-Engineering-Team, 6operations: Proposal: Reroute all requests from WMF Office IPs to mw1017 - https://phabricator.wikimedia.org/T115631#1728700 (10Krenair) What about the ability to use X-Wikimedia-Debug: 0 to disable any automatic(?) use of mw1017? [17:21:50] 6Release-Engineering-Team, 6operations: Proposal: Reroute all requests from WMF Office IPs to mw1017 - https://phabricator.wikimedia.org/T115631#1728704 (10greg) >>! In T115631#1728699, @Joe wrote: > I think this has way more downsides than upsides. I strongly recommend against this. without actually enumerat... [17:22:16] 6Release-Engineering-Team, 6operations: Proposal: Reroute all requests from WMF Office IPs to mw1017 - https://phabricator.wikimedia.org/T115631#1728705 (10greg) >>! In T115631#1728700, @Krenair wrote: > What about the ability to use X-Wikimedia-Debug: 0 to disable any automatic(?) use of mw1017? Right, there... [17:26:45] 6Release-Engineering-Team, 6operations: Proposal: Reroute all requests from WMF Office IPs to mw1017 - https://phabricator.wikimedia.org/T115631#1728720 (10Joe) >>! In T115631#1728704, @greg wrote: >>>! In T115631#1728699, @Joe wrote: >> I think this has way more downsides than upsides. I strongly recommend ag... [17:32:56] 6Release-Engineering-Team, 6operations: Proposal: Reroute all requests from WMF Office IPs to mw1017 - https://phabricator.wikimedia.org/T115631#1728740 (10greg) >>! In T115631#1728720, @Joe wrote: > - mw1017 runs a version of mediawiki that is ahead of the version actually run on the major wikis; bugs with co... [17:33:11] 6Release-Engineering-Team, 6operations: Proposal: Reroute all requests from WMF Office IPs to a machine/machines similar to mw1017 - https://phabricator.wikimedia.org/T115631#1728742 (10greg) [17:40:54] 10Browser-Tests, 10Wikidata, 5Patch-For-Review, 3Wikidata-Sprint-2015-10-13: [Bug] fix negative argument (ArgumentError) in browsertests - https://phabricator.wikimedia.org/T110510#1728748 (10dduvall) After some further debugging, we've narrowed it down to the `--expand` option that the Raita formatter for... [17:42:00] 6Release-Engineering-Team, 6operations: Proposal: Reroute all requests from WMF Office IPs to a machine/machines similar to the canary cluster - https://phabricator.wikimedia.org/T115631#1728750 (10Joe) [17:48:07] (03PS1) 10Paladox: [WebPlatformAuth] Update Jenkins tests [integration/config] - 10https://gerrit.wikimedia.org/r/246712 (https://phabricator.wikimedia.org/T115061) [17:51:39] 6Release-Engineering-Team, 6operations: Proposal: Reroute all requests from WMF Office IPs to a machine/machines similar to the canary cluster - https://phabricator.wikimedia.org/T115631#1728765 (10greg) [17:53:38] 10Continuous-Integration-Config, 5Patch-For-Review: replace Jenkins job mwext-testextension-zend by mwext-testextension-zend-composer - https://phabricator.wikimedia.org/T115061#1728771 (10Paladox) It should work without that test. Even that test was causing it fail the same way. Ive fixed it in a patched link... [18:01:42] Can somebody take a look at https://gerrit.wikimedia.org/r/#/c/246709/ ? [18:06:19] Luke081515: should be fine for a deploy on Monday [18:06:38] Thanks [18:12:28] twentyafterfour: I could've sworn I got an e-mail saying you left comments on https://gerrit.wikimedia.org/r/#/c/227489/, but I can't find said comments. [18:12:32] Am I blind? Crazy? [18:12:35] All of the above? [18:13:05] Er, july 20-something. [18:13:08] stupid e-mail [18:30:44] Yippee, build fixed! [18:30:45] Project browsertests-CentralNotice-en.wikipedia.beta.wmflabs.org-linux-firefox-sauce build #471: 09FIXED in 44 sec: https://integration.wikimedia.org/ci/job/browsertests-CentralNotice-en.wikipedia.beta.wmflabs.org-linux-firefox-sauce/471/ [18:31:31] twentyafterfour: hey! any news about https://phabricator.wikimedia.org/T114694 ? [18:39:53] 6Release-Engineering-Team, 6operations: Proposal: Reroute all requests from WMF Office IPs to a machine/machines similar to the canary cluster - https://phabricator.wikimedia.org/T115631#1728863 (10Krenair) >>! In T115631#1728740, @greg wrote: >>>! In T115631#1728720, @Joe wrote: >> - mw1017 runs a version of... [18:41:55] We just got a really creepy build failure, https://integration.wikimedia.org/ci/job/npm/31617/console "npm ERR! EEXIST, symlink '../esprima/bin/esparse.js' [18:42:23] I overrode for now, but I hope this was spurious... [18:44:22] oh my [18:44:24] not that again [18:45:26] awight: https://phabricator.wikimedia.org/T90816 [18:46:02] there's a long upstream npm ticket about it [18:46:34] oh dear, thx for the info! [18:51:14] 10Continuous-Integration-Infrastructure, 5Patch-For-Review, 7Upstream: Fails npm build failure "File exists: ../esprima/bin/esparse.js" - https://phabricator.wikimedia.org/T90816#1728898 (10awight) Another example, this time because our library was out-of-date: https://integration.wikimedia.org/ci/job/npm/31... [18:51:45] Commented on the bug just to encourage better shared CI glue reuse [18:55:00] 10Continuous-Integration-Config, 10Fundraising-Backlog: Use the name "grunt-jscs" in all Fundraising CI glue - https://phabricator.wikimedia.org/T115642#1728902 (10awight) 3NEW [18:56:01] 10Continuous-Integration-Config, 10Fundraising-Backlog: Use the name "grunt-jscs" in all Fundraising CI glue - https://phabricator.wikimedia.org/T115642#1728909 (10awight) [18:59:45] 7Blocked-on-RelEng, 10Deployment-Systems, 3Scap3, 6Discovery: Create deployment for wikimedia/portals - https://phabricator.wikimedia.org/T114694#1728913 (10bd808) >>! In T114694#1703156, @mmodell wrote: > I'd really like to see this use #scap3 for deployment. If they want content on all Apache servers th... [19:09:38] 10Browser-Tests, 10MediaWiki-extensions-ContentTranslation, 5Patch-For-Review, 7WorkType-Maintenance: Delete failing ContentTranslation browsertests Jenkins jobs - https://phabricator.wikimedia.org/T113734#1728951 (10Amire80) [19:18:32] 10Browser-Tests, 10MediaWiki-extensions-ContentTranslation, 5Patch-For-Review, 7WorkType-Maintenance: Update ContentTranslation mediawiki_selenium Ruby gem to version 1.x - https://phabricator.wikimedia.org/T115319#1729005 (10Amire80) [19:18:43] 10Browser-Tests, 10MediaWiki-extensions-ContentTranslation, 5Patch-For-Review, 7Technical-Debt, 7WorkType-Maintenance: Update ContentTranslation mediawiki_selenium Ruby gem to version 1.x - https://phabricator.wikimedia.org/T115319#1721088 (10Amire80) [19:59:27] (03PS1) 10Paladox: [EventLogging] Add jsduck test [integration/config] - 10https://gerrit.wikimedia.org/r/246773 (https://phabricator.wikimedia.org/T88343) [20:06:48] (03PS1) 10Paladox: Add new template flake8-py27 [integration/config] - 10https://gerrit.wikimedia.org/r/246776 [20:07:33] 10Browser-Tests, 5Testing Initiative 2015: Experiment with browser testing in other software languages - https://phabricator.wikimedia.org/T108874#1729165 (10ggellerman) This also came up in the RelEng <-> VE SLU discussion: [20:33:49] !log cherry-picked https://gerrit.wikimedia.org/r/#/c/240888/1 to deployment-puppetmaster.eqiad.wmflabs to test portal deployment [20:33:52] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL, Master [20:40:22] 10MediaWiki-Codesniffer, 10MediaWiki-extensions-TimedMediaHandler: Fatal error: Maximum function nesting level of '100' reached, aborting! in /mnt/jenkins-workspace/workspace/php-composer-test/vendor/squizlabs/php_codesniffer/CodeSniffer/File.php on line 2197 - https://phabricator.wikimedia.org/T115651#1729256... [20:41:13] 10MediaWiki-Codesniffer, 10MediaWiki-extensions-TimedMediaHandler: Fatal error: Maximum function nesting level of '100' reached, aborting! in /mnt/jenkins-workspace/workspace/php-composer-test/vendor/squizlabs/php_codesniffer/CodeSniffer/File.php on line 2197 - https://phabricator.wikimedia.org/T115651#1729264... [20:41:37] 10MediaWiki-Codesniffer, 10MediaWiki-extensions-TimedMediaHandler: Fatal error: Maximum function nesting level of '100' reached, aborting! in /mnt/jenkins-workspace/workspace/php-composer-test/vendor/squizlabs/php_codesniffer/CodeSniffer/File.php on line 2197 - https://phabricator.wikimedia.org/T115651#1729267... [20:41:44] 10MediaWiki-Codesniffer, 10MediaWiki-extensions-TimedMediaHandler: Fatal error: Maximum function nesting level of '100' reached, aborting! in /mnt/jenkins-workspace/workspace/php-composer-test/vendor/squizlabs/php_codesniffer/CodeSniffer/File.php on line 2197 - https://phabricator.wikimedia.org/T115651#1729269... [20:44:25] 10MediaWiki-Codesniffer, 10MediaWiki-extensions-TimedMediaHandler: Fatal error: Maximum function nesting level of '100' reached, aborting! in /mnt/jenkins-workspace/workspace/php-composer-test/vendor/squizlabs/php_codesniffer/CodeSniffer/File.php on line 2197 - https://phabricator.wikimedia.org/T115651#1729280... [20:46:40] 10MediaWiki-Codesniffer, 10MediaWiki-extensions-TimedMediaHandler: Fatal error: Maximum function nesting level of '100' reached, aborting! in /mnt/jenkins-workspace/workspace/php-composer-test/vendor/squizlabs/php_codesniffer/CodeSniffer/File.php on line 2197 - https://phabricator.wikimedia.org/T115651#1729288... [20:48:39] 10MediaWiki-Codesniffer, 10MediaWiki-extensions-TimedMediaHandler: Fatal error: Maximum function nesting level of '100' reached, aborting! - https://phabricator.wikimedia.org/T115651#1729308 (10Reedy) [20:48:39] TOO LONG [20:50:34] what the [20:54:05] hey all, what would be the best way to reset varnish cache for http://www.wikipedia.beta.wmflabs.org/ ? [20:58:04] restart varnish ;D [20:58:33] Probably use purgeList.php maintenance script [21:05:47] Reedy: I'm not sure which varnish is that... does beta has its own varnish setup? [21:07:34] the phpcs thing passes fine locally, but I'm on 5.6 [21:07:44] 21:07:22 Processing module.audio-video.quicktime.php PHP Fatal error: Maximum function nesting level of '100' reached, aborting! in /mnt/jenkins-workspace/workspace/php-composer-test/vendor/squizlabs/php_codesniffer/CodeSniffer/File.php on line 2197 [21:07:46] nicee [21:08:58] SMalyshev: deployment-cache-text04 is the host. trying to figure out how to restart the fe varnish there [21:09:24] sudo reboot [21:09:26] bd808: ok will do [21:10:01] I know hash.ar documented this somewhere [21:10:12] It was on wikitech [21:10:56] 10MediaWiki-Codesniffer, 10MediaWiki-extensions-TimedMediaHandler: Fatal error: Maximum function nesting level of '100' reached, aborting! - https://phabricator.wikimedia.org/T115651#1729462 (10Legoktm) I switched -p into -v so it gave extra debugging output... 21:07:22 Processing module.audio-video.quicktime... [21:12:09] 10Continuous-Integration-Config, 10Fundraising-Backlog, 5Patch-For-Review, 7WorkType-Maintenance: Switch wikimedia/fundraising/slander to use tox as an entry point - https://phabricator.wikimedia.org/T114250#1729480 (10atgo) [21:12:33] 10Continuous-Integration-Config, 10Fundraising Tech Backlog, 10Fundraising-Backlog, 5Patch-For-Review: wikimedia/fundraising/tools should pass python lint checks (flake8) - https://phabricator.wikimedia.org/T114218#1729495 (10atgo) [21:12:34] I tried `service varnish restart; service varnish-frontend restart` but that didn't change anything [21:14:18] 10MediaWiki-Codesniffer, 10MediaWiki-extensions-TimedMediaHandler: Fatal error: Maximum function nesting level of '100' reached, aborting! - https://phabricator.wikimedia.org/T115651#1729500 (10Paladox) Thankyou for digging through to find the error. I will ignore the libs folder. [21:15:00] SMalyshev: `curl -v -H 'Host: www.wikipedia.beta.wmflabs.org' http://127.0.0.1/` on deployment-mediawiki01 gets me the "domain not configured" page [21:15:06] is that what you expect? [21:15:13] bd808: not exactly [21:15:40] bd808: I would expect it to return /portals/www.wikipedia.org.html as rewrite rule states [21:15:51] bd808: but somehow that vhost config is not working [21:16:07] 10MediaWiki-Codesniffer, 10MediaWiki-extensions-TimedMediaHandler: Fatal error: Maximum function nesting level of '100' reached, aborting! - https://phabricator.wikimedia.org/T115651#1729504 (10Paladox) @Legoktm should we also ignore the MwEmbedModules folder since it is also an upstream repo. [21:16:18] I guess we should figure that out before worrying too much about varnish [21:16:27] bd808: see https://gerrit.wikimedia.org/r/#/c/240888/2/modules/mediawiki/files/apache/beta/sites/wikipedia.conf [21:16:28] but it only fails on localhost, the vhost seems to work correctly when hitting eth0 [21:16:39] (the vhost that is, the rewrite still doesn't work when hitting the eth0 ip) [21:16:41] bd808: the problem I'm not sure if it's supposed to be working at all on localhost [21:16:46] oh? that may be a quirk of the hosts [21:17:00] because alias works... [21:17:54] I get a different "not found" page from curl -v -H 'Host: www.wikipedia.beta.wmflabs.org' http://10.68.17.170/ [21:18:05] actually a 404 [21:18:26] thats the rewrite failing, the rewrite destination comes back correct: curl -H "Host: www.wikipedia.beta.wmflabs.org" "http://deployment-mediawiki02/portals/www.wikipedia.org.html [21:19:06] greg-g: around? want to ask about the train next week [21:19:11] ... I remember something about rewrites and aliases not playing nice together [21:19:59] 10MediaWiki-Codesniffer, 10MediaWiki-extensions-TimedMediaHandler: Fatal error: Maximum function nesting level of '100' reached, aborting! - https://phabricator.wikimedia.org/T115651#1729529 (10Paladox) Works now since ignoring the libs folder. [21:20:05] Project browsertests-QuickSurveys-en.m.wikipedia.beta.wmflabs.org-linux-chrome-sauce build #35: 04FAILURE in 4 min 4 sec: https://integration.wikimedia.org/ci/job/browsertests-QuickSurveys-en.m.wikipedia.beta.wmflabs.org-linux-chrome-sauce/35/ [21:20:14] heh, google even had an autocomplete for that not working :) [21:21:10] question: What do I need to get +2 instead of +1 verfied form jenkins-bot? [21:21:17] *from [21:21:27] Luke081515: someone else to +2 the patch [21:21:35] or be whitelisted [21:21:49] aude: yup :) [21:21:49] hmm... I wonder how it can happen that alias works but rewrite does not... [21:21:50] 10MediaWiki-Codesniffer, 10MediaWiki-extensions-TimedMediaHandler: Fatal error: Maximum function nesting level of '100' reached, aborting! - https://phabricator.wikimedia.org/T115651#1729537 (10Legoktm) 5Open>3Invalid a:3Legoktm [21:21:55] legoktm: What are the criterias to be whitelisted? [21:22:09] you have be not a vandal :P [21:22:21] that Luke081515 person, totally a vandal [21:22:27] :) [21:22:32] :) [21:22:45] my last vandalizing change: https://gerrit.wikimedia.org/r/#/c/246709/ [21:22:51] :D [21:23:11] brb, calling the gerrit police [21:23:56] SMalyshev: I wonder if you just need a [PT] option? [21:24:18] (03PS1) 10Legoktm: Whitelist Luke081515 [integration/config] - 10https://gerrit.wikimedia.org/r/246785 [21:24:19] SMalyshev: another option i see mentioned on stackoverflow is setting RewriteBase [21:24:26] no clue though [21:24:32] legoktm: Thanks a lot [21:24:41] I'll deploy that in a bit [21:25:02] hmm, no RewriteBase doesn't look relevant based on the apache docs [21:25:04] bd808: hmm... maybe PT [21:25:14] greg-g: i was hoping to cut a new branch of wikidata next week for test.wikidata [21:25:25] ebernhardson: no, rewriteBase is needed when you have subdirs but here we're just on / [21:25:34] as we are trying to get stuff ready to enable geodata and special:nearby on wikidata :) [21:25:46] PT "Forces the resulting URI to be passed back to the URL mapping engine for processing of other URI-to-filename translators, such as Alias or Redirect." [21:25:57] that sounds like the ticket [21:26:09] so, wonder if it would be ok if we updated group0 to new wikidata / wikibase code on tuesday? [21:26:16] QSA hardly ever hurts too [21:26:31] (we had a branch this past week, so the difference isn't that huge yet important stuff) [21:26:51] aude: ahh, I see... [21:26:54] yeah PT seems to help [21:27:18] aude: I think that should be OK, generally. Send an email to mukunda (cc me) to remind us ;) [21:27:19] bd808: QSA not sure if we need... do we have any meaningful args that go to /? [21:27:28] it's a static html anyway [21:27:30] we're hoping to have special:nearby ready for wikidata's birthday at the end of the month, and think we can do it :) [21:27:35] greg-g: ok [21:27:59] also, wikispecies, meta-wiki and mediawiki.org get wikibase next tuesday (phase 1, interwiki links only) [21:28:13] weee [21:28:25] SMalyshev: did you change the vhost config already? curl -v -H 'Host: www.wikipedia.beta.wmflabs.org' http://10.68.17.170/ looks right now [21:28:48] bd808: yeah I did local change. but puppet will kill it so I'll commit it now and do it correctly [21:28:58] greg-g: but i'm having trouble staying logged in to wikitech long enough to click save on the deployments page :( [21:29:01] *nod* [21:29:05] i can try again tomorrow [21:29:28] (03CR) 10Alex Monk: [C: 031] Whitelist Luke081515 [integration/config] - 10https://gerrit.wikimedia.org/r/246785 (owner: 10Legoktm) [21:29:53] aude: blugh [21:30:49] https://gist.github.com/filbertkm/0929b2119f099ffbca34 is what i want [21:31:23] will do [21:31:51] thanks [21:31:55] aude: wait, 16:00 UTC? [21:32:20] 6:00 PDT? [21:32:21] if that is ok, but flexible [21:32:27] 16:00 UTC is swat window [21:32:34] oh [21:32:44] er [21:32:51] * aude confused [21:32:52] gah, timezones... /me thinks for a second [21:33:02] it's after swat [21:33:06] its just after sawt [21:33:06] no, you're right [21:33:07] :) [21:33:16] 6pm berlin [21:33:22] I have a headache, that's my excuse [21:33:30] :/ [21:33:56] i estimate 2 hours, since we might have to poke the sites stuff (caching) for the new wikibase wikis [21:33:59] we should just use swatch internet time, that will fix things ;P [21:34:16] aude: during puppet swat, but that should be ok? [21:34:19] or wait an hour for cache to expire [21:34:23] greg-g: should be [21:34:25] kk [21:34:34] or i can wait until after [21:34:35] scheduling man, so annoying [21:34:44] added [21:34:47] thanks [21:34:54] no idea why i can't stay logged in :( [21:34:56] np [21:35:03] me neither, can't repro [21:35:14] will send mail to mukunda probably tomorrow and/or monday [21:35:51] greg-g: if you don't have it yet, put a UTC column on your gcal -- settings > your current time zone + additional time zone [21:36:35] I got one in my gnome clock [21:36:37] and in gcal [21:36:42] just sometimes i'm stupid [21:36:48] it happens [21:37:13] you would have correct in November I think [21:38:11] grammar? [21:38:18] no thanks [21:38:19] been [21:38:21] got it [21:38:23] :) [21:38:49] * bd808 types like he dances; fast and awkward [21:39:15] that's an image that'll take a while to get out of my head [21:41:38] I do fine in a circle pit but not so much in a ballroom situation [21:45:23] ok, check out new and shiny http://www.wikipedia.beta.wmflabs.org/ [21:45:32] sweet [21:45:38] now served directly from git! [21:45:46] well, not directly, but from git :) [22:17:59] PROBLEM - Puppet failure on deployment-cache-text04 is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [0.0] [22:26:24] (03CR) 10Legoktm: [C: 032] Whitelist Luke081515 [integration/config] - 10https://gerrit.wikimedia.org/r/246785 (owner: 10Legoktm) [22:27:17] (03Merged) 10jenkins-bot: Whitelist Luke081515 [integration/config] - 10https://gerrit.wikimedia.org/r/246785 (owner: 10Legoktm) [22:27:55] !log deploying https://gerrit.wikimedia.org/r/246785 [22:27:58] Luke081515: ^^ [22:28:02] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL, Master [22:28:21] thanks, legoktm [22:28:30] np [22:29:30] legoktm: Could you review https://gerrit.wikimedia.org/r/#/c/242934/ please since it has to do with php code sniffer. [22:29:47] yes [22:29:51] I'll put it on my list [22:30:05] legoktm: thanks. [22:30:08] +677, -286 [22:30:11] it's a pretty big change :/ [22:31:04] legoktm: Yes. Ive fixed the tests not passing in it. [22:33:02] 6Release-Engineering-Team, 3releng-201516-q2: QR action item: Phabricator - https://phabricator.wikimedia.org/T115176#1729764 (10greg) Some PM ones, just link aggregating right now: * "Support workboard column triggers which activate when a task is dropped into a column" - https://secure.phabricator.com/T5474... [22:37:36] I emailed the qa list asking why we still have the whitelist [22:39:29] PROBLEM - Puppet failure on deployment-cache-upload04 is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [0.0] [22:39:56] also, is scaling only available for jessie right now? [22:58:48] Project browsertests-Flow-en.wikipedia.beta.wmflabs.org-linux-firefox-sauce build #831: 04FAILURE in 47 min: https://integration.wikimedia.org/ci/job/browsertests-Flow-en.wikipedia.beta.wmflabs.org-linux-firefox-sauce/831/