[01:23:33] PROBLEM - App Server Main HTTP Response on deployment-mediawiki02 is CRITICAL: HTTP CRITICAL: HTTP/1.1 500 Internal Server Error - 50557 bytes in 0.014 second response time [01:24:19] PROBLEM - App Server Main HTTP Response on deployment-mediawiki03 is CRITICAL: HTTP CRITICAL: HTTP/1.1 500 Internal Server Error - 50556 bytes in 0.012 second response time [01:26:39] ugh, I know [01:28:33] RECOVERY - App Server Main HTTP Response on deployment-mediawiki02 is OK: HTTP OK: HTTP/1.1 200 OK - 42975 bytes in 0.567 second response time [01:29:23] RECOVERY - App Server Main HTTP Response on deployment-mediawiki03 is OK: HTTP OK: HTTP/1.1 200 OK - 42969 bytes in 2.810 second response time [01:39:36] PROBLEM - App Server Main HTTP Response on deployment-mediawiki02 is CRITICAL: HTTP CRITICAL: HTTP/1.1 500 Internal Server Error - 50534 bytes in 0.014 second response time [01:40:08] PROBLEM - English Wikipedia Main page on beta-cluster is CRITICAL: HTTP CRITICAL: HTTP/1.1 500 Internal Server Error - 50902 bytes in 0.017 second response time [01:40:12] (I really don't) [01:40:20] PROBLEM - App Server Main HTTP Response on deployment-mediawiki03 is CRITICAL: HTTP CRITICAL: HTTP/1.1 500 Internal Server Error - 50533 bytes in 0.012 second response time [01:44:30] Project beta-scap-eqiad build #110514: 04FAILURE in 0.33 sec: https://integration.wikimedia.org/ci/job/beta-scap-eqiad/110514/ [01:45:11] RECOVERY - English Wikipedia Main page on beta-cluster is OK: HTTP OK: HTTP/1.1 200 OK - 43311 bytes in 0.539 second response time [01:46:10] I think I may be going crazy [01:49:35] RECOVERY - App Server Main HTTP Response on deployment-mediawiki02 is OK: HTTP OK: HTTP/1.1 200 OK - 42975 bytes in 0.676 second response time [01:50:21] RECOVERY - App Server Main HTTP Response on deployment-mediawiki03 is OK: HTTP OK: HTTP/1.1 200 OK - 42975 bytes in 0.822 second response time [01:51:47] 10Continuous-Integration-Infrastructure, 10Zuul, 07Tracking, 07WorkType-Maintenance: Scale merge operations (tracking) - https://phabricator.wikimedia.org/T70480#2445067 (10Danny_B) [01:55:54] Yippee, build fixed! [01:55:55] Project beta-scap-eqiad build #110515: 09FIXED in 1 min 22 sec: https://integration.wikimedia.org/ci/job/beta-scap-eqiad/110515/ [01:59:52] I put it back to how I found it, AND NOW IT WORKS!? [01:59:55] I give up [02:07:55] Okay, so it turns out it wasn't exactly how I found it, but my 'fix' is not what's running in production, yet production is somehow working [02:18:43] I'm not really sure why my fix does anything if it's not in use in production - so either how was labs breaking or how is production working? [02:43:58] (03PS1) 10Legoktm: Save tests/*.log for php-compile-hhvm-test jobs [integration/config] - 10https://gerrit.wikimedia.org/r/298169 [02:44:46] (03CR) 10Legoktm: [C: 032] "Already deployed" [integration/config] - 10https://gerrit.wikimedia.org/r/298169 (owner: 10Legoktm) [02:46:18] (03Merged) 10jenkins-bot: Save tests/*.log for php-compile-hhvm-test jobs [integration/config] - 10https://gerrit.wikimedia.org/r/298169 (owner: 10Legoktm) [03:01:18] 10Beta-Cluster-Infrastructure: Setup a Swift cluster on beta-cluster to match production - https://phabricator.wikimedia.org/T64835#2445079 (10AlexMonk-WMF) Everything's in kind of a mess while I try this - I've got live hacks to config code on deployment-tin, a live hack (and so puppet is disabled) to make depl... [03:06:27] looks like I'll have to leave it like that for a few hours [04:04:25] Project selenium-MultimediaViewer ยป safari,beta,OS X 10.9,contintLabsSlave && UbuntuTrusty build #69: 04FAILURE in 8 min 24 sec: https://integration.wikimedia.org/ci/job/selenium-MultimediaViewer/BROWSER=safari,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=OS%20X%2010.9,label=contintLabsSlave%20&&%20UbuntuTrusty/69/ [06:46:21] Project UploadWizard-api-commons.wikimedia.beta.wmflabs.org build #4255: 04FAILURE in 20 sec: https://integration.wikimedia.org/ci/job/UploadWizard-api-commons.wikimedia.beta.wmflabs.org/4255/ [09:32:29] 10Continuous-Integration-Infrastructure, 10Zuul, 07Tracking: deploy Zuul (tracking) - https://phabricator.wikimedia.org/T42681#2445249 (10Danny_B) [10:37:39] PROBLEM - Parsoid on deployment-parsoid06 is CRITICAL: Connection refused [12:04:59] 10Continuous-Integration-Infrastructure: Update chromium to 51 on trusty - https://phabricator.wikimedia.org/T139891#2445484 (10Paladox) [12:09:17] 10Continuous-Integration-Infrastructure: Update chromium to 51 on trusty - https://phabricator.wikimedia.org/T139891#2445497 (10Paladox) p:05Triage>03High Changing to high so we can enable puppet again on trusty. [14:42:43] (03PS3) 10Lethexie: Single Line comments no multiple '*'. [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/295895 [15:38:58] 10Continuous-Integration-Infrastructure: Update zuul and jenkins config's to work with lead (New gerrit server) - https://phabricator.wikimedia.org/T139900#2445665 (10Paladox) [15:41:42] 10Continuous-Integration-Infrastructure, 10Zuul, 07Jenkins: Update zuul and jenkins config's to work with lead (New gerrit server) - https://phabricator.wikimedia.org/T139900#2445679 (10Danny_B) [20:58:54] (03PS1) 10Legoktm: [php-compile-hhvm-test] Don't fail if all tests pass [integration/config] - 10https://gerrit.wikimedia.org/r/298234 [20:59:29] legoktm: Boring [20:59:40] you need 101% of tests passing [21:01:04] xD [21:02:29] but really: https://gerrit.wikimedia.org/r/#/c/298182/ [21:04:34] legoktm hi, im wondering if you know how to dual load php in debian jessie (php 5.5 and 5.6) please [21:06:51] paladox: kind of, I started working on php7 on debian jessie, but it got tricky so I haven't finished yet [21:07:09] legoktm oh, i have a test install [21:07:26] Meaning i have zuul gerrit and jenkins installed on a labs instance [21:08:46] (03CR) 10Legoktm: [C: 032] "Already deployed" [integration/config] - 10https://gerrit.wikimedia.org/r/298234 (owner: 10Legoktm) [21:08:55] okay [21:09:07] I was working on getting php7 running on a debian jessie VM [21:09:19] Oh [21:09:41] I was working on php 5.3 but there's no point if php 5.3 ci will be going in a year [21:09:44] Im using https://wikitech.wikimedia.org/wiki/Nova_Resource:Gerrit-test.git.eqiad.wmflabs [21:10:15] legoktm im wondering what about installing php in different location and just exporting the php location for the different php versions through zuul or jenkins [21:10:45] (03Merged) 10jenkins-bot: [php-compile-hhvm-test] Don't fail if all tests pass [integration/config] - 10https://gerrit.wikimedia.org/r/298234 (owner: 10Legoktm) [21:11:13] http://gerrit-test.wmflabs.org/gerrit/#/q/status:open [21:11:18] maybe [21:11:28] Oh [21:11:28] I think for 5.3 we're better off just using precise for another year [21:11:34] Yes [21:12:41] stretch is going to be out with php7 in mid-2017, and I think we need an interim solution in the meantime [21:12:51] Oh [21:13:45] legoktm how about creating a folder called php7 and php56 and then add a bin folder in there [21:14:04] then create a php file that is symblinked to the actual php folder [21:14:09] folder = file [21:14:11] or folder [21:14:26] and then export php location to jenkins [21:14:46] that would be the easist. I havent tryed though. [21:15:28] maybe. [21:15:35] Ok [21:15:39] I was trying to avoid building it manually but that may just be the easiest [21:15:50] debian packages are way more portable [21:15:57] Oh, i tryed building it but gave up when it was erroring. [21:16:16] legoktm there's snaps but that will only work in the newest debian version [21:16:48] yeah, not trying those :P [21:16:53] legoktm we could build it then create a dpkg. but i though it would be called php5 and php7 is php7 [21:16:57] oh [21:17:42] In my local install of ubuntu 14.04 running nativly on windows 10 i installed php 7 [21:17:44] off a ppa [21:18:00] and it called the folder php7 [21:18:19] i had to change the default php5 install file to use php7. [21:19:23] leogktm or we can install stretch on a local machine apt get php and copy it over to jessie. [21:22:27] uh, doesn't work like that, you can't copy packages like that :P [21:22:34] but rebuilding them from stretch is basically what I tried doing [21:23:42] Oh [22:13:31] 10Continuous-Integration-Infrastructure, 10Zuul, 07Tracking: Switch zuul to be gearman based (tracking) - https://phabricator.wikimedia.org/T52664#2446001 (10Danny_B) [22:19:43] 10Browser-Tests-Infrastructure, 07Easy: Remove regular expressions in browser tests page element selectors - https://phabricator.wikimedia.org/T112291#2446007 (10Danny_B) No subtasks = not #tracking.