[00:09:52] 06Release-Engineering-Team, 10Wikidata, 07Story: [Story] Use composer-merge-plugin to include Wikidata components in mediawiki-vendor - https://phabricator.wikimedia.org/T95663#3100535 (10demon) I just simply haven't had the time to look into it yet, I apologize. [00:25:03] 06Release-Engineering-Team, 10Wikidata, 07Story: [Story] Use composer-merge-plugin to include Wikidata components in mediawiki-vendor - https://phabricator.wikimedia.org/T95663#3100585 (10Legoktm) I don't think there's any need to use the composer-merge-plugin here...if something is a MW extension, it should... [00:27:18] 06Release-Engineering-Team, 10Wikidata, 07Story: [Story] Use composer-merge-plugin to include Wikidata components in mediawiki-vendor - https://phabricator.wikimedia.org/T95663#3100588 (10demon) >>! In T95663#3100585, @Legoktm wrote: > If it's a library, it should be published on packagist and added to media... [00:56:34] PROBLEM - Free space - all mounts on deployment-fluorine02 is CRITICAL: CRITICAL: deployment-prep.deployment-fluorine02.diskspace._srv.byte_percentfree (<11.11%) [02:05:48] 10Scap (Scap3-Adoption-Phase1), 10Analytics-EventLogging, 06Analytics-Kanban, 13Patch-For-Review: Stop using global python setup.py install for eventlogging deploy - https://phabricator.wikimedia.org/T131263#3100710 (10Krinkle) [02:05:51] 10Scap (Scap3-Adoption-Phase1), 10scap2, 10Analytics, 10Analytics-EventLogging, 13Patch-For-Review: Use scap3 to deploy eventlogging/eventlogging - https://phabricator.wikimedia.org/T118772#3100711 (10Krinkle) [03:56:08] RainbowSprinkles: https://phabricator.wikimedia.org/T115890 - you might be interested in the killing of CACHE_ANYTHING and the adoption of CACHE_DB as the default [03:59:29] So CACHE_NONE really wouldn't be used outside of development? [04:04:56] RainbowSprinkles: Right. CACHE_NONE would only be used if explicitly configured as MainCache. Some of the existing non-main cache groups (such as ParserCache) may be better kept as CACHE_NONE by default, though. [04:05:19] Or at least effectively so. Perhaps by proxy of QoS() within parser cache instead of explicitly, like we do in various other places. [04:06:27] * RainbowSprinkles nods [04:08:21] Project selenium-MultimediaViewer » firefox,beta,Linux,BrowserTests build #330: 04FAILURE in 12 min: https://integration.wikimedia.org/ci/job/selenium-MultimediaViewer/BROWSER=firefox,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=Linux,label=BrowserTests/330/ [04:17:44] !sal [04:17:44] https://tools.wmflabs.org/sal/releng [05:01:43] 10Gerrit, 10MediaWiki-extensions-Other, 06Repository-Admins, 07Technical-Debt: Archive PageLanguageApi extension - https://phabricator.wikimedia.org/T160371#3100837 (10Liuxinyu970226) [06:18:58] 10Continuous-Integration-Config, 10ContentTranslation, 03Language-2017 Sprint 2, 03Language-2017 Sprint 3, and 7 others: mwext-qunit-jessie test fails on unrelated change - https://phabricator.wikimedia.org/T153038#3100918 (10KartikMistry) There are some recent Qunit failures (eg: https://integration.wikim... [06:58:24] PROBLEM - Puppet run on integration-slave-trusty-1004 is CRITICAL: CRITICAL: 55.56% of data above the critical threshold [0.0] [07:01:35] RECOVERY - Free space - all mounts on deployment-fluorine02 is OK: OK: All targets OK [07:33:25] RECOVERY - Puppet run on integration-slave-trusty-1004 is OK: OK: Less than 1.00% above the threshold [0.0] [09:38:54] !sal [09:38:54] https://tools.wmflabs.org/sal/releng [10:00:20] hashar: o/ [10:00:54] elukey: shoot! I might or might not reply depending on the question :} [10:01:15] I am wondering if analytics could spin up two more medium instances like deployment-aqs01 in deployment-prep [10:01:34] given it is a shared platform yes I guess ? :} [10:01:54] the labs project has some quota limits [10:02:01] oh yes but I wanted to ask you if there were things to do before spinning up instances that will stay for a long time [10:02:15] yeah I checked it, we are way below limits [10:02:26] so hopefully the project can be filled up granted labs infra has enough capacity [10:03:30] I don't think there are any step required [10:03:36] but you can !log here about the creation [10:03:40] super [10:03:43] thanks :) [10:03:44] note also that puppet is broken on jessie instances [10:03:46] ah last thing [10:03:50] :/ [10:03:57] how come puppet is broken? [10:04:45] random puppet code that landed and does not take in account labs projects having a puppetmaster [10:04:59] (last thing was - I am going to restore the prod version of memcached on deployment-memc04) [10:05:21] hashar: :( okok [10:05:22] elukey: https://phabricator.wikimedia.org/T148929 has the workaround commands [10:05:34] basically spin it, wait for the initial puppet run to fail [10:05:41] then copy paste command on agent/master [10:05:49] in the order they are mentionned on the task. That should fix it [10:05:56] ah the usual brutality to "help puppet understand" [10:05:56] something related to ssl certificates [10:06:09] thanks! [10:20:30] hashar: as FYI instead of https://phabricator.wikimedia.org/T148929 I just removed the cert in the agent, cleaned on pmaster (wasn't there though), re-run puppet on the agent to create the cert and signed the cert on pmaster [10:20:47] and now it works fine [10:22:29] !log created instances deployment-aqs0[23] to have better testing for the AQS beta environment [10:22:33] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [10:38:29] PROBLEM - Puppet run on deployment-aqs02 is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [0.0] [10:39:29] PROBLEM - Puppet run on deployment-aqs03 is CRITICAL: CRITICAL: 22.22% of data above the critical threshold [0.0] [10:54:30] RECOVERY - Puppet run on deployment-aqs03 is OK: OK: Less than 1.00% above the threshold [0.0] [11:02:35] this is me :) [11:03:29] RECOVERY - Puppet run on deployment-aqs02 is OK: OK: Less than 1.00% above the threshold [0.0] [11:09:33] !log Restore prod version of memcached on deployment-memc04 after experiment (I installed a new version a while ago) [11:09:35] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [11:09:53] let me know if it causes issues [11:10:03] just ran puppet and everything seems fine [11:20:34] \O/ [11:20:45] elukey: congratulations! [11:21:07] hashar upstream are taking a look at my trilead-ssh change :) [11:21:13] (jenkins) [11:21:47] https://github.com/jenkinsci/trilead-ssh2/pull/9 [11:23:17] paladox: good !;-} [11:23:23] Yep :) [11:23:36] I've been running it for a month+ now [11:23:44] All works fine [11:44:25] 10Continuous-Integration-Config, 10OOjs-UI: Optimize oojs/ui Jenkins jobs - https://phabricator.wikimedia.org/T160513#3101478 (10hashar) [12:04:10] 10Continuous-Integration-Config, 10OOjs-UI: Optimize oojs/ui Jenkins jobs - https://phabricator.wikimedia.org/T160513#3101510 (10hashar) [12:05:50] hashar: https://phabricator.wikimedia.org/T153038#3100918 - again :/ [12:15:33] does anybody know how /srv/deployment/etc.. are synced between tin and deployment-tin? (if they are synced) [12:16:00] I don't find /srv/deployment/cassandra/jmx_exporter in deployment-tin [12:27:04] kart_: https://phabricator.wikimedia.org/T153038#3076267 should let you reproduce it locally [12:28:20] elukey: the list of repo is handled in a hiera hash [12:28:38] elukey: so your repo has to be added on one of hiera source either puppet, horizon or wikitech. Twist: that is on https://wikitech.wikimedia.org/wiki/Hiera:Deployment-prep [12:28:57] elukey: look for "role::deployment::repo_config" [12:29:18] then I guess run puppet on deployment-tin and that might populate it [12:29:24] heading out for a snack [12:29:53] thanks! [12:46:33] 10Continuous-Integration-Config, 10ContentTranslation, 03Language-2017 Sprint 2, 03Language-2017 Sprint 3, and 7 others: mwext-qunit-jessie test fails on unrelated change - https://phabricator.wikimedia.org/T153038#3101744 (10hashar) Please try to reproduce based on my previous comment T153038#3076267 [13:24:55] 06Release-Engineering-Team, 07Jenkins: Jenkins fails to run browser tests for Wikibase - https://phabricator.wikimedia.org/T160519#3102004 (10Zppix) [13:26:29] hashar: trying again. Thanks! [13:27:23] 06Release-Engineering-Team, 07Jenkins: Jenkins Browser tests for Wikibase are failing - https://phabricator.wikimedia.org/T160519#3102005 (10Zppix) [13:46:49] Yippee, build fixed! [13:46:49] Project selenium-VisualEditor » firefox,beta,Linux,BrowserTests build #337: 09FIXED in 2 min 48 sec: https://integration.wikimedia.org/ci/job/selenium-VisualEditor/BROWSER=firefox,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=Linux,label=BrowserTests/337/ [13:51:16] 10Continuous-Integration-Config, 10OOjs-UI: Optimize oojs/ui Jenkins jobs - https://phabricator.wikimedia.org/T160513#3102056 (10matmarex) [14:08:41] 10Continuous-Integration-Config, 10OOjs-UI: Optimize oojs/ui Jenkins jobs - https://phabricator.wikimedia.org/T160513#3101478 (10SamanthaNguyen) Duplicate of T155483 ? [14:19:29] PROBLEM - Puppet run on deployment-aqs02 is CRITICAL: CRITICAL: 50.00% of data above the critical threshold [0.0] [14:26:07] 10Continuous-Integration-Config, 10OOjs-UI: Optimize oojs/ui Jenkins jobs - https://phabricator.wikimedia.org/T160513#3102198 (10hashar) @SamanthaNguyen I am stupid and don't know how to search before filling a task. Will merge the content in T155483. Thank you! [14:26:28] 10Continuous-Integration-Config, 10OOjs-UI: Speed up oojs/ui Jenkins jobs - https://phabricator.wikimedia.org/T155483#3102200 (10hashar) [14:26:30] 10Continuous-Integration-Config, 10OOjs-UI: Optimize oojs/ui Jenkins jobs - https://phabricator.wikimedia.org/T160513#3102202 (10hashar) [14:28:40] 10Continuous-Integration-Config, 10OOjs-UI: Speed up oojs/ui Jenkins jobs - https://phabricator.wikimedia.org/T155483#3102208 (10hashar) [14:30:41] 10Continuous-Integration-Config, 10OOjs-UI: Speed up oojs/ui Jenkins jobs - https://phabricator.wikimedia.org/T155483#2944459 (10hashar) Incorporate changes from T160513. Specially I have looked at what each jobs and there is a lot of overlapping grunt tasks. Specially svg2png and colorizeSvg. See the update... [14:50:28] 06Release-Engineering-Team, 10MediaWiki-Authentication-and-authorization: Jenkins Browser tests for Wikibase are failing - https://phabricator.wikimedia.org/T160519#3102279 (10hashar) Specially the debug log of HTTP requests seems to indicate the session cache is EmptyBagOStuff: ``` [caches] cluster: EmptyBagO... [15:12:28] 06Release-Engineering-Team, 10MediaWiki-Authentication-and-authorization: Jenkins Browser tests for Wikibase are failing - https://phabricator.wikimedia.org/T160519#3102372 (10hashar) I went on the Jenkins master that hold the debug log archives ( contint1001 under `/srv/jenkins/builds`). I looked at another j... [15:41:54] (03PS2) 10Niedzielski: Hygiene: Remove Jenkins plugin-driven install-android-sdk builder [integration/config] - 10https://gerrit.wikimedia.org/r/342263 (owner: 10Mholloway) [15:44:28] RECOVERY - Puppet run on deployment-aqs02 is OK: OK: Less than 1.00% above the threshold [0.0] [15:49:17] (03CR) 10Niedzielski: [C: 032] Hygiene: Remove Jenkins plugin-driven install-android-sdk builder [integration/config] - 10https://gerrit.wikimedia.org/r/342263 (owner: 10Mholloway) [15:49:35] (03CR) 10Niedzielski: [V: 032 C: 032] Hygiene: Remove Jenkins plugin-driven install-android-sdk builder [integration/config] - 10https://gerrit.wikimedia.org/r/342263 (owner: 10Mholloway) [15:53:19] Project selenium-MobileFrontend » firefox,beta,Linux,BrowserTests build #359: 04FAILURE in 31 min: https://integration.wikimedia.org/ci/job/selenium-MobileFrontend/BROWSER=firefox,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=Linux,label=BrowserTests/359/ [15:54:50] (03PS1) 10Niedzielski: Hygiene: [Android] move JJB script to app repo [integration/config] - 10https://gerrit.wikimedia.org/r/342844 [15:55:20] PROBLEM - App Server Main HTTP Response on deployment-mediawiki06 is CRITICAL: HTTP CRITICAL: HTTP/1.1 503 Service Unavailable - 50406 bytes in 0.007 second response time [15:55:31] !log Removed hhvm statcache cherrypick from beta puppetmaster [15:55:33] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [15:55:52] niedzielski: well done :} [15:56:31] hashar: thanks to you and releng for the support as always in helping michael and myself [15:57:36] niedzielski: you are welcome. I feel sorry mdholloway|afk spent time on java-mwapi when it is an abandonned repo :/ [15:57:51] guess if one want to fix it, it is just about bumping the gradle version in the wrapper [15:59:11] hashar: i felt a bit bad about that too. i think he saw all the problems in the repo and just started fixing things forgetting that we want to remove it [16:00:12] niedzielski: hygiene is always a good thing :} [16:00:22] RECOVERY - App Server Main HTTP Response on deployment-mediawiki06 is OK: HTTP OK: HTTP/1.1 200 OK - 45851 bytes in 7.746 second response time [16:01:36] meeting time & [16:03:03] 👍 [16:20:20] 10Scap (Scap3-MediaWiki-MVP), 10Fundraising-Backlog, 10MediaWiki-extensions-ContributionTracking: Clean up Contribution Tracking settings in main wmf config repo - https://phabricator.wikimedia.org/T147479#3102766 (10demon) We should get this done :) [16:36:09] 10Scap (Scap3-MediaWiki-MVP), 10Fundraising-Backlog, 10MediaWiki-extensions-ContributionTracking: Clean up Contribution Tracking settings in main wmf config repo - https://phabricator.wikimedia.org/T147479#2693840 (10awight) @demon I don't understand how the current config works, it seems to include a file w... [17:03:16] PROBLEM - Puppet run on deployment-sca01 is CRITICAL: CRITICAL: 22.22% of data above the critical threshold [0.0] [17:04:50] 10Scap (Scap3-MediaWiki-MVP), 10Fundraising-Backlog, 10MediaWiki-extensions-ContributionTracking: Clean up Contribution Tracking settings in main wmf config repo - https://phabricator.wikimedia.org/T147479#3102966 (10demon) >>! In T147479#3102879, @awight wrote: > @demon I don't understand how the current co... [17:32:57] 06Release-Engineering-Team (Deployment-Blockers), 05Release: MW-1.29.0-wmf.17 deployment blockers - https://phabricator.wikimedia.org/T160549#3103115 (10greg) [17:33:13] 06Release-Engineering-Team (Deployment-Blockers), 05Release: MW-1.29.0-wmf.16 deployment blockers - https://phabricator.wikimedia.org/T158997#3053950 (10greg) [17:34:29] 06Release-Engineering-Team (Deployment-Blockers), 05Release: MW-1.29.0-wmf.18 deployment blockers - https://phabricator.wikimedia.org/T160550#3103136 (10greg) [17:34:35] 06Release-Engineering-Team (Deployment-Blockers), 05Release: MW-1.29.0-wmf.17 deployment blockers - https://phabricator.wikimedia.org/T160549#3103115 (10greg) [17:35:46] 06Release-Engineering-Team (Deployment-Blockers), 05Release: MW-1.29.0-wmf.19 deployment blockers - https://phabricator.wikimedia.org/T160551#3103155 (10greg) [17:35:59] 06Release-Engineering-Team (Deployment-Blockers), 05Release: MW-1.29.0-wmf.18 deployment blockers - https://phabricator.wikimedia.org/T160550#3103136 (10greg) [17:36:54] 06Release-Engineering-Team (Deployment-Blockers), 05Release: MW-1.29.0-wmf.20 deployment blockers - https://phabricator.wikimedia.org/T160552#3103176 (10greg) [17:37:06] 06Release-Engineering-Team (Deployment-Blockers), 05Release: MW-1.29.0-wmf.19 deployment blockers - https://phabricator.wikimedia.org/T160551#3103155 (10greg) [17:37:57] [17:38:19] RECOVERY - Puppet run on deployment-sca01 is OK: OK: Less than 1.00% above the threshold [0.0] [17:53:45] RainbowSprinkles i've now figured out how to get gerrit to create the base url for polygerrit :) [17:53:51] Never knew it was that easy [17:54:04] just had to remove index.html and use java's Filter [18:18:18] (03PS1) 10DCausse: Search: add checkstyle:check to the job [integration/config] - 10https://gerrit.wikimedia.org/r/342878 [18:26:06] (03PS2) 10Niedzielski: Hygiene: Get and display lint reports from /app/build/reports [integration/config] - 10https://gerrit.wikimedia.org/r/342265 (owner: 10Mholloway) [18:37:24] (03CR) 10Niedzielski: [C: 032] Hygiene: Get and display lint reports from /app/build/reports [integration/config] - 10https://gerrit.wikimedia.org/r/342265 (owner: 10Mholloway) [18:53:28] I tried to deploy the layout change portion of this patch but I'm getting a timeout connecting to contint1001.wikimedia.org. I think I just lack permissions and it's hanging on a sudo. I've already merged this change unaware of the fab part. Would someone mind doing a fab deploy? https://gerrit.wikimedia.org/r/#/c/342265/ [18:57:10] niedzielski: hmm you are a member of the group [18:57:20] can you: ssh contint1001.wikimedia.org [18:57:32] note that although the machine has a public IP, the ssh port is firewalled [18:57:40] so you have to configure your client to use the bastions [19:01:44] I've got an odd set of unit test failures coming from Wikibase's SpecialSetSiteLinkTest with the copyright release warning from dewiki – https://integration.wikimedia.org/ci/job/mediawiki-extensions-hhvm-jessie/8165/console – known issue? I asked in #wikidata a couple of hours ago but no response. [19:01:44] hashar: thanks that fixed it. i had to use bast1001 instead of bastion [19:02:29] !log Reloading Zuul to deploy f1c9073c6bda0bc83329c5178cb53613479ba200 [19:02:32] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [19:03:08] \O/ [19:21:07] (03PS2) 10Niedzielski: Hygiene: [Android] move JJB script to app repo [integration/config] - 10https://gerrit.wikimedia.org/r/342844 [19:21:41] Hey, could someone look into https://gerrit.wikimedia.org/r/#/c/338006/ ? CI is failing for unknown reasons, a job (mwext-mw-selenium-jessie) which ran fine when uploading the patchset now fails at gate-and-submit, and it's not because of different settings in that pipeline, as with "recheck" this job also fails now. It's a really tiny code change, so it can't be an issue with the code either. [19:22:46] CI logs: https://integration.wikimedia.org/ci/job/mwext-mw-selenium-jessie/2168/console https://integration.wikimedia.org/ci/job/mwext-mw-selenium-jessie/2170/console https://integration.wikimedia.org/ci/job/mwext-mw-selenium-jessie/2172/console [19:23:22] (03CR) 10Niedzielski: [C: 032] Hygiene: [Android] move JJB script to app repo [integration/config] - 10https://gerrit.wikimedia.org/r/342844 (owner: 10Niedzielski) [19:37:36] 10Scap (Scap3-MediaWiki-MVP), 10scap2, 06Operations: Depool proxies temporarily while scap is ongoing to avoid taxing those nodes - https://phabricator.wikimedia.org/T125629#3103684 (10demon) [20:02:52] 06Release-Engineering-Team, 03Reading-Web-Sprint-94: Invalid CSRF token in Selenium browser test in Popups blocking merges - https://phabricator.wikimedia.org/T160566#3103750 (10Jdlrobson) [20:21:17] Asking the same question again, anybody around who could tell me how to handle those broken CI tests? (See links in the message above) [20:25:06] fix them [20:25:09] or recheck till they pass [20:27:42] eddiegp: I believe that is related to: https://phabricator.wikimedia.org/T153038#3100918 [20:27:50] what is failing are selenium browser tests [20:28:00] because "invalid CSRF token" [20:28:09] 06Release-Engineering-Team (Deployment-Blockers), 05Release: MW-1.29.0-wmf.16 deployment blockers - https://phabricator.wikimedia.org/T158997#3103850 (10mmodell) [20:28:13] which antoine worked on reproducing and fixing himself but now others get to have that crown :) (if I understand your issue) [20:29:05] 06Release-Engineering-Team (Deployment-Blockers), 05Release: MW-1.29.0-wmf.16 deployment blockers - https://phabricator.wikimedia.org/T158997#3053950 (10mmodell) [20:29:16] yea, looks like you should paste those error logs somewhere in phab and add hashar to it [20:29:31] well, and try to reproduce locally [20:29:31] oh wait, this: [20:29:39] Reading-Web-Sprint-94: Invalid CSRF token in Selenium browser test in Popups blocking merges - https://phabricator.wikimedia.org/T160566#3103750 [20:29:48] well then... [20:29:53] right above there, that looks like it , totally [20:29:56] !log Update mobileapps to bb8fcf2 [20:30:00] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [20:30:18] eddiegp: not your fault, look at https://phabricator.wikimedia.org/T160566#3103750 and add a comment there [20:30:30] That's it, yeah. Thanks though. [20:30:40] thanks mutante [20:31:12] sure, np [20:31:39] 10Continuous-Integration-Config, 10ContentTranslation, 03Language-2017 Sprint 2, 03Language-2017 Sprint 3, and 7 others: mwext-qunit-jessie test fails on unrelated change - https://phabricator.wikimedia.org/T153038#2867233 (10EddieGP) Please also see T160566, might be related. [20:33:12] 06Release-Engineering-Team, 03Reading-Web-Sprint-94: Invalid CSRF token in Selenium browser test in Popups blocking merges - https://phabricator.wikimedia.org/T160566#3103750 (10EddieGP) CI logs: - https://integration.wikimedia.org/ci/job/mwext-mw-selenium-jessie/2168/console - https://integration.wikimedia.o... [20:42:52] Project selenium-Echo » chrome,beta,Linux,BrowserTests build #334: 04FAILURE in 1 min 51 sec: https://integration.wikimedia.org/ci/job/selenium-Echo/BROWSER=chrome,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=Linux,label=BrowserTests/334/ [20:42:55] Project selenium-Echo » firefox,beta,Linux,BrowserTests build #334: 04FAILURE in 1 min 55 sec: https://integration.wikimedia.org/ci/job/selenium-Echo/BROWSER=firefox,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=Linux,label=BrowserTests/334/ [20:53:15] 06Release-Engineering-Team, 07Browser-Tests, 03Reading-Web-Sprint-94, 07Unplanned-Sprint-Work: Invalid CSRF token in Selenium browser test in Popups blocking merges - https://phabricator.wikimedia.org/T160566#3103951 (10Jdlrobson) @zeljkofilipin @dduvall seems to be related to mediawiki_selenium - I notice... [21:55:07] chanop, please update the Topic to link the new log location: https://wm-bot.wmflabs.org/logs/%23wikimedia-releng/ [21:55:09] Thanks! [21:57:34] I thought I did last week.... [21:58:54] yeah, it's right. cc quiddity [21:59:02] 06Release-Engineering-Team (Deployment-Blockers), 05Release: MW-1.29.0-wmf.16 deployment blockers - https://phabricator.wikimedia.org/T158997#3104157 (10mmodell) [21:59:33] ack, sorry, should've manually checked. All the previous URL shorteners I checked were the outdated bots.wmflabs link. My bad. [22:06:28] 06Release-Engineering-Team, 10MediaWiki-Authentication-and-authorization: Jenkins Browser tests for Wikibase are failing - https://phabricator.wikimedia.org/T160519#3104182 (10Bawolff) >>! In T160519#3102279, @hashar wrote: > Specially the debug log of HTTP requests seems to indicate the session cache is Empty... [22:08:55] 06Release-Engineering-Team, 10MediaWiki-Authentication-and-authorization: Jenkins Browser tests for Wikibase are failing - https://phabricator.wikimedia.org/T160519#3104198 (10hashar) I guess the lamest way is to craft a patch that output the value via `wfDebug()` (captured by Jenkins as mwdebug-www.log iirc)... [22:31:20] 06Release-Engineering-Team, 10MediaWiki-Authentication-and-authorization: Jenkins Browser tests for Wikibase are failing - https://phabricator.wikimedia.org/T160519#3104264 (10Bawolff) Looking at the code more closely, what might be happening. Installer detects APC is present, chooses CACHE_ACCEL. APC really... [22:32:44] 10Continuous-Integration-Config, 10OOjs-UI: oojs-ui-demos-publish job needs to run on anything other than Trusty please (modern Node version needed) - https://phabricator.wikimedia.org/T160583#3104266 (10Jdforrester-WMF) [22:35:51] 06Release-Engineering-Team, 10MediaWiki-Authentication-and-authorization: Jenkins Browser tests for Wikibase are failing - https://phabricator.wikimedia.org/T160519#3101972 (10Krinkle) >>! In T160519#3104182, @Bawolff wrote: >>>! In T160519#3102279, @hashar wrote: >> Specially the debug log of HTTP requests se... [22:45:36] 06Release-Engineering-Team, 10MediaWiki-Authentication-and-authorization: Jenkins Browser tests for Wikibase are failing - https://phabricator.wikimedia.org/T160519#3104335 (10Bawolff) So the console output does say: https://integration.wikimedia.org/ci/job/mwext-mw-selenium-composer-jessie/2083/consoleFull ``... [22:47:11] 06Release-Engineering-Team, 10MediaWiki-Authentication-and-authorization: Jenkins Browser tests for Wikibase are failing - https://phabricator.wikimedia.org/T160519#3101972 (10Ciencia_Al_Poder) This may help figuring out {T147161}, in case it's related, that is: installer detects CACHE_ACCEL when it's not avai... [22:55:53] 06Release-Engineering-Team (Deployment-Blockers), 05Release: MW-1.29.0-wmf.16 deployment blockers - https://phabricator.wikimedia.org/T158997#3104372 (10EBernhardson) [23:03:42] 06Release-Engineering-Team, 10MediaWiki-Authentication-and-authorization, 13Patch-For-Review: Jenkins Browser tests for Wikibase are failing - https://phabricator.wikimedia.org/T160519#3104412 (10Krinkle) >>! In T160519#3104335, @Bawolff wrote: > So the console output does say: https://integration.wikimedia.... [23:04:43] 06Release-Engineering-Team, 10MediaWiki-Authentication-and-authorization, 13Patch-For-Review: Jenkins Browser tests for Wikibase are failing - https://phabricator.wikimedia.org/T160519#3104415 (10Bawolff) >>! In T160519#3104379, @gerritbot wrote: > Change 342959 had a related patch set uploaded (by Brian Wol... [23:36:10] 06Release-Engineering-Team (Deployment-Blockers), 05Release: MW-1.29.0-wmf.16 deployment blockers - https://phabricator.wikimedia.org/T158997#3104534 (10mmodell)