[00:30:04] apparently the l10nupdate phase of scap had been failing for ~24 hours [00:30:12] Fun. [00:30:16] it's running that part now [00:30:31] I expect it will take a while longer [00:30:54] our l10nupdate process loves cpu, ram and disk iops [00:31:03] And it loves to break. [00:31:09] all of which are in short supply on deployment-bastion [00:31:15] heh. yeah that too [00:32:04] \o/ passed that bit [00:32:11] https://integration.wikimedia.org/ci/view/Beta/job/beta-scap-eqiad/46608/console [00:33:29] * James_F gets out the popcorn. [00:47:19] Yippee, build fixed! [00:47:19] Project beta-scap-eqiad build #46608: FIXED in 34 min: https://integration.wikimedia.org/ci/job/beta-scap-eqiad/46608/ [00:47:31] VICTORY IS MINE! [00:47:44] hooray! [00:48:18] 10Beta-Cluster, 10Deployment-Systems, 5Patch-For-Review: scap failed: IOError [Errno 13] Permission denied: '/srv/mediawiki-staging/wikiversions-labs.cdb.tmp' - https://phabricator.wikimedia.org/T94261#1158979 (10bd808) This seems to have been another small bout of file permissions and active user fallout fr... [00:49:04] * bd808 rides off into the sunset to drink *more* beer [00:54:14] (03PS5) 10BryanDavis: proxies: allow filtering by datacenter [tools/scap] - 10https://gerrit.wikimedia.org/r/200130 (owner: 10Giuseppe Lavagetto) [00:55:57] (03CR) 10BryanDavis: [C: 031] "More refactoring.Tested on me dev server and it still works without enabling the filter. Not sure where we can test the filter outside of " [tools/scap] - 10https://gerrit.wikimedia.org/r/200130 (owner: 10Giuseppe Lavagetto) [02:11:36] (03CR) 1020after4: [C: 031] proxies: allow filtering by datacenter [tools/scap] - 10https://gerrit.wikimedia.org/r/200130 (owner: 10Giuseppe Lavagetto) [03:26:51] bd808, https://integration.wikimedia.org/ci/view/Beta/job/beta-code-update-eqiad/49395/consoleFull [03:58:45] blerg. missed another mwdeploy reference [04:02:46] Yippee, build fixed! [04:02:46] Project beta-code-update-eqiad build #49399: FIXED in 53 sec: https://integration.wikimedia.org/ci/job/beta-code-update-eqiad/49399/ [04:02:53] !log manually updated beta-code-update-eqiad job to remove sudo to mwdeploy; needs associated jjb change for T94261 [04:02:59] Logged the message, Master [04:14:25] (03PS1) 10BryanDavis: Run wmf-beta-autoupdate.py as jenkins-deploy [integration/config] - 10https://gerrit.wikimedia.org/r/200285 (https://phabricator.wikimedia.org/T94261) [04:27:16] Krenair: Not sure why it didn't announce here, but I fixed the beta-code-update-eqiad job [04:27:36] thanks [04:30:48] (03CR) 10BryanDavis: [C: 032] "Deployed" [integration/config] - 10https://gerrit.wikimedia.org/r/200285 (https://phabricator.wikimedia.org/T94261) (owner: 10BryanDavis) [04:32:53] Yippee, build fixed! [04:32:53] Project browsertests-MultimediaViewer-en.wikipedia.beta.wmflabs.org-windows_7-internet_explorer-9-sauce build #391: FIXED in 40 min: https://integration.wikimedia.org/ci/job/browsertests-MultimediaViewer-en.wikipedia.beta.wmflabs.org-windows_7-internet_explorer-9-sauce/391/ [04:35:11] (03Merged) 10jenkins-bot: Run wmf-beta-autoupdate.py as jenkins-deploy [integration/config] - 10https://gerrit.wikimedia.org/r/200285 (https://phabricator.wikimedia.org/T94261) (owner: 10BryanDavis) [04:36:15] (03PS1) 10BryanDavis: Run scap directly [integration/config] - 10https://gerrit.wikimedia.org/r/200287 [04:40:56] (03CR) 10BryanDavis: [C: 032] "Deployed" [integration/config] - 10https://gerrit.wikimedia.org/r/200287 (owner: 10BryanDavis) [04:43:39] (03PS1) 10BryanDavis: Run update.php as jenkins-deploy [integration/config] - 10https://gerrit.wikimedia.org/r/200289 [04:45:27] (03Merged) 10jenkins-bot: Run scap directly [integration/config] - 10https://gerrit.wikimedia.org/r/200287 (owner: 10BryanDavis) [04:48:22] 10Beta-Cluster, 10Deployment-Systems, 6MediaWiki-Core-Team, 5Patch-For-Review: scap failed: IOError [Errno 13] Permission denied: '/srv/mediawiki-staging/wikiversions-labs.cdb.tmp' - https://phabricator.wikimedia.org/T94261#1159111 (10bd808) [04:50:47] (03CR) 10BryanDavis: [C: 032] "Deployed" [integration/config] - 10https://gerrit.wikimedia.org/r/200289 (owner: 10BryanDavis) [04:55:05] (03Merged) 10jenkins-bot: Run update.php as jenkins-deploy [integration/config] - 10https://gerrit.wikimedia.org/r/200289 (owner: 10BryanDavis) [07:53:06] (03PS2) 10Legoktm: Run composer commands inside "src" for mediawiki-core [integration/config] - 10https://gerrit.wikimedia.org/r/193757 [07:53:37] (03CR) 10Legoktm: "https://integration.wikimedia.org/ci/job/mediawiki-phpunit-hhvm-composer/8/console" [integration/config] - 10https://gerrit.wikimedia.org/r/193757 (owner: 10Legoktm) [10:45:35] 10Deployment-Systems, 6Release-Engineering: Clean up erroneously created wmf/1.20wmf21 branches - https://phabricator.wikimedia.org/T92501#1159223 (10mmodell) I don't have permission to delete branches on those repos. @demon: can has permission? [13:43:48] 10Continuous-Integration, 10MediaWiki-Codesniffer, 3Google-Summer-of-Code-2015, 3Outreachy-Round-10: GSoC Proposal for Improving static analysis tools for MediaWiki - https://phabricator.wikimedia.org/T94140#1159306 (10NiharikaKohli) Hi @Hharchani. Could you breakdown the timeline further and set monthly/b... [13:49:00] 10Continuous-Integration, 10MediaWiki-Codesniffer, 3Google-Summer-of-Code-2015: GSoC Proposal for Improving static analysis tools for MediaWiki - https://phabricator.wikimedia.org/T94140#1159307 (10NiharikaKohli) [14:03:16] Project browsertests-UploadWizard-commons.wikimedia.beta.wmflabs.org-linux-firefox-sauce build #570: FAILURE in 32 min: https://integration.wikimedia.org/ci/job/browsertests-UploadWizard-commons.wikimedia.beta.wmflabs.org-linux-firefox-sauce/570/ [14:40:29] 10Staging, 3releng-201415-Q3: [Quarterly Success Metric] Stable uptime metrics of the Staging cluster - https://phabricator.wikimedia.org/T88705#1159343 (10mmodell) [15:09:07] PROBLEM - Puppet failure on deployment-cache-mobile03 is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [0.0] [17:55:21] 10Continuous-Integration, 10Wikidata: Switch or add additional jenkins jobs to run Wikibase tests with mysql - https://phabricator.wikimedia.org/T94208#1159446 (10JeroenDeDauw) Testing against both would be awesome. Switching to just MySQL has the disadvantage that devs running MySQL might not notice them brea... [19:10:39] 10Continuous-Integration, 10MediaWiki-extensions-MultimediaViewer, 6Multimedia, 5Patch-For-Review: MultimediaViewer thumbnailBeforeProduceHTML hook breaks other extensions parser tests - https://phabricator.wikimedia.org/T69302#1159506 (10TheDJ) Ehm, how about we just add: [22:53:03] 10Continuous-Integration, 6Release-Engineering, 6operations, 7Graphite, 7Upstream: Let us customize Zuul metrics reported to statsd - https://phabricator.wikimedia.org/T1369#1159684 (10hashar) a:5hashar>3None [22:55:05] 10Continuous-Integration: Bump Zuul support for python-statsd 3.x - https://phabricator.wikimedia.org/T78402#1159693 (10hashar) I have send a work in progress patch upstream https://review.openstack.org/#/c/141391/ [23:32:18] So I'm trying to get multiversion working on mediawiki-vagrant. It seems that the multiversion bits are half way there but only currently handle switching of the database, not the source checkout. Also, it looks like an awful lot of legacy cruft (and lots of it unnecessary) ... would anyone be offended if I rewrite the whole thing? ;) [23:34:24] I guess it wouldn't be fair to take silence on a saturday to signify broad approval and agreement ;) [23:47:58] twentyafterfour: if you make it better, I doubt you'll offend anyone [23:48:56] legoktm: Yeah I was half-joking about offending anyone... I think it's definitely got some room for improvement [23:51:04] :)