[00:25:44] 10Continuous-Integration-Infrastructure, 10Parsoid, 10RESTBase, 6Services, 7Parsoid-Tests: Move Parsoid and RESTBase testing from Travis CI to our Jenkins - https://phabricator.wikimedia.org/T78410#1714232 (10jayvdb) >>! In T78410#1714147, @GWicke wrote: > @jayvdb: http://codecov.io looks interesting, th... [00:35:55] 10Continuous-Integration-Infrastructure, 10Parsoid, 10RESTBase, 6Services, 7Parsoid-Tests: Move Parsoid and RESTBase testing from Travis CI to our Jenkins - https://phabricator.wikimedia.org/T78410#1714244 (10GWicke) >>! In T78410#1714232, @jayvdb wrote: >>>! In T78410#1714147, @GWicke wrote: >> @jayvdb:... [00:39:13] 10Deployment-Systems, 6operations, 5Patch-For-Review: install/deploy mira as codfw deployment server - https://phabricator.wikimedia.org/T95436#1714249 (10Dzahn) [00:40:11] 10Deployment-Systems, 6operations, 5Patch-For-Review: install/deploy mira as codfw deployment server - https://phabricator.wikimedia.org/T95436#1190083 (10Dzahn) firewalling also done now. fixed in T113351 and active now. [00:49:20] 10Beta-Cluster-Infrastructure, 10MobileFrontend, 7Easy, 7Mobile: Beta Cluster login (desktop and mobile) should have a warning that it is not a Wikimedia site - https://phabricator.wikimedia.org/T114552#1714266 (10Jdlrobson) [00:49:36] 10Beta-Cluster-Infrastructure, 10MobileFrontend, 7Easy, 7Mobile: Beta Cluster login (desktop and mobile) should have a warning that it is not a Wikimedia site - https://phabricator.wikimedia.org/T114552#1699178 (10Jdlrobson) I haven't got the bandwidth right now to research logos for this stuff... [00:49:46] 10Beta-Cluster-Infrastructure, 7Easy, 7Mobile: Beta Cluster login (desktop and mobile) should have a warning that it is not a Wikimedia site - https://phabricator.wikimedia.org/T114552#1714268 (10Jdlrobson) [00:55:40] PROBLEM - Puppet staleness on integration-dev is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [43200.0] [01:15:00] PROBLEM - Puppet staleness on deployment-conf03 is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [43200.0] [01:38:23] PROBLEM - Free space - all mounts on deployment-bastion is CRITICAL: CRITICAL: deployment-prep.deployment-bastion.diskspace._var.byte_percentfree (<33.33%) [02:55:40] 10Beta-Cluster-Infrastructure, 10MobileFrontend, 7Easy, 7Mobile: MobileFrontEnd on Beta Cluster should have a warning that it is not a Wikimedia site - https://phabricator.wikimedia.org/T115078#1714377 (10greg) 3NEW [02:56:56] heh "Change 243732 had a related patch set uploaded (by $uploader-name):" [02:57:01] https://phabricator.wikimedia.org/T115078#1714385 [02:57:52] 10Beta-Cluster-Infrastructure, 10MobileFrontend, 7Easy, 7Mobile, 5Patch-For-Review: MobileFrontEnd on Beta Cluster should have a warning that it is not a Wikimedia site - https://phabricator.wikimedia.org/T115078#1714390 (10greg) [02:57:55] 10Beta-Cluster-Infrastructure, 6Labs, 7Tracking: Beta Cluster <-> WMF Labs policy compliance (tracking) - https://phabricator.wikimedia.org/T114615#1714389 (10greg) [02:58:41] 10Beta-Cluster-Infrastructure, 7Easy, 7Mobile: Beta Cluster login should have a warning that it is not a Wikimedia site (on Desktop) - https://phabricator.wikimedia.org/T114552#1714391 (10greg) [02:59:13] 10Beta-Cluster-Infrastructure, 10MobileFrontend, 7Easy, 7Mobile, 5Patch-For-Review: MobileFrontEnd on Beta Cluster should have a warning that it is not a Wikimedia site - https://phabricator.wikimedia.org/T115078#1714395 (10Jdlrobson) It's a config change so is outside MobileFrontend ;) I just want to se... [02:59:33] 10Beta-Cluster-Infrastructure, 6Labs, 7Tracking: Beta Cluster <-> WMF Labs policy compliance (tracking) - https://phabricator.wikimedia.org/T114615#1700939 (10greg) [02:59:35] 10Beta-Cluster-Infrastructure, 7Easy, 7Mobile: Beta Cluster login should have a warning that it is not a Wikimedia site (on Desktop) - https://phabricator.wikimedia.org/T114552#1699178 (10greg) 5Open>3Resolved a:5Jdlrobson>3Luke081515 [04:58:23] 10Continuous-Integration-Config, 10MediaWiki-extensions-GPGMail: Add Jenkins configuration for mediawiki/GPGMail - https://phabricator.wikimedia.org/T115041#1714471 (10Revi) [06:38:24] RECOVERY - Free space - all mounts on deployment-bastion is OK: OK: All targets OK [08:01:44] zeljkof: pff poor hangouts [08:02:24] hashar: want to switch to firefox hello? [08:23:08] (03PS3) 10Hashar: Migrate forrestbot to a single tox job [integration/config] - 10https://gerrit.wikimedia.org/r/242349 [08:23:27] freezing freezing zeljkof :D [08:24:18] (03CR) 10Hashar: [C: 032] Migrate forrestbot to a single tox job [integration/config] - 10https://gerrit.wikimedia.org/r/242349 (owner: 10Hashar) [08:24:22] hashar: argh hangouts [08:24:30] yeah [08:24:38] zeljkof: we are done anyway [08:24:42] I think there is something wrong maybe with this machine [08:24:56] yes, see you next week [08:25:17] (03Merged) 10jenkins-bot: Migrate forrestbot to a single tox job [integration/config] - 10https://gerrit.wikimedia.org/r/242349 (owner: 10Hashar) [09:14:48] (03PS3) 10Zfilipin: Cleanup of browser tests notification e-mails [integration/config] - 10https://gerrit.wikimedia.org/r/242874 (https://phabricator.wikimedia.org/T90705) [09:15:15] (03CR) 10Amire80: [C: 031] Cleanup of browser tests notification e-mails [integration/config] - 10https://gerrit.wikimedia.org/r/242874 (https://phabricator.wikimedia.org/T90705) (owner: 10Zfilipin) [09:18:28] (03CR) 10Zfilipin: [C: 032] Cleanup of browser tests notification e-mails [integration/config] - 10https://gerrit.wikimedia.org/r/242874 (https://phabricator.wikimedia.org/T90705) (owner: 10Zfilipin) [09:20:09] (03Merged) 10jenkins-bot: Cleanup of browser tests notification e-mails [integration/config] - 10https://gerrit.wikimedia.org/r/242874 (https://phabricator.wikimedia.org/T90705) (owner: 10Zfilipin) [09:22:20] 10Browser-Tests, 10Continuous-Integration-Infrastructure, 10VisualEditor, 5Patch-For-Review: Add Amir to browsertests-VisualEditor-language-screenshot-os_x_10.10-firefox e-mail notifications - https://phabricator.wikimedia.org/T90705#1714818 (10zeljkofilipin) 5Open>3Resolved The commit is merged, the j... [09:34:46] 10Browser-Tests, 10ContentTranslation-cxserver: Fix or delete failing ContentTranslation browsertests Jenkins jobs - https://phabricator.wikimedia.org/T113734#1714837 (10zeljkofilipin) Looks like this is the file: https://commons.wikimedia.org/wiki/File:ContentTranslation_Contributions_popover-en.png This lo... [09:35:24] 10Browser-Tests, 10MediaWiki-extensions-ContentTranslation: Fix or delete failing ContentTranslation browsertests Jenkins jobs - https://phabricator.wikimedia.org/T113734#1714839 (10Amire80) [09:44:43] 10Browser-Tests, 10MediaWiki-extensions-ContentTranslation: Fix or delete failing ContentTranslation browsertests Jenkins jobs - https://phabricator.wikimedia.org/T113734#1714854 (10zeljkofilipin) a:5Amire80>3zeljkofilipin Looks like there is something wrong with the cucumber scenario, the language is alwa... [09:48:12] (03PS1) 10Bmansurov: Add the Cards extension [integration/config] - 10https://gerrit.wikimedia.org/r/244650 (https://phabricator.wikimedia.org/T114393) [09:52:24] CFisch_WMDE: I have moved the meeting to 1:30 pm, is that what you wanted? later? [09:52:40] jepps [09:52:47] perfect [09:52:58] thanks [09:54:04] ok, see you then! [09:55:04] oh wait Tobi just wrote me - would 2om also be good for you? ^^ [09:55:07] zeljkof: [09:55:42] *2pm [09:55:54] CFisch_WMDE: sure, moving to 2pm [09:56:08] great ;-) [10:24:27] (03CR) 10Thiemo Mättig (WMDE): [C: 031] "Needed for If4ec903." [integration/config] - 10https://gerrit.wikimedia.org/r/244489 (owner: 10Aude) [10:34:04] (03CR) 10Aude: "we might also want to enable it for the Wikidata build jobs, but not sure where that is done" [integration/config] - 10https://gerrit.wikimedia.org/r/244489 (owner: 10Aude) [11:00:49] (03PS1) 10Hashar: Remove some obsolete jslint jobs [integration/config] - 10https://gerrit.wikimedia.org/r/244664 [11:02:15] (03CR) 10Hashar: [C: 032] Remove some obsolete jslint jobs [integration/config] - 10https://gerrit.wikimedia.org/r/244664 (owner: 10Hashar) [11:04:18] (03Merged) 10jenkins-bot: Remove some obsolete jslint jobs [integration/config] - 10https://gerrit.wikimedia.org/r/244664 (owner: 10Hashar) [12:05:56] 10Continuous-Integration-Config: replace Jenkins job mwext-testextension-zend by mwext-testextension-zend-composer - https://phabricator.wikimedia.org/T115061#1715058 (10JanZerebecki) Yes an extension that never needs to use vendor.git can be switched to only composer based jobs instead of needing to also have t... [12:22:34] 10Browser-Tests, 10Wikidata, 3Wikidata-Sprint-2015-10-13: adapt wikidata_api gem to be compatible with mediawiki_api gem version 0.4 - https://phabricator.wikimedia.org/T106811#1715067 (10zeljkofilipin) Related commit: https://github.com/wmde/WikidataApiGem/pull/8 [12:23:11] 10Browser-Tests, 10Wikidata, 3Wikidata-Sprint-2015-10-13: adapt wikidata_api gem to be compatible with mediawiki_api gem version 0.4 - https://phabricator.wikimedia.org/T106811#1715069 (10zeljkofilipin) a:3Tobi_WMDE_SW [12:23:51] 10Browser-Tests, 10Wikidata, 3Wikidata-Sprint-2015-10-13: adapt wikidata_api gem to be compatible with mediawiki_api gem version 0.4 - https://phabricator.wikimedia.org/T106811#1478899 (10zeljkofilipin) Assigned to @Tobi_WMDE_SW since he has pushed a commit that should fix this. [12:24:44] 10Browser-Tests, 10Wikidata, 5Patch-For-Review, 3Wikidata-Sprint-2015-10-13: Adapt wikidata_api gem to be compatible with newest mediawiki_api gem - https://phabricator.wikimedia.org/T106811#1715071 (10Tobi_WMDE_SW) [12:24:53] 10Browser-Tests, 10Wikidata, 5Patch-For-Review, 3Wikidata-Sprint-2015-10-13: Adapt wikidata_api gem to be compatible with newest mediawiki_api gem - https://phabricator.wikimedia.org/T106811#1478899 (10Tobi_WMDE_SW) https://github.com/wmde/WikidataApiGem/pull/8 [12:29:51] 10Browser-Tests, 6Release-Engineering-Team, 10Wikidata: Update Wikidata BrowserTests to use mediawiki_selenium 1.6.0 - https://phabricator.wikimedia.org/T115109#1715075 (10Tobi_WMDE_SW) 3NEW a:3Tobi_WMDE_SW [12:30:11] 10Browser-Tests, 10Wikidata, 5Patch-For-Review, 3Wikidata-Sprint-2015-10-13: Adapt wikidata_api gem to be compatible with newest mediawiki_api gem - https://phabricator.wikimedia.org/T106811#1715083 (10Tobi_WMDE_SW) [12:30:14] 10Browser-Tests, 6Release-Engineering-Team, 10Wikidata: Update Wikidata BrowserTests to use mediawiki_selenium 1.6.0 - https://phabricator.wikimedia.org/T115109#1715075 (10Tobi_WMDE_SW) [12:33:39] 10Browser-Tests, 6Release-Engineering-Team, 10Wikidata, 5Patch-For-Review: Update Wikidata BrowserTests to use mediawiki_selenium 1.6.0 - https://phabricator.wikimedia.org/T115109#1715084 (10Tobi_WMDE_SW) [12:33:42] 10Browser-Tests, 6Release-Engineering-Team, 10Wikidata, 5Patch-For-Review: Update Wikidata BrowserTests to use mediawiki_selenium 1.6.0 - https://phabricator.wikimedia.org/T115109#1715075 (10Tobi_WMDE_SW) https://github.com/wmde/WikidataBrowserTests/pull/89 [13:04:25] (03CR) 10Hashar: [C: 04-1] "Well done! Some of the jobs triggers are redundant with the templates, so that can be lightened." (036 comments) [integration/config] - 10https://gerrit.wikimedia.org/r/244650 (https://phabricator.wikimedia.org/T114393) (owner: 10Bmansurov) [13:05:07] 10Browser-Tests, 10MediaWiki-extensions-WikibaseRepository, 10Wikidata: [Bug] fix no implicit conversion of String into Integer (TypeError) in browsertests - https://phabricator.wikimedia.org/T111069#1715135 (10Tobi_WMDE_SW) I was not able to reproduce this. Sure this issue still exists? [13:06:26] 10Browser-Tests, 10MediaWiki-extensions-WikibaseRepository, 10Wikidata: [Bug] fix no implicit conversion of String into Integer (TypeError) in browsertests - https://phabricator.wikimedia.org/T111069#1715137 (10Tobi_WMDE_SW) Also, on the current version of Wikidata I'm getting back a Hash in both cases (if s... [13:13:36] (03Abandoned) 10Hashar: Update repositories on developer machine [integration/dashboard] - 10https://gerrit.wikimedia.org/r/238691 (owner: 10Hashar) [13:46:52] (03PS3) 10Hashar: [Ads] Add extension-unittests-generic test [integration/config] - 10https://gerrit.wikimedia.org/r/242196 (owner: 10Paladox) [13:47:40] (03PS4) 10Hashar: [Ads] Add extension-unittests-generic test [integration/config] - 10https://gerrit.wikimedia.org/r/242196 (owner: 10Paladox) [13:48:23] (03CR) 10Hashar: [Ads] Add extension-unittests-generic test (031 comment) [integration/config] - 10https://gerrit.wikimedia.org/r/242196 (owner: 10Paladox) [13:49:49] (03PS5) 10Hashar: [Ads] Add extension-unittests-generic test [integration/config] - 10https://gerrit.wikimedia.org/r/242196 (owner: 10Paladox) [13:50:00] (03CR) 10Hashar: [C: 032] [Ads] Add extension-unittests-generic test [integration/config] - 10https://gerrit.wikimedia.org/r/242196 (owner: 10Paladox) [13:51:54] (03Merged) 10jenkins-bot: [Ads] Add extension-unittests-generic test [integration/config] - 10https://gerrit.wikimedia.org/r/242196 (owner: 10Paladox) [14:06:30] CFisch_WMDE: dare to merge https://github.com/wmde/WikidataApiGem/pull/8? :D [14:08:39] Tobi_WMDE_SW: sure ;-) [14:10:09] \0/ [14:15:55] 10Browser-Tests, 7I18n, 5Patch-For-Review, 5WMF-deploy-2015-10-13_(1.27.0-wmf.3): Hacking: Load i18n messages from MediaWiki to browser tests - https://phabricator.wikimedia.org/T90577#1715188 (10zeljkofilipin) 5Open>3Resolved [14:19:57] 10Browser-Tests, 6Release-Engineering-Team, 10Wikidata, 5Patch-For-Review: Update Wikidata BrowserTests to use mediawiki_selenium 1.6.0 - https://phabricator.wikimedia.org/T115109#1715192 (10Tobi_WMDE_SW) [14:19:58] 10Browser-Tests, 6Release-Engineering-Team, 6Security: Update all repositories that use mediawiki_selenium Ruby gem to version 1.6.x - https://phabricator.wikimedia.org/T114241#1715193 (10Tobi_WMDE_SW) [14:20:02] 10Browser-Tests, 10Wikidata, 5Patch-For-Review, 3Wikidata-Sprint-2015-10-13: Adapt wikidata_api gem to be compatible with newest mediawiki_api gem - https://phabricator.wikimedia.org/T106811#1715191 (10Tobi_WMDE_SW) 5Open>3Resolved [14:24:10] CFisch_WMDE: thanks! road clear for mediawiki_selenium 1.6.0 :) [14:24:20] https://github.com/wmde/WikidataBrowserTests/pull/89 [14:24:52] jepp currently running a few features :-) [14:39:51] bd808, any idea what the scap-test dsh group does? [14:44:37] hashar: around? or someone who can review https://gerrit.wikimedia.org/r/#/c/244489/ ? [14:44:47] to update zuul config [14:45:12] aude: he :) [14:50:19] (03PS2) 10Hashar: Enable GeoData extension for Wikibase repo jobs [integration/config] - 10https://gerrit.wikimedia.org/r/244489 (owner: 10Aude) [14:51:17] thanks [14:51:42] aude: how is it needed since https://gerrit.wikimedia.org/r/#/c/243625/ doesn't fail the tests ? [14:51:50] oh skip [14:52:15] zeljkof: hashar: wondering if https://phabricator.wikimedia.org/T110510 will be fixed by using mediawiki_selenium 1.6.0. but I'm not very optimistic.. [14:53:13] hashar: yes skip [14:53:28] aude: jobs are updating [14:54:39] !log added Geodata as a dependency to the wikibase jobs ( https://gerrit.wikimedia.org/r/#/c/244489/ ) [14:54:47] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL, Master [14:54:50] aude: should be good I rechecked https://gerrit.wikimedia.org/r/#/c/243625/ [14:55:09] Tobi_WMDE_SW: we talked about it with dan/zeljko [14:55:23] hashar: great [14:55:27] Tobi_WMDE_SW: you might want to poke Dan about it since that is actually a blocker [14:56:29] aude: if it is all good on https://gerrit.wikimedia.org/r/#/c/243625/ , I will +2 the CI change [14:57:08] ok [14:57:51] hashar: is there some doc where the issue is outlined? [14:58:06] don't think the tests got skipped this time [14:58:14] Krenair: I think that was the group Ori setup for when we were testing hhvm restarts as part of the scap process [14:58:24] It can probably be removed [14:58:38] Tobi_WMDE_SW: which issue? The selenium 1.6x indentation error ? [14:58:44] Okay, I was just checking for differences between tin and mira and that file came up [14:58:50] (03CR) 10Hashar: [C: 032] Enable GeoData extension for Wikibase repo jobs [integration/config] - 10https://gerrit.wikimedia.org/r/244489 (owner: 10Aude) [14:59:17] hashar: yep [15:02:08] hashar: but the issues outlined in https://phabricator.wikimedia.org/T110510 were with mediawiki_selenium 1.3x already [15:02:26] (03CR) 10JanZerebecki: "The dependencies for the build are in jjb/mediawiki-extensions.yaml (first occurrence of Wikidata)." [integration/config] - 10https://gerrit.wikimedia.org/r/244489 (owner: 10Aude) [15:04:17] (03Merged) 10jenkins-bot: Enable GeoData extension for Wikibase repo jobs [integration/config] - 10https://gerrit.wikimedia.org/r/244489 (owner: 10Aude) [15:05:55] (03CR) 10Aude: "@jan thanks. we shall submit another patch for the build" [integration/config] - 10https://gerrit.wikimedia.org/r/244489 (owner: 10Aude) [15:35:47] 10Beta-Cluster-Infrastructure, 10MobileFrontend, 7Easy, 7Mobile, 5Patch-For-Review: MobileFrontEnd on Beta Cluster should have a warning that it is not a Wikimedia site - https://phabricator.wikimedia.org/T115078#1715432 (10Krenair) [15:35:49] 10Beta-Cluster-Infrastructure, 7Easy, 7Mobile: Beta Cluster login should have a warning that it is not a Wikimedia site (on Desktop) - https://phabricator.wikimedia.org/T114552#1715431 (10Krenair) [15:41:36] 10Beta-Cluster-Infrastructure, 10MobileFrontend, 7Easy, 7Mobile, 5Patch-For-Review: MobileFrontEnd on Beta Cluster should have a warning that it is not a Wikimedia site - https://phabricator.wikimedia.org/T115078#1715470 (10greg) [15:45:11] Hmm, master scap be broken. [15:47:07] (03PS2) 10Bmansurov: Add the Cards extension [integration/config] - 10https://gerrit.wikimedia.org/r/244650 (https://phabricator.wikimedia.org/T114393) [15:51:52] ostriches: say what now? [15:55:11] Lemme try somethin.... [15:55:54] ostriches: present for you [15:55:55] git clone ssh://vcs@git-ssh.wikimedia.org/diffusion/TEST/testrepo.git [15:56:30] 10Beta-Cluster-Infrastructure, 10MobileFrontend, 7Easy, 7Mobile, 5Patch-For-Review: MobileFrontEnd on Beta Cluster should display a different logo so that it is clearly not a production site - https://phabricator.wikimedia.org/T115078#1715481 (10Krenair) [16:00:28] 6Release-Engineering-Team, 6Phabricator, 10Traffic, 6operations, and 2 others: Phabricator needs to expose ssh - https://phabricator.wikimedia.org/T100519#1715484 (10chasemp) >>! In T100519#1707242, @Legoktm wrote: >>>! In T100519#1706391, @chasemp wrote: >> @demon explained some of the historical difficul... [16:02:04] chasemp: \o/ [16:03:15] PROBLEM - Puppet failure on deployment-parsoidcache02 is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [0.0] [16:03:15] PROBLEM - Puppet failure on deployment-mx is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [0.0] [16:03:15] PROBLEM - Puppet failure on integration-slave-jessie-1001 is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [0.0] [16:03:27] is vcs@git-ssh wonky yes, hopefully we can address that w/ death of git.wm.o [16:12:46] thcipriani: 09:12:14 ['/srv/deployment/scap/scap/bin/deploy-local', "-D 'git_deploy_dir:/srv/deployment'", "-D 'git_repo_user:vagrant'", "-D 'git_server:192.168.122.1'", "-D 'git_scheme:http'", "-D 'git_repo:mockbase/deploy'", "-D 'git_rev:09ca395f2d503c3717cff3f2700fc00ef6458cb1'", "-D 'git_submodules:True'", "-D 'service_name:mockbase'", "-D [16:12:46] 'service_port:1134'", "-D 'service_timeout:120'", "-D 'config_deploy:True'", "-D 'perform_checks:True'", '-D log_json:True', '-v', 'config_deploy'] on scap-target-07 returned [70]: [16:12:57] (This is with a fresh VM) [16:13:37] ostriches: :\ bummer, lemme destroy/rebuild. [16:14:11] oh, wait, is there an nrpe check in scap-vagrant/files/deploy/scap/checks.yaml ? [16:14:26] 10Browser-Tests, 6Release-Engineering-Team, 10Reading-Web, 5Patch-For-Review: Failed Jenkins job sets Sauce Labs job to passed - https://phabricator.wikimedia.org/T105589#1715529 (10Jdlrobson) Do we know what's happening here? It's preventing us debugging a problem with browser tests. [16:14:35] I noticed yesterday that that had merged to scap-vagrant, but hasn't merged to scap yet. [16:14:44] (which causes a failure) [16:14:56] indeed! [16:15:00] indeed it does [16:16:13] we really need to reimplement logging of target messages [16:16:27] ^ [16:16:36] 10Browser-Tests, 6Release-Engineering-Team, 10Reading-Web, 5Patch-For-Review: Failed Jenkins job sets Sauce Labs job to passed - https://phabricator.wikimedia.org/T105589#1715534 (10Jdlrobson) [16:16:36] definitely slowing down troubleshooting. [16:17:26] * bd808 is jealous of people who get to work on deploy tools [16:17:58] bd808: we always have a place at our table for you [16:18:29] bd808: wa-wa [16:18:51] somebody get that guy off our lawn [16:18:58] maybe I'll code review mw-vagrant patches today to compensate [16:19:20] somebody make a space for that guy on our lawn [16:22:00] lol [16:22:25] bd808: I trust you saw scap-vagrant? :) [16:22:35] umm... no? [16:22:39] marxarelli: !!!! [16:22:50] https://phabricator.wikimedia.org/diffusion/GSV/ [16:23:14] fun. [16:23:17] yeah man, it's on Diff(u) now [16:23:31] I have one of those but never made it sharable with anyone. [16:23:44] (or updated it to work on the 14.04 branch) [16:24:15] ha. https://www.mediawiki.org/wiki/Deployment_tooling/Notes/What_does_scap_do is a trip down memory lane [16:24:35] so much starting at weird shell scripts and scratching my head [16:29:32] marxarelli: We could set Phab to replicate to Github possibly so we can just submit patches directly to Phab. [16:29:39] (Gotta figure that out eventually anyway) [16:30:01] ostriches: that sounds good to me [16:30:17] Actually, I dunno if we can. Ugh [16:30:21] "No credentials" [16:30:34] And "K6 Testing credential storage" [16:30:41] Are the two options for auth on mirrors. [16:30:56] ostriches: i'd also be happy to just kill the GH repo now that it's on diffusion [16:31:08] pretty please figure out how to handle PRs with a bot like FB does with their github->phab bridge [16:31:26] marxarelli: Which is also ok in this case, but I'm curious how we plan to do this generally. [16:31:47] ostriches: ah, ok. it would make a good test dummy then [16:31:53] phab is much much much nicer for code review but github drivebys are easy to get from people [16:35:45] I guess we need to land that npre change to scap then? [16:37:14] ostriches: yeah, we were discussing Diff workflow yesterday. it seems Diff wants the author to land the patch which has implications for our general +2 mentality [16:37:56] which actually seems like a better workflow to me, but it makes accepting the patch more of a commitment than a Gerrit +1 would be [16:37:58] Yeah [16:38:42] so, anyway, i can land it if that sounds good to you guys [16:39:54] +1 [16:40:07] though adopting a broader policy around who lands Diff patches should be weighed in on [16:40:13] maybe an rfc [16:40:44] It'll be a component of our RfC, I'm sure. [16:43:10] https://phabricator.wikimedia.org/T138 [16:43:18] "There are multiple revisions on feature branch 'T114284' which are not present on 'master'" [16:43:33] liar [16:44:43] thcipriani: lame. i think when you landed my patch, arc created a brand new commit [16:45:38] and it doesn't seem to add a commit field, but changes the author [16:45:45] *commiter* [16:57:57] marxarelli: Yerp :\ [17:04:54] 10Deployment-Systems, 3Scap3: Implement nrpe config parser to easily hook into Puppet managed checks - https://phabricator.wikimedia.org/T114284#1715628 (10dduvall) [17:12:15] some of this, most of this is configurable [17:12:22] the default squash behavior etc [17:13:45] also if you guys haven't check out https://phabricator.wikimedia.org/owners/ [17:14:09] docs are sparse but it's going to be super powerful for us I think [17:16:01] marxarelli: fwiw I used a similar work flow to ops-puppet before where ppl could submit diffs on a repo they had no privs to land on [17:16:11] and it was all more or less sane, but different [17:19:11] chasemp: The upside of Gerrit is it preserves the committer/author distinction when a user puts up a patch for a repo they can't land on. [17:19:24] I think we can do that here too [17:19:31] Good :) [17:19:48] this has evolved since I lived with it day to day [17:19:57] but I recall this workflow as we had a locked down puppet repo etc [17:20:59] 10Beta-Cluster-Infrastructure, 10MediaWiki-Configuration, 10Reading Web Planning, 7Easy, and 2 others: MobileFrontEnd on Beta Cluster should display a different logo so that it is clearly not a production site - https://phabricator.wikimedia.org/T115078#1715678 (10Jdlrobson) [17:35:21] chasemp: https://gerrit.wikimedia.org/r/#/c/244715/ :) [17:37:37] ostriches: phabricator.wikimedia.org vs git-ssh.wikimedia.org? [17:38:05] We don't typically push back from these repos, also wouldn't have a pub/private key pair. [17:38:48] I'm not sure you can clone at all not from git-ssh atm [17:38:54] even http? [17:39:41] chasemp: You can clone over https... [17:40:04] right yes ok :) It's early man [17:40:26] I forgot its diffusion.SSH-host [17:41:49] chasemp: eg: `git clone https://phabricator.wikimedia.org/diffusion/OPUP/operations-puppet.git` [17:42:12] I just have to go and turn it on everywhere now...it's off by default when we're unhosted. [17:42:19] the moment I said anything I realized :) [17:42:28] riht [17:44:54] It's all stored in a json blob in a single column, yay [17:46:39] and bin/repository only lets you edit the local path? Meh [17:47:24] what are you trying to edit now? oh [17:47:30] the clone avail [17:47:44] yes one of their big blind spots of "let's drop all settings into this one field as json" [17:49:03] chasemp: Yeah, enabling read-only serving of all repos over http and ssh [17:49:36] I'm guessing this is needed to supplant git.wm.o? [17:49:48] Technically yes [17:56:40] 10Beta-Cluster-Infrastructure, 10MediaWiki-Configuration, 10Reading Web Planning, 7Easy, and 2 others: MobileFrontEnd on Beta Cluster should display a different logo so that it is clearly not a production site - https://phabricator.wikimedia.org/T115078#1715822 (10Krenair) This is not #MediaWiki-Configuration [17:56:51] 10Beta-Cluster-Infrastructure, 10Reading Web Planning, 7Easy, 7Mobile, 5Patch-For-Review: MobileFrontEnd on Beta Cluster should display a different logo so that it is clearly not a production site - https://phabricator.wikimedia.org/T115078#1715823 (10Krenair) [18:03:10] 10Deployment-Systems, 3Scap3: Scap3 check to monitor logstash and detect changes in error frequency - https://phabricator.wikimedia.org/T110068#1715859 (10dduvall) [18:03:13] 10Deployment-Systems, 3Scap3, 5Patch-For-Review: Scap3 should support post-deploy checks - https://phabricator.wikimedia.org/T109515#1715858 (10dduvall) 5Open>3Resolved [18:04:14] chasemp: I've hacked up a change to bin/repository that lets me edit hosting policies. [18:14:07] ostriches: cool deal [18:17:58] Enabled readonly serving of all Phab repos over https/ssh. [18:18:10] (minus the 2 that are supposed to be read/write atm) [18:19:22] which two are supposed to be writeable? [18:19:43] A test repo and scap. [18:20:07] twentyafterfour: https://phabricator.wikimedia.org/P2176, if you think it's worth upstreaming. I undid my hack from iridium after I finished. [18:21:28] ostriches: we could at least merge it into our fork... [18:22:05] I like it a lot [18:22:16] but it may be better suited as part of the repo api? [18:22:21] but I don't mind either way [18:23:16] chasemp: it's probably easier to hack into the cli and also easier to use since it doesn't require a custom conduit client to exercise the api. But yeah the api should really support it too [18:23:25] The repo api is read only and create only [18:23:29] Not update [18:23:38] Yeah making it support update would be nice [18:23:48] weird that it doesn't [18:24:02] Its newish and unstable still [18:24:07] chasemp: they are in the middle of totally overhauling the repo hosting stuff to allow clustered repos [18:24:18] like one front end that terminates to multiple git backends [18:24:27] or actually multiple frontends and backends [18:24:33] sure yeah [18:25:38] (03PS1) 10Hashar: Hardcode wiki page header [integration/dashboard] - 10https://gerrit.wikimedia.org/r/244723 [18:26:53] I'm not even sure it's worth keeping that change, heh [18:27:03] It really was just a one-time mass migration of all the existing repos [18:27:20] ostriches: it still doesn't hurt anything we might as well upstream it if they want it [18:27:42] * ostriches arc diffs [18:28:27] sweet [18:35:13] * ostriches twiddles thumbs while arc lint does its thing [18:44:22] (03PS1) 10Hashar: Normalize path of oojs/VisualEditor [integration/dashboard] - 10https://gerrit.wikimedia.org/r/244726 [18:45:22] (03CR) 10Hashar: "@legoktm that is a breaking change for your and labs setups. Maybe later we can introduce a file hierarchy map." [integration/dashboard] - 10https://gerrit.wikimedia.org/r/244726 (owner: 10Hashar) [18:49:46] greg-g: there's something totally weird about your gerrit account, even gerrit-->phab bot doesn't see it properly: https://phabricator.wikimedia.org/T115078#1714385 [18:51:08] (03CR) 10Jforrester: [C: 04-1] "The 'hierarchy' of gerrit is irrelevant, won't mean anything once we've moved to Phabricator, and both of these changes are inappropriate " [integration/dashboard] - 10https://gerrit.wikimedia.org/r/244726 (owner: 10Hashar) [18:56:23] (03CR) 10Hashar: "extension-gate is slightly over complicated / undocumented. It is not very suitable right now :-(" (031 comment) [integration/config] - 10https://gerrit.wikimedia.org/r/244650 (https://phabricator.wikimedia.org/T114393) (owner: 10Bmansurov) [18:56:30] (03PS3) 10Hashar: Add the Cards extension [integration/config] - 10https://gerrit.wikimedia.org/r/244650 (https://phabricator.wikimedia.org/T114393) (owner: 10Bmansurov) [18:56:40] (03CR) 10Hashar: [C: 032] Add the Cards extension [integration/config] - 10https://gerrit.wikimedia.org/r/244650 (https://phabricator.wikimedia.org/T114393) (owner: 10Bmansurov) [18:57:35] (03Merged) 10jenkins-bot: Add the Cards extension [integration/config] - 10https://gerrit.wikimedia.org/r/244650 (https://phabricator.wikimedia.org/T114393) (owner: 10Bmansurov) [19:18:32] (03CR) 10Hashar: [C: 04-1] "I have my local repo mapped based on Gerrit tree which ease things for me. Guess I will add support for alternate hierarchies :-D" [integration/dashboard] - 10https://gerrit.wikimedia.org/r/244726 (owner: 10Hashar) [19:19:53] (03CR) 10Hashar: parsoid: deploy node_modules with npm (031 comment) [integration/config] - 10https://gerrit.wikimedia.org/r/243997 (https://phabricator.wikimedia.org/T92871) (owner: 10Hashar) [19:20:20] (03PS3) 10Hashar: parsoid: deploy node_modules with npm [integration/config] - 10https://gerrit.wikimedia.org/r/243997 (https://phabricator.wikimedia.org/T92871) [19:22:27] 10Continuous-Integration-Config, 5Continuous-Integration-Scaling, 7Puppet: Puppetize npm/grunt manual setup - https://phabricator.wikimedia.org/T113903#1716053 (10hashar) [19:26:49] legoktm: yeah... I saw that [19:26:55] legoktm: I'll futz later [19:27:22] 10Deployment-Systems, 3Scap3: (Re)implement logging output for scap targets - https://phabricator.wikimedia.org/T115137#1716071 (10dduvall) 3NEW a:3dduvall [19:28:03] 10Continuous-Integration-Infrastructure, 10Deployment-Systems, 6Release-Engineering-Team: Don't allow non-existent wikis in server configuration files - https://phabricator.wikimedia.org/T115138#1716084 (10Amire80) 3NEW [19:28:53] 10Browser-Tests, 6Release-Engineering-Team, 10Reading-Web, 5Patch-For-Review: Failed Jenkins job sets Sauce Labs job to passed - https://phabricator.wikimedia.org/T105589#1716092 (10zeljkofilipin) @jdlrobson: unfortunately, nobody had the time to take a look yet :( I have added the task to the meeting [[... [19:30:53] 10Browser-Tests, 3Reading-Web-Sprint-57-The Fifth Element: Investigate QuickSurveys browser tests failures - https://phabricator.wikimedia.org/T113534#1716102 (10Jdlrobson) [19:34:34] 10Continuous-Integration-Config, 6Release-Engineering-Team, 10MediaWiki-Configuration: Don't allow non-existent wikis in server configuration files - https://phabricator.wikimedia.org/T115138#1716132 (10greg) [19:40:15] 10Deployment-Systems, 3Scap3: (Re)implement logging output for scap targets - https://phabricator.wikimedia.org/T115137#1716149 (10mmodell) @dduval: iscap output multiplexing works by directly writing to the pty devices that tmux creates. So what a log viewer for iscap needs to do is simply read the structured... [19:58:29] (03PS1) 10Paladox: [examples] Update extension-unittest test [integration/config] - 10https://gerrit.wikimedia.org/r/244745 [20:01:03] (03PS1) 10Paladox: [examples] Update jenkins tests [integration/config] - 10https://gerrit.wikimedia.org/r/244747 [20:02:42] 10Continuous-Integration-Config, 5Continuous-Integration-Scaling, 5Patch-For-Review, 7Puppet: Puppetize npm/grunt manual setup - https://phabricator.wikimedia.org/T113903#1716267 (10hashar) a:3hashar [20:07:19] (03PS4) 10Hashar: parsoid: deploy node_modules with npm [integration/config] - 10https://gerrit.wikimedia.org/r/243997 (https://phabricator.wikimedia.org/T92871) [20:07:45] (03CR) 10Paladox: "Adds tests here:" [integration/config] - 10https://gerrit.wikimedia.org/r/244747 (owner: 10Paladox) [20:09:35] !log switching Parsoid on beta to install dependencies with npm (instead of /deploy) https://phabricator.wikimedia.org/T92871 for subbu [20:09:41] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL, Master [20:13:22] (03CR) 10Hashar: "Job updated in Jenkins. Puppet part is https://gerrit.wikimedia.org/r/#/c/243992/" [integration/config] - 10https://gerrit.wikimedia.org/r/243997 (https://phabricator.wikimedia.org/T92871) (owner: 10Hashar) [20:16:35] !log Parsoid on beta is broken. Busy installing npm dependencies [20:16:38] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL, Master [20:17:47] 10Browser-Tests, 6Release-Engineering-Team, 10Reading-Web, 5Patch-For-Review: Failed Jenkins job sets Sauce Labs job to passed - https://phabricator.wikimedia.org/T105589#1716347 (10Jdlrobson) Thanks @zeljkofilipin for the update. [20:23:09] 10Beta-Cluster-Infrastructure, 7Blocked-on-RelEng, 10Continuous-Integration-Config, 10Parsoid, 5Patch-For-Review: Parsoid patches don't update Beta Cluster automatically -- only deploy repo patches seem to update that code - https://phabricator.wikimedia.org/T92871#1716355 (10hashar) I have completed the... [20:24:18] PROBLEM - Puppet failure on deployment-parsoid05 is CRITICAL: CRITICAL: 44.44% of data above the critical threshold [0.0] [20:25:55] (03CR) 10Hashar: [C: 032] parsoid: deploy node_modules with npm [integration/config] - 10https://gerrit.wikimedia.org/r/243997 (https://phabricator.wikimedia.org/T92871) (owner: 10Hashar) [20:27:48] (03Merged) 10jenkins-bot: parsoid: deploy node_modules with npm [integration/config] - 10https://gerrit.wikimedia.org/r/243997 (https://phabricator.wikimedia.org/T92871) (owner: 10Hashar) [20:28:15] 10Beta-Cluster-Infrastructure, 7Blocked-on-RelEng, 10Continuous-Integration-Config, 10Parsoid, 5Patch-For-Review: Parsoid patches don't update Beta Cluster automatically -- only deploy repo patches seem to update that code - https://phabricator.wikimedia.org/T92871#1716363 (10hashar) Lets keep the task o... [20:28:59] !log beta cluster parsoid now runs from /parsoid.git && npm install (was from /deploy.git previously). In case of troubles poke subbu and see revert instructions on https://phabricator.wikimedia.org/T92871 [20:29:02] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL, Master [20:33:06] hashar: Could you recheck experiment for https://gerrit.wikimedia.org/r/#/c/236207/ please [20:39:04] ahhh [20:39:21] paladox: did we get any activity on the task to whitelist you ? [20:39:49] I doint think so only two people i think have added them selfs as subscribers [20:39:55] hashar: is it just me, or is jenkins slow again? [20:40:17] !downforme htttps://integration.wikimedia.org/ci/ [20:40:22] zeljkof: do you mean the web ui ? [20:40:29] hashar: yes [20:41:07] zeljkof: https://integration.wikimedia.org/ci/monitoring sometimes gives clue [20:41:51] you can see a surge of http hits https://integration.wikimedia.org/ci/monitoring?part=graph&graph=httpHitsRate [20:42:14] hashar: Would this https://gerrit.wikimedia.org/r/#/c/244745/ patch fix the examples test failing. [20:42:18] yeah, what's up with that [20:42:32] hashar: https://gerrit.wikimedia.org/r/#/c/226684/ [20:42:38] zeljkof: no clue. gotta dig in the /monitoring page [20:42:46] paladox: gotta look at Jenkins :/ [20:42:58] hashar: ok. [20:43:59] paladox: maybe you can reach out to other developers in #wikimedia-dev ? [20:45:03] 10Browser-Tests, 5Patch-For-Review: All repositories that have browser tests should be updated to the latest version of watir-webdriver - https://phabricator.wikimedia.org/T112748#1716398 (10zeljkofilipin) The only thing left to do is merging the last three commits: - https://gerrit.wikimedia.org/r/#/c/238975... [20:46:18] zeljkof: on gallium /var/log/jenkins/access.log , the http requests are from https://integration.wikimedia.org/ci/view/BrowserTests/view/Wikidata/ and hit /ci/view/BrowserTests/view/Wikidata/ajaxExecutors [20:46:34] zeljkof: so someone has left its browser open on that view, and its browser keep asking for the executor queue [20:46:37] nothing to worry about [20:47:59] hashar: thanks [20:47:59] I give up for today [20:47:59] tomorrow is a new day [20:48:29] zeljkof: does it cause you troubles ? [20:48:33] there is some slowness when we update jobs with JJB [20:48:41] cause they have to be reregister with Zuul [20:48:59] hashar: only frustration because it is slow :) [20:49:12] (03PS2) 10Hashar: [examples] Update extension-unittest test [integration/config] - 10https://gerrit.wikimedia.org/r/244745 (owner: 10Paladox) [20:49:33] (03CR) 10Hashar: [C: 04-1] "Pending source change https://gerrit.wikimedia.org/r/#/c/226684/" [integration/config] - 10https://gerrit.wikimedia.org/r/244745 (owner: 10Paladox) [20:50:33] paladox: I did the check experimental [20:50:42] hashar: thankyou. [20:51:33] Reedy: one day we should get rid of timeline/EasyTimeline ( re https://gerrit.wikimedia.org/r/#/c/244739/ ) [20:51:59] Reedy: some hackathon proposed a nice graph system, I am wondering if it can be enhanced to cover the EasyTime use case [20:52:53] Maybe we could create a task for moving it into that nice graph system. [20:54:06] paladox: demo https://www.mediawiki.org/wiki/Extension:Graph/Demo [20:54:29] one trouble is that we have EasyTimeline in the history of a lot of articles [20:54:43] so we would need to find a back compatible way to represent the old timelines [20:55:57] hashar: Could you merge https://gerrit.wikimedia.org/r/#/c/226684/ since it passes the extension-unittests-generic test. It fixes the jenkins test so it can be run. This change does not change anything except from adding a entry point. [20:56:34] hashar: maybe we could keep the timeline/EasyTimeline extension for compat but migrate the code to the graphs extension where it can be updated frequently. [20:57:14] paladox: yeah going to deploy the CI change for examples [20:57:20] (03PS3) 10Hashar: [examples] Update extension-unittest test [integration/config] - 10https://gerrit.wikimedia.org/r/244745 (owner: 10Paladox) [20:57:28] hashar: Thanks. [20:57:50] (03CR) 10Hashar: [C: 032] [examples] Update extension-unittest test [integration/config] - 10https://gerrit.wikimedia.org/r/244745 (owner: 10Paladox) [20:58:38] paladox: with all the expertise you now have on defining composer/npm entry points, maybe you can update the examples at https://www.mediawiki.org/wiki/Continuous_integration/Entry_points [20:58:59] I also found out the 'BoilerPlate' extension [20:59:09] seems to be a skeleton to create a new ext, might be worth referring to it [20:59:20] RECOVERY - Puppet failure on deployment-parsoid05 is OK: OK: Less than 1.00% above the threshold [0.0] [20:59:47] (03Merged) 10jenkins-bot: [examples] Update extension-unittest test [integration/config] - 10https://gerrit.wikimedia.org/r/244745 (owner: 10Paladox) [21:02:23] paladox: congrats for [examples] ! [21:04:53] hashar: what should i do to examples [21:07:21] Oh i know now. I should add the npm/composer test to the examples extension [21:09:18] paladox: legoktm has created some nice dashboard https://www.mediawiki.org/wiki/User:Legoktm/ci :d [21:09:33] that more or less gives you an idea of what still needs to be done [21:09:44] but really, we should find a way to automatize it [21:10:38] hashar: yes it looks really nice and is very helpful on getting the rest of the extensions/skins to be updates to the latest jenkins tests. and yes we should find a way to automatize this. [21:10:54] Thanks @Legoktm [21:10:59] the code is in integration/dashboard.git [21:11:10] Thanks @hashar for finding the link [21:11:12] it is in python [21:11:46] with a bunch of hardcoded stuff :-} [21:12:36] Ok. [21:21:29] hashar: could you rechecke experiment for https://gerrit.wikimedia.org/r/#/c/227220/ since this also fixes jenkins test failing for the extension-unittest-generic test [21:23:21] paladox: you might want to leave Blog.php for back compatibility [21:23:28] and have it just include the new BlogPage.php [21:23:45] this way people don't need to update their LocalSettings.php file [21:23:54] 10Deployment-Systems, 3Scap3: (Re)implement logging output for scap targets - https://phabricator.wikimedia.org/T115137#1716456 (10dduvall) >>! In T115137#1716149, @mmodell wrote: > So, the DeployLog class should be implemented as a stream filter that reads from one stream and writes to another. It would get p... [21:23:54] Ok thanks i will do that after adding npm and grunt to example extension. [21:24:09] paladox: also you can mimic the Jenkins test run [21:24:29] in your LocalSettings.php require_once 'extensions/BlogPages/BlogPages.php' [21:24:34] then you should be able to run: [21:24:42] Oh ok. [21:24:43] php tests/phpunit/phpunit.php --testsuite extensions [21:24:59] you will need to get phpunit installed somehow [21:25:54] Ok. [21:26:10] hashar: i have npm and grunt here for examples extension https://gerrit.wikimedia.org/r/#/c/244750/ [21:27:31] 10Deployment-Systems, 3Scap3: (Re)implement logging output for scap targets - https://phabricator.wikimedia.org/T115137#1716457 (10mmodell) @dduvall I kinda like the idea of the subprocess as well, though doing it in-process would directly address your concern about serializing/parsing json multiple times. At... [21:27:53] PROBLEM - App Server Main HTTP Response on deployment-mediawiki01 is CRITICAL: HTTP CRITICAL: HTTP/1.1 500 Internal Server Error - 50429 bytes in 0.452 second response time [21:28:35] PROBLEM - English Wikipedia Mobile Main page on beta-cluster is CRITICAL: HTTP CRITICAL: HTTP/1.1 503 Service Unavailable - string 'Wikipedia' not found on 'http://en.m.wikipedia.beta.wmflabs.org:80/wiki/Main_Page?debug=true' - 8774 bytes in 0.487 second response time [21:29:05] PROBLEM - App Server Main HTTP Response on deployment-mediawiki02 is CRITICAL: HTTP CRITICAL: HTTP/1.1 500 Internal Server Error - 50430 bytes in 0.470 second response time [21:29:35] PROBLEM - English Wikipedia Main page on beta-cluster is CRITICAL: HTTP CRITICAL: HTTP/1.1 503 Service Unavailable - string 'Wikipedia' not found on 'http://en.wikipedia.beta.wmflabs.org:80/wiki/Main_Page?debug=true' - 8830 bytes in 0.441 second response time [21:29:57] PROBLEM - App Server Main HTTP Response on deployment-mediawiki03 is CRITICAL: HTTP CRITICAL: HTTP/1.1 500 Internal Server Error - 50430 bytes in 0.469 second response time [21:31:09] eh? [21:31:34] yep, 503s on beta [21:31:38] Yeah [21:31:43] 10Deployment-Systems, 3Scap3: (Re)implement logging output for scap targets - https://phabricator.wikimedia.org/T115137#1716476 (10mmodell) @dduvall: Maybe we can make the underlying `DeployLog` class accept native python objects as well as a json stream, then the same filtering code would work in either conte... [21:31:52] Also Elena says she saw "Error connecting to 10.68.16.193: Can't connect to MySQL server on '10.68.16.193' (111)" [21:32:00] Which suggests mysql is down on deployment-db1 [21:32:14] Which it is [21:32:21] thcipriani: marxarelli|lunch twentyafterfour ostriches ^^ [21:32:27] /etc/init.d/mysql: 1: /etc/init.d/mysql: my_print_defaults: not found [21:32:27] /etc/init.d/mysql: 1: /etc/init.d/mysql: my_print_defaults: not found [21:32:28] * MySQL is not running [21:32:28] thcipriani: marxarelli|lunch twentyafterfour ostriches beta cluster is down [21:32:38] ... [21:33:01] /etc/init.d/mysql: 1: /etc/init.d/mysql: my_print_defaults: not found [21:33:34] hashar: Ive re added Blog.php file and fixed the errors it said at https://gerrit.wikimedia.org/r/#/c/227220/ please could you recheck or recheck experiemnt [21:33:38] Starting MySQL [21:33:38] * Couldn't find MySQL manager (/usr/bin/mysqlmanager) or server (/usr/bin/mysqld_safe) [21:33:46] hashar: recheck experiment [21:34:01] Krenair: so it's as if the mysql package was removed? [21:34:02] muther [21:34:23] Honestly I don't know which mysql package to look for [21:34:30] not me not me! [21:34:31] it'll be mariadb [21:34:46] krenair@deployment-db1:/var/log$ mysqld --version [21:34:46] mysqld Ver 5.5.44-0ubuntu0.12.04.1-log for debian-linux-gnu on x86_64 ((Ubuntu)) [21:34:50] Commandline: apt-get install mysql-server-core-5.5 [21:34:51] Install: mysql-server-core-5.5:amd64 (5.5.44-0ubuntu0.12.04.1) [21:34:53] Remove: mariadb-server-core-5.5:amd64 (5.5.34+maria-1~precise) [21:35:00] ii mysql-server-core-5.5 5.5.44-0ubuntu0.12.04.1 MySQL database server binaries [21:35:03] mariadb-server [21:35:09] Aha [21:35:12] OK so maybe that's it [21:35:22] someone removed mariadb-server and added mysql-server [21:35:29] (that paste was from the apt log) [21:35:34] :/ [21:35:41] what. [21:35:43] 21:32 < ori> i broke labs [21:35:43] 21:32 < ori> fixing [21:35:45] btw [21:36:01] hashar: This can be merge https://gerrit.wikimedia.org/r/#/c/227220/ now passes test. [21:36:10] "rc mariadb-server-5.5" [21:36:15] :/ [21:36:44] * hashar loves to see Beta cluster has more DBA than prod [21:37:09] hashar: Please recheck experiment at https://gerrit.wikimedia.org/r/#/c/244750/ [21:37:27] where was the "!log breaking Beta Cluster ... " :) [21:37:38] paladox: will let JackPhoenix the opportunity to review it [21:37:38] hashar: >1 dba could be dangerous ;) [21:38:02] hashar: Ok. Thanks for rechecking to make sure it passes. [21:38:55] 10Continuous-Integration-Config, 5Patch-For-Review: Whitelist Paladox in Zuul configuration - https://phabricator.wikimedia.org/T114528#1716484 (10hashar) A week has elapsed. I will get him whitelisted following the CI meeting on Tuesday. [21:38:59] now I see mariadb reinstalled but not running [21:41:30] hashar: this can be merged https://gerrit.wikimedia.org/r/#/c/244750/ since it dosent change any thing just adds support for npm and composer and also since it is an example extension it also helps other update there extensions. [21:41:38] !log ori broke mariadb on deployment-db1 :-P [21:41:44] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL, Master [21:43:08] legoktm: We might want to create a bot for https://www.mediawiki.org/wiki/User:Legoktm/ci to update the information automatically and should we move it to a page of its own since this is really helpful. [21:43:19] hashar: we should create a bot for https://www.mediawiki.org/wiki/User:Legoktm/ci [21:45:09] paladox: you don't need to send duplicate messages [21:45:26] Ok sorry. [21:47:31] (03PS2) 10Paladox: [examples] Update jenkins tests [integration/config] - 10https://gerrit.wikimedia.org/r/244747 [21:52:54] RECOVERY - App Server Main HTTP Response on deployment-mediawiki01 is OK: HTTP OK: HTTP/1.1 200 OK - 45631 bytes in 0.836 second response time [21:53:21] 10Deployment-Systems, 3Scap3: (Re)implement logging output for scap targets - https://phabricator.wikimedia.org/T115137#1716508 (10dduvall) >>! In T115137#1716457, @mmodell wrote: > @dduvall I kinda like the idea of the subprocess as well, though doing it in-process would directly address your concern about se... [21:53:35] RECOVERY - English Wikipedia Mobile Main page on beta-cluster is OK: HTTP OK: HTTP/1.1 200 OK - 35823 bytes in 0.575 second response time [21:54:03] RECOVERY - App Server Main HTTP Response on deployment-mediawiki02 is OK: HTTP OK: HTTP/1.1 200 OK - 45657 bytes in 0.644 second response time [21:54:38] RECOVERY - English Wikipedia Main page on beta-cluster is OK: HTTP OK: HTTP/1.1 200 OK - 45926 bytes in 0.567 second response time [21:54:58] RECOVERY - App Server Main HTTP Response on deployment-mediawiki03 is OK: HTTP OK: HTTP/1.1 200 OK - 45652 bytes in 0.636 second response time [21:55:33] !log deployment-db1 has a running mysqld again, shinken reports recovery. [21:55:37] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL, Master [21:57:03] wee [21:57:18] !log 21:51 < ori> !log deployment-prep Accidentally clobbered /etc/init.d/mysql on deployment-db1, causing deployment-prep failures. Restored now [21:57:25] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL, Master [22:17:58] PROBLEM - Puppet failure on deployment-cache-text04 is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [0.0] [22:23:55] How do I find which callsign is operations/software.git? [22:24:53] https://www.mediawiki.org/wiki/Phabricator/Diffusion/Callsign_naming_conventions/Existing_repositories ? [22:26:24] chasemp, so um... where is operations/software? [22:26:35] good question :) [22:26:38] It's not on that list. [22:27:12] I don't see it imported [22:27:30] operations-software-foo's yes [22:32:12] where the hell is jouncebot [22:32:28] should have alerted me half an hour ago to deploy to bed [22:39:28] PROBLEM - Puppet failure on deployment-cache-upload04 is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [0.0] [22:57:27] 6Release-Engineering-Team, 6Phabricator, 10Traffic, 6operations: Phabricator needs to expose ssh - https://phabricator.wikimedia.org/T100519#1716696 (10chasemp) [22:59:25] PROBLEM - Free space - all mounts on deployment-bastion is CRITICAL: CRITICAL: deployment-prep.deployment-bastion.diskspace._var.byte_percentfree (<60.00%) [22:59:45] hashar: Dear anthropoid, the time has come. Please go to bed. [23:00:14] ¡log jouncebot is lagged out by an hour. DST issue ? [23:00:29] heh. I ping on "dear anthropoid" [23:00:34] hah [23:00:35] note how bd808 sal bot does not understand spanish exclamation marks [23:00:57] boringly monolingual [23:01:00] :D [23:01:06] I was doing dishes real quick before wife+kid come back tonight (any minute between now and 9pm, I have no idea) [23:01:14] sorry for the delay :) [23:02:32] (03PS1) 10Hashar: Package managers abstraction [integration/dashboard] - 10https://gerrit.wikimedia.org/r/244822 [23:02:38] ah [23:02:40] evening hacking [23:02:58] (03CR) 10Hashar: [C: 04-1] "WIP !" [integration/dashboard] - 10https://gerrit.wikimedia.org/r/244822 (owner: 10Hashar) [23:03:28] * JohnFLewis is tempted to say "wait, we can package greg-g's abstraction??" [23:03:41] JohnFLewis: I thought the same thing, fwiw [23:04:35] greg-g: apt-get install greg-g-abstraction && greg-g [23:05:25] (03PS2) 10Hashar: Package managers abstraction [integration/dashboard] - 10https://gerrit.wikimedia.org/r/244822 [23:05:42] (03CR) 10Hashar: [C: 04-2] "Sticky WIP" [integration/dashboard] - 10https://gerrit.wikimedia.org/r/244822 (owner: 10Hashar) [23:06:32] JohnFLewis: on Debian you might end up with a babbling greg [23:06:38] JohnFLewis: INFO: Privilege escalation is only in theory, not in practice. [23:08:13] hashar: he can take over the sudo notice for when you first use it. instead of the old 3 rules, you get greg babbling on :) [23:09:02] :D [23:18:56] well time to actually sleep [23:18:58] have fun! [23:19:21] RECOVERY - Free space - all mounts on deployment-bastion is OK: OK: All targets OK [23:25:45] g'night