[04:18:41] Yippee, build fixed! [04:18:41] Project selenium-MultimediaViewer » firefox,beta,Linux,contintLabsSlave && UbuntuTrusty build #88: 09FIXED in 22 min: https://integration.wikimedia.org/ci/job/selenium-MultimediaViewer/BROWSER=firefox,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=Linux,label=contintLabsSlave%20&&%20UbuntuTrusty/88/ [04:24:43] 07Browser-Tests, 10Continuous-Integration-Config, 10Wikidata, 07Story: [Story] Run browsertests regularly on test.wikidata.org via Jenkins - https://phabricator.wikimedia.org/T101497#2504321 (10Tobi_WMDE_SW) [04:24:46] 10Continuous-Integration-Config, 10Wikidata, 13Patch-For-Review: [Task] Setup a Jenkins job to run Wikidata browsertests on test.wikidata.org - https://phabricator.wikimedia.org/T101499#2504318 (10Tobi_WMDE_SW) 05Open>03Resolved a:03Tobi_WMDE_SW Tests are set-up to run against test.wikidata.org since s... [04:26:11] 07Browser-Tests, 10Wikidata, 07Tracking: make Wikidata browsertests non-flaky (tracking) - https://phabricator.wikimedia.org/T92619#2504325 (10Tobi_WMDE_SW) [04:26:14] 10Browser-Tests-Infrastructure, 10Wikidata, 13Patch-For-Review, 07Upstream, 15User-zeljkofilipin: [Bug] fix negative argument (ArgumentError) in browsertests - https://phabricator.wikimedia.org/T110510#2504322 (10Tobi_WMDE_SW) 05Open>03Resolved a:03Tobi_WMDE_SW [05:30:42] 06Release-Engineering-Team, 15User-greg: Add #Wikimedia-Incident to all open "actionables" in past incident reports - https://phabricator.wikimedia.org/T141493#2504346 (10greg) p:05Normal>03Lowest [05:42:04] 07Browser-Tests, 10Wikidata, 13Patch-For-Review, 15User-zeljkofilipin: selenium-Wikidata Jenkins job fails with MediawikiSelenium::ConfigurationError - https://phabricator.wikimedia.org/T140097#2504363 (10Tobi_WMDE_SW) 05Open>03Resolved a:03Tobi_WMDE_SW This should be fixed with https://gerrit.wikime... [06:36:22] 10Continuous-Integration-Config, 06Release-Engineering-Team, 10DBA, 10Datasets-General-or-Unknown, and 3 others: Automatize the check and fix of object, schema and data drifts between production masters and slaves - https://phabricator.wikimedia.org/T104459#2504400 (10ArielGlenn) Sounds great! Care to lin... [06:58:15] PROBLEM - Puppet run on phab-beta is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [0.0] [07:40:35] good morning [08:09:29] (03CR) 10Hashar: [C: 032] debian-glue: override Wikimedia BUILDRESULT [integration/config] - 10https://gerrit.wikimedia.org/r/301714 (https://phabricator.wikimedia.org/T141538) (owner: 10Hashar) [08:10:55] (03Merged) 10jenkins-bot: debian-glue: override Wikimedia BUILDRESULT [integration/config] - 10https://gerrit.wikimedia.org/r/301714 (https://phabricator.wikimedia.org/T141538) (owner: 10Hashar) [08:15:25] (03PS1) 10Alexandros Kosiaris: debian-glue: Merge 2 shell builders, set distribution correctly [integration/config] - 10https://gerrit.wikimedia.org/r/301753 [08:20:15] 06Release-Engineering-Team, 10DBA, 10Gerrit, 06Operations: Need snapshot of 'reviewdb' on spare machine to test gerrit schema upgrades - https://phabricator.wikimedia.org/T139755#2504553 (10jcrespo) @Dzahn @demon can db1042 be wiped? [08:42:40] 10Continuous-Integration-Infrastructure, 10Zuul: Fix zuul-cloner so that it checkout the ref to the local branch instead of a detached one - https://phabricator.wikimedia.org/T141607#2504601 (10hashar) [08:42:59] (03PS1) 10Hashar: debian-glue: fix zuul-cloner detached branch [integration/config] - 10https://gerrit.wikimedia.org/r/301763 (https://phabricator.wikimedia.org/T141607) [08:43:38] 10Continuous-Integration-Config, 10BlueSpice, 13Patch-For-Review: Enable unit tests on BlueSpice* repos - https://phabricator.wikimedia.org/T130811#2504616 (10Osnard) Hello @Paladox! There are two changes on Gerrit [1] [2] that seem to be not needed anymore. If you don't mind I will abandon them. [1] https... [08:50:29] (03CR) 10Hashar: [C: 032] "Much better! You can tell that the whole job is a random crappy experiment :(" [integration/config] - 10https://gerrit.wikimedia.org/r/301753 (owner: 10Alexandros Kosiaris) [08:51:06] (03CR) 10Hashar: [C: 04-2] debian-glue: Merge 2 shell builders, set distribution correctly [integration/config] - 10https://gerrit.wikimedia.org/r/301753 (owner: 10Alexandros Kosiaris) [08:51:29] (03CR) 10Hashar: debian-glue: Merge 2 shell builders, set distribution correctly (031 comment) [integration/config] - 10https://gerrit.wikimedia.org/r/301753 (owner: 10Alexandros Kosiaris) [08:53:44] (03PS1) 10Legoktm: global-set-env: Set COMPOSER_DISABLE_XDEBUG_WARN=1 [integration/jenkins] - 10https://gerrit.wikimedia.org/r/301767 [08:58:48] (03PS1) 10Hashar: WMF: reduce Gerrit replication delay from 300 to 15 secs [integration/zuul] (patch-queue/debian/precise-wikimedia) - 10https://gerrit.wikimedia.org/r/301768 (https://phabricator.wikimedia.org/T93812) [08:59:35] (03CR) 10jenkins-bot: [V: 04-1] global-set-env: Set COMPOSER_DISABLE_XDEBUG_WARN=1 [integration/jenkins] - 10https://gerrit.wikimedia.org/r/301767 (owner: 10Legoktm) [09:02:38] (03PS1) 10Hashar: 2.1.0-391-gbc58ea3-wmf2precise1 [integration/zuul] (debian/precise-wikimedia) - 10https://gerrit.wikimedia.org/r/301769 (https://phabricator.wikimedia.org/T93812) [09:05:39] (03PS1) 10Hashar: Have flake8 to exclude .tox [integration/jenkins] - 10https://gerrit.wikimedia.org/r/301770 [09:05:56] legoktm: flake8 was not ignoring .tox for some reason https://gerrit.wikimedia.org/r/#/c/301770/ [09:06:29] (03CR) 10Hashar: [C: 032] Have flake8 to exclude .tox [integration/jenkins] - 10https://gerrit.wikimedia.org/r/301770 (owner: 10Hashar) [09:07:04] hashar: ahhh. I think that changed in a new upstream release or something [09:07:16] (03Merged) 10jenkins-bot: Have flake8 to exclude .tox [integration/jenkins] - 10https://gerrit.wikimedia.org/r/301770 (owner: 10Hashar) [09:07:33] (03PS2) 10Legoktm: global-set-env: Set COMPOSER_DISABLE_XDEBUG_WARN=1 [integration/jenkins] - 10https://gerrit.wikimedia.org/r/301767 [09:08:21] (03CR) 10Hashar: [C: 032] global-set-env: Set COMPOSER_DISABLE_XDEBUG_WARN=1 [integration/jenkins] - 10https://gerrit.wikimedia.org/r/301767 (owner: 10Legoktm) [09:08:25] (03PS1) 10Alexandros Kosiaris: Followup typo fix for 142c998a5ada440 [integration/config] - 10https://gerrit.wikimedia.org/r/301772 [09:08:37] thanks hashar :) [09:09:02] (03Merged) 10jenkins-bot: global-set-env: Set COMPOSER_DISABLE_XDEBUG_WARN=1 [integration/jenkins] - 10https://gerrit.wikimedia.org/r/301767 (owner: 10Legoktm) [09:37:56] (03PS1) 10Hashar: 2.1.0-391-gbc58ea3-wmf2precise1 [integration/zuul] (debian/jessie-wikimedia) - 10https://gerrit.wikimedia.org/r/301774 (https://phabricator.wikimedia.org/T93812) [09:38:54] !log Upgrading Zuul to get rid of a forced sleep(300) whenever a patch is merged T93812. zuul_2.1.0-391-gbc58ea3-wmf2precise1 [09:38:55] T93812: Change force merged cause a deadlock in Zuul gate-and-submit pipeline - https://phabricator.wikimedia.org/T93812 [09:38:57] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL, Master [09:40:36] (03CR) 10Hashar: [C: 032] 2.1.0-391-gbc58ea3-wmf2precise1 [integration/zuul] (debian/jessie-wikimedia) - 10https://gerrit.wikimedia.org/r/301774 (https://phabricator.wikimedia.org/T93812) (owner: 10Hashar) [09:41:28] (03Abandoned) 10Hashar: 2.1.0-391-gbc58ea3-wmf2precise1 [integration/zuul] (debian/jessie-wikimedia) - 10https://gerrit.wikimedia.org/r/301774 (https://phabricator.wikimedia.org/T93812) (owner: 10Hashar) [09:42:19] (03PS2) 10Hashar: 2.1.0-391-gbc58ea3-wmf2precise1 [integration/zuul] (debian/precise-wikimedia) - 10https://gerrit.wikimedia.org/r/301769 (https://phabricator.wikimedia.org/T93812) [09:42:44] (03CR) 10Hashar: [C: 032] 2.1.0-391-gbc58ea3-wmf2precise1 [integration/zuul] (debian/precise-wikimedia) - 10https://gerrit.wikimedia.org/r/301769 (https://phabricator.wikimedia.org/T93812) (owner: 10Hashar) [09:47:54] (03Restored) 10Hashar: 2.1.0-391-gbc58ea3-wmf2precise1 [integration/zuul] (debian/jessie-wikimedia) - 10https://gerrit.wikimedia.org/r/301774 (https://phabricator.wikimedia.org/T93812) (owner: 10Hashar) [09:48:25] (03PS2) 10Hashar: Merge branch 'debian/precise-wikimedia' into debian/jessie-wikimedia [integration/zuul] (debian/jessie-wikimedia) - 10https://gerrit.wikimedia.org/r/301774 (https://phabricator.wikimedia.org/T93812) [09:51:01] 10Browser-Tests-Infrastructure, 10Wikidata, 07Tracking: Wikidata Browsertests (tracking) - https://phabricator.wikimedia.org/T88541#2504694 (10Tobi_WMDE_SW) [09:51:03] 07Browser-Tests, 10Continuous-Integration-Config, 10Wikidata, 07Story: [Story] Run browsertests regularly on test.wikidata.org via Jenkins - https://phabricator.wikimedia.org/T101497#2504691 (10Tobi_WMDE_SW) 05Open>03Resolved a:03Tobi_WMDE_SW [09:51:42] (03CR) 10Hashar: [C: 032] "https://people.wikimedia.org/~hashar/debs/zuul_2.1.0-391-gbc58ea3-jessie/" [integration/zuul] (debian/jessie-wikimedia) - 10https://gerrit.wikimedia.org/r/301774 (https://phabricator.wikimedia.org/T93812) (owner: 10Hashar) [09:56:08] 10Continuous-Integration-Infrastructure, 06Operations, 10Zuul, 07Blocked-on-Operations: Upgrade Zuul on scandium.eqiad.wmnet (Jessie zuul-merger) - https://phabricator.wikimedia.org/T140894#2504697 (10hashar) 05Resolved>03Open I had to rebuild the package on Precise for T93812 and I have rebuild the Je... [10:19:50] 06Release-Engineering-Team (Deployment-Blockers), 05Release: MW-1.28.0-wmf.12 deployment blockers - https://phabricator.wikimedia.org/T139214#2504736 (10phuedx) [10:21:50] 10Continuous-Integration-Config, 10BlueSpice, 13Patch-For-Review: Enable unit tests on BlueSpice* repos - https://phabricator.wikimedia.org/T130811#2504759 (10Paladox) Ok thanks. [10:23:48] 10Continuous-Integration-Config, 10BlueSpice, 13Patch-For-Review: Enable unit tests on BlueSpice* repos - https://phabricator.wikimedia.org/T130811#2504761 (10Paladox) @Osnard Hi, I'm wondering if you would be able to fix these api documentation errors https://integration.wikimedia.org/ci/job/mwext-testexten... [10:25:08] (03CR) 10Paladox: [C: 031] debian-glue: fix zuul-cloner detached branch [integration/config] - 10https://gerrit.wikimedia.org/r/301763 (https://phabricator.wikimedia.org/T141607) (owner: 10Hashar) [10:26:24] (03CR) 10Paladox: "Why not use debian/ patches to do this would probably prevent merge conflicts." [integration/zuul] (patch-queue/debian/precise-wikimedia) - 10https://gerrit.wikimedia.org/r/301768 (https://phabricator.wikimedia.org/T93812) (owner: 10Hashar) [10:28:58] (03CR) 10Hashar: "patch-queue/ branches are the upstream versions + our cherry picks." [integration/zuul] (patch-queue/debian/precise-wikimedia) - 10https://gerrit.wikimedia.org/r/301768 (https://phabricator.wikimedia.org/T93812) (owner: 10Hashar) [10:29:12] paladox: see http://honk.sigxcpu.org/projects/git-buildpackage/manual-html/man.gbp.pq.html :D [10:29:32] hashar ok yeh i was looking through my backlog [10:29:35] sorry about that [10:29:36] and hi [10:29:43] paladox: and http://honk.sigxcpu.org/projects/git-buildpackage/manual-html/gbp.patches.html :D [10:29:45] I saw your zuul updates :) [10:29:51] Im updating now [10:38:27] hashar hi, is zuul status meant to be like this [10:38:28] sudo: /etc/sudoers.d/test-jenkins is owned by uid 15041, should be 0 [10:38:28] ● zuul.service - LSB: Zuul [10:38:28] Loaded: loaded (/etc/init.d/zuul) [10:38:28] Active: active (exited) since Fri 2016-07-29 10:37:49 UTC; 10s ago [10:38:34] on a jenkins slave [10:38:52] Including [10:38:54] yeah [10:38:57] zuul-merger [10:38:58] sudo: /etc/sudoers.d/test-jenkins is owned by uid 15041, should be 0 [10:38:58] ● zuul-merger.service - LSB: Zuul Merger [10:38:58] Loaded: loaded (/etc/init.d/zuul-merger) [10:38:58] Active: active (exited) since Fri 2016-07-29 10:37:55 UTC; 49s ago [10:38:59] the systemd unit is enabled [10:39:04] Yep [10:39:07] but the init.d script refuses to start it [10:39:10] Oh [10:39:15] based on an env variable in /etc/default/zuul [10:39:19] Will it still work though [10:39:30] the zuul package is not meant for systemd yet [10:39:36] Oh [10:39:49] But works on gerrit-test [10:40:27] Sorry for the too many pings [10:41:15] less then 24 hours to update to windows 10 for free [10:41:22] from windows 8 and windows 7 [10:42:34] http://www.neowin.net/news/microsoft-releases-skype-for-linux-alpha-13 [10:42:46] Microsoft has brought back skype for linux ^^ :) [10:44:07] Im wondering if you could help me with, https://gerrit.wikimedia.org/r/#/c/256663/ [10:44:09] please [10:44:14] Ive tested it and it works [10:44:16] but when you do [10:44:34] 06Release-Engineering-Team, 15User-greg: Add #Wikimedia-Incident to all open "actionables" in past incident reports - https://phabricator.wikimedia.org/T141493#2504787 (10Danny_B) [10:44:35] T12 [10:44:35] T12: (test) How do design attachments/assets work? - https://phabricator.wikimedia.org/T12 [10:44:48] as a plain comment it wont link to phabricator any more [11:06:17] hashar should we also update trusty ? [11:39:26] (03PS2) 10Hashar: debian-glue: Merge 2 shell builders, set distribution correctly [integration/config] - 10https://gerrit.wikimedia.org/r/301753 (owner: 10Alexandros Kosiaris) [11:49:31] (03PS1) 10Hashar: debian-glue: [integration/config] - 10https://gerrit.wikimedia.org/r/301791 (https://phabricator.wikimedia.org/T141607) [11:50:10] (03CR) 10Paladox: [C: 031] debian-glue: [integration/config] - 10https://gerrit.wikimedia.org/r/301791 (https://phabricator.wikimedia.org/T141607) (owner: 10Hashar) [11:51:28] hashar hi, do you know how i can get gerrit to detect this [11:51:28]

T76459" target="_blank">https://phabricator.wikimedia.org/T76459

[11:51:29] T76459: Allow links to phabricator comments from gerrit messages. - https://phabricator.wikimedia.org/T76459 [11:51:32] in the commit link [11:51:43] Since i do [commentlink "its-phabricator-2"] [11:51:43] match = "

(T[0-9]\") target=\"_blank\">https://phabricator\\.wikimedia\\.org/T[0-9]

" [11:51:43] html = "$1" [11:51:57] (03CR) 10Hashar: [C: 031] "I had a CR-2 just to prevent merge due to the echo lines that got swapped. That is fixed." [integration/config] - 10https://gerrit.wikimedia.org/r/301753 (owner: 10Alexandros Kosiaris) [11:52:45] (03PS2) 10Hashar: debian-glue: fix improper checkout [integration/config] - 10https://gerrit.wikimedia.org/r/301791 (https://phabricator.wikimedia.org/T141607) [11:52:53] but it dosent seem to work [11:52:57] please [11:54:19] (03CR) 10Hashar: [C: 031] "Still the same issue of local master branch not having the patch :( Worked around by abusing GIT_BRANCH :(" [integration/config] - 10https://gerrit.wikimedia.org/r/301791 (https://phabricator.wikimedia.org/T141607) (owner: 10Hashar) [11:54:37] 10Continuous-Integration-Config, 10BlueSpice, 13Patch-For-Review: Enable unit tests on BlueSpice* repos - https://phabricator.wikimedia.org/T130811#2504856 (10Osnard) @Paladox, can you gie me a hint on this? We've got the I18N key "apihelp-bs-responsibleeditorsposibleeditors-store" but tests say "apihelp-bs... [11:55:57] 10Continuous-Integration-Config, 10BlueSpice, 13Patch-For-Review: Enable unit tests on BlueSpice* repos - https://phabricator.wikimedia.org/T130811#2504858 (10Paladox) Nope, you need to also add the description too, but I belive there were changes earler this year that would have caused these types of api er... [11:58:36] 10Continuous-Integration-Config, 10BlueSpice, 13Patch-For-Review: Enable unit tests on BlueSpice* repos - https://phabricator.wikimedia.org/T130811#2504874 (10Osnard) Okay, so adding empty values is a common practice? I don't want to have @siebrand give me a -1 for it :) [11:59:52] 10Continuous-Integration-Config, 10BlueSpice, 13Patch-For-Review: Enable unit tests on BlueSpice* repos - https://phabricator.wikimedia.org/T130811#2504875 (10Paladox) @Osnard nope not common practice but will get rid of the errors. [12:01:09] 10Continuous-Integration-Config, 10BlueSpice, 13Patch-For-Review: Enable unit tests on BlueSpice* repos - https://phabricator.wikimedia.org/T130811#2504877 (10Osnard) Okay. Thanks. I think I will try to fill in something suitable. [12:02:57] 10Continuous-Integration-Config, 10BlueSpice, 13Patch-For-Review: Enable unit tests on BlueSpice* repos - https://phabricator.wikimedia.org/T130811#2504878 (10Paladox) @Osnard Thankyou :) [12:06:34] 10Continuous-Integration-Infrastructure, 10Packaging: debian-glue have the pbuilderrc override cowbuilder parameters - https://phabricator.wikimedia.org/T141538#2504879 (10hashar) 05Open>03Resolved a:03hashar Fixed with assistance of @akosiaris Other patches that are similar: https://gerrit.wikimedia.o... [12:46:21] 10Continuous-Integration-Infrastructure, 06Operations, 10Zuul, 07Blocked-on-Operations: Upgrade Zuul on scandium.eqiad.wmnet (Jessie zuul-merger) - https://phabricator.wikimedia.org/T140894#2504931 (10hashar) [12:43:25] <@elukey> !log upgrading zuul-merger to zuul_2.1.0-391-gbc58ea3-wmf2jessie1_amd64.deb o... [12:51:21] 10Continuous-Integration-Infrastructure, 06Operations, 10Zuul, 07Blocked-on-Operations: Upgrade Zuul on scandium.eqiad.wmnet (Jessie zuul-merger) - https://phabricator.wikimedia.org/T140894#2504946 (10hashar) 05Open>03Resolved Good. Will have to push the packages to apt.wm.o: Files are in https://peop... [12:53:04] !log Upgrading Zuul on precise slaves using https://people.wikimedia.org/~hashar/debs/zuul_2.1.0-391-gbc58ea3/zuul_2.1.0-391-gbc58ea3-wmf2precise1_amd64.deb [12:53:07] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL, Master [13:01:16] !log Upgrading Zuul on jessie slaves using https://people.wikimedia.org/~hashar/debs/zuul_2.1.0-391-gbc58ea3-jessie/zuul_2.1.0-391-gbc58ea3-wmf2jessie1_amd64.deb [13:01:21] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL, Master [13:04:25] (03PS1) 10Paladox: Merge remote-tracking branch 'origin/debian/precise-wikimedia' into debian/trusty-wikimedia [integration/zuul] (debian/trusty-wikimedia) - 10https://gerrit.wikimedia.org/r/301805 [13:04:33] hashar ^^ thats a test [13:16:27] hashar can python-gear be enable in control [13:16:30] in trusty [13:16:36] or does it still need to be embed [13:16:44] (03CR) 10Hashar: "Just overwrite the old names based on trusty. But yeah looks like that is all what needs to be done." (031 comment) [integration/config] - 10https://gerrit.wikimedia.org/r/301720 (https://phabricator.wikimedia.org/T139137) (owner: 10Thcipriani) [13:17:37] thcipriani: your patch for android emulator to java8 looks fine https://gerrit.wikimedia.org/r/#/c/301720/1 . Just have to not change the job name and overwrite the existing one. Then delete the -new I have hacked [13:17:39] thcipriani: kudos! [13:20:36] (03PS2) 10Paladox: Merge remote-tracking branch 'origin/debian/precise-wikimedia' into debian/trusty-wikimedia [integration/zuul] (debian/trusty-wikimedia) - 10https://gerrit.wikimedia.org/r/301805 [13:20:46] ^^ yay works [13:24:21] !log created integration-slave-jessie-1003 m1.medium to help processing debian-glue jobs [13:24:24] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL, Master [13:25:09] hashar we forgot to update parameter_functions for the test change to integration/zuul [13:26:06] (03PS1) 10Paladox: Fix integration/zuul debian-glue test [integration/config] - 10https://gerrit.wikimedia.org/r/301808 [13:26:07] ^^ [13:27:10] (03CR) 10jenkins-bot: [V: 04-1] Fix integration/zuul debian-glue test [integration/config] - 10https://gerrit.wikimedia.org/r/301808 (owner: 10Paladox) [13:28:01] (03PS2) 10Paladox: Fix integration/zuul debian-glue test [integration/config] - 10https://gerrit.wikimedia.org/r/301808 [13:28:47] (03CR) 10Hashar: "That is not needed 'foo' in 'zzfoozz' => True." (031 comment) [integration/config] - 10https://gerrit.wikimedia.org/r/301808 (owner: 10Paladox) [13:28:59] paladox: https://gerrit.wikimedia.org/r/#/c/301808/1/zuul/parameter_functions.py that is not needed [13:29:05] Oh [13:29:10] see the diff :D [13:29:28] (03Abandoned) 10Paladox: Fix integration/zuul debian-glue test [integration/config] - 10https://gerrit.wikimedia.org/r/301808 (owner: 10Paladox) [13:29:31] Yep [13:30:16] hashar sorry for ping again but im thinking off adding DEB_BUILD_OPTIONS=nocheck to the enviroment [13:30:21] for integration/zuul only [13:30:29] It would fix building them [13:30:55] Or we can just do [13:30:56] echo USENETWORK=yes >> ~/.pbuilderrc [13:30:56] echo PBUILDER_USENETWORK=yes >> ~/.pbuilderrc [13:31:08] just keeping it as non voting for now [13:31:12] Ok [13:31:16] until I figure out how to get the tests to pass [13:31:22] but really it does not matter much [13:31:26] I mean adding DEB_BUILD_OPTIONS=nocheck to get it to work [13:31:37] 06Release-Engineering-Team, 10DBA, 10Gerrit, 06Operations: Need snapshot of 'reviewdb' on spare machine to test gerrit schema upgrades - https://phabricator.wikimedia.org/T139755#2505059 (10demon) Ah yep, we're done. Wipe away! [13:31:38] the debian-glue was mostly for the hundred or so package for apertium [13:31:44] zuul packaging is awful [13:32:10] just skip / ignore it :] [13:32:13] for trusty no [13:32:20] Oh [13:32:20] I will rebuild the trusty package later on. It is not really needed [13:32:27] Ok [13:33:15] (03PS2) 10Hashar: Followup typo fix for 142c998a5ada440 [integration/config] - 10https://gerrit.wikimedia.org/r/301772 (owner: 10Alexandros Kosiaris) [13:33:49] (03Abandoned) 10Hashar: Followup typo fix for 142c998a5ada440 [integration/config] - 10https://gerrit.wikimedia.org/r/301772 (owner: 10Alexandros Kosiaris) [13:34:05] (03CR) 10Hashar: [C: 032] debian-glue: Merge 2 shell builders, set distribution correctly [integration/config] - 10https://gerrit.wikimedia.org/r/301753 (owner: 10Alexandros Kosiaris) [13:34:07] (03CR) 10Hashar: [C: 032] debian-glue: fix improper checkout [integration/config] - 10https://gerrit.wikimedia.org/r/301791 (https://phabricator.wikimedia.org/T141607) (owner: 10Hashar) [13:34:51] (03Merged) 10jenkins-bot: debian-glue: Merge 2 shell builders, set distribution correctly [integration/config] - 10https://gerrit.wikimedia.org/r/301753 (owner: 10Alexandros Kosiaris) [13:34:53] 10Continuous-Integration-Infrastructure, 10Zuul: Fix zuul-cloner so that it checkout the ref to the local branch instead of a detached one - https://phabricator.wikimedia.org/T141607#2505069 (10hashar) p:05Triage>03Normal [13:35:10] (03Merged) 10jenkins-bot: debian-glue: fix improper checkout [integration/config] - 10https://gerrit.wikimedia.org/r/301791 (https://phabricator.wikimedia.org/T141607) (owner: 10Hashar) [13:35:41] hashar: if I megre something in mediawiki-config for beta, should it get auto deployed? [13:35:46] or do other steps need to be taken? [13:36:52] For the debian-glue test [13:36:53] i do [13:36:54] git fetch "$ZUUL_URL"/"$ZUUL_PROJECT" "$ZUUL_REF" && git checkout -f FETCH_HEAD [13:37:00] http://gerrit-jenkins.wmflabs.org/job/debian-glue/ [13:39:28] (03Abandoned) 10Paladox: Merge remote-tracking branch 'origin/debian/precise-wikimedia' into debian/trusty-wikimedia [integration/zuul] (debian/trusty-wikimedia) - 10https://gerrit.wikimedia.org/r/301805 (owner: 10Paladox) [13:40:30] 10Deployment-Systems, 06Operations: dologmsg doesn't work on terbium - https://phabricator.wikimedia.org/T141619#2505074 (10Anomie) [13:41:16] (03CR) 10Hashar: [C: 04-1] "Not needed anymore that has been worked around by properly setting $distribution." [integration/config] - 10https://gerrit.wikimedia.org/r/301763 (https://phabricator.wikimedia.org/T141607) (owner: 10Hashar) [13:46:47] ostriches: good morning!! how do I come with a huge spam of Diffusion emails from you ? :) [13:47:24] You're part of the same auditor group :p [13:47:36] https://phabricator.wikimedia.org/owners/package/1/ https://phabricator.wikimedia.org/owners/package/4/ [13:47:36] It's not spam! It's a notification ;-) [13:47:37] bah [13:47:43] ostriches: heh, still need the '@'? [13:47:56] I already have enough notifications as such really [13:49:41] Luke081515: Of course not :p [13:49:50] hashar: Disable them if you don't want them :p [13:49:57] did :d [13:49:57] They're in your e-mail prefs. [13:50:24] ohh [13:51:02] ostriches: you don't want to give it away, heh? :D [13:51:13] Don't care enough :p [13:53:05] lol [13:53:46] hashar: can I get added to the 'admins' group for https://wikitech.wikimedia.org/wiki/Nova_Resource:Deployment-prep ? [13:55:46] 10Continuous-Integration-Config, 10BlueSpice, 13Patch-For-Review: Enable unit tests on BlueSpice* repos - https://phabricator.wikimedia.org/T130811#2505125 (10hashar) Thank you @osnard . I have added a topic T130811 to easily find them https://gerrit.wikimedia.org/r/#/q/topic:T130811 I have approve a few :) [13:56:22] 10Continuous-Integration-Config, 10BlueSpice, 13Patch-For-Review: Enable unit tests on BlueSpice* repos - https://phabricator.wikimedia.org/T130811#2505126 (10Paladox) Thankyou too :). [14:02:26] 10Continuous-Integration-Config, 10BlueSpice, 13Patch-For-Review: Enable unit tests on BlueSpice* repos - https://phabricator.wikimedia.org/T130811#2505138 (10Paladox) @Osnard there is also this error 14:00:14 13) AvailableRightsTest::testAvailableRights 14:00:14 Additional user rights need to be added to $... [14:02:29] addshore: done :) [14:02:40] !log deployment-prep / beta : added addshore to the project [14:02:43] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL, Master [14:02:50] addshore: dont mess with it !!! :))) [14:03:06] I am off [14:03:17] might hangout this evening a bit [14:03:43] PROBLEM - Puppet run on integration-slave-jessie-1003 is CRITICAL: CRITICAL: 60.00% of data above the critical threshold [0.0] [14:04:16] ^ still being provisioned [14:05:15] 10MediaWiki-Codesniffer: phpcs: Enforce clone, require, etc., are not functions - https://phabricator.wikimedia.org/T116779#2505139 (10Florian) a:03Florian [14:05:49] hasharAway: I disagree with moving releng from that owners group. [14:05:57] cf: not siloing :) [14:06:55] ostriches hi, could i have help to do https://gerrit.wikimedia.org/r/#/c/256663/ please [14:06:56] it works [14:07:12] but then T 1 wont link now [14:07:17] if in plain coment [14:07:30] Spaced between them so it dosent get pickup by the bot [14:08:09] See http://gerrit-test.wmflabs.org/gerrit/#/c/16/ please [14:08:13] with the phab link [14:08:20] and then task on it's own [14:10:36] I will have to remove #id [14:10:41] so that we doint break gerrit [14:10:47] and can do proper testing [14:10:56] but if we fix phab links that will be great [14:10:58] please [14:11:08] ostriches ^^ [14:11:54] ostriches: ah yeah sorry [14:12:10] ostriches: I have disabled email instead [14:12:48] done [14:12:50] and away [14:28:45] RECOVERY - Puppet run on integration-slave-jessie-1003 is OK: OK: Less than 1.00% above the threshold [0.0] [14:43:00] 10Deployment-Systems, 06Release-Engineering-Team (Long-Lived-Branches), 07WorkType-NewFunctionality: Use subrepos instead of git submodules for deployed MediaWiki extensions - https://phabricator.wikimedia.org/T98834#2505231 (10Addshore) [14:43:46] 10Deployment-Systems, 06Operations: dologmsg doesn't work on terbium - https://phabricator.wikimedia.org/T141619#2505074 (10AlexMonk-WMF) From manifests/role/tcpircbot.pp: ``` ferm::rule { 'tcpircbot_allowed': # eventlog1001, tin (v4), mira (v4), localhost, tin (v6), mira (v6) rule => 'proto... [14:46:10] 10Continuous-Integration-Config, 10BlueSpice, 13Patch-For-Review: Enable unit tests on BlueSpice* repos - https://phabricator.wikimedia.org/T130811#2505249 (10Osnard) Another two changes - https://gerrit.wikimedia.org/r/#/c/301821 - https://gerrit.wikimedia.org/r/#/c/301826 [14:47:00] 10Continuous-Integration-Config, 10BlueSpice, 13Patch-For-Review: Enable unit tests on BlueSpice* repos - https://phabricator.wikimedia.org/T130811#2505252 (10Paladox) @Osnard Thankyou :) :) :) [14:50:55] 10Continuous-Integration-Config, 10BlueSpice, 13Patch-For-Review: Enable unit tests on BlueSpice* repos - https://phabricator.wikimedia.org/T130811#2505257 (10Paladox) @Osnard seems there is also this error 14:37:46 PHP Warning: file_put_contents(/mnt/jenkins-workspace/workspace/mwext-testextension-php55-c... [14:52:16] (03PS1) 10Florianschmidtwelzow: Disallow parenthesis around keywords like clone or require [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/301828 (https://phabricator.wikimedia.org/T116779) [14:53:20] 10Continuous-Integration-Config, 10BlueSpice, 13Patch-For-Review: Enable unit tests on BlueSpice* repos - https://phabricator.wikimedia.org/T130811#2505268 (10Paladox) That may be because of composer, since it will installed the foundation extension in vendor and not in extensions ie /extensions/ It will i... [14:59:36] ostriches do you know what i do to support plain task ids [14:59:37] too [14:59:39] please [14:59:39] ? [14:59:46] I dunno :) [14:59:49] (03PS2) 10Thcipriani: Add job apps-android-wikipedia-periodic-test-new [integration/config] - 10https://gerrit.wikimedia.org/r/301720 (https://phabricator.wikimedia.org/T139137) [14:59:49] I was looking [15:00:05] Oh [15:00:07] thanks [15:00:08] :) [15:00:32] (03CR) 10jenkins-bot: [V: 04-1] Add job apps-android-wikipedia-periodic-test-new [integration/config] - 10https://gerrit.wikimedia.org/r/301720 (https://phabricator.wikimedia.org/T139137) (owner: 10Thcipriani) [15:02:00] ostriches maybe another way is to match [15:02:01]

T76459" target="_blank">https://phabricator.wikimedia.org/T76459

[15:02:01] T76459: Allow links to phabricator comments from gerrit messages. - https://phabricator.wikimedia.org/T76459 [15:02:07] Sorry for stashbot [15:02:14] I just just copied and pasted [15:02:35] But anyways match that, that way we can get the plain task id to work [15:02:41] but im not sure how to do it, [15:02:44] Oh, those. [15:02:46] i tryed but failed [15:02:49] Yeh [15:02:51] I wanna land the other one first. [15:02:57] Oh which one [15:02:58] ? [15:03:20] ostriches ^^ [15:03:24] https://gerrit.wikimedia.org/r/#/c/301673/ [15:03:28] Thanks [15:03:36] Is that on gerrit-test without a followup? [15:03:39] Doesn't seem to be working [15:03:42] Yeh [15:03:53] Wait gerrit-test dosent work for you [15:03:53] ? [15:04:00] http://gerrit-test.wmflabs.org/gerrit/#/c/16/ [15:04:03] No links [15:04:03] Oh i need [15:04:07] to reaply that [15:04:09] patch [15:04:17] I will apply it again [15:04:25] I was testing something today for something else [15:05:03] (03CR) 10Thcipriani: "recheck" [integration/config] - 10https://gerrit.wikimedia.org/r/301720 (https://phabricator.wikimedia.org/T139137) (owner: 10Thcipriani) [15:06:10] ostriches ive applied it and have restarted gerrit may take a few mins [15:06:19] since gerrit dosent seem to start right a way for me [15:06:20] lol [15:06:42] Should probably figure out why :) [15:06:54] Oh, maybe a bug [15:06:59] since gerrit 2.8 works [15:07:00] for me [15:10:54] Could that [15:10:55] root@gerrit-test:/var/www/html/review_site# bin/gerrit.sh threads [15:10:55] bin/gerrit.sh: 69: bin/gerrit.sh: /usr/lib/jvm/java-7-openjdk-amd64/jre/bin/jstack: not found [15:10:58] be why [15:10:59] ? [15:13:11] root@gerrit-test:/var/www/html/review_site# bin/gerrit.sh supervise [15:13:12] [2016-07-29 15:12:55,127] [main] INFO com.google.gerrit.server.cache.h2.H2CacheFactory : Enabling disk cache /var/www/html/review_site/cache [15:18:01] jstack is just part of openjdk-7-jdk (we use -jre). Only difference is some debugging tools really. [15:18:07] (so no, it doesn't "matter") [15:18:17] But actually let's swap the package requirement. [15:20:22] Oh [15:22:38] ostriches where would jdk be installed [15:22:43] since jre is installed in [15:22:46] /usr/lib/jvm/java-7-openjdk-amd64/jre [15:22:55] Oh wait [15:23:11] Never mind not sure where jdk would be installed [15:24:05] Oh wait in /usr/lib/jvm/java-7-openjdk-amd64/bin/ [15:26:46] `apt-get install openjdk-7-jdk` [15:26:49] And you'll have it [15:26:53] Yep [15:26:56] i installed that [15:26:56] :) [15:27:06] I'm gonna add it to puppet [15:27:13] Ok [15:27:14] thanks [15:27:50] - locked <0x00000007dc21e160> (a sun.security.provider.SecureRandom) [15:27:51] at java.security.SecureRandom.nextBytes(SecureRandom.java:466) [15:27:51] - locked <0x00000007dc21e478> (a java.security.SecureRandom) [15:27:51] at java.security.SecureRandom.next(SecureRandom.java:488) [15:27:51] at java.util.Random.nextInt(Random.java:239) [15:27:53] at com.google.gerrit.gpg.SignedPushModule.randomString(SignedPushModule.java:158) [15:28:02] What is that [15:28:02] ? [15:30:44] "GC task thread#3 (ParallelGC)" prio=10 tid=0x00007fc258023000 nid=0x5a76 runnable [15:30:45] "VM Periodic Task Thread" prio=10 tid=0x00007fc25817d800 nid=0x5a7e waiting on condition [15:30:45] JNI global references: 266 [15:30:47] ostriches ^^ [15:30:53] Oh wait gc [15:30:59] Should i cancel that [15:31:27] Something with signed pushes :) [15:31:32] Oh [15:31:33] ah [15:31:36] Maybe should disable that and use the puppet role :) [15:31:38] i am going to disable that [15:31:43] Oh [15:31:54] But puppet uses gerrit 2.12.2 im using gerrit 2.12.3 [15:32:07] and it would overwrite my other things too [15:32:13] jenkins and zuul [15:32:44] Well, you can upgrade over the role. [15:32:48] It won't downgrade :) [15:32:56] And no, it won't overwrite your jenkins and zuul. [15:33:01] Gerrit role doesn't touch that :) [15:33:04] Oh [15:33:24] (I guess my main point is that it should work. And if it doesn't, we should adjust it to make it more usable :)) [15:33:46] Oh [15:33:47] ah [15:33:47] :) [15:33:57] ostriches also i hear you setup a instance yesturday [15:34:08] also should i remove this bcpg-jdk15on-1.52.jar from lib [15:34:10] in gerrit [15:34:21] since i think that was for signed pushes [15:34:26] ostriches ^^ [15:34:30] You want that. [15:34:36] Oh [15:34:45] What about bcpkix-jdk15on-1.52.jar [15:34:57] one of these were installed when i turned signed pushes on [15:35:13] ostriches ^^ [15:35:32] That gets installed when you install gerrit anyway. [15:35:36] Oh [15:35:42] Regardless of signed pushes [15:35:44] Oh [15:42:40] ostriches there you go http://gerrit-test.wmflabs.org/gerrit/#/c/16/25 [15:42:42] :) [15:43:51] ostriches i have its-phabricator installed and turned on [15:44:03] but it keeps getting something to due with certificate invalid [15:44:10] when connecting to phab-01. [15:50:27] ostriches it's up and running doing see any errors yet. [15:50:42] but without the its-phabricator working properly i carn't full test [15:50:55] But im hopping it wont break this time [15:50:56] :) [15:55:38] !log pooled Jenkins slave integration-slave-jessie-1003 [10.68.21.145] [15:55:41] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL, Master [16:29:22] 06Release-Engineering-Team, 15User-greg: Add #Wikimedia-Incident to all open "actionables" in past incident reports - https://phabricator.wikimedia.org/T141493#2505557 (10greg) Per the description edit: The active `#incident-` projects are all done. I did those en masse yesterday afternoon (pacific time). [16:32:24] (03CR) 10EBernhardson: "code looks good for what it's supposed to do, I'm not sure how to best allow proper usages of query though." (031 comment) [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/301364 (owner: 10Lethexie) [17:41:36] (03PS2) 10Mholloway: Make apps-android-wikipedia-lint voting [integration/config] - 10https://gerrit.wikimedia.org/r/301370 (https://phabricator.wikimedia.org/T141440) [17:48:31] 06Release-Engineering-Team, 15User-greg: Add #Wikimedia-Incident to all open "actionables" in past incident reports - https://phabricator.wikimedia.org/T141493#2505818 (10Danny_B) So can I proceed then with {T134624} as such tasks are now on active board? [17:53:17] 06Release-Engineering-Team, 15User-greg: Add #Wikimedia-Incident to all open "actionables" in past incident reports - https://phabricator.wikimedia.org/T141493#2500484 (10greg) Yup, and commented there as well. [17:56:00] (03CR) 10EBernhardson: Add detection for calling global functions in target classes. (032 comments) [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/301335 (owner: 10Lethexie) [17:57:03] (03CR) 10EBernhardson: "ideally i think this should also handled the case where a class extends/implements something. this should have a warning:" [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/297355 (owner: 10Lethexie) [17:59:01] (03CR) 10EBernhardson: Add usage to forbid superglobals like $_GET,$_POST (031 comment) [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/296395 (owner: 10Lethexie) [18:07:50] (03CR) 10Niedzielski: [C: 031] Make apps-android-wikipedia-lint voting [integration/config] - 10https://gerrit.wikimedia.org/r/301370 (https://phabricator.wikimedia.org/T141440) (owner: 10Mholloway) [18:08:27] (03CR) 10Mholloway: Make apps-android-wikipedia-lint voting [integration/config] - 10https://gerrit.wikimedia.org/r/301370 (https://phabricator.wikimedia.org/T141440) (owner: 10Mholloway) [18:20:23] PROBLEM - Host deployment-upload is DOWN: CRITICAL - Host Unreachable (10.68.16.189) [18:29:59] 07Browser-Tests, 03Reading-Web-Sprint-78-T: Fix browser tests for language switching on the beta cluster - https://phabricator.wikimedia.org/T141647#2505954 (10Jdlrobson) [18:30:54] 07Browser-Tests, 03Reading-Web-Sprint-78-T: Fix browser tests for language switching on the beta cluster - https://phabricator.wikimedia.org/T141647#2505967 (10Jdlrobson) [18:40:27] 07Browser-Tests, 03Reading-Web-Sprint-78-T: Fix browser tests for language switching on the beta cluster - https://phabricator.wikimedia.org/T141647#2505991 (10Jdlrobson) [19:51:23] (03CR) 10BearND: [C: 031] Make apps-android-wikipedia-lint voting [integration/config] - 10https://gerrit.wikimedia.org/r/301370 (https://phabricator.wikimedia.org/T141440) (owner: 10Mholloway) [19:54:24] (03PS2) 10Cscott: Move Parsoid roundtrip and toolcheck tests into npm scripts in Parsoid repo [integration/config] - 10https://gerrit.wikimedia.org/r/301499 (https://phabricator.wikimedia.org/T141481) [19:59:24] ostriches hi, did you view the gerrit-test page [19:59:34] to see T#1 links [19:59:36] working [20:00:02] PROBLEM - Puppet run on deployment-sentry01 is CRITICAL: CRITICAL: 30.00% of data above the critical threshold [0.0] [20:00:34] ? [20:00:42] I did. [20:00:45] I've been busy though [20:04:21] Ok [20:04:28] Thanks [20:05:25] ostriches would we be able to give it a shot please, i tryed testing with its-phabricator but seems it wont connect to phab-01 [20:05:37] so i carn't really be 100% sure it will work [20:05:43] please [20:06:36] I want to see it working in your staging environment before we merge. It broke stuff yesterday and I don't want to have to play revert cycle today since it's friday [20:06:54] Ok [20:07:11] I doint have it connected to phab-01 [20:07:15] since it wont connect [20:07:35] since it keeps saying something to do with certificate invali [20:07:37] invali [20:07:40] invalid [20:07:58] But i have both formats here http://gerrit-test.wmflabs.org/gerrit/#/c/16/26 [20:08:05] T-1 [20:08:08] T-1#1 [20:08:13] ostriches ^^ [20:08:26] I saw that [20:08:28] I also edited and it allowed me to without 500 errors [20:08:57] I want to see it running with the phab part though [20:09:00] More testing please. [20:09:07] Oh ok [20:09:13] How do i get it connected [20:09:18] since i have the certificate [20:09:23] But it wont connect [20:12:18] You'll have to debug and figure out why [20:12:25] ok [20:12:53] ostriches so i used arc install-certificate domain and went to domain and got token [20:12:59] and entered it in secure.config [20:14:50] On tuesday 350 million + users will gain access to bash [20:14:54] through windows 10 [20:15:09] and? [20:15:10] ubuntu just gained 350 + million users once they start installing [20:15:22] Most people won't chose to install it [20:15:33] Actually microsoft found most have already [20:15:38] In the insider preview [20:15:40] Right [20:15:46] 8 million + insider [20:15:48] But those are the sort of person tht would [20:15:59] Joe Bloggs isn't going to be using the insider previews [20:16:07] Joe Blogs won't know or care what bash was [20:16:17] Who is joe blogs [20:17:06] ? [20:22:54] paladox: "joe blogs" == "average joe" == "average person" [20:23:32] Oh ah [20:23:35] thanks for explaning [20:24:00] But maybe but microsoft would not have included it in the release if not alot of people were using it [20:24:26] they wrote a blog on this since they were intially not going to release it for the update next week but are now due to popularity [20:24:29] Project beta-code-update-eqiad build #114922: 04FAILURE in 1 min 28 sec: https://integration.wikimedia.org/ci/job/beta-code-update-eqiad/114922/ [20:28:22] I suspect they won't just install it [20:28:31] It'll be an addon feature [20:28:49] PROBLEM - Puppet run on integration-slave-trusty-1004 is CRITICAL: CRITICAL: 60.00% of data above the critical threshold [0.0] [20:29:24] Reedy yeh it is in control panel then turn windows features on or off [20:34:11] (03PS3) 10Thcipriani: Add job apps-android-wikipedia-periodic-test-new [integration/config] - 10https://gerrit.wikimedia.org/r/301720 (https://phabricator.wikimedia.org/T139137) [20:34:33] Yippee, build fixed! [20:34:33] Project beta-code-update-eqiad build #114923: 09FIXED in 1 min 32 sec: https://integration.wikimedia.org/ci/job/beta-code-update-eqiad/114923/ [20:40:02] RECOVERY - Puppet run on deployment-sentry01 is OK: OK: Less than 1.00% above the threshold [0.0] [20:59:11] Project selenium-Wikidata » firefox,test,Linux,contintLabsSlave && UbuntuTrusty build #69: 04FAILURE in 2 hr 9 min: https://integration.wikimedia.org/ci/job/selenium-Wikidata/BROWSER=firefox,MEDIAWIKI_ENVIRONMENT=test,PLATFORM=Linux,label=contintLabsSlave%20&&%20UbuntuTrusty/69/ [21:08:51] RECOVERY - Puppet run on integration-slave-trusty-1004 is OK: OK: Less than 1.00% above the threshold [0.0] [21:15:29] 06Release-Engineering-Team, 10Monitoring, 06Operations: "MediaWiki exceptions and fatals per minute" alarm is too slow (half an hour delay!) - https://phabricator.wikimedia.org/T141520#2506920 (10hashar) [21:24:04] (03CR) 10Florianschmidtwelzow: Disallow parenthesis around keywords like clone or require (031 comment) [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/301828 (https://phabricator.wikimedia.org/T116779) (owner: 10Florianschmidtwelzow) [22:00:54] stashbot: T2001 [22:01:17] ostriches: ^ "notin" seems to work [22:01:37] T2001 [22:01:48] <3 [22:03:19] I kinda liked it, but, :P [22:03:47] greg-g: work it out with ostriches :) [22:04:10] It works in all the other channels :p [22:10:06] ostriches i got https://phabricator.wikimedia.org/D300 working [22:10:07] yay [22:13:56] Did alot of testing and i found a solution yay [22:14:43] T1 [23:13:43] PROBLEM - Puppet run on deployment-mathoid is CRITICAL: CRITICAL: 33.33% of data above the critical threshold [0.0] [23:16:22] Project beta-scap-eqiad build #113347: 04FAILURE in 1 min 48 sec: https://integration.wikimedia.org/ci/job/beta-scap-eqiad/113347/ [23:19:59] hmm, is beta logstash not having a good time? [23:20:37] seems to be taking forever to load... [23:21:17] down to ssh [23:21:21] I can't ssh into it, although nc thinks the port is open [23:21:46] PROBLEM - Puppet run on deployment-sca03 is CRITICAL: CRITICAL: 40.00% of data above the critical threshold [0.0] [23:21:47] * bd808 looks at system console [23:22:04] PROBLEM - Puppet run on deployment-zotero01 is CRITICAL: CRITICAL: 55.56% of data above the critical threshold [0.0] [23:22:17] thcipriani: kernel madness [23:22:33] Yuvi might want a look though. he's been chasing this bug in Labs [23:23:07] ack, sure. [23:26:08] thcipriani: Yuvi doesn't have time to look so imma gonna reboot and cross fingers [23:26:25] Project beta-scap-eqiad build #113348: 04STILL FAILING in 1 min 49 sec: https://integration.wikimedia.org/ci/job/beta-scap-eqiad/113348/ [23:26:27] sounds like a plan [23:26:57] PROBLEM - Puppet run on deployment-eventlogging03 is CRITICAL: CRITICAL: 60.00% of data above the critical threshold [0.0] [23:27:20] blerg. These puppet runs are likely me. [23:27:47] !log Rebooting deployment-logstash2; Console showed hung task timeouts (P3606) [23:27:50] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL, Master [23:31:25] looks back [23:33:46] PROBLEM - Puppet staleness on deployment-logstash2 is CRITICAL: CRITICAL: 40.00% of data above the critical threshold [43200.0] [23:34:17] yeah It came right up [23:34:20] PROBLEM - Puppet run on deployment-eventlogging04 is CRITICAL: CRITICAL: 22.22% of data above the critical threshold [0.0] [23:36:28] Yippee, build fixed! [23:36:29] Project beta-scap-eqiad build #113349: 09FIXED in 1 min 53 sec: https://integration.wikimedia.org/ci/job/beta-scap-eqiad/113349/ [23:37:26] ^ and now since scap checks canaries via logstash, that's back in business, too :) [23:39:17] looks like it was busted since 2016-07-27T09:00Z [23:39:20] which is o_0 [23:39:31] nobody looks at beta logs anymore? [23:41:52] damn. that's no good :( [23:43:46] RECOVERY - Puppet staleness on deployment-logstash2 is OK: OK: Less than 1.00% above the threshold [3600.0] [23:52:24] 10Deployment-Systems, 03Scap3: scap3 upstream/debian versioning - https://phabricator.wikimedia.org/T127828#2507263 (10thcipriani) 05Open>03Resolved a:03thcipriani >>! In T127828#2388609, @fgiunchedi wrote: > thanks @hashar for the overview! I think I prefer the latter, namely keep debian packaging and u... [23:52:27] <^demon|away> We need to get the prod error alerts into shinken [23:52:51] ^ +1 [23:55:44] 10Deployment-Systems, 03Scap3: Update Debian Package for Scap3 - https://phabricator.wikimedia.org/T127762#2507267 (10thcipriani) 05Resolved>03Open @fgiunchedi could I get you to update/upload to v.3.2.1-1? I created tags for the upstream version (`3.2.1`) and the debian version with the changelog (`debia... [23:56:46] RECOVERY - Puppet run on deployment-sca03 is OK: OK: Less than 1.00% above the threshold [0.0] [23:57:04] RECOVERY - Puppet run on deployment-zotero01 is OK: OK: Less than 1.00% above the threshold [0.0] [23:58:04] 10Deployment-Systems, 03Scap3: Update Debian Package for Scap3 - https://phabricator.wikimedia.org/T127762#2507290 (10thcipriani) p:05High>03Normal