[00:00:10] PROBLEM - Puppet run on deployment-ircd is CRITICAL: CRITICAL: 33.33% of data above the critical threshold [0.0] [00:20:06] PROBLEM - Puppet run on deployment-phab02 is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [0.0] [00:22:57] PROBLEM - Puppet run on deployment-phab01 is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [0.0] [02:42:49] RainbowSprinkles: Is https://phabricator.wikimedia.org/T148958 worth a point release for 1.27 some time soon? [02:42:57] unfortunately it was merged right after your fixup [02:43:23] May wanna wait until https://phabricator.wikimedia.org/T162600 is fixed, too. though [03:17:53] Krinkle: blah I hate 1.23.x [04:07:21] Yippee, build fixed! [04:07:22] Project selenium-MultimediaViewer » safari,beta,OS X 10.9,BrowserTests build #359: 09FIXED in 11 min: https://integration.wikimedia.org/ci/job/selenium-MultimediaViewer/BROWSER=safari,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=OS%20X%2010.9,label=BrowserTests/359/ [07:46:28] 10Continuous-Integration-Infrastructure, 06Release-Engineering-Team, 07Jenkins: Jenkins Web UI error - Backend fetch failed - https://phabricator.wikimedia.org/T162505#3174250 (10hashar) [08:12:06] looks like something is broken on jenkins? [08:12:18] hashar ? [08:12:46] A bunch of mediawiki-core-doxygen-publish jobs are totally stuck in postmerge [08:12:53] and blocking some gatesubmit jobs [08:13:03] 10Continuous-Integration-Infrastructure, 06Release-Engineering-Team, 07Jenkins: Jenkins Web UI error - Backend fetch failed - https://phabricator.wikimedia.org/T162505#3165426 (10hashar) Yup that has happened for age and in my experience solely when a console is emitting output. User requests are handled by... [08:13:37] 12 stuck in the postmerge pipe, looks like since about 12 hours ago O_o [08:14:56] ci-jessie-wikimedia-610368 is offline [08:18:38] Either me clicking the cancel job button fixed it, or you did something ;) [08:30:01] 10Continuous-Integration-Infrastructure, 06Release-Engineering-Team, 07Jenkins: Jenkins Web UI error - Backend fetch failed - https://phabricator.wikimedia.org/T162505#3174350 (10hashar) p:05Triage>03Normal I dont really know what is happening, lack of logs beside `AH01102: error reading status line from... [08:30:19] addshore: will look [08:35:04] addshore: so yeah I noticed that yesterday. mediawiki-core-doxygen-publish does not run concurrently [08:35:12] and somehow that hold a lock in jenkins somewhere [08:35:15] that prevents other jobs from running [08:52:47] !log Cancelled bunch of mediawiki-core-doxygen-publish jobs that were keeping the queue busy/deadlocked builds. Should be moved to poll scm instead ( T115755 ) [08:52:53] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [08:52:53] T115755: Rewrite mediawiki-core-doxygen-publish Jenkins job to poll scm instead of being triggered by Zuul - https://phabricator.wikimedia.org/T115755 [09:05:55] Project beta-scap-eqiad build #150566: 15ABORTED in 50 sec: https://integration.wikimedia.org/ci/job/beta-scap-eqiad/150566/ [09:14:31] hashar: I'm having trouble upgrading jjb on my machine :( [09:14:42] paste! [09:14:47] are you around if I can't figure it out myself? [09:14:48] should be all about git pull [09:14:55] ok, so you are around :) [09:14:59] and then dish out the virtual env: rm -fR .Tox [09:15:02] rm -fR .tox [09:15:07] yes, git pull complains [09:15:20] then run tox -e venv -- jenkins-jobs --help [09:15:32] the repo has been force pushed, so maybe that is why git pull complain? [09:16:18] and I don't have .tox folder at all [09:16:36] I don't even know what that is [09:16:43] package manager for python? [09:17:16] oh, more like rvm for python, virtual environment [09:17:52] looks like I do have it installed, probably a python dependency, but I don't remember ever using it [09:18:22] zeljkof: can you paste the error you have? [09:18:33] sure, just checking the docs [09:19:14] zeljkof is it merge conflicts? [09:19:28] i did git pull then git reset --hard origin/master [09:19:38] paladox: yes [09:19:43] ah paladox good morning. Was wondering if you ever tried the Jenkins theme http://afonsof.com/jenkins-material-theme/ :-} [09:19:54] oh i havent tryed that [09:19:57] though i can [09:19:57] hashar: the docs don't mention tox :/ https://www.mediawiki.org/wiki/Continuous_integration/Jenkins_job_builder [09:20:19] zeljkof try git reset --hard origin/master that worked for me just now :) [09:20:35] hashar and also too you :) [09:20:47] zeljkof: bah guess I screwed up my mail announcement [09:20:58] zeljkof: but again what is the error you get? [09:21:12] hashar: that's what I'm reading and confused [09:21:13] here it is [09:23:56] hashar: https://phabricator.wikimedia.org/P5250 [09:24:04] Project beta-scap-eqiad build #150569: 15ABORTED in 27 sec: https://integration.wikimedia.org/ci/job/beta-scap-eqiad/150569/ [09:26:00] hashar oh wow check out http://gerrit-jenkins.wmflabs.org [09:26:33] zeljkof thats the same error i got [09:26:37] and same merge conflicts [09:27:10] doing git reset --hard origin/master will fix that. It wont delete you jenkins ini file with the details you set or at least it didnt for me. [09:27:58] hashar: is what paladox recommends the way to go? if so, we should also make that explicit in the announcement e-mail [09:29:42] running sudo pip install -e . i get this error [09:29:44] ['__name__']) [09:29:44] ImportError: No module named pbr_json [09:29:44] Complete output from command python setup.py egg_info: [09:29:44] running egg_info [09:30:52] hashar jenkins-job-builder wants a newer pbr version. But zuul is using an older version. [09:31:07] 10Continuous-Integration-Infrastructure (Little Steps Sprint), 10Wikidata: Revisit Jenkins jobs being triggered for Wikibase - https://phabricator.wikimedia.org/T160989#3174490 (10WMDE-leszek) What @Krinkle has suggested sounds like a good plan at glance! We just need to make sure that all tests are run in suc... [09:31:27] paladox: http://gerrit-jenkins.wmflabs.org/ is that running the Jenkins Material Theme http://afonsof.com/jenkins-material-theme/ ? [09:31:34] yep [09:32:31] that would be really good on integration.wikimedia.org/ci :) [09:32:33] zeljkof: just git reset --hard [09:33:23] hashar: thanks, will do [09:34:28] paladox: yeah we should try it [09:35:07] yep [09:35:31] hashar probaly want to deploy the file on wikimedia so that it isen't loading an external file. [09:35:44] https://wikimediafoundation.org/wiki/Visual_identity_guidelines#toc-colorvalues ... [09:35:55] they have changed to use black / gray .... that is so evil [09:36:24] https://wikimediafoundation.org/wiki/Archived/Wikimedia_visual_identity_guidelines#Color_specifications list the red/green/blue colors [09:36:36] lol [09:36:55] hashar guess what blueocean is no longer beta [09:37:11] hashar and it was so popular it was causing load increases on jenkins sites [09:37:23] it took some of them down too. [09:38:10] hashar: `git reset --hard` does nothing, but returns to the state before `git pull` [09:38:39] that should fix all merge conflicts [09:38:44] and get you to what head is [09:38:45] hashar: `git reset --hard origin/master`? [09:38:50] yep [09:38:57] try that one [09:40:12] hashar i like the new log layout http://gerrit-jenkins.wmflabs.org/job/composer-gerrit-test/17/console :) [09:40:26] also which colour would we use? [09:43:04] though the colors are off :( [09:43:16] I think the ansicolor plugins support different colors scheme [09:43:20] eg when using a dark background [09:43:45] oh [09:45:05] nfo for package from file:///etc/zuul/wikimedia/jenkins-job-builder [09:45:05] error in setup command: Error parsing /etc/zuul/wikimedia/jenkins-job-builder/setup.cfg: ImportError: No module named testrepository [09:45:05] Complete output from command python setup.py egg_info: [09:45:05] error in setup command: Error parsing /etc/zuul/wikimedia/jenkins-job-builder/setup.cfg: ImportError: No module named testrepository [09:45:11] hmm i get that now [09:47:48] doing pip install testrepository fixed that [09:51:43] paladox: it would be in test-requirements.txt [09:51:50] oh [10:00:44] ValueError: Unknown remainder ['-8-gcbc7f62-wmf4jessie1'] in '2.5.0-8-gcbc7f62-wmf4jessie1' [10:00:52] hashar hmm i get that from zuul now [10:02:12] yeah that is the version failing [10:02:20] cause it is not recognized by distutils/setuptools or something [10:02:42] I think you have to downgrade python-pbr / pbr [10:03:00] Oh [10:03:02] paladox: https://phabricator.wikimedia.org/T153877 [10:03:10] thanks [10:03:15] how do i downgrade? [10:03:45] paladox: assuming you use puppet : https://gerrit.wikimedia.org/r/#/c/328555/4/modules/zuul/manifests/init.pp [10:03:48] need an apt::pin [10:03:54] Oh, i doint use puppet [10:04:14] apt-cache policy python-pbr would give all the versions [10:04:30] so maybe you can install it using: sudo apt-get install -t jessie -c main python-pbr [10:04:34] python-pbr: [10:04:34] Installed: 1.10.0-1 [10:04:37] *** 0.8.2-1 1002 [10:04:38] 500 http://mirrors.wikimedia.org/debian/ jessie/main amd64 Packages [10:04:45] python-pbr: [10:04:46] Installed: 1.10.0-1 [10:04:46] Candidate: 1.10.0-1 [10:04:46] Version table: [10:04:46] *** 1.10.0-1 0 [10:04:47] 1001 http://apt.wikimedia.org/wikimedia/ jessie-wikimedia/backports amd64 Packages [10:04:48] 100 /var/lib/dpkg/status [10:04:49] 1.8.0-4.1~bpo8+1 0 [10:04:50] 100 http://ftp.debian.org/debian/ jessie-backports/main amd64 Packages [10:04:51] 100 http://mirrors.wikimedia.org/debian/ jessie-backports/main amd64 Packages [10:04:52] 0.8.2-1 0 [10:04:53] 500 http://httpredir.debian.org/debian/ jessie/main amd64 Packages [10:05:01] yeah and 1.10 uses pypi versions [10:05:06] or semver or whatever [10:05:10] oh [10:05:16] but that choke on the version we use for the deb package [10:05:41] Oh, should we open a task for pbr to be upgraded? [10:06:18] paladox: yeah as a follow up to T153877 [10:06:19] T153877: Zuul has started failing on some repo's in gerrit.wikimedia.org - https://phabricator.wikimedia.org/T153877 [10:06:26] Ok thanks [10:08:28] 06Release-Engineering-Team, 06Labs, 06Operations, 07Zuul: Upgrade pbr for zuul - https://phabricator.wikimedia.org/T162787#3174639 (10Paladox) [10:08:41] hashar ^^ [10:08:42] 06Release-Engineering-Team, 06Labs, 06Operations, 07Zuul: Upgrade pbr for zuul - https://phabricator.wikimedia.org/T162787#3174651 (10Paladox) [10:09:00] 10Continuous-Integration-Infrastructure, 06Release-Engineering-Team, 07Zuul: Upgrade pbr for zuul - https://phabricator.wikimedia.org/T162787#3174654 (10hashar) [10:09:06] yeah adjusted and dropped #operations / #labs [10:09:33] ok [10:09:34] thanks [10:11:03] thats [10:11:03] why [10:11:07] jenkins job builder [10:11:07] does [10:11:08] pbr>=1.8 # Apache-2.0 [10:12:01] yeah version mismatches [10:12:06] yep [10:12:17] so most probably you want to run JJB in a virtualenv [10:12:19] using tox [10:12:47] cd integration/jenkins-job-builder [10:12:54] tox -e venv -- jenkins-jobs [10:12:56] oh [10:13:18] tox will install dependencies under .tox/venv/ [10:13:24] and copy python into there [10:13:27] then tox -e venv -- [10:13:37] executes a command inside that environment so you use the proper versions [10:13:50] doing [10:13:51] pip install -r requirements.txt [10:13:51] Requirement already satisfied (use --upgrade to upgrade): pbr>=0.8.2 in /usr/lib/python2.7/dist-packages (from -r requirements.txt (line 1)) [10:13:51] Cleaning up.. [10:14:03] yeah that would install it globally [10:14:12] which you probably dont want to do [10:14:26] yep. but it seems it still uses 1.1.0 [10:14:27] still shows [10:14:29] ValueError: Unknown remainder ['-8-gcbc7f62-wmf4jessie1'] in '2.5.0-8-gcbc7f62-wmf4jessie1' [10:22:45] hashar fixed it [10:22:57] by downloading python-pbr_0.8.2-1_all.deb from debian [10:24:50] hashar i wonder what version we can use for the new pbr version. [10:25:16] paladox: most probably we will have to patch zuul to not use the git version [10:25:27] oh [10:25:53] but i though zuul uses pbr for the zuul command [10:26:04] though = thought [10:33:17] !sal [10:33:17] https://tools.wmflabs.org/sal/releng [10:34:19] Project beta-code-update-eqiad build #151090: 15ABORTED in 1 min 18 sec: https://integration.wikimedia.org/ci/job/beta-code-update-eqiad/151090/ [10:34:38] zeljkof: I have upgraded the "Email Extension" Jenkins plugin 2.57.1..2.57.2 [10:34:50] zeljkof: that might cause some jobs sending emails to fail [10:36:24] hashar: should I test it? run for a broken job? [10:36:33] no diea [10:36:37] I am running https://integration.wikimedia.org/ci/job/integration-config-qa/169/console [10:36:44] a custom job I made that mails me [10:37:14] if something fails that will be in https://integration.wikimedia.org/ci/scriptApproval/ [10:37:43] !log Jenkins email-ext plugin got upgraded. Some groovy templating might be prevented and would have to be reviewed/approved via https://integration.wikimedia.org/ci/scriptApproval/ [10:37:46] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [10:39:12] zeljkof: I am still receiving emails :} [10:40:36] hashar: that's good :) [11:47:11] 06Release-Engineering-Team, 10Wikidata, 07Story: [Story] Use composer-merge-plugin to include Wikidata components in mediawiki-vendor - https://phabricator.wikimedia.org/T95663#3174916 (10hoo) @demon @greg Any updates here? Is there anything we can help you with? [12:24:44] 06Release-Engineering-Team, 10Wikidata, 07Story: [Story] Use composer-merge-plugin to include Wikidata components in mediawiki-vendor - https://phabricator.wikimedia.org/T95663#1197083 (10Reedy) Just add the stuff you need to mediawiki-vendor? :) Presumably everything that's in Wikidata/vendor should just go... [12:26:33] hashar apparently a bug was introduced in https://github.com/jenkinsci/trilead-ssh2/commit/7dda62dff60192ac1ff3adb470bd7b305eefcda8 so that's causing auth error. [12:27:27] 06Release-Engineering-Team, 10Wikidata, 07Story: [Story] Use composer-merge-plugin to include Wikidata components in mediawiki-vendor - https://phabricator.wikimedia.org/T95663#3174966 (10Reedy) And using composer-merge-plugin would only make sense if we were building the vendor on the fly during the deploym... [12:47:47] 10Browser-Tests-Infrastructure, 07Documentation, 07Easy, 07Software-Licensing: Ruby gem documentation should state license - https://phabricator.wikimedia.org/T94001#3175058 (10Rammanojpotla) @zeljkofilipin I cannot find the documentation page of mediawiki_api and mediawiki_selenium in the docs file of the... [13:00:36] zeljkof: hi, would you have few mins to help me on a browser test (cucumber)? [13:03:07] dcausse: just to see if I have to do swat... [13:03:30] sure [13:04:09] dcausse: ok, I am back, looks like swat is taken care of [13:04:20] ok :) [13:04:28] what's the problem [13:04:39] so I have this page definition: https://github.com/wikimedia/mediawiki-extensions-CirrusSearch/blob/master/tests/browser/features/support/pages/search_page.rb [13:05:10] and I have a test now that starts failing on "search_results_element" [13:05:26] but I have no idea where this is defined [13:05:46] looking [13:06:13] dcausse: it's this one [13:06:13] https://github.com/wikimedia/mediawiki-extensions-CirrusSearch/blob/master/tests/browser/features/support/pages/search_page.rb#L7 [13:06:35] _element gets added to the end by page-object ruby gem (I know, I know, confusing...) [13:06:43] ah.. ok [13:06:51] div(:search_results, class: "suggestions-results") [13:07:37] dcausse: anything else? [13:07:52] I'm around for a few more hours, ping at will :) [13:08:09] zeljkof: thanks I'll continue to investigate! :) [13:08:27] dcausse: ping me if you get stuck [13:08:30] sure [13:44:18] 10Browser-Tests-Infrastructure, 07Documentation, 07Easy, 07Software-Licensing: Ruby gem documentation should state license - https://phabricator.wikimedia.org/T94001#3175189 (10zeljkofilipin) @Rammanojpotla the first step (and probably the last) is just to add a link from `README` to `LICENSE` file. The t... [13:52:29] zeljkof: hey, what is Lisa Seitz-Gruwell's email, please ? [13:52:49] matanya: I don't know :) [13:54:02] thanks zeljkof who would know? (doesn't gmail have your directory to look up things like this?) [13:54:38] matanya: I can probably find out [13:54:56] would be nice if you can help me with that! :) [13:55:22] i am guessing something like Lgruwell@wikimedia.org [13:55:35] matanya: did you try that? [13:55:49] no, it is just a guess [14:04:09] matanya: why do you need Lisa's e-mail? [14:04:37] zeljkof: I blocked angola from editing wikipedia due to abuse of wikipedia zero [14:04:56] I want her too be cc'ed on the email i am sending about this [14:05:04] *to be [14:05:10] PROBLEM - Free space - all mounts on integration-slave-jessie-1002 is CRITICAL: CRITICAL: integration.integration-slave-jessie-1002.diskspace._mnt.byte_percentfree (No valid datapoints found)integration.integration-slave-jessie-1002.diskspace.root.byte_percentfree (<11.11%) [14:09:15] matanya: email wikipediazero@wikimedia.org folks [14:09:28] thanks hashar [14:09:34] matanya: that would reach out to anyone somehow maintaining Zero [14:09:53] Lisa is a C-level and I can see her baby sitting that [14:10:14] most probably it is handled by someone else from her team (assuming Zero is in her team) and she would get summaries [14:10:20] and eventually get involved if need be [14:10:50] matanya: I got the mail from https://wikimediafoundation.org/wiki/Wikipedia_Zero :} [14:11:42] hashar: let's hope it gets somewhere [14:28:18] The c-level *might* be interested by an entire country being blocked. [14:30:07] 06Release-Engineering-Team, 06Labs, 10MediaWiki-extensions-Linter, 07Wikimedia-log-errors: Table 'labtestwiki.linter' doesn't exist (208.80.153.14) - https://phabricator.wikimedia.org/T162605#3175255 (10jcrespo) @Legoktm we didn't get any response about this, so this is probably unmaintained. Can you use a... [14:33:49] Yippee, build fixed! [14:33:49] Project selenium-WikiLove » firefox,beta,Linux,BrowserTests build #360: 09FIXED in 1 min 48 sec: https://integration.wikimedia.org/ci/job/selenium-WikiLove/BROWSER=firefox,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=Linux,label=BrowserTests/360/ [14:38:35] 10Browser-Tests-Infrastructure, 07Documentation, 07Easy, 07Software-Licensing: Ruby gem documentation should state license - https://phabricator.wikimedia.org/T94001#3175266 (10Rammanojpotla) @zeljkofilipin thanks for explanation but I have fallowed the above process and installed ruby and also run the co... [14:54:58] !log integration-slave-jessie-1002 : mv /mnt/home/jenkins-deploy/.android-sdk /mnt/home/jenkins-deploy/.android-sdk.T162635.back for T162635 [14:55:02] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [14:55:02] T162635: Investigate disk usage of integration-slave-jessie-1002 - https://phabricator.wikimedia.org/T162635 [14:56:22] !log integration-slave-jessie-1001 : mv /mnt/home/jenkins-deploy/.android-sdk /mnt/home/jenkins-deploy/.android-sdk.T162635.back for T162635 [14:56:28] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [15:02:40] 10Continuous-Integration-Infrastructure: Investigate disk usage of integration-slave-jessie-1002 - https://phabricator.wikimedia.org/T162635#3175319 (10hashar) My guess is that it: * used to be shared between jobs and set in `$HOME/.android-sdk` ( /mnt/home/jenkins-deploy/.android-sdk ) * the build somehow sti... [15:14:01] !log rm -fR /mnt/home/jenkins-deploy/.android/build-cache/* # T162635 [15:14:05] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [15:14:05] T162635: Investigate disk usage of integration-slave-jessie-1002 - https://phabricator.wikimedia.org/T162635 [15:15:10] RECOVERY - Free space - all mounts on integration-slave-jessie-1002 is OK: OK: integration.integration-slave-jessie-1002.diskspace._mnt.byte_percentfree (No valid datapoints found) [15:17:12] * hashar flexes [15:21:18] 10Continuous-Integration-Infrastructure: Investigate disk usage of integration-slave-jessie-1002 - https://phabricator.wikimedia.org/T162635#3175370 (10hashar) After I have deleted `/mnt/home/jenkins-deploy/.android/build-cache` I rebuild the job apps-android-wikipedia-test and it took 4 minutes 30 seconds whic... [15:34:52] 10Browser-Tests-Infrastructure, 07Documentation, 07Easy, 07Software-Licensing: Ruby gem documentation should state license - https://phabricator.wikimedia.org/T94001#3175386 (10hashar) The Jenkins job that publishes the documentation runs yard directly so try: ``` bundle install bundle exec yard ``` Alter... [15:51:36] Yippee, build fixed! [15:51:36] Project selenium-MobileFrontend » firefox,beta,Linux,BrowserTests build #388: 09FIXED in 29 min: https://integration.wikimedia.org/ci/job/selenium-MobileFrontend/BROWSER=firefox,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=Linux,label=BrowserTests/388/ [15:53:21] hashar ssh slaves now requires java 8 https://github.com/jenkinsci/ssh-slaves-plugin/pull/43#issuecomment-293596394 [15:59:50] 10Continuous-Integration-Infrastructure: Investigate disk usage of integration-slave-jessie-1002 - https://phabricator.wikimedia.org/T162635#3175423 (10Niedzielski) {icon thumbs-up} More on the build cache [[ http://tools.android.com/tech-docs/build-cache | here ]]: > Android Studio 2.2 Beta 3 introduces a new... [16:48:48] 06Release-Engineering-Team, 10Fundraising-Backlog, 03Fundraising Sprint Gondwanaland Reunification Engine, 13Patch-For-Review: Fix raw HTML tags breaking 1.29.0-wmf19+ - https://phabricator.wikimedia.org/T162716#3172368 (10awight) 05Open>03Resolved [17:05:38] 10Scap: Ensure deployment_server is global - https://phabricator.wikimedia.org/T162814#3175632 (10thcipriani) [17:06:44] 06Release-Engineering-Team (Deployment-Blockers), 05Release: MW-1.29.0-wmf.19 deployment blockers - https://phabricator.wikimedia.org/T160551#3175662 (10Pcoombe) [17:07:00] 10Scap: Ensure deployment_server is global - https://phabricator.wikimedia.org/T162814#3175679 (10thcipriani) p:05Triage>03High [17:24:45] 10Continuous-Integration-Infrastructure, 06Labs, 10Labs-Infrastructure, 13Patch-For-Review: OpenStack instances stuck in deletion state - https://phabricator.wikimedia.org/T162529#3175788 (10Andrew) [17:25:47] 10Continuous-Integration-Infrastructure, 06Release-Engineering-Team, 10Icinga, 06Operations: remove/fix jenkins icinga monitoring on contin2001 - https://phabricator.wikimedia.org/T162822#3175792 (10Dzahn) [17:25:56] 10Continuous-Integration-Infrastructure, 06Release-Engineering-Team, 10Icinga, 06Operations: remove/fix jenkins icinga monitoring on contin2001 - https://phabricator.wikimedia.org/T162822#3175808 (10Dzahn) a:05RobH>03None [17:27:15] 10Continuous-Integration-Infrastructure, 06Release-Engineering-Team, 10Icinga, 06Operations: remove/fix jenkins icinga monitoring on contin2001 - https://phabricator.wikimedia.org/T162822#3175792 (10Dzahn) ah, actually this is T150771 and just like what we did for zuul (https://gerrit.wikimedia.org/r/327695) [17:27:33] 10Continuous-Integration-Infrastructure, 06Release-Engineering-Team, 10Icinga, 06Operations: remove/fix jenkins icinga monitoring on contin2001 - https://phabricator.wikimedia.org/T162822#3175818 (10Dzahn) a:03Dzahn [17:27:54] 10Continuous-Integration-Infrastructure, 06Release-Engineering-Team, 10Icinga, 06Operations: remove/fix jenkins icinga monitoring on contint2001 - https://phabricator.wikimedia.org/T162822#3175792 (10Dzahn) [17:28:14] 10Continuous-Integration-Infrastructure, 06Release-Engineering-Team, 06Operations, 13Patch-For-Review: Secondary production Jenkins for CI - https://phabricator.wikimedia.org/T150771#2795939 (10Dzahn) [17:28:17] 10Continuous-Integration-Infrastructure, 06Release-Engineering-Team, 10Icinga, 06Operations: remove/fix jenkins icinga monitoring on contint2001 - https://phabricator.wikimedia.org/T162822#3175792 (10Dzahn) [17:29:38] 10Continuous-Integration-Infrastructure, 06Labs, 10Labs-Infrastructure, 13Patch-For-Review: OpenStack instances stuck in deletion state - https://phabricator.wikimedia.org/T162529#3175830 (10Andrew) 05Open>03Resolved This particular case, at least, is resolved. [17:52:25] Hey RelEng! I wondered if there's any guidelines on sunsetting a desktop beta feature? How can we clear up the user preference artifacts once it gone? [17:56:32] 06Release-Engineering-Team, 06Labs, 10MediaWiki-extensions-Linter, 07Wikimedia-log-errors: Table 'labtestwiki.linter' doesn't exist (208.80.153.14) - https://phabricator.wikimedia.org/T162605#3168367 (10Andrew) I think this was discussed on IRC, but, to follow up... this wiki is a test/dev version of wikit... [17:59:52] jdlrobson: I'd ask James_F, he knows the most about beta features (not really a releng thing) [18:01:27] jdlrobson: I believe the Official Advice™ from RelEng (but greg-g can correct) is "please don't try to delete old user preferences, it's risky and not that valuable". [18:01:50] James_F: great. Just wanted to check. [18:01:57] jdlrobson: Other than that, it just needs dropping from config/etc. [18:03:06] 06Release-Engineering-Team, 06Labs, 10MediaWiki-extensions-Linter, 07Wikimedia-log-errors: Table 'labtestwiki.linter' doesn't exist (208.80.153.14) - https://phabricator.wikimedia.org/T162605#3175944 (10jcrespo) Just see the errors- that is probably not a huge issue, but it clutters db mediawiki logging an... [18:11:53] 10Beta-Cluster-Infrastructure, 06Collaboration-Team-Triage, 10Flow, 07Technical-Debt: Use dedicated $wgFlowCluster and $wgFlowDefaultWikiDb on Beta Cluster - https://phabricator.wikimedia.org/T147523#3175963 (10jmatazzoni) [18:53:37] 10Continuous-Integration-Config, 10Continuous-Integration-Infrastructure, 06Release-Engineering-Team, 07Jenkins: Upgrade jenkins server and jenkins slaves to java 8 - https://phabricator.wikimedia.org/T162828#3176110 (10Paladox) [18:58:04] 10Continuous-Integration-Config, 10Continuous-Integration-Infrastructure, 06Release-Engineering-Team, 07Jenkins: Upgrade jenkins server and jenkins slaves to java 8 - https://phabricator.wikimedia.org/T162828#3176140 (10Paladox) This may affect android cc @Niedzielski [18:58:21] 06Release-Engineering-Team, 06Labs, 10MediaWiki-extensions-Linter, 07Wikimedia-log-errors: Table 'labtestwiki.linter' doesn't exist (208.80.153.14) - https://phabricator.wikimedia.org/T162605#3168367 (10bd808) Table created: ``` labtestweb2001:~ bd808$ mwscript extensions/WikimediaMaintenance/createExtensi... [18:59:20] 10Continuous-Integration-Config, 10Continuous-Integration-Infrastructure, 06Release-Engineering-Team, 07Jenkins: Upgrade jenkins server and jenkins slaves to java 8 - https://phabricator.wikimedia.org/T162828#3176158 (10Niedzielski) @Paladox, thanks for the tip! AFAIK, all Android jobs have already been up... [19:00:38] 10Continuous-Integration-Config, 10Continuous-Integration-Infrastructure, 06Release-Engineering-Team, 07Jenkins: Upgrade jenkins server and jenkins slaves to java 8 - https://phabricator.wikimedia.org/T162828#3176164 (10Paladox) Your welcome and :) [19:01:46] 06Release-Engineering-Team (Deployment-Blockers), 05Release: MW-1.29.0-wmf.20 deployment blockers - https://phabricator.wikimedia.org/T160552#3176167 (10Jdlrobson) [19:14:51] 06Release-Engineering-Team, 06Labs, 10MediaWiki-extensions-Linter, 15User-bd808, 07Wikimedia-log-errors: Table 'labtestwiki.linter' doesn't exist (208.80.153.14) - https://phabricator.wikimedia.org/T162605#3176192 (10Legoktm) 05Open>03Resolved a:03bd808 Thanks @bd808 . [20:48:28] PROBLEM - Puppet run on deployment-urldownloader is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [0.0] [21:00:09] 10Continuous-Integration-Config: Enforce our PHP coding standards on operations/mediawiki-config via composer? - https://phabricator.wikimedia.org/T162835#3176500 (10Jdforrester-WMF) [22:57:04] (03PS2) 10MaxSem: Enable Phan tests for GeoData [integration/config] - 10https://gerrit.wikimedia.org/r/345880 [22:58:24] (03CR) 10jerkins-bot: [V: 04-1] Enable Phan tests for GeoData [integration/config] - 10https://gerrit.wikimedia.org/r/345880 (owner: 10MaxSem) [22:59:05] eh? [23:12:31] 06Release-Engineering-Team, 06Operations, 05DC-Switchover-Prep-Q3-2016-17, 13Patch-For-Review: Understand the preparedness of misc services for datacenter switchover - https://phabricator.wikimedia.org/T156937#3176958 (10Dzahn)