[00:16:45] Project selenium-Flow » chrome,beta,Linux,contintLabsSlave && UbuntuTrusty build #294: 04FAILURE in 45 sec: https://integration.wikimedia.org/ci/job/selenium-Flow/BROWSER=chrome,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=Linux,label=contintLabsSlave%20&&%20UbuntuTrusty/294/ [00:16:51] Project selenium-Flow » firefox,beta,Linux,contintLabsSlave && UbuntuTrusty build #294: 04FAILURE in 50 sec: https://integration.wikimedia.org/ci/job/selenium-Flow/BROWSER=firefox,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=Linux,label=contintLabsSlave%20&&%20UbuntuTrusty/294/ [00:56:04] Project selenium-RelatedArticles » chrome,beta-desktop,Linux,contintLabsSlave && UbuntuTrusty build #305: 04FAILURE in 12 sec: https://integration.wikimedia.org/ci/job/selenium-RelatedArticles/BROWSER=chrome,MEDIAWIKI_ENVIRONMENT=beta-desktop,PLATFORM=Linux,label=contintLabsSlave%20&&%20UbuntuTrusty/305/ [00:56:06] Project selenium-RelatedArticles » chrome,beta-mobile,Linux,contintLabsSlave && UbuntuTrusty build #305: 04FAILURE in 13 sec: https://integration.wikimedia.org/ci/job/selenium-RelatedArticles/BROWSER=chrome,MEDIAWIKI_ENVIRONMENT=beta-mobile,PLATFORM=Linux,label=contintLabsSlave%20&&%20UbuntuTrusty/305/ [02:12:24] chasemp: greg-g: phurl is now whitelist-enabled [02:12:53] https://phabricator.wikimedia.org/rPHAB56e10336461f4ed2c4ff8f1c36c2294de130c64c [02:13:11] Project selenium-QuickSurveys » chrome,beta,Linux,contintLabsSlave && UbuntuTrusty build #305: 04FAILURE in 11 sec: https://integration.wikimedia.org/ci/job/selenium-QuickSurveys/BROWSER=chrome,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=Linux,label=contintLabsSlave%20&&%20UbuntuTrusty/305/ [02:30:36] 06Release-Engineering-Team, 06Discovery, 06Discovery-Search, 10Elasticsearch, 10Phabricator (Search): phab+elasticsearch: support multiple elasticsearch clusters / datacenters - https://phabricator.wikimedia.org/T157156#3011917 (10mmodell) p:05Triage>03High [02:31:06] 06Release-Engineering-Team, 10Elasticsearch, 10Phabricator (Search): Add support for elasticsearch 5 - https://phabricator.wikimedia.org/T155299#3011918 (10mmodell) p:05Triage>03High [02:31:30] 06Release-Engineering-Team, 10Elasticsearch, 10Phabricator (Search): Add support for elasticsearch 5 - https://phabricator.wikimedia.org/T155299#2939806 (10mmodell) [02:41:15] Project selenium-CirrusSearch » firefox,beta,Linux,contintLabsSlave && UbuntuTrusty build #306: 04FAILURE in 14 sec: https://integration.wikimedia.org/ci/job/selenium-CirrusSearch/BROWSER=firefox,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=Linux,label=contintLabsSlave%20&&%20UbuntuTrusty/306/ [02:57:29] 10Beta-Cluster-Infrastructure, 10MediaWiki-User-login-and-signup: Can't log in to en.wikipedia.beta.wmflabs.org - https://phabricator.wikimedia.org/T157650#3011927 (10kaldari) [02:58:51] 10Beta-Cluster-Infrastructure, 10MediaWiki-User-login-and-signup: Can't log in to Beta Cluster wikis - https://phabricator.wikimedia.org/T157650#3011939 (10kaldari) [03:56:15] Project selenium-MultimediaViewer » chrome,beta,OS X 10.9,contintLabsSlave && UbuntuTrusty build #291: 04FAILURE in 14 sec: https://integration.wikimedia.org/ci/job/selenium-MultimediaViewer/BROWSER=chrome,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=OS%20X%2010.9,label=contintLabsSlave%20&&%20UbuntuTrusty/291/ [04:16:05] 10Beta-Cluster-Infrastructure, 10MediaWiki-extensions-CentralAuth, 07Beta-Cluster-reproducible: Global account manager (Special:CentralAuth) errors out on beta - https://phabricator.wikimedia.org/T157636#3012112 (10Legoktm) Special:CentralAuth will query any db table in the localuser/globaluser tables, so I... [06:29:04] 10Beta-Cluster-Infrastructure, 10MediaWiki-extensions-CentralAuth, 07Beta-Cluster-reproducible: Global account manager (Special:CentralAuth) errors out on beta - https://phabricator.wikimedia.org/T157636#3012192 (10Tgr) Oh, I remember now, I wrote https://gerrit.wikimedia.org/r/#/c/297519/ to deal with this... [06:29:22] 10Beta-Cluster-Infrastructure, 10MediaWiki-extensions-CentralAuth, 07Beta-Cluster-reproducible: Global account manager (Special:CentralAuth) errors out on beta - https://phabricator.wikimedia.org/T157636#3012193 (10Tgr) [06:31:05] 10Beta-Cluster-Infrastructure, 10MediaWiki-extensions-CentralAuth, 07Beta-Cluster-reproducible: Global account manager (Special:CentralAuth) errors out on beta - https://phabricator.wikimedia.org/T157636#3011511 (10Tgr) Although maybe Special:CA should just do a sanity check like the one added in https://ger... [07:33:56] 10Continuous-Integration-Config, 06Front-end-Standards-Group: Consider moving from npm to yarn for WMF repos? - https://phabricator.wikimedia.org/T148230#3012228 (10TheDJ) [09:10:11] 06Release-Engineering-Team, 10Elasticsearch, 10Phabricator (Search): Add support for elasticsearch 5 - https://phabricator.wikimedia.org/T155299#3012361 (10Paladox) I think they are switching to es5 next week. So we will want to try and fix support for it before then. [09:11:41] 06Release-Engineering-Team, 10Elasticsearch, 10Phabricator (Search): Add support for elasticsearch 5 - https://phabricator.wikimedia.org/T155299#3012364 (10Paladox) a:05Paladox>03mmodell @mmodell I presume your working on fixing this so assigning to you. [09:44:29] (03PS4) 10Hashar: .gitreview: swap defaultbranch for track [integration/uprightdiff] (debian) - 10https://gerrit.wikimedia.org/r/326821 [09:45:13] (03CR) 10Hashar: [C: 031] "I have removed the "tar-ignore = .gitreview" it does not work and it is not that important." [integration/uprightdiff] (debian) - 10https://gerrit.wikimedia.org/r/326821 (owner: 10Hashar) [10:06:42] PROBLEM - DPKG on contint2001 is CRITICAL: DPKG CRITICAL dpkg reports broken packages [10:08:42] RECOVERY - DPKG on contint2001 is OK: All packages OK [10:15:09] zeljkof: i think i've figured out T155797 [10:15:09] T155797: GettingStarted failing on Jenkins due to CAPTCHA bypass - https://phabricator.wikimedia.org/T155797 [10:15:22] thanks for looking into it too! :) [10:15:30] phuedx: I think the password is wrong, just about to update the task [10:15:44] can you check jenkins and office wiki both have the correct password? [10:16:30] zeljkof: it might be -- i updated the password to the value in the file that matt flaschen references in his original implementation [10:16:44] but the job still failed so i reset it to the one from office wiki [10:17:04] zeljkof: i believe its actually being caused by html5 form validation [10:17:10] the password may well be wrong too [10:17:19] but the form isn't submitting either [10:17:33] phuedx: oh, we had a bug with html form validation in core recently, could be it [10:17:52] zeljkof: https://gerrit.wikimedia.org/r/#/c/336770/ [10:18:08] does the script from here work when you run in in browser console? https://phabricator.wikimedia.org/diffusion/EGST/browse/master/tests/browser/features/support/pages/registration_page.rb;554a2e12d4855c00f2e6d7145f3d528bc9563db0 [10:19:10] phuedx: ok, will test that in jenkins [10:21:23] zeljkof: i've just verified it manually via the browser console [10:21:38] zeljkof: the office wiki and the jenkins credential store are both correct [10:21:44] ok, will merge in a couple of minutes, just to test in jenkins [10:21:53] cool 👍 [10:22:38] i must've looked at the wrong file -- misread matt's instructions from the original ticket [10:22:48] in a minute now: https://integration.wikimedia.org/ci/job/selenium-GettingStarted-336770/ [10:24:26] running: https://integration.wikimedia.org/ci/job/selenium-GettingStarted-336770/BROWSER=firefox,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=Linux,label=contintLabsSlave%20&&%20UbuntuTrusty/1/console [10:24:38] please hold, your patch is important to us... [10:25:29] ;D [10:25:31] phuedx: green! https://integration.wikimedia.org/ci/job/selenium-GettingStarted-336770/BROWSER=firefox,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=Linux,label=contintLabsSlave%20&&%20UbuntuTrusty/1/console [10:25:41] \o/ [10:26:10] hashar: this is so cool! https://phabricator.wikimedia.org/T155797#3012498 [10:26:48] also evil [10:26:50] ;) [10:26:53] ^ hashar [10:27:46] zeljkof: I have another customer holding the line https://gerrit.wikimedia.org/r/#/c/330856/ :D [10:28:40] I am trying to dish out all my patches still open in Gerrit :D [10:29:20] hashar: oh man, what was that line all about anyway o.O [10:29:25] ok, looking [10:30:00] the context is the mediawiki-selenium-integration job [10:30:16] which setup mediawiki and runs mediawiki/selenium integration tests against it [10:30:19] (as I got it) [10:30:35] but when moving the job to Nodepool Jessie instance it fails because Jessie is weird [10:30:54] I'm fine with it, but maybe Dan should also take a look before merging [10:30:57] namely Gem.bin_path('bundler', 'bundle') can not find bundler :/ [10:30:59] yeah probably [10:31:17] I am not sure why he made it to look up the path [10:31:19] I'll give it a worthless +1 ;) [10:31:51] this is merged, restarting the job https://gerrit.wikimedia.org/r/#/c/336770/ [10:32:39] * hashar \O/ [10:32:40] phuedx: I'll work on creating users via api on wikis with captcha, so getting started js workarond would not be needed [10:32:54] this week, I promise [10:33:15] I mean, I work on it this week, maybe not resolve :) [10:33:22] awesome! [10:33:27] but no pressure [10:33:37] Yippee, build fixed! [10:33:37] Project selenium-GettingStarted » firefox,beta,Linux,contintLabsSlave && UbuntuTrusty build #300: 09FIXED in 1 min 29 sec: https://integration.wikimedia.org/ci/job/selenium-GettingStarted/BROWSER=firefox,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=Linux,label=contintLabsSlave%20&&%20UbuntuTrusty/300/ [10:33:40] on my list for a while, anways something [10:33:47] phuedx: ok, back to green ^ [10:35:28] awesome [10:36:38] (03CR) 10Zfilipin: [C: 031] "Looks good to me. Dan?" [selenium] - 10https://gerrit.wikimedia.org/r/330856 (https://phabricator.wikimedia.org/T137112) (owner: 10Hashar) [10:37:17] ok, I need some javascript, after all this ruby ;) [10:37:50] (03PS2) 10Addshore: Add phan template to TwoColConflict [integration/config] - 10https://gerrit.wikimedia.org/r/336615 [10:37:53] (03PS3) 10Addshore: Add phan template to TwoColConflict [integration/config] - 10https://gerrit.wikimedia.org/r/336615 [10:38:00] hashar: ^^ that is ready :) [10:57:39] (03CR) 10Hashar: [C: 032] Add phan template to TwoColConflict [integration/config] - 10https://gerrit.wikimedia.org/r/336615 (owner: 10Addshore) [10:57:43] addshore: so be it [10:57:46] alea jacta est [10:57:51] or whatever other latin reference [10:58:29] (03Merged) 10jenkins-bot: Add phan template to TwoColConflict [integration/config] - 10https://gerrit.wikimedia.org/r/336615 (owner: 10Addshore) [11:00:48] hashar: thanks! [11:07:38] (03PS1) 10Legoktm: Increase timeout for RemexHtml phpunit-coverage [integration/config] - 10https://gerrit.wikimedia.org/r/336779 [11:08:21] (03CR) 10Legoktm: [C: 032] Increase timeout for RemexHtml phpunit-coverage [integration/config] - 10https://gerrit.wikimedia.org/r/336779 (owner: 10Legoktm) [11:10:29] (03Merged) 10jenkins-bot: Increase timeout for RemexHtml phpunit-coverage [integration/config] - 10https://gerrit.wikimedia.org/r/336779 (owner: 10Legoktm) [11:11:08] uh hashar, you didn't deploy it to zuul [11:11:26] !log deploying https://gerrit.wikimedia.org/r/336615 and https://gerrit.wikimedia.org/r/336779 [11:11:29] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [11:19:22] pff ruby [11:19:25] legoktm[NE]: ah yeah sorry [11:25:42] ah Kernel.spawn [11:25:53] * hashar digs in ruby to run commands in parallel :D [11:31:34] and there is also Process.fork bah [12:42:48] hashar: just curious, but can you make gerrit repos? [12:44:12] yup [12:44:42] addshore: yes I can as well as ops and https://gerrit.wikimedia.org/r/#/admin/groups/uuid-93b1e277b72d0e0a883afbc0a87948dd6dd0d7b7 :) [12:46:13] hashar: I was wondering if you would be able to speed my 2 reqyetss through at the bottom of https://www.mediawiki.org/wiki/Git/New_repositories/Requests ? :) [12:46:25] then I can push on with that work today! :D [12:47:48] oh [12:47:56] we should stop using that wiki page really [12:49:12] addshore: what is that move to commons thing ? :} [12:49:34] an extension WMDE is working on to make moving files from wikis to commons easier [12:49:42] will you then later have a FileShared ? } [12:50:52] bwhahaaa, naaah [12:51:35] addshore: done [12:51:36] https://gerrit.wikimedia.org/r/#/admin/projects/mediawiki/extensions/FileImporter,access [12:51:42] https://gerrit.wikimedia.org/r/#/admin/projects/mediawiki/extensions/FileExporter,access [12:51:43] ty! [12:51:45] belongs to 'mediawiki' group [12:51:48] so you should be all set [12:51:59] please mark them as done on https://www.mediawiki.org/wiki/Git/New_repositories/Requests :) [12:55:20] {{doing}} [12:55:55] but yeh, we should totally stop using that page [12:55:58] {{done}} [13:07:28] hashar: ! i can't clone them however :P How can I get started with them? [13:07:38] can't clone ? [13:07:40] I guess I can just push to them? [13:07:53] I made them empty [13:08:12] so I guess your git clone complains it can not find origin/HEAD [13:08:29] warning: remote HEAD refers to nonexistent ref, unable to checkout. [13:09:01] And I can't push from the old repo straight to the new one (prohibited by Gerrit) [13:09:20] azyea NN N [13:09:31] addshore: in Gerrit access grant your self push / force push rights maybe [13:09:42] and you will have to create the branches [13:09:42] oooh, okay *looks* [13:09:43] sorry [13:09:49] https://gerrit.wikimedia.org/r/#/admin/projects/mediawiki/extensions/FileImporter,branches [13:09:55] https://gerrit.wikimedia.org/r/#/admin/projects/mediawiki/extensions/FileExporter,branches [13:10:04] addshore: just add some master branches there [13:10:18] use the refs/meta/config sha1 as a starting point [13:10:28] then in Access [13:10:42] grant force push right to the mediawiki group [13:10:44] git push -f the branches [13:10:49] remove the force push right [13:11:49] 10Beta-Cluster-Infrastructure, 13Patch-For-Review: "Undefined index: wmgExtraLanguageNames" on beta - https://phabricator.wikimedia.org/T157656#3012838 (10Aklapper) [13:13:42] bingo, hashar force push and also forge committe and author identify, and it worked :) [13:38:43] :-} [13:44:29] Project selenium-VisualEditor » firefox,beta,Linux,contintLabsSlave && UbuntuTrusty build #300: 04FAILURE in 28 sec: https://integration.wikimedia.org/ci/job/selenium-VisualEditor/BROWSER=firefox,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=Linux,label=contintLabsSlave%20&&%20UbuntuTrusty/300/ [14:32:34] Project selenium-WikiLove » firefox,beta,Linux,contintLabsSlave && UbuntuTrusty build #296: 04FAILURE in 33 sec: https://integration.wikimedia.org/ci/job/selenium-WikiLove/BROWSER=firefox,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=Linux,label=contintLabsSlave%20&&%20UbuntuTrusty/296/ [15:03:18] 10Gerrit: Gerrit upload-pack send ALL references causing massive network I/O on common operations - https://phabricator.wikimedia.org/T103990#3013151 (10Orgads) By the way, http is faster probably because it uses gzip compression. [15:10:24] (03CR) 10Kaldari: [C: 032] Explicitely check for method structure before using [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/330846 (https://phabricator.wikimedia.org/T154731) (owner: 10Samwilson) [15:12:15] 10MediaWiki-Codesniffer: Release v0.8.0 - https://phabricator.wikimedia.org/T154715#3013164 (10kaldari) [15:12:18] 10MediaWiki-Codesniffer, 03Community-Tech-Sprint, 13Patch-For-Review: Undefined index: scope_opener in MediaWiki/Sniffs/Usage/ExtendClassUsageSniff.php - https://phabricator.wikimedia.org/T154731#3013163 (10kaldari) 05Open>03Resolved [15:12:58] (03Merged) 10jenkins-bot: Explicitely check for method structure before using [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/330846 (https://phabricator.wikimedia.org/T154731) (owner: 10Samwilson) [15:21:34] 06Release-Engineering-Team, 10Elasticsearch, 10Phabricator (Search): Add support for elasticsearch 5 - https://phabricator.wikimedia.org/T155299#3013193 (10EBernhardson) probably not next week, but coming up soon no doubt. hoping to start moving codfw over by the last week of this month. [15:28:06] Project selenium-MobileFrontend » chrome,beta,Linux,contintLabsSlave && UbuntuTrusty build #319: 04FAILURE in 6 min 6 sec: https://integration.wikimedia.org/ci/job/selenium-MobileFrontend/BROWSER=chrome,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=Linux,label=contintLabsSlave%20&&%20UbuntuTrusty/319/ [15:32:39] Project selenium-MobileFrontend » firefox,beta,Linux,contintLabsSlave && UbuntuTrusty build #319: 04FAILURE in 10 min: https://integration.wikimedia.org/ci/job/selenium-MobileFrontend/BROWSER=firefox,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=Linux,label=contintLabsSlave%20&&%20UbuntuTrusty/319/ [15:52:26] 03Scap3, 13Patch-For-Review, 15User-mobrovac: Scap deploy failed to sync git-fat artifacts - https://phabricator.wikimedia.org/T147856#3013329 (10Ottomata) 05Open>03Resolved a:03Ottomata Done! https://apt.wikimedia.org/wikimedia/pool/main/g/git-fat/ Reopen if it doesn't work! :) [15:53:23] 03Scap3, 13Patch-For-Review, 15User-mobrovac: Scap deploy failed to sync git-fat artifacts - https://phabricator.wikimedia.org/T147856#3013332 (10Ottomata) 05Resolved>03Open Oops, wrong ticket, meant to close T155856. [15:53:34] 03Scap3, 13Patch-For-Review, 15User-mobrovac: Scap deploy failed to sync git-fat artifacts - https://phabricator.wikimedia.org/T147856#3013338 (10Ottomata) [15:53:36] 03Scap3, 10Analytics, 06Operations: Package + deploy new version of git-fat - https://phabricator.wikimedia.org/T155856#2956925 (10Ottomata) 05Open>03Resolved Done! https://apt.wikimedia.org/wikimedia/pool/main/g/git-fat/ Reopen if it doesn't work! :) [15:54:37] 03Scap3, 13Patch-For-Review, 15User-mobrovac: Scap deploy failed to sync git-fat artifacts - https://phabricator.wikimedia.org/T147856#2705818 (10Ottomata) [15:54:39] 03Scap3, 10Analytics, 06Operations: Package + deploy new version of git-fat - https://phabricator.wikimedia.org/T155856#3013355 (10Ottomata) 05Resolved>03Open Ok, I'm just clicking buttons way too fast over here. It's been packaged. To deploy, we need to run a `apt-get install git-fat` everywhere. Can... [15:54:48] 03Scap3, 06Analytics-Kanban, 06Operations: Package + deploy new version of git-fat - https://phabricator.wikimedia.org/T155856#3013358 (10Ottomata) [16:05:33] 10Beta-Cluster-Infrastructure, 10Browser-Tests-Infrastructure, 10MediaWiki-extensions-CentralAuth, 07Beta-Cluster-reproducible, 15User-zeljkofilipin: Global account manager (Special:CentralAuth) errors out on beta - https://phabricator.wikimedia.org/T157636#3013389 (10zeljkofilipin) p:05Triage>03High [16:06:21] 10Beta-Cluster-Infrastructure, 10Browser-Tests-Infrastructure, 10MediaWiki-extensions-CentralAuth, 07Beta-Cluster-reproducible, 15User-zeljkofilipin: Global account manager (Special:CentralAuth) errors out on beta - https://phabricator.wikimedia.org/T157636#3011511 (10zeljkofilipin) This broke a lot of b... [16:07:20] 10Beta-Cluster-Infrastructure, 10Browser-Tests-Infrastructure, 10MediaWiki-extensions-CentralAuth, 07Beta-Cluster-reproducible, 15User-zeljkofilipin: Global account manager (Special:CentralAuth) errors out on beta - https://phabricator.wikimedia.org/T157636#3011511 (10hashar) We had tasks in the paste wi... [16:07:22] 06Release-Engineering-Team, 10scap: scap should handle changes to .gitmodules - https://phabricator.wikimedia.org/T157694#3013408 (10Halfak) [16:11:02] 06Release-Engineering-Team, 10scap: scap should handle changes to .gitmodules - https://phabricator.wikimedia.org/T157694#3013435 (10Halfak) Probably add `sync_submodules()` here: https://phabricator.wikimedia.org/source/scap/browse/master/scap/git.py;bf6443a7ba1be34f9418408ca8d0ae049c9f7101$319 [16:13:31] 10Browser-Tests-Infrastructure, 07Ruby, 15User-zeljkofilipin: Selenium tests broken on Ruby 2.4 - https://phabricator.wikimedia.org/T157695#3013437 (10zeljkofilipin) [16:17:01] (03PS1) 10Zfilipin: WIP Selenium tests broken on Ruby 2.4 [selenium] - 10https://gerrit.wikimedia.org/r/336824 (https://phabricator.wikimedia.org/T157695) [16:18:09] 10Browser-Tests-Infrastructure, 13Patch-For-Review, 07Ruby, 15User-zeljkofilipin: Selenium tests broken on Ruby 2.4 - https://phabricator.wikimedia.org/T157695#3013459 (10zeljkofilipin) p:05Triage>03Low [16:26:21] 10Browser-Tests-Infrastructure, 07Ruby, 15User-zeljkofilipin: Selenium Jenkins jobs fail with: Database query error. (internal_api_error_DBQueryError) (MediawikiApi::ApiError) - https://phabricator.wikimedia.org/T157665#3013475 (10zeljkofilipin) p:05High>03Unbreak! [16:26:58] 10Beta-Cluster-Infrastructure, 10Browser-Tests-Infrastructure, 10MediaWiki-extensions-CentralAuth, 07Beta-Cluster-reproducible, 15User-zeljkofilipin: Global account manager (Special:CentralAuth) errors out on beta - https://phabricator.wikimedia.org/T157636#3013484 (10zeljkofilipin) [16:27:00] 10Browser-Tests-Infrastructure, 07Ruby, 15User-zeljkofilipin: Selenium Jenkins jobs fail with: Database query error. (internal_api_error_DBQueryError) (MediawikiApi::ApiError) - https://phabricator.wikimedia.org/T157665#3013483 (10zeljkofilipin) [16:28:03] 10Beta-Cluster-Infrastructure, 10Browser-Tests-Infrastructure, 10MediaWiki-extensions-CentralAuth, 07Beta-Cluster-reproducible, 15User-zeljkofilipin: Global account manager (Special:CentralAuth) errors out on beta - https://phabricator.wikimedia.org/T157636#3013486 (10zeljkofilipin) p:05High>03Unbreak! [16:29:30] 06Release-Engineering-Team, 10scap: scap should handle changes to .gitmodules - https://phabricator.wikimedia.org/T157694#3013488 (10Halfak) https://phabricator.wikimedia.org/D559 [16:30:10] (03CR) 10jerkins-bot: [V: 04-1] WIP Selenium tests broken on Ruby 2.4 [selenium] - 10https://gerrit.wikimedia.org/r/336824 (https://phabricator.wikimedia.org/T157695) (owner: 10Zfilipin) [16:31:37] 06Release-Engineering-Team, 10scap: scap should handle changes to .gitmodules - https://phabricator.wikimedia.org/T157694#3013490 (10Halfak) [16:34:48] 10Browser-Tests-Infrastructure, 13Patch-For-Review, 07Ruby, 15User-zeljkofilipin: Selenium tests broken on Ruby 2.4 - https://phabricator.wikimedia.org/T157695#3013507 (10hashar) 05Open>03declined We already talked about it see https://github.com/watir/watir/issues/519#issuecomment-271015471 watir-dri... [16:35:50] 10Browser-Tests-Infrastructure, 13Patch-For-Review, 07Ruby, 15User-zeljkofilipin: Selenium tests broken on Ruby 2.4 - https://phabricator.wikimedia.org/T157695#3013510 (10hashar) 05declined>03Open [16:40:14] !log deploying 030c269 ores to sca03 [16:40:16] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [16:40:29] 03Scap3, 06Analytics-Kanban, 06Operations: Package + deploy new version of git-fat - https://phabricator.wikimedia.org/T155856#3013520 (10thcipriani) >>! In T155856#3013355, @Ottomata wrote: > Ok, I'm just clicking buttons way too fast over here. It's been packaged. To deploy, we need to run a `apt-get ins... [17:15:56] * Reedy waits for jerkings [17:33:20] Since today, I can't login locally (mw-vagrant). I always get: "There seems to be a problem with your login session; this action has been canceled as a precaution against session hijacking. Go back to the previous page, reload that page and then try again." [17:33:23] Any idea what may be causing that? [17:38:16] 03Scap3, 06Analytics-Kanban, 06Operations: Package + deploy new version of git-fat - https://phabricator.wikimedia.org/T155856#3013818 (10thcipriani) I just tried the above ^ on a labs project machine with the new git fat version and it worked! Here's the tl;dr: ``` $ /bin/bash fattest.sh Cloning into '/ho... [17:45:27] 03Scap3, 06Analytics-Kanban, 06Operations: Package + deploy new version of git-fat - https://phabricator.wikimedia.org/T155856#3013854 (10Ottomata) Ok, great. Can I install on a remote target and we try in prod for something? [17:50:33] Anyone any idea why these qunit are failing? [17:50:34] https://integration.wikimedia.org/ci/job/mediawiki-extensions-qunit-jessie/23253/console [17:59:46] 10Browser-Tests-Infrastructure, 06Release-Engineering-Team, 10DBA, 10MediaWiki-API: Database query error (internal_api_error_DBQueryError) while getting list=allrevisions - https://phabricator.wikimedia.org/T123557#3013913 (10Jdlrobson) p:05Triage>03Unbreak! Hey this is hitting browser tests now consis... [18:08:26] 10Browser-Tests-Infrastructure, 06Release-Engineering-Team, 10DBA, 10MediaWiki-API: Database query error (internal_api_error_DBQueryError) while getting list=allrevisions - https://phabricator.wikimedia.org/T123557#3013983 (10jcrespo) @Jdlrobson I do not know the details- but the original bug is a producti... [18:13:24] 10Browser-Tests-Infrastructure, 06Release-Engineering-Team, 06Reading-Web-Backlog, 07Browser-Tests: Browser tests that use API to write hitting database errors - https://phabricator.wikimedia.org/T157711#3014004 (10Jdlrobson) [18:13:51] 10Browser-Tests-Infrastructure, 06Release-Engineering-Team, 10DBA, 10MediaWiki-API: Database query error (internal_api_error_DBQueryError) while getting list=allrevisions - https://phabricator.wikimedia.org/T123557#3014016 (10Jdlrobson) p:05Unbreak!>03Triage Tracking this now in T157711 [18:21:12] 10Beta-Cluster-Infrastructure, 10Browser-Tests-Infrastructure, 10MediaWiki-extensions-CentralAuth, 07Beta-Cluster-reproducible, 15User-zeljkofilipin: Global account manager (Special:CentralAuth) errors out on beta - https://phabricator.wikimedia.org/T157636#3011511 (10greg) >>! In T157636#3012192, @Tgr w... [18:24:28] Login in beta labs is broken: [WJyzWQpEE4AAAHWfcdkAAAAE] 2017-02-09 18:22:17: Fatal exception of type "DBQueryError" [18:27:01] Error: 1054 Unknown column 'ug_expiry' in 'where clause' (10.68.18.35) [18:27:05] WTF, did the DB update not run? [18:27:25] It halted just to bug you [18:27:29] [ABORTED] Cuz it'll bug Roan [18:27:55] Honestly I have no idea tho [18:29:40] That should've been live a while [18:31:25] RoanKattouw: Fucking ee_prototypewiki wiki [18:31:45] WTF what is that and how does it interact with beta [18:32:17] 2017-02-09 18:22:17 [WJyzWQpEE4AAAHWfcdkAAAAE] deployment-mediawiki04 enwiki 1.29.0-alpha DBQuery ERROR: CentralAuthUser::localUserData 10.68.18.35 1054 Unknown column 'ug_expiry' in 'where clause' (10.68.18.35) SELECT ug_group FROM `user_groups` WHERE ug_user = '306' AND (ug_expiry IS NULL OR ug_expiry >= '20170209182217') {"db_server":"10.68.18.35","db_name":"ee_prototypewiki","db_user":"wikiuser","method":"Database:: [18:32:17] reportQueryError","errno":1054,"error":"Unknown column 'ug_expiry' in 'where clause' (10.68.18.35)","sql1line":"SELECT ug_group FROM `user_groups` WHERE ug_user = '306' AND (ug_expiry IS NULL OR ug_expiry >= '20170209182217') ","fname":"CentralAuthUser::localUserData"} [18:33:26] 06Release-Engineering-Team, 10Phabricator, 10Wikimedia-Blog: Write a blog post on 2017-01-25 phabricator update on wmf - https://phabricator.wikimedia.org/T155896#3014099 (10Aklapper) 05Open>03declined Silence. Which likely means "declined". [18:33:55] 3000 rows of ee_prototypewiki in localusers [18:34:29] RainbowSprinkles: I'm just gonna nuke those 3k rows [18:34:54] tgr: fyi ^ [18:35:02] k [18:35:16] mysql> show databases LIKE 'ee_%'; [18:35:17] +------------------+ [18:35:17] | Database (ee_%) | [18:35:17] +------------------+ [18:35:17] | ee_prototypewiki | [18:35:17] +------------------+ [18:35:19] 1 row in set (0.00 sec) [18:36:24] GONE [18:36:27] RoanKattouw: Try again? [18:36:40] !log someone should kill the ee_prototypewiki db from beta [18:36:43] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [18:37:35] Reedy: Still broken [18:37:52] Function: CentralAuthUser::localUserData so maybe it's not the DB we expect [18:38:34] 2017-02-09 18:37:18 [WJy23gpEE4AAADxj8PgAAAAD] deployment-mediawiki04 enwiki 1.29.0-alpha DBQuery ERROR: CentralAuthUser::localUserData 10.68.18.35 1054 Unknown column 'ug_expiry' in 'where clause' (10.68.18.35) SELECT ug_group FROM `user_groups` WHERE ug_user = '306' AND (ug_expiry IS NULL OR ug_expiry >= '20170209183718') {"db_server":"10.68.18.35","db_name":"ee_prototypewiki","db_user":"wikiuser","method":"Database:: [18:38:34] reportQueryError","errno":1054,"error":"Unknown column 'ug_expiry' in 'where clause' (10.68.18.35)","sql1line":"SELECT ug_group FROM `user_groups` WHERE ug_user = '306' AND (ug_expiry IS NULL OR ug_expiry >= '20170209183718') ","fname":"CentralAuthUser::localUserData"} [18:38:37] Caching? [18:38:44] Or, it's still trying to load it as it's in some list somewhere [18:39:19] let's stop my battery dying [18:42:22] 03Scap3, 06Analytics-Kanban, 06Operations: Package + deploy new version of git-fat - https://phabricator.wikimedia.org/T155856#3014122 (10thcipriani) >>! In T155856#3013854, @Ottomata wrote: > Ok, great. Can I install on a remote target and we try in prod for > something? hrm. I usually test in beta and do... [18:42:44] Would be really nice if we had this on labs [18:42:45] mysql:wikiadmin@db1055 [enwiki]> [18:43:58] nfi whether I'm on master or slave [18:44:13] RoanKattouw: And again? [18:45:57] 10Browser-Tests-Infrastructure, 06Release-Engineering-Team, 06Reading-Web-Backlog, 07Browser-Tests, and 2 others: Browser tests that use API to write hitting database errors - https://phabricator.wikimedia.org/T157711#3014143 (10Jdlrobson) [18:46:08] 10Browser-Tests-Infrastructure, 06Release-Engineering-Team, 06Reading-Web-Backlog, 07Browser-Tests, and 2 others: Browser tests that use API to write hitting database errors - https://phabricator.wikimedia.org/T157711#3014145 (10Jdlrobson) p:05Triage>03Unbreak! [18:46:33] 10Beta-Cluster-Infrastructure, 06Release-Engineering-Team: Better mysql command prompt info - https://phabricator.wikimedia.org/T157714#3014147 (10Reedy) [18:49:14] RoanKattouw: WFM now. CC greg-g tgr [18:49:31] Also.. Why can I apparently do destructive commands on the mysql slaves? [18:51:15] Yeah WFM too [18:51:36] Sorry, I'm a meeting so my response to pings is delyaed [18:51:43] ¯\_(ツ)_/¯ [18:52:10] 10Beta-Cluster-Infrastructure, 10Browser-Tests-Infrastructure, 10MediaWiki-extensions-CentralAuth, 07Beta-Cluster-reproducible, and 2 others: Global account manager (Special:CentralAuth) errors out on beta - https://phabricator.wikimedia.org/T157636#3014186 (10Tgr) The patch should fix the errors (and log... [18:53:57] greg-g: MAKE BETA GREAT AGAIN [18:54:34] Reedy: don't you ever [18:54:47] * Reedy builds a wall on beta [18:55:23] lol [18:59:50] Beta had the biggest virtualization cloud.! #tremendous [19:17:37] 03Scap3, 06Analytics-Kanban, 06Operations: Package + deploy new version of git-fat - https://phabricator.wikimedia.org/T155856#3014261 (10Ottomata) I think we’ll have a refinery deploy to do soon. Will check… [19:23:25] 10Deployment-Systems, 06Release-Engineering-Team, 03Scap3, 10scap, and 2 others: Error after "Finished deploy": xrange() arg 3 must not be zero - https://phabricator.wikimedia.org/T157136#2996635 (10Smalyshev) Same error for me trying to do `scap deploy -l wdqs2003.codfw.wmnet` [19:28:07] RainbowSprinkles, https://phabricator.wikimedia.org/D559 :D I think that addresses your comments. [19:28:16] I'm gonna dig into another one I saw crop up [19:35:28] 10Deployment-Systems, 06Release-Engineering-Team, 03Scap3, 10scap, and 2 others: Error after "Finished deploy": xrange() arg 3 must not be zero - https://phabricator.wikimedia.org/T157136#3014300 (10Halfak) [19:36:33] halfak: Accepted & landed [19:36:39] \o/ [19:36:49] Just finished https://phabricator.wikimedia.org/D561 too [19:36:51] (03PS1) 10Arlolra: Run parsoid's cite parser tests as well [integration/config] - 10https://gerrit.wikimedia.org/r/336873 [19:36:54] Not sure if it's the best solution [19:37:05] I saw that SMalyshev was running into this too [19:37:26] yay, halfak contributing to scap :) [19:37:33] :D [19:37:52] (03PS2) 10Arlolra: Run parsoid's cite parser tests as well [integration/config] - 10https://gerrit.wikimedia.org/r/336873 (https://phabricator.wikimedia.org/T114256) [19:38:02] 06Release-Engineering-Team (Deployment-Blockers), 05Release: MW-1.29.0-wmf.11 deployment blockers - https://phabricator.wikimedia.org/T155526#3014311 (10brion) [19:38:37] (03CR) 10Arlolra: "Not sure how to test this ..." [integration/config] - 10https://gerrit.wikimedia.org/r/336873 (https://phabricator.wikimedia.org/T114256) (owner: 10Arlolra) [19:40:20] halfak: So the description Antoine gives: "so maybe we did an optimization that filter out host that already got deployed" is correct. [19:40:34] We don't repeat nodes that have been done at an earlier stage (eg: canaries) [19:41:13] And somehow that gets transfered to the self.size [19:41:20] When we have a group size of zero, we error. [19:44:23] Yep, totally makes sense. [19:44:29] I'm just digging to see if your fix is the *right* fix [19:49:26] RainbowSprinkles, gotcha. Totally is kind of a bandaid :) [19:59:22] 06Release-Engineering-Team, 06Operations, 05DC-Switchover-Prep-Q3-2016-17: Understand the preparedness of misc services for datacenter switchover - https://phabricator.wikimedia.org/T156937#3014405 (10RobH) [19:59:25] 10Gerrit, 06Release-Engineering-Team, 06Operations, 13Patch-For-Review: Build warm slave for Gerrit in Dallas - https://phabricator.wikimedia.org/T148186#3014406 (10RobH) [19:59:29] 10Gerrit, 06Release-Engineering-Team, 06Operations, 10hardware-requests, 13Patch-For-Review: Requesting 1 spare misc box for Gerrit in codfw - https://phabricator.wikimedia.org/T148187#3014404 (10RobH) 05Open>03Resolved [20:02:08] 05Gerrit-Migration: Turn on "diffusion.allow-http-auth" - https://phabricator.wikimedia.org/T123#3014452 (10dduvall) [20:07:02] 10Beta-Cluster-Infrastructure, 10MediaWiki-JobRunner, 10MediaWiki-Vagrant, 10TimedMediaHandler-Transcode: Video transcode job runner on beta cluster runs 5 jobs even though configured for 2 - https://phabricator.wikimedia.org/T110916#3014480 (10brion) [20:10:04] 10Beta-Cluster-Infrastructure, 10MediaWiki-JobRunner, 10MediaWiki-Vagrant, 10TimedMediaHandler-Transcode: Video transcode job runner on beta cluster runs 5 jobs even though configured for 2 - https://phabricator.wikimedia.org/T110916#3014490 (10brion) 05Open>03Resolved a:03brion I'm pretty sure we re... [20:17:08] 06Release-Engineering-Team (Deployment-Blockers), 05Release: MW-1.29.0-wmf.11 deployment blockers - https://phabricator.wikimedia.org/T155526#3014504 (10thcipriani) [20:19:04] (03PS3) 10Arlolra: Run parsoid's cite parser tests as well [integration/config] - 10https://gerrit.wikimedia.org/r/336873 (https://phabricator.wikimedia.org/T114256) [20:21:21] hmm thcipriani [20:21:25] scap deploy -l stat1004.eqiad.wmnet [20:21:29] 20:21:11 deploy failed: xrange() arg 3 must not be zero [20:21:35] works fine without a limit? [20:21:52] ottomata: yeah, I just realized that the limit is broken in the latest version see scrollback in -operations :( [20:22:05] ahh ok [20:22:22] for now: to deploy to one host you just have to adjust server_groups and dsh_targets to just have one host :\ [20:27:01] oook, thcipriani that's ok. i just verified that git-fat continues to work with the updated version in production [20:27:12] not sure about your edge case, haven't tested that, but at least normal operation isfine [20:27:16] i think we can update it everywhere [20:27:28] ottomata: awesome! Thank you so much! [20:27:28] kinda hard to figure out all the places, but it hink i can do it from pupet [20:28:42] thcipriani: hm, it looks like puppet doesn't ensure git-fat is installed for scap stuff, its just in trebuchet::packages [20:28:46] shoudl I put it in scap puppet somewhere? [20:29:28] probably in scap init.pp ? [20:29:40] oh! hrm. yeah, that'd probably be good :) [20:29:58] I don't know if it's needed by scap on the scap master, but people probably use it to prep their repos on the scap master. [20:30:27] (03PS4) 10Arlolra: Run parsoid's cite parser tests as well [integration/config] - 10https://gerrit.wikimedia.org/r/336873 (https://phabricator.wikimedia.org/T114256) [20:30:37] looks like scap is included on targets as well [20:30:44] seems like the only place that does both [20:30:47] and it installs other scap deps [20:30:49] i think [20:33:37] scap init is the right place for it I think [20:34:09] although... [20:34:23] this may conflict with trebuchet/packages :\ [20:34:25] blerg. [20:34:42] oh ya, wrapping if !defined(Package['git-fat'] { :p [20:34:53] seeing if this works, not sure about the version thing... [20:38:20] So yeah git-fat is installed indirectly via the trebuchet manifests. Been wanting to clean that up [20:39:09] (03PS5) 10Arlolra: Run parsoid's cite parser tests as well [integration/config] - 10https://gerrit.wikimedia.org/r/336873 (https://phabricator.wikimedia.org/T114256) [20:40:15] RainbowSprinkles: https://gerrit.wikimedia.org/r/#/c/336887/1 [20:40:25] shoudl I remove it altogether from trebuchet packages.pp? [20:41:36] Is anything on trebuchet still using git-fat? [20:42:11] Yippee, build fixed! [20:42:11] Yippee, build fixed! [20:42:12] Project selenium-Echo » firefox,beta,Linux,contintLabsSlave && UbuntuTrusty build #299: 09FIXED in 1 min 10 sec: https://integration.wikimedia.org/ci/job/selenium-Echo/BROWSER=firefox,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=Linux,label=contintLabsSlave%20&&%20UbuntuTrusty/299/ [20:42:12] Project selenium-Echo » chrome,beta,Linux,contintLabsSlave && UbuntuTrusty build #299: 09FIXED in 1 min 10 sec: https://integration.wikimedia.org/ci/job/selenium-Echo/BROWSER=chrome,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=Linux,label=contintLabsSlave%20&&%20UbuntuTrusty/299/ [20:42:32] dunno! [20:42:45] RainbowSprinkles: i'll just leave it like this [20:42:51] So to be safe, let's just leave it in both and wrap them in defined() [20:42:54] and if/when yall finally remove all trebuchet stuff i'll just disappear [20:42:55] yeah [20:42:57] It's ugly, but safest for now [20:43:01] And won't be like that Forever [20:43:03] :) [20:43:35] RainbowSprinkles: would you prefer if I put ensure => latest instead of the version? [20:43:43] that would maek git-fat auto update if we put a new package into apt.wm.o [20:43:57] but would also mean we wouldnt' need to remember to change the version here when we update [20:44:49] Eh, downside to latest => means harder to test debian package in labs [20:46:21] k [20:46:38] merging [20:49:28] 10Continuous-Integration-Config, 10Parsoid: parsoidsvc-hhvm-parsertests-jessie doesn't run tidy tests - https://phabricator.wikimedia.org/T157730#3014649 (10Arlolra) [20:52:42] PROBLEM - puppet last run on contint2001 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): Package[git-fat] [20:54:24] PROBLEM - Puppet run on integration-slave-docker-1000 is CRITICAL: CRITICAL: 40.00% of data above the critical threshold [0.0] [20:57:25] PROBLEM - Puppet run on integration-slave-trusty-1004 is CRITICAL: CRITICAL: 55.56% of data above the critical threshold [0.0] [20:58:23] PROBLEM - Puppet run on integration-slave-jessie-android is CRITICAL: CRITICAL: 66.67% of data above the critical threshold [0.0] [20:59:10] these are me ^ fixing... [21:03:20] PROBLEM - Puppet run on integration-slave-trusty-1006 is CRITICAL: CRITICAL: 66.67% of data above the critical threshold [0.0] [21:03:42] RECOVERY - puppet last run on contint2001 is OK: OK: Puppet is currently enabled, last run 58 seconds ago with 0 failures [21:09:43] PROBLEM - Puppet run on integration-slave-precise-1011 is CRITICAL: CRITICAL: 22.22% of data above the critical threshold [0.0] [21:12:19] 10Browser-Tests-Infrastructure, 06Release-Engineering-Team, 06Reading-Web-Backlog, 07Browser-Tests, and 2 others: Browser tests that use API to write hitting database errors - https://phabricator.wikimedia.org/T157711#3014752 (10Jdlrobson) [21:13:38] 10Deployment-Systems, 06Release-Engineering-Team (Long-Lived-Branches): Convert old wmf/* deployment branches to tags (recurring chore) - https://phabricator.wikimedia.org/T1288#3014753 (10demon) So I think the last thing to do here is to automate this a bit. I'm going to add it to `scap clean` [21:14:33] ok thcipriani, puppet fixed and it will install newer git fat now [21:14:33] i guess give it a while to run everywhere to do that [21:14:33] lemme know if you have any problems [21:14:57] ottomata: ok. Thank you again for this! [21:16:22] :) [21:16:22] yw [21:18:17] (03CR) 10Arlolra: "Hmm, so the citeParserTest.txt now runs, but it seems like the extension isn't being configured in LocalSettings.php" [integration/config] - 10https://gerrit.wikimedia.org/r/336873 (https://phabricator.wikimedia.org/T114256) (owner: 10Arlolra) [21:28:01] anyone know what is going on in operations [21:28:48] Zppix: pretty sure there was a puppet action [21:28:52] reboot/recovery [21:31:00] JustBerry ok, i though icinga-wm was having a issue or something :P [21:31:13] Zppix: yeah... might have to do with https://tools.wmflabs.org/iabot/index.php [21:31:20] just a thought [21:31:40] 10Browser-Tests-Infrastructure, 07Ruby, 15User-zeljkofilipin: Selenium Jenkins jobs fail with: Database query error. (internal_api_error_DBQueryError) (MediawikiApi::ApiError) - https://phabricator.wikimedia.org/T157665#3014826 (10greg) [21:31:43] 10Browser-Tests-Infrastructure, 06Release-Engineering-Team, 06Reading-Web-Backlog, 07Browser-Tests, and 2 others: Browser tests that use API to write hitting database errors - https://phabricator.wikimedia.org/T157711#3014828 (10greg) [21:32:01] i highly doubt an tool will do that to a puppet [21:32:23] RECOVERY - Puppet run on integration-slave-trusty-1004 is OK: OK: Less than 1.00% above the threshold [0.0] [21:33:20] 10Beta-Cluster-Infrastructure, 10Browser-Tests-Infrastructure, 10MediaWiki-extensions-CentralAuth, 07Beta-Cluster-reproducible, and 2 others: Global account manager (Special:CentralAuth) errors out on beta - https://phabricator.wikimedia.org/T157636#3014847 (10greg) [21:33:22] 06Release-Engineering-Team (Deployment-Blockers), 05Release: MW-1.29.0-wmf.12 deployment blockers - https://phabricator.wikimedia.org/T155527#3014846 (10greg) [21:33:23] RECOVERY - Puppet run on integration-slave-jessie-android is OK: OK: Less than 1.00% above the threshold [0.0] [21:33:59] 10Beta-Cluster-Infrastructure, 10Browser-Tests-Infrastructure, 10MediaWiki-extensions-CentralAuth, 07Beta-Cluster-reproducible, and 2 others: Global account manager (Special:CentralAuth) errors out on beta - https://phabricator.wikimedia.org/T157636#3011511 (10greg) This is now blocking next week's train,... [21:34:23] RECOVERY - Puppet run on integration-slave-docker-1000 is OK: OK: Less than 1.00% above the threshold [0.0] [21:38:21] RECOVERY - Puppet run on integration-slave-trusty-1006 is OK: OK: Less than 1.00% above the threshold [0.0] [21:40:55] 10Beta-Cluster-Infrastructure, 10Browser-Tests-Infrastructure, 10MediaWiki-extensions-CentralAuth, 07Beta-Cluster-reproducible, and 2 others: Global account manager (Special:CentralAuth) errors out on beta - https://phabricator.wikimedia.org/T157636#3014890 (10Tgr) I think @Reedy deleted the offending rows? [21:42:23] 10Browser-Tests-Infrastructure, 03Reading-Web-Sprint-91-🐔🍔, 07Ruby, 07Unplanned-Sprint-Work, 15User-zeljkofilipin: Selenium Jenkins jobs fail with: Database query error. (internal_api_error_DBQueryError) (MediawikiApi::ApiError) - https://phabricator.wikimedia.org/T157665#3014908 (10Jdlrobson) [21:43:04] 10Beta-Cluster-Infrastructure, 10Browser-Tests-Infrastructure, 10MediaWiki-extensions-CentralAuth, 07Beta-Cluster-reproducible, and 2 others: Global account manager (Special:CentralAuth) errors out on beta - https://phabricator.wikimedia.org/T157636#3014911 (10Reedy) >>! In T157636#3014890, @Tgr wrote: > I... [21:44:31] 10Beta-Cluster-Infrastructure, 10Browser-Tests-Infrastructure, 10MediaWiki-extensions-CentralAuth, 07Beta-Cluster-reproducible, and 2 others: Global account manager (Special:CentralAuth) errors out on beta - https://phabricator.wikimedia.org/T157636#3014913 (10greg) Soooo, status? :) [21:49:45] RECOVERY - Puppet run on integration-slave-precise-1011 is OK: OK: Less than 1.00% above the threshold [0.0] [21:50:38] 10Beta-Cluster-Infrastructure, 10Browser-Tests-Infrastructure, 10MediaWiki-extensions-CentralAuth, 07Beta-Cluster-reproducible, and 2 others: Global account manager (Special:CentralAuth) errors out on beta - https://phabricator.wikimedia.org/T157636#3014939 (10Reedy) >>! In T157636#3014847, @greg wrote: >... [21:55:37] Yippee, build fixed! [21:55:38] Project selenium-CentralAuth » firefox,beta,Linux,contintLabsSlave && UbuntuTrusty build #299: 09FIXED in 1 min 50 sec: https://integration.wikimedia.org/ci/job/selenium-CentralAuth/BROWSER=firefox,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=Linux,label=contintLabsSlave%20&&%20UbuntuTrusty/299/ [21:57:37] 10Beta-Cluster-Infrastructure, 10Browser-Tests-Infrastructure, 10MediaWiki-extensions-CentralAuth, 07Beta-Cluster-reproducible, and 2 others: Global account manager (Special:CentralAuth) errors out on beta - https://phabricator.wikimedia.org/T157636#3014943 (10greg) Re-running some others now... [21:57:46] 03Scap3, 06Analytics-Kanban, 06Operations, 13Patch-For-Review: Package + deploy new version of git-fat - https://phabricator.wikimedia.org/T155856#3014951 (10Ottomata) Updating here: git-fat 0.1.2 now installed everywhere by puppet. [21:58:30] 06Release-Engineering-Team (Deployment-Blockers), 05Release: MW-1.29.0-wmf.12 deployment blockers - https://phabricator.wikimedia.org/T155527#3014966 (10greg) [21:58:36] 10Beta-Cluster-Infrastructure, 10Browser-Tests-Infrastructure, 10MediaWiki-extensions-CentralAuth, 07Beta-Cluster-reproducible, and 2 others: Global account manager (Special:CentralAuth) errors out on beta - https://phabricator.wikimedia.org/T157636#3014964 (10greg) 05Open>03Resolved w00t ```lang=irc... [21:59:02] Yippee, build fixed! [21:59:02] Project selenium-Core » firefox,beta,Linux,contintLabsSlave && UbuntuTrusty build #309: 09FIXED in 7 min 1 sec: https://integration.wikimedia.org/ci/job/selenium-Core/BROWSER=firefox,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=Linux,label=contintLabsSlave%20&&%20UbuntuTrusty/309/ [21:59:48] Yippee, build fixed! [21:59:49] Project selenium-RelatedArticles » chrome,beta-mobile,Linux,contintLabsSlave && UbuntuTrusty build #309: 09FIXED in 44 sec: https://integration.wikimedia.org/ci/job/selenium-RelatedArticles/BROWSER=chrome,MEDIAWIKI_ENVIRONMENT=beta-mobile,PLATFORM=Linux,label=contintLabsSlave%20&&%20UbuntuTrusty/309/ [21:59:49] Yippee, build fixed! [21:59:50] Project selenium-RelatedArticles » chrome,beta-desktop,Linux,contintLabsSlave && UbuntuTrusty build #309: 09FIXED in 45 sec: https://integration.wikimedia.org/ci/job/selenium-RelatedArticles/BROWSER=chrome,MEDIAWIKI_ENVIRONMENT=beta-desktop,PLATFORM=Linux,label=contintLabsSlave%20&&%20UbuntuTrusty/309/ [22:01:48] Yippee, build fixed! [22:01:49] Project selenium-VisualEditor » firefox,beta,Linux,contintLabsSlave && UbuntuTrusty build #301: 09FIXED in 2 min 49 sec: https://integration.wikimedia.org/ci/job/selenium-VisualEditor/BROWSER=firefox,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=Linux,label=contintLabsSlave%20&&%20UbuntuTrusty/301/ [22:13:36] 06Release-Engineering-Team, 10scap: Cleanup old cache dirs if still around - https://phabricator.wikimedia.org/T157743#3015007 (10Reedy) [22:17:03] Yippee, build fixed! [22:17:04] Project selenium-MobileFrontend » chrome,beta,Linux,contintLabsSlave && UbuntuTrusty build #320: 09FIXED in 23 min: https://integration.wikimedia.org/ci/job/selenium-MobileFrontend/BROWSER=chrome,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=Linux,label=contintLabsSlave%20&&%20UbuntuTrusty/320/ [22:20:50] Yippee, build fixed! [22:20:51] Project selenium-CirrusSearch » firefox,beta,Linux,contintLabsSlave && UbuntuTrusty build #307: 09FIXED in 1 min 1 sec: https://integration.wikimedia.org/ci/job/selenium-CirrusSearch/BROWSER=firefox,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=Linux,label=contintLabsSlave%20&&%20UbuntuTrusty/307/ [22:21:04] Yippee, build fixed! [22:21:04] Project selenium-Flow » chrome,beta,Linux,contintLabsSlave && UbuntuTrusty build #295: 09FIXED in 1 min 9 sec: https://integration.wikimedia.org/ci/job/selenium-Flow/BROWSER=chrome,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=Linux,label=contintLabsSlave%20&&%20UbuntuTrusty/295/ [22:21:10] Yippee, build fixed! [22:21:10] Project selenium-Flow » firefox,beta,Linux,contintLabsSlave && UbuntuTrusty build #295: 09FIXED in 1 min 15 sec: https://integration.wikimedia.org/ci/job/selenium-Flow/BROWSER=firefox,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=Linux,label=contintLabsSlave%20&&%20UbuntuTrusty/295/ [22:21:30] * greg-g kicked off a bunch of selenium tests, if it wasn't clear [22:22:20] Yippee, build fixed! [22:22:20] Project selenium-WikiLove » firefox,beta,Linux,contintLabsSlave && UbuntuTrusty build #297: 09FIXED in 1 min 49 sec: https://integration.wikimedia.org/ci/job/selenium-WikiLove/BROWSER=firefox,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=Linux,label=contintLabsSlave%20&&%20UbuntuTrusty/297/ [22:22:30] !log manually kicked off a bunch of selenium tests after tgr and Reedy fixed T157636 [22:22:33] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [22:22:33] T157636: Global account manager (Special:CentralAuth) errors out on beta - https://phabricator.wikimedia.org/T157636 [22:24:21] (03PS15) 10Paladox: Phabricator/harbormaster job templates [integration/config] - 10https://gerrit.wikimedia.org/r/295396 (https://phabricator.wikimedia.org/T130950) (owner: 1020after4) [22:26:11] Yippee, build fixed! [22:26:11] Project selenium-MobileFrontend » firefox,beta,Linux,contintLabsSlave && UbuntuTrusty build #320: 09FIXED in 32 min: https://integration.wikimedia.org/ci/job/selenium-MobileFrontend/BROWSER=firefox,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=Linux,label=contintLabsSlave%20&&%20UbuntuTrusty/320/ [22:29:30] 10Continuous-Integration-Infrastructure, 10Phabricator: Disable phabricator unit tests - https://phabricator.wikimedia.org/T157745#3015093 (10Paladox) [22:30:51] 10Continuous-Integration-Infrastructure, 10Phabricator: Disable phabricator unit tests - https://phabricator.wikimedia.org/T157745#3015122 (10Dzahn) please paste the whole error message you showed me.. the one about the database missing [22:32:12] 10Continuous-Integration-Infrastructure, 10Phabricator: Disable phabricator unit tests - https://phabricator.wikimedia.org/T157745#3015126 (10Paladox) [22:33:25] Yippee, build fixed! [22:33:26] Project selenium-QuickSurveys » chrome,beta,Linux,contintLabsSlave && UbuntuTrusty build #306: 09FIXED in 4 min 29 sec: https://integration.wikimedia.org/ci/job/selenium-QuickSurveys/BROWSER=chrome,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=Linux,label=contintLabsSlave%20&&%20UbuntuTrusty/306/ [22:35:20] 10Continuous-Integration-Infrastructure, 06Release-Engineering-Team, 07Jenkins: Upgrade Jenkins from 1.x to latest 2.x - https://phabricator.wikimedia.org/T144106#3015137 (10Paladox) @hashar unless you have some special way that allows you to use

on tests config pages then it will not work in jenkins 2.x... [22:36:02] 10Continuous-Integration-Infrastructure, 06Release-Engineering-Team, 07Jenkins: Upgrade Jenkins to 1.651.3 - https://phabricator.wikimedia.org/T144105#3015139 (10Paladox) @hashar should we close this as declined as it looks like we are going with 2.7.3? [22:47:09] 10MediaWiki-Codesniffer: Release v0.8.0 - https://phabricator.wikimedia.org/T154715#3015190 (10Samwilson) Are there any other blockers to a new release? [22:48:23] 10MediaWiki-Codesniffer: Release Codesniffer v0.8.0 - https://phabricator.wikimedia.org/T154715#3015197 (10Reedy) [22:48:46] (03Draft1) 10Paladox: Update squizlabs/PHP_CodeSniffer to 2.8.0 [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/336935 [22:48:48] (03PS2) 10Paladox: Update squizlabs/PHP_CodeSniffer to 2.8.0 [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/336935 [22:49:48] 10MediaWiki-Codesniffer: Release Codesniffer v0.8.0 - https://phabricator.wikimedia.org/T154715#2921575 (10Reedy) https://github.com/squizlabs/PHP_CodeSniffer/releases/tag/2.8.0 has been released if we care... https://github.com/squizlabs/PHP_CodeSniffer/compare/2.7.1...2.8.0 [22:52:13] hi it seems this test is failing [22:52:14] https://integration.wikimedia.org/ci/job/mw-tools-codesniffer-mwcore-testrun/265/console [22:56:04] 22:50:14 Assertion error: php is not hhvm: [22:56:15] paladox: I presume it's a change in 2.8.0 [22:56:21] nope [22:56:25] i see other tests failing. [22:56:33] in the repo [22:56:43] i see it says php is not hhvm. [22:57:04] Does it work locally? [22:57:43] 10Continuous-Integration-Infrastructure, 10Phabricator: Disable phabricator unit tests - https://phabricator.wikimedia.org/T157745#3015235 (10mmodell) @paladox: Just skip the unit tests with `--nounit` I have mysql set up so that I can properly run the unit tests before merging patches. [22:59:06] Reedy i think this caused it [22:59:06] https://github.com/wikimedia/integration-config/commit/d1901366f0dce7656ee85207c559b584e365abaa [22:59:18] i haven't tested locall, but the tests are failing with 22:50:14 Assertion error: php is not hhvm: [23:06:11] 10Continuous-Integration-Config, 10Continuous-Integration-Infrastructure, 10MediaWiki-Codesniffer: mw-tools-codesniffer-mwcore-testrun test fails with php is not hhvm - https://phabricator.wikimedia.org/T157750#3015241 (10Paladox) [23:09:12] 06Release-Engineering-Team (Deployment-Blockers), 05Release: MW-1.29.0-wmf.11 deployment blockers - https://phabricator.wikimedia.org/T155526#3015280 (10thcipriani) [23:10:56] greg-g: is https://phabricator.wikimedia.org/T157665 a dupe of https://phabricator.wikimedia.org/T157636 ? looks like it... [23:12:22] 10Continuous-Integration-Config, 10Continuous-Integration-Infrastructure, 10MediaWiki-Codesniffer: mw-tools-codesniffer-mwcore-testrun test fails with php is not hhvm - https://phabricator.wikimedia.org/T157750#3015286 (10Reedy) [23:13:35] 10Continuous-Integration-Infrastructure, 10Phabricator: Disable phabricator unit tests - https://phabricator.wikimedia.org/T157745#3015287 (10Paladox) thanks. [23:14:52] 10MediaWiki-Codesniffer: Release Codesniffer v0.8.0 - https://phabricator.wikimedia.org/T154715#3015303 (10Paladox) Might as well update to 2.8.0. Done in https://gerrit.wikimedia.org/r/#/c/336935/ [23:16:48] * Reedy triggers some more selenium jobs [23:17:02] well, MMV at least [23:17:07] Wikibase is broken differently [23:17:39] 10Beta-Cluster-Infrastructure, 10Browser-Tests-Infrastructure, 10MediaWiki-extensions-CentralAuth, 07Beta-Cluster-reproducible, and 2 others: Global account manager (Special:CentralAuth) errors out on beta - https://phabricator.wikimedia.org/T157636#3015309 (10Reedy) [23:17:41] 10Browser-Tests-Infrastructure, 03Reading-Web-Sprint-91-🐔🍔, 07Ruby, 07Unplanned-Sprint-Work, 15User-zeljkofilipin: Selenium Jenkins jobs fail with: Database query error. (internal_api_error_DBQueryError) (MediawikiApi::ApiError) - https://phabricator.wikimedia.org/T157665#3015311 (10Reedy) [23:27:50] Yippee, build fixed! [23:27:50] Project selenium-MultimediaViewer » safari,beta,OS X 10.9,contintLabsSlave && UbuntuTrusty build #292: 09FIXED in 11 min: https://integration.wikimedia.org/ci/job/selenium-MultimediaViewer/BROWSER=safari,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=OS%20X%2010.9,label=contintLabsSlave%20&&%20UbuntuTrusty/292/ [23:28:34] 10MediaWiki-Codesniffer: Release Codesniffer v0.8.0 - https://phabricator.wikimedia.org/T154715#3015325 (10Reedy) >>! In T154715#3015303, @Paladox wrote: > Might as well update to 2.8.0. Done in https://gerrit.wikimedia.org/r/#/c/336935/ Core will need validating against it and 0.8.0 to check nothing needs chan... [23:29:16] 10MediaWiki-Codesniffer: Release Codesniffer v0.8.0 - https://phabricator.wikimedia.org/T154715#3015329 (10Paladox) Yep, that's currently blocked on T157750 [23:29:24] 10Continuous-Integration-Config, 10Continuous-Integration-Infrastructure, 10MediaWiki-Codesniffer: mw-tools-codesniffer-mwcore-testrun test fails with php is not hhvm - https://phabricator.wikimedia.org/T157750#3015332 (10Paladox) p:05Triage>03Unbreak! [23:34:36] Reedy: yeah, I think he just opened it to track the selenium test specifics /me shrugs [23:34:52] All were seemingly broken for the same reason [23:34:59] Bar wikibase, which seems long broken for other stuff [23:35:44] yup [23:35:51] thanks :) [23:40:33] Yippee, build fixed! [23:40:34] Project selenium-MultimediaViewer » firefox,beta,Linux,contintLabsSlave && UbuntuTrusty build #292: 09FIXED in 23 min: https://integration.wikimedia.org/ci/job/selenium-MultimediaViewer/BROWSER=firefox,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=Linux,label=contintLabsSlave%20&&%20UbuntuTrusty/292/ [23:41:30] wmf-insecte is one reason it'd be amusing moving to slack [23:41:39] I could just see it posting firework gifs [23:43:12] Yippee, build fixed! [23:43:13] Project selenium-MultimediaViewer » chrome,beta,OS X 10.9,contintLabsSlave && UbuntuTrusty build #292: 09FIXED in 26 min: https://integration.wikimedia.org/ci/job/selenium-MultimediaViewer/BROWSER=chrome,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=OS%20X%2010.9,label=contintLabsSlave%20&&%20UbuntuTrusty/292/ [23:43:18] 10Continuous-Integration-Infrastructure, 10Phabricator: Disable phabricator unit tests - https://phabricator.wikimedia.org/T157745#3015348 (10greg) 05Open>03declined