[06:35:32] Project selenium-Wikibase » chrome,test,Linux,contintLabsSlave && UbuntuTrusty build #227: 04FAILURE in 1 hr 54 min: https://integration.wikimedia.org/ci/job/selenium-Wikibase/BROWSER=chrome,MEDIAWIKI_ENVIRONMENT=test,PLATFORM=Linux,label=contintLabsSlave%20&&%20UbuntuTrusty/227/ [08:06:46] 05Gerrit-Migration, 03releng-201617-q2, 07Documentation: Document workflow and creation of CI jobs in Differential - https://phabricator.wikimedia.org/T130952#2912108 (10mmodell) 05Open>03stalled a:03mmodell [08:30:22] 10Deployment-Systems: Make make-wmf-branch able to branch extensions with replaced substring of the version of mediawiki being branched - https://phabricator.wikimedia.org/T51392#2912117 (10mmodell) With the new `scap branch` tool, this can be configured on a per-submodule basis to support the following branchin... [13:47:33] Project selenium-VisualEditor » firefox,beta,Linux,contintLabsSlave && UbuntuTrusty build #263: 04FAILURE in 2 min 33 sec: https://integration.wikimedia.org/ci/job/selenium-VisualEditor/BROWSER=firefox,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=Linux,label=contintLabsSlave%20&&%20UbuntuTrusty/263/ [14:09:14] 10Deployment-Systems, 06Release-Engineering-Team, 10scap: scap 3.4.2-1 on tin.eqiad.wmnet reports: ImportError: No module named sh - https://phabricator.wikimedia.org/T154482#2912661 (10hashar) [16:06:22] 10Gerrit, 06Release-Engineering-Team, 06Operations, 07Upstream: Gerrit: Restarting gerrit could lead to data loss + maybe accounts - https://phabricator.wikimedia.org/T154205#2912984 (10Paladox) Apparently the way they fixed it was the wrong way, but they are keeping it as is on the stable branch as it wor... [16:51:07] (03PS1) 10Filip: Added Ids extension composer tests [integration/config] - 10https://gerrit.wikimedia.org/r/330241 (https://phabricator.wikimedia.org/T154453) [16:51:53] (03CR) 10Paladox: [C: 031] Added Ids extension composer tests [integration/config] - 10https://gerrit.wikimedia.org/r/330241 (https://phabricator.wikimedia.org/T154453) (owner: 10Filip) [16:58:16] (03CR) 10Filip: "(for https://gerrit.wikimedia.org/r/#/c/330239/)" [integration/config] - 10https://gerrit.wikimedia.org/r/330241 (https://phabricator.wikimedia.org/T154453) (owner: 10Filip) [17:07:40] 10Continuous-Integration-Infrastructure, 06Labs, 10Labs-Infrastructure, 10MediaWiki-Unit-tests, and 2 others: labs DHCP server gives only a single DNS resolver (was: CI jobs failing with DNS resolution errors such as "Could not resolve host: gerrit.wikimedi... - https://phabricator.wikimedia.org/T137460#2913237 [17:09:57] 10Continuous-Integration-Infrastructure, 06Labs, 10Labs-Infrastructure, 10MediaWiki-Unit-tests, and 2 others: labs DHCP server gives only a single DNS resolver (was: CI jobs failing with DNS resolution errors such as "Could not resolve host: gerrit.wikimedi... - https://phabricator.wikimedia.org/T137460#2913241 [17:37:50] (03CR) 10Florianschmidtwelzow: [C: 031] Added Ids extension composer tests [integration/config] - 10https://gerrit.wikimedia.org/r/330241 (https://phabricator.wikimedia.org/T154453) (owner: 10Filip) [17:43:30] (03CR) 10Reedy: [C: 032] Added Ids extension composer tests [integration/config] - 10https://gerrit.wikimedia.org/r/330241 (https://phabricator.wikimedia.org/T154453) (owner: 10Filip) [17:46:14] 10Gerrit, 10DBA, 06Operations, 13Patch-For-Review, 07Upstream: Gerrit shows HTTP 500 error when pasting an emoji - https://phabricator.wikimedia.org/T145885#2913402 (10Paladox) [17:46:34] (03Merged) 10jenkins-bot: Added Ids extension composer tests [integration/config] - 10https://gerrit.wikimedia.org/r/330241 (https://phabricator.wikimedia.org/T154453) (owner: 10Filip) [17:47:25] 10Gerrit, 10DBA, 06Operations, 13Patch-For-Review, 07Upstream: Gerrit shows HTTP 500 error when pasting an emoji - https://phabricator.wikimedia.org/T145885#2644059 (10Paladox) [17:55:02] 10Continuous-Integration-Infrastructure, 06Labs, 10Labs-Infrastructure, 10MediaWiki-Unit-tests, and 2 others: labs DHCP server gives only a single DNS resolver (was: CI jobs failing with DNS resolution errors such as "Could not resolve host: gerrit.wikimedi... - https://phabricator.wikimedia.org/T137460#2368900 [18:03:38] hashar: are freshly-built CI instances still only getting one DNS resolver? [18:12:58] 10Continuous-Integration-Infrastructure, 06Labs, 10Labs-Infrastructure, 10MediaWiki-Unit-tests, and 2 others: labs DHCP server gives only a single DNS resolver (was: CI jobs failing with DNS resolution errors such as "Could not resolve host: gerrit.wikimedi... - https://phabricator.wikimedia.org/T137460#2913504 [18:17:42] 10Gerrit, 06Release-Engineering-Team, 10DBA, 06Operations, 13Patch-For-Review: Gerrit: Schedule downtime for T154205 (To do with data loss) - https://phabricator.wikimedia.org/T154327#2913541 (10demon) Gerrit's built against latest stable-2.13 and uploaded for review. Need to pick a (very lengthy, low-tr... [19:03:14] 10Gerrit, 06Release-Engineering-Team, 10DBA, 06Operations, 13Patch-For-Review: Gerrit: Schedule downtime for T154205 (To do with data loss) - https://phabricator.wikimedia.org/T154327#2913752 (10Paladox) @ostriches that could be done tonight as most of wikimedia is back but not everyone so it would be a... [19:03:23] hey, anyone here who uses phab-01 ? [19:03:49] 10Gerrit, 06Release-Engineering-Team, 10DBA, 06Operations, 13Patch-For-Review: Gerrit: Schedule downtime for T154205 (To do with data loss) - https://phabricator.wikimedia.org/T154327#2913754 (10demon) I'm not rushing into it **tonight**, it will be scheduled and announced. [19:05:13] 10Gerrit, 06Release-Engineering-Team, 10DBA, 06Operations, 13Patch-For-Review: Gerrit: Schedule downtime for T154205 (To do with data loss) - https://phabricator.wikimedia.org/T154327#2913761 (10Paladox) Ok [19:05:44] mutante is that phab-01 as in phab-01.phabricator.eqiad.wmflabs? [19:06:31] paladox: probably :) [19:06:53] we use that for testing [19:06:54] i want a list of the instance FQDNs using it [19:06:59] and then a list of the users on those instances [19:07:08] it = the labs role [19:07:12] also that instance dosent use the phabricator labs role [19:07:15] purpose: delete labs role [19:07:35] if it doesn't use the labs role then i don't care about it [19:07:39] that's a good point [19:07:45] Ok [19:07:59] oh right, the labs role was broken, wasnt it [19:08:03] when we tried [19:08:11] do you remember trying it [19:08:11] yep [19:08:27] yep [19:08:38] so that means if i delete it nothing will happen even if it was used somewhere [19:08:41] labs role didnt work for me, but the prod role works for me now [19:08:42] :) [19:08:46] ehmm. ok, guess i'll just go ahead, thanks [19:08:50] ok [19:08:52] your welcome [19:08:53] :) [19:08:55] yea, that's the good part [19:09:06] Ok [19:09:07] :) [19:09:50] greg-g twentyafterfour ^^ [19:10:11] the phabricator labs class is being deleted and instead the prod one should be used :) [19:10:57] good deal [19:29:02] Hi releng! Is there a discussion active about using an automated dependency vulnerability checker as part of CI? For instance, https://wiki.jenkins-ci.org/display/JENKINS/OWASP+Dependency-Check+Plugin or https://security.sensiolabs.org/api ? [19:29:31] cc dp [19:29:44] ejegg: not that I know of, I was also loop in Darian P. [19:29:54] I would* [19:29:55] thanks greg-g [19:30:28] I know he's been thinking about this but not sure where it's gotten on the priority list from his side lately [19:31:27] @seen Luke12345 [19:31:32] that number :) [19:31:46] @seen Sagan [19:31:58] I'm here [19:32:12] mutante ^^ [19:32:16] Sagan: oh hi, do you have access to deployment-phab instances? [19:32:24] do you use them? [19:32:31] hi, gerrit admin +2 -- https://gerrit.wikimedia.org/r/#/c/330273/ [19:32:49] IIRC to deployment-prep, but not sure to deployment-phab [19:33:35] mutante: you mean https://wikitech.wikimedia.org/wiki/Nova_Resource:Phabricator ? [19:33:44] there I'm listed [19:34:23] https://wikitech.wikimedia.org/wiki/Special:Ask/-5B-5BResource-20Type::instance-5D-5D-5B-5BProject::deployment-2Dprep-5D-5D/-3F%3DFQDN-23/-3FInstance-20Type/-3FImage-20Id/-3FPublic-20IP/-3FNumber-20of-20CPUs/-3FRAM-20Size/-3FAmount-20of-20Storage/-3FModification-20date/format%3Dbroadtable/limit%3D20/offset%3D20/sort%3DModification-20date/order%3DDESC/mainlabel%3DFQDN [19:34:27] mutante ^^ [19:34:49] Sagan: no, i think that's separate [19:35:06] https://wikitech.wikimedia.org/wiki/Nova_Resource:Deployment-phab02.deployment-prep.eqiad.wmflabs [19:35:12] https://wikitech.wikimedia.org/wiki/Nova_Resource:Deployment-phab01.deployment-prep.eqiad.wmflabs [19:35:30] let me find the "watroles" tool ... [19:36:11] https://tools.wmflabs.org/?tool=watroles [19:36:19] paladox: ^ used this before? [19:36:24] 10Continuous-Integration-Infrastructure, 06Labs, 10Labs-Infrastructure, 10MediaWiki-Unit-tests, and 2 others: labs DHCP server gives only a single DNS resolver (was: CI jobs failing with DNS resolution errors such as "Could not resolve host: gerrit.wikimedi... - https://phabricator.wikimedia.org/T137460#2913874 [19:36:26] yes [19:37:12] 10Continuous-Integration-Config: CI: Support running phan for extensions - https://phabricator.wikimedia.org/T153039#2867258 (10Addshore) For manual use I have added phan configs to a bunch of WMDE extensions. https://gerrit.wikimedia.org/r/#/c/328917/ https://gerrit.wikimedia.org/r/#/c/330257/ https://gerrit.w... [19:37:24] paladox: have the full URL to search? [19:37:45] 10Continuous-Integration-Config, 15User-Addshore: CI: Support running phan for extensions - https://phabricator.wikimedia.org/T153039#2913877 (10Addshore) [19:37:52] Not Found [19:37:52] The requested URL was not found on the server. If you entered the URL manually please check your spelling and try again. [19:37:55] mutante: oh, that'S deployment-prep [19:37:57] https://tools.wmflabs.org/watroles [19:38:01] there I have access. not admin, but normal [19:38:14] paladox: yea, that's why i asked for the URL that works :) [19:38:19] oh [19:38:30] Sagan: ah, ok, can you see if the instances there use a puppet class and which? [19:38:57] also, if you run puppet, is it currently broken or working? [19:40:40] 10Continuous-Integration-Infrastructure, 06Labs, 10Labs-Infrastructure, 10MediaWiki-Unit-tests, and 2 others: labs DHCP server gives only a single DNS resolver (was: CI jobs failing with DNS resolution errors such as "Could not resolve host: gerrit.wikimedi... - https://phabricator.wikimedia.org/T137460#2913884 [19:41:05] mutante: lemme checkout [19:41:21] mutante: for which ones do you need? [19:42:19] Sagan: any (one) instance that uses the class role::phabricator::labs [19:42:38] https://wikitech.wikimedia.org/wiki/Nova_Resource:Deployment-phab02.deployment-prep.eqiad.wmflabs [19:42:42] I need to search iin Horizon a bit, give me a moment [19:42:45] https://wikitech.wikimedia.org/wiki/Nova_Resource:Deployment-phab01.deployment-prep.eqiad.wmflabs [19:42:46] if none of them use it, ok. if they use it but they are broken anyways, also ok [19:42:58] if it's broken, i'd ask you to remove it from the instance [19:43:20] thanks Sagan, no rush [19:44:57] mutante: I looked up the phabricator instances there now, they don't have *any* roles active [19:45:54] :) [19:46:10] Sagan do you use the class on your instances? [19:46:20] andrewbogott: hello! The CI instances all got two DNS resolver in their resolv.conf now :] [19:46:29] andrewbogott: and I have closed the task as a result. Thx! [19:47:50] paladox: I used an old version of it, set it up, overwrite phabricator by phabricator from phacility, and deactivated the role [19:48:02] so I did not need to mess up with the apache stuff [19:48:31] Ok. Sagan if you need to use the phabricator class would you be able to use prod's as we are removing labs? [19:49:16] I already use prod, at least the old version, which I guess is still available at the history of the git-repo [19:49:18] Sagan: thanks for confirming that [19:49:29] mutante: yw [19:49:53] :) [19:50:02] paladox: does that change your review? [19:50:05] I did this with rol::puppetmaster::self, then picked the version, then installing it etc [19:50:18] mutante yes, it's a +1 now [19:50:23] I'm away for dinner, see you later ;) (if there is something to do for me, just ping me) [19:50:31] oh [19:50:44] paladox: but how did you know it was these instances ? [19:50:49] well, it wasn't [19:50:54] but what made you pick them [19:51:07] if it wasn't watroles, what else let you check that [19:51:09] Because i saw a patch by someone to fix the class for these instances [19:51:15] and since watroles is deleted now... [19:51:17] do we know? [19:51:21] but most likly since then the class was removed from the instances. [19:51:22] aha [20:03:35] (03PS3) 10Hashar: Decouple pywikibot/core [integration/config] - 10https://gerrit.wikimedia.org/r/295922 [20:09:43] (03CR) 10Hashar: [C: 032] "Zuul layout diff shows the queue is kept (eg it is not merged with the mediawiki one)" [integration/config] - 10https://gerrit.wikimedia.org/r/295922 (owner: 10Hashar) [20:12:25] ahhhh [20:12:34] puppet new documentation system has been rewritten and released :D [20:12:37] puppet-strings gem [20:17:06] (03Merged) 10jenkins-bot: Decouple pywikibot/core [integration/config] - 10https://gerrit.wikimedia.org/r/295922 (owner: 10Hashar) [20:54:22] (03PS1) 10Umherirrender: [Ids] add npm job [integration/config] - 10https://gerrit.wikimedia.org/r/330309 [21:11:55] (03CR) 10Hashar: [C: 032] [Ids] add npm job [integration/config] - 10https://gerrit.wikimedia.org/r/330309 (owner: 10Umherirrender) [21:14:10] (03Merged) 10jenkins-bot: [Ids] add npm job [integration/config] - 10https://gerrit.wikimedia.org/r/330309 (owner: 10Umherirrender) [21:17:11] (03CR) 10Hashar: "Deployed :]" [integration/config] - 10https://gerrit.wikimedia.org/r/330309 (owner: 10Umherirrender) [21:21:51] 05Gerrit-Migration, 10Differential: Consider documenting the Arcanist installer for Windows and Mac that Paladox created - https://phabricator.wikimedia.org/T131939#2914382 (10greg) Mac users can just use the same setup as Linux users: https://www.mediawiki.org/wiki/Phabricator/Arcanist#Using_git_.28recommende... [21:29:49] 10Continuous-Integration-Infrastructure, 10Gerrit, 07Zuul: Depends on dosent work correctly if a change is a cherry pick - https://phabricator.wikimedia.org/T154359#2914431 (10greg) [21:37:55] 10Deployment-Systems, 06Release-Engineering-Team, 03Scap3, 10scap: scap 3.4.2-1 on tin.eqiad.wmnet reports: ImportError: No module named sh - https://phabricator.wikimedia.org/T154482#2914507 (10greg) [21:55:40] 10Deployment-Systems, 06Release-Engineering-Team, 03Scap3, 10scap: scap 3.4.2-1 on tin.eqiad.wmnet reports: ImportError: No module named sh - https://phabricator.wikimedia.org/T154482#2914630 (10demon) p:05Triage>03Low Known "issue," plugins (if they exist) will catch any exception and skip loading, so... [21:57:32] 10Deployment-Systems, 06Release-Engineering-Team, 03Scap3, 10scap: scap3 allows plugins to declare dependencies we do not support - https://phabricator.wikimedia.org/T154482#2914640 (10demon) p:05Low>03Normal [21:57:49] hashar: Should clarify things a bit ^ [21:58:02] tldr: It's working as "designed" but it could be nicer. [22:02:32] ostriches: eeek :D [22:02:42] ostriches: any reason why we dont bail out /abort on faliure ? [22:03:10] Wouldn't want someone writing a bad plugin to keep you from doing your work :) [22:03:15] (if you're not using said plugin) [22:03:29] maybe :] [22:03:58] Also makes python2/3 compat really really freaking hard [22:04:05] I guess we can just close my task so ? [22:04:05] As not everything will move in concert [22:04:14] what scaried me was the exception trace + import error [22:04:18] Nah, I made the scope a little broader to deal with the import issue [22:04:23] It's been on my mind, wasn't tracking it [22:05:07] After D527, the error would just read "14:07:42 WARNING - Problem loading plugins from module: scap.plugins.branch (ImportError: No module named sh)" [22:05:07] D527: Plugins: Simplify error output a bit - https://phabricator.wikimedia.org/D527 [22:05:08] ok ok :) [22:05:12] And rather than a scary tracktrace :) [22:05:31] s/And// [22:07:08] 10Continuous-Integration-Config, 06Release-Engineering-Team, 06Discovery, 06Discovery-Analysis: Add CI to all wikimedia/discovery repositories that are active - https://phabricator.wikimedia.org/T153856#2914722 (10mpopov) The dashboard repositories are R/Shiny applications (e.g. http://discovery.wmflabs.or... [22:13:25] did something break in gerrit's autocomplete? cannot cherry pick to a branch [22:14:05] Shouldn't have, nothing's changed [22:14:14] Maybe just type the whole branch name :) [22:14:48] ostriches, but it worked just fine two hours ago :(( https://gerrit.wikimedia.org/r/#/c/330316/ -- trying to cherry pick it to wmf7 :( [22:15:33] Well, I can tell you for sure nothing has changed in the last 2 hous [22:15:43] Just type the whole branch? [22:15:53] wmf/1.29.0-wmf.7 [22:16:11] ostriches, it refuses it [22:16:26] something did change - we had a train :) [22:16:34] Well, that just created wmf.8 [22:16:39] Nothing happened to gerrit [22:16:41] oh, wait [22:16:43] never mind [22:16:45] i'm an idiot [22:16:52] its not an extension :( [22:16:53] sorry [22:17:25] ostriches, do you know if its possible to rename a gerrit repo? [22:17:43] No, it isn't [22:18:29] (better answer: it is, but it's a hugely manual, error-prone and disruptive process so I refuse to do them) [22:23:22] 10Gerrit, 10DBA, 06Operations, 13Patch-For-Review, 07Upstream: Gerrit shows HTTP 500 error when pasting an emoji - https://phabricator.wikimedia.org/T145885#2914781 (10Paladox) [22:23:33] 10Gerrit, 10DBA, 06Operations, 13Patch-For-Review, 07Upstream: Gerrit shows HTTP 500 error when pasting an emoji - https://phabricator.wikimedia.org/T145885#2644059 (10Paladox) [22:58:40] 10Continuous-Integration-Config, 06Operations, 13Patch-For-Review, 07Puppet, 07Upstream: post build failures for operations/puppet on operations-puppet-doc - https://phabricator.wikimedia.org/T143233#2914951 (10hashar) Early September I looked at [[ https://github.com/puppetlabs/puppet-strings/ | puppet-... [23:06:24] marxarelli|afk: I have CCed you on a task about puppet doc being broken. [23:06:40] marxarelli|afk: eventually finished/polished an utility that uses yard to generate the doc!!! https://gerrit.wikimedia.org/r/309561 Puppet doc with strings/yard [23:07:45] maybe that can be of some use for mediawiki/vagrant as well ( bd808 ^^ ) [23:08:24] hashar: send in a patch :) [23:08:32] well [23:08:38] Dan told me that Vagrant is from the past [23:08:47] I am too afraid to dig there! but yeah I should [23:08:59] https://doc.wikimedia.org/mediawiki-vagrant/ [23:09:51] hashar: "from the past"? [23:10:26] sorry was a private joke :D [23:10:41] but yeah the idea would be to replace that generated doc with something a bit more pleasant [23:10:43] and less broken [23:21:11] 10Gerrit, 10DBA, 06Operations, 13Patch-For-Review, 07Upstream: Gerrit shows HTTP 500 error when pasting an emoji - https://phabricator.wikimedia.org/T145885#2915066 (10Paladox) >>! In T145885#2897016, @jcrespo wrote: >> ahaha it works now. >> >> you have to set >> >> character-set-client-handshake = FA... [23:21:57] sleeepp bed etc [23:27:31] 10Gerrit, 10DBA, 06Operations, 13Patch-For-Review, 07Upstream: Gerrit shows HTTP 500 error when pasting an emoji - https://phabricator.wikimedia.org/T145885#2915101 (10Paladox) Apparently jdbc does not support utf8mb4 https://www.google.co.uk/#q=fatal:+++caused+by+java.sql.SQLException:+Unsupported+char... [23:29:39] 10Gerrit, 10DBA, 06Operations, 13Patch-For-Review, 07Upstream: Gerrit shows HTTP 500 error when pasting an emoji - https://phabricator.wikimedia.org/T145885#2915102 (10Paladox) https://dev.mysql.com/doc/connector-j/5.1/en/connector-j-reference-charsets.html [23:32:57] 10Gerrit, 10DBA, 06Operations, 13Patch-For-Review, 07Upstream: Gerrit shows HTTP 500 error when pasting an emoji - https://phabricator.wikimedia.org/T145885#2915107 (10Paladox) >>! In T145885#2897016, @jcrespo wrote: >> ahaha it works now. >> >> you have to set >> >> character-set-client-handshake = FA...