[01:40:13] yuvipanda: hi, I'm here with Volker_E trying to labs-vagrant enable-role simple_performant. That worked, but now labs-vagrant provision is choking with [01:40:26] Error: Duplicate declaration: File[/var/www/robots.txt] is already declared in file /vagrant/puppet/modules/role/manifests/simple_performant.pp:67; cannot redeclare at /vagrant/puppet/modules/role/manifests/labs_initial_content.pp:22 on node living-style-guide.design.eqiad.wmflabs [01:41:03] I pulled latest /vagrant/puppet, checking permissions... [01:42:40] seems like a genuine bug, both try to set it. I'll file [01:44:24] Hi [01:44:45] Any idea why so many tools do not support outreachwiki? [01:45:05] Is it missing from some dblist or something like that? [01:45:46] which tools? [01:46:15] See the bottommost topic on [[outreach:Wikimedia:Village pump]] [01:46:21] @link [01:46:21] https://wikitech.wikimedia.org/wiki/outreach:Wikimedia:Village_pump [01:46:26] it's in meta_p.wiki [01:48:28] (Says little to me) [01:48:43] Does it mean that all should be right? [01:49:01] Or that tools need to be rewritten to reflect it? [01:49:38] Or I have to put the wiki's name in some fancy fashion when working with tools? [01:50:55] Esuba, it means they should know about it if they are querying meta_p.wiki [01:51:20] xtools-articleinfo doesn't seem to work at all for me on any wiki [01:52:39] wppagehiststat seems to be missing a bunch of special wikis, except commons, meta and species [01:52:57] wikiblame seems to just work [01:53:30] I don't know what she means by internal vs. external tools [01:54:17] the usersearch one that redirects seems to do it for any wiki, not just outreach [01:54:27] I think she just called internal the ones linked from some interface messages like header on history pages [01:55:56] ugh [01:59:01] (Tech teams on wmf should host some workshops for non-tech ones from time to time ;) ) [02:00:19] Can you respond there please? Noting that wikiblame works and perhaps you will recall some other working tools matching her interest? [02:05:43] https://wikitech.wikimedia.org/wiki/Help:MediaWiki-Vagrant_in_Labs says ' "default" security group for your project may allow on port 8080.' Well it doesn't for design. I guessed and added 8080 and gave it CIDR range "0.0.0.0/0", but maybe it should be restricted to labs? [02:22:32] what's the password for labs::mediawiki_vagrant [02:22:38] it's not "vagrant", or "mwvagrant" [02:24:40] I feel like I've seen someone asking this before [02:29:21] ah, I think it's sudo asking for the password: "[sudo] password for mwvagrant: ". but `sudo -u mwvagrant echo hello` works fine [02:29:24] so many bugs [02:57:53] 6Labs, 10Beta-Cluster-Infrastructure, 7Tracking: Beta Cluster <-> WMF Labs policy compliance (tracking) - https://phabricator.wikimedia.org/T114615#1714389 (10greg) [02:59:32] 6Labs, 10Beta-Cluster-Infrastructure, 7Tracking: Beta Cluster <-> WMF Labs policy compliance (tracking) - https://phabricator.wikimedia.org/T114615#1700939 (10greg) [03:08:26] 6Labs, 10Labs-Infrastructure, 10MediaWiki-Vagrant: sudo prompts for my password running `vagrant up` in labs::mediawiki_vagrant role - https://phabricator.wikimedia.org/T115080#1714409 (10Spage) 3NEW [06:28:10] !log Mediahandler-tests mediahandler-tests-mol: Deleted, not used, moved demo wiki to smaller Debian Jessie instance Mediahandler-mol [06:28:10] Mediahandler-tests is not a valid project. [06:28:30] !log mediahandler-tests mediahandler-tests-mol: Deleted, not used, moved demo wiki to smaller Debian Jessie instance Mediahandler-mol [06:28:36] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Mediahandler-tests/SAL, Master [08:13:55] (03CR) 10Hashar: On Jenkins, skip missing interpreters (031 comment) [labs/tools/forrestbot] - 10https://gerrit.wikimedia.org/r/242348 (owner: 10Hashar) [08:15:04] (03PS3) 10Hashar: On Jenkins, skip missing interpreters [labs/tools/forrestbot] - 10https://gerrit.wikimedia.org/r/242348 [08:21:22] (03CR) 10John Vandenberg: [C: 031] On Jenkins, skip missing interpreters [labs/tools/forrestbot] - 10https://gerrit.wikimedia.org/r/242348 (owner: 10Hashar) [08:21:45] (03CR) 10Hashar: "check experimental" [labs/tools/forrestbot] - 10https://gerrit.wikimedia.org/r/242348 (owner: 10Hashar) [08:22:56] (03CR) 10Hashar: "Works!" [labs/tools/forrestbot] - 10https://gerrit.wikimedia.org/r/242348 (owner: 10Hashar) [08:47:06] 6Labs, 7Tracking: Project wcidfwm (What can I do for wikimedia) - https://phabricator.wikimedia.org/T115092#1714710 (10Petrb) 3NEW [08:49:14] 6Labs, 7Tracking: Project wcidfwm (What can I do for wikimedia) - https://phabricator.wikimedia.org/T115092#1714728 (10yuvipanda) Doesn't https://www.whatcanidoforwikimedia.org/ already exist and is from someone else? [08:49:22] 6Labs, 7Tracking: Project wcidfwm (What can I do for wikimedia) - https://phabricator.wikimedia.org/T115093#1714722 (10Petrb) [08:53:06] 6Labs, 7Tracking: Project wcidfwm (What can I do for wikimedia) - https://phabricator.wikimedia.org/T115093#1714733 (10Petrb) [08:53:08] 6Labs, 7Tracking: Project wcidfwm (What can I do for wikimedia) - https://phabricator.wikimedia.org/T115092#1714734 (10Petrb) [09:13:14] 6Labs: Project wcidfwm (What can I do for wikimedia) - https://phabricator.wikimedia.org/T115093#1714801 (10Revi) [09:13:48] 6Labs: Project wcidfwm (What can I do for wikimedia) - https://phabricator.wikimedia.org/T115092#1714805 (10Revi) [09:15:02] 6Labs, 7Tracking: New Labs project requests (tracking) - https://phabricator.wikimedia.org/T76375#1714812 (10Revi) [10:06:32] (03PS4) 10Hashar: On Jenkins, skip missing interpreters [labs/tools/forrestbot] - 10https://gerrit.wikimedia.org/r/242348 [10:07:12] (03CR) 10Hashar: [C: 032] "\O/" [labs/tools/forrestbot] - 10https://gerrit.wikimedia.org/r/242348 (owner: 10Hashar) [10:07:29] (03Merged) 10jenkins-bot: On Jenkins, skip missing interpreters [labs/tools/forrestbot] - 10https://gerrit.wikimedia.org/r/242348 (owner: 10Hashar) [10:31:23] 6Labs, 6Discovery, 7Elasticsearch, 3labs-sprint-116, 3labs-sprint-117: Replicate production elasticsearch indices to labs - https://phabricator.wikimedia.org/T109715#1714925 (10yuvipanda) Testwiki is replicating there now! \o/ [10:44:12] 6Labs, 10Tool-Labs, 6Design Research Backlog, 6Learning-and-Evaluation, and 3 others: Organize a (annual?) toollabs survey - https://phabricator.wikimedia.org/T95155#1181554 (10yuvipanda) This closes tomorrow! [13:09:49] Change on 12wikitech.wikimedia.org a page Nova Resource:Tools/Access Request/Vaggelisifa was created, changed by Vaggelisifa link https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/Access_Request/Vaggelisifa edit summary: Created page with "{{Tools Access Request |Justification=I want to use the tools to make smart answers for the Dribper search engine. |Completed=false |User Name=Vaggelisifa }}" [13:15:33] Anyone around to help me troubleshoot why a DB query isnt working in python? [13:16:44] maybe [13:18:06] Betacommand: what is your problem [13:19:08] Jogo-obb: Im running the following query on enwiki and should get ~120 results. However the result set is empty [13:19:09] cursor.execute("select ipb_timestamp, ipb_by_text , ipb_address , ipb_reason , ipb_expiry , ipb_anon_only , ipb_create_account , ipb_enable_autoblock , ipb_block_email from ipblocks where ipb_address like %s;", ("172%",)) [13:20:03] If I run the query manually via sql enwiki [13:20:06] it works [13:21:00] Betacommand: what's in cursor._last_executed / cursor.statement ? [13:21:10] nevermind, found the problem [13:21:29] its using the wrong db for some reason [13:22:15] ok ;) [13:27:04] They introduced several new "testwiki" databases which messed up my selection query [13:52:21] PROBLEM - Puppet failure on tools-webgrid-lighttpd-1411 is CRITICAL: CRITICAL: 22.22% of data above the critical threshold [0.0] [14:32:21] RECOVERY - Puppet failure on tools-webgrid-lighttpd-1411 is OK: OK: Less than 1.00% above the threshold [0.0] [14:37:33] !log tools Beginning rotation of execution nodes to apply fix for T106170 [14:37:45] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/SAL, Master [14:47:45] PROBLEM - ToolLabs Home Page on toollabs is CRITICAL: HTTP CRITICAL: HTTP/1.1 503 Service Temporarily Unavailable - string 'Magnus' not found on 'http://tools.wmflabs.org:80/' - 383 bytes in 0.002 second response time [14:51:01] Coren: is that alert about tools.wmflabs.org something you’re doing? [14:51:22] andrewbogott: Yeah, it's in the SAL. Cycling the trusty webhosts. [14:51:28] ok [14:52:20] Homepage is back, shinken just didn't notice yet. [14:52:47] RECOVERY - ToolLabs Home Page on toollabs is OK: HTTP OK: HTTP/1.1 200 OK - 897437 bytes in 2.732 second response time [14:59:06] PROBLEM - Puppet failure on tools-webgrid-lighttpd-1406 is CRITICAL: CRITICAL: 33.33% of data above the critical threshold [0.0] [15:00:37] 6Labs, 10Labs-Infrastructure, 10hardware-requests, 6operations, 3labs-sprint-117: Labs test cluster in codfw - https://phabricator.wikimedia.org/T114435#1715316 (10Andrew) We should be able to use out-of-warranty 8g systems for: - labservices2001 (designate, pdns, future ldap) - labmetal2001 -- a host d... [15:03:35] 6Labs, 10Labs-Infrastructure, 10hardware-requests, 6operations, 3labs-sprint-117: Labs test cluster in codfw - https://phabricator.wikimedia.org/T114435#1715323 (10coren) I'd call labnet2001 "labnet"; it's the network control node independently of the technology (imo) [15:06:12] Yeay! Bikeshed! [15:09:09] RECOVERY - Puppet failure on tools-webgrid-lighttpd-1406 is OK: OK: Less than 1.00% above the threshold [0.0] [15:12:26] Coren, so you want to get rid of the '2001'? [15:12:45] but then what about labnet1001? [15:12:50] Nono. I mean labnet* vs labneutron* [15:12:53] ah [15:13:07] * Coren realizes how that is less than clear [15:13:34] * Coren edits. [15:14:08] It makes more sense in context now that I read the rest [15:14:19] 6Labs, 10Labs-Infrastructure, 10hardware-requests, 6operations, 3labs-sprint-117: Labs test cluster in codfw - https://phabricator.wikimedia.org/T114435#1715347 (10Andrew) [15:20:38] 6Labs, 10Labs-Infrastructure, 10MediaWiki-Vagrant: sudo prompts for my password running `vagrant up` in labs::mediawiki_vagrant role - https://phabricator.wikimedia.org/T115080#1715356 (10bd808) This is going to be a bug in the Puppet code in operations/puppet rather than MediaWiki-Vagrant. The `::vagrant::... [15:22:47] 6Labs, 10Labs-Infrastructure, 10hardware-requests, 6operations, 3labs-sprint-117: Labs test cluster in codfw - https://phabricator.wikimedia.org/T114435#1715359 (10Andrew) We have two 8g servers out of warranty, and two 16g servers out of warranty. So if we don't mind gobbling up all of those we can pha... [15:26:01] Krenair: I need breakfast… ping me in 45 or so and I’ll test/merge your bastion users patch if Yuvi or I haven’t done so already. [15:26:11] ok [15:27:33] I'm off to locate lunch. [15:29:31] 6Labs, 6Discovery, 10Wikidata, 10Wikidata-Query-Service: Wikidata Metrics - https://phabricator.wikimedia.org/T115120#1715403 (10Christopher) 3NEW [16:14:00] 6Labs, 10Labs-Infrastructure, 10hardware-requests, 6operations, 3labs-sprint-117: Labs test cluster in codfw - https://phabricator.wikimedia.org/T114435#1715528 (10RobH) I just want to ensure we have a summary so far, since the task description has since shifted to be slightly innaccurate: * This is a p... [16:16:09] Krenair: want to make a submodule patch for that? [16:34:08] 6Labs, 10Labs-Infrastructure, 10hardware-requests, 6operations, 3labs-sprint-117: Labs test cluster in codfw - https://phabricator.wikimedia.org/T114435#1715592 (10Andrew) [17:45:37] !log icinga added johnflewis [17:45:43] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Icinga/SAL, Master [17:55:21] 6Labs, 10Tool-Labs, 6Design Research Backlog, 6Learning-and-Evaluation, and 3 others: Organize a (annual?) toollabs survey - https://phabricator.wikimedia.org/T95155#1715814 (10egalvezwmf) Looking forward to the analysis! Where is the analysis going to be posted? has this been documented in research:Meta? [17:59:51] 6Labs, 10Labs-Infrastructure, 10MediaWiki-Vagrant, 5Patch-For-Review: sudo prompts for my password running `vagrant up` in labs::mediawiki_vagrant role - https://phabricator.wikimedia.org/T115080#1715842 (10bd808) @smalyshev got a debug trace for me that shows the failing command: {P2175} The sudo rules a... [18:00:41] yuvipanda: quick review & +2? https://gerrit.wikimedia.org/r/#/c/244718 [18:01:22] looks like rush is already on it [18:02:44] yeah I gotcha, i was following along in -discovery [18:05:35] 6Labs, 10Labs-Infrastructure, 10MediaWiki-Vagrant, 5Patch-For-Review: sudo prompts for my password running `vagrant up` in labs::mediawiki_vagrant role - https://phabricator.wikimedia.org/T115080#1715872 (10Smalyshev) there are a number of other commands also run through env [18:06:06] 6Labs, 10Labs-Infrastructure, 10MediaWiki-Vagrant, 5Patch-For-Review: sudo prompts for my password running `vagrant up` in labs::mediawiki_vagrant role - https://phabricator.wikimedia.org/T115080#1715882 (10bd808) ``` [12:01] bd808: that seems not to be enough [12:01] INFO subproc... [18:06:42] thanks chasemp. looks like there is more to do :/ new plugin version I think had changed fragile crap I hard coded [18:10:46] 6Labs, 10Labs-Infrastructure, 10MediaWiki-Vagrant, 5Patch-For-Review: sudo prompts for my password running `vagrant up` in labs::mediawiki_vagrant role - https://phabricator.wikimedia.org/T115080#1715885 (10bd808) Version 1.2.0 of the vagrant-lxc plugin has [[https://github.com/fgrehm/vagrant-lxc/commit/4b... [18:16:03] 6Labs, 10MediaWiki-extensions-OpenStackManager, 10wikitech.wikimedia.org, 5Patch-For-Review, and 2 others: Adding a user to a project results in a blank page with the user added to the project but no shell access - https://phabricator.wikimedia.org/T114229#1715903 (10Krenair) 5Open>3Resolved Should wor... [18:29:09] PROBLEM - Puppet failure on tools-exec-1404 is CRITICAL: CRITICAL: 22.22% of data above the critical threshold [0.0] [18:39:09] RECOVERY - Puppet failure on tools-exec-1404 is OK: OK: Less than 1.00% above the threshold [0.0] [18:58:44] 10Quarry, 6Analytics-Backlog: it would be useful to run the same Quarry query conveniently in several database - https://phabricator.wikimedia.org/T95582#1715995 (10Halfak) I do this often. I've been using a python script. See https://github.com/halfak/multiquery It would be nice to do this in quarry. [19:55:17] 6Labs, 10Labs-Infrastructure, 10MediaWiki-Vagrant: Forwarded ports are bound only to localhost - https://phabricator.wikimedia.org/T115139#1716219 (10Smalyshev) [19:55:39] thanks, chasemp / bd808 [19:55:49] * yuvipanda seems to have fucked up his sleep cycle again [19:55:56] oh noes! [19:56:03] are you somewhere near Hawaii now? [19:56:23] bd808: not sure [19:56:30] I've been meaning to write a small piece of code for that [19:56:34] tells me what timezone I'm in today [19:56:54] I woke up at a about 12:30 PM, after waking up once at 8:30 AM to verify I had no meetings [19:57:14] lazypanda is lazy ;) [19:57:34] I was up till 4AM though :P [19:57:51] so it's timelagged panda rather than lazy :D [20:02:33] If my timezone math is right I guess you are in Fiji/New Zealand but on the wrong side of the dateline [20:15:00] bd808: heh [20:15:09] yeah that sounds right... [20:15:43] 6Labs, 10Tool-Labs, 3Labs-Sprint-115, 5Patch-For-Review, and 2 others: Attribute cache issue with NFS on Trusty - https://phabricator.wikimedia.org/T106170#1716338 (10coren) 5Open>3Resolved All Trusty exec nodes have been rebooted with the new NFS mount options - this should solve the issue (I was unab... [20:58:15] bd808: want me to merge https://gerrit.wikimedia.org/r/#/c/244802/ too? [20:58:37] yes please [21:01:09] 6Labs, 10Labs-Infrastructure, 10MediaWiki-Vagrant, 5Patch-For-Review: sudo prompts for my password running `vagrant up` in labs::mediawiki_vagrant role - https://phabricator.wikimedia.org/T115080#1716440 (10bd808) 5Open>3Resolved a:3bd808 [21:01:21] bd808: thank you for taking care of it! \o/ [21:02:05] I've got another one to figure out now too -- https://phabricator.wikimedia.org/T115139 [21:02:35] aaah yes [21:32:15] i broke labs [21:32:16] fixing [21:32:50] ori: do give details after... [21:49:26] 6Labs, 10Labs-Infrastructure, 10MediaWiki-Vagrant, 5Patch-For-Review: Forwarded ports are bound only to localhost - https://phabricator.wikimedia.org/T115139#1716499 (10bd808) Testing new config setting: ``` $ netstat -ln|grep 8080 tcp 0 0 127.0.0.1:8080 0.0.0.0:* LISTEN... [21:51:30] !log deployment-prep Accidentally clobbered /etc/init.d/mysql on deployment-db1, causing deployment-prep failures. Restored now. [21:51:37] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Deployment-prep/SAL, Master [21:53:57] ori: also, it's beta cluster, not labs :) [21:54:30] yuvipanda: sigh, yeah. [21:54:33] i'll get that right, eventually [21:55:16] ori: I'll keep telling people until, etc :) [21:55:32] I've considered writing a weechat script that does that for 'betalabs' since that's unambiguouasly not-correct [21:58:01] ori: I'll let your own guilt take care of this one ;) thanks for the quick fix [21:58:33] thanks [21:59:19] just curiousity, what was the change? ori [21:59:29] * greg-g looks in gerrit [22:00:14] * greg-g can't find anything obvious [22:08:22] greg-g: wasn't a git change, i was poking around db1 on deployment prep [22:09:06] ah [22:09:19] !log that shiz in -releng [22:09:19] that is not a valid project. [22:09:24] heh, sorry [22:09:49] need to create projects called 'that' and 'deleted' [22:11:00] !log valid project [22:11:00] valid is not a valid project. [22:11:55] !log a valid project [22:11:55] a is not a valid project. [22:12:24] !log !log labs cluster [22:12:24] !log is not a valid project. [22:13:02] good try [22:13:20] :) i already saw it breaking and then i have to fix it, hehe [22:33:02] yuvipanda: I've got another one for you -- https://gerrit.wikimedia.org/r/#/c/244815/ [22:35:23] bd808: done [22:35:43] lol. I'm the king of the bums [22:36:50] I was at a music festival the other day [22:36:57] ended up talking to a bunch of homeless folks for a whil [22:37:00] seemed cool [22:38:57] most of them are just normal folks for sure. [22:39:08] yeah [22:39:18] had a very silent bob + the other guy from 'clerks' feel [22:39:23] I used to drink at a bar that was about 50% homeless and 50% poor college kids [22:39:49] Jay would be sad you don't know his name [22:40:58] ah yes, that's the name [22:41:20] if homelessness wasn't so scandalous I'd try that lifestyle for a while [22:41:37] I'm pretty sure my possessions already fit in my backpack, and I've the mifi... [22:41:42] finding a shower shouldn't be too hard [22:41:51] and you get to sleep by the bay bridge! [22:42:08] 6Labs, 10Labs-Infrastructure, 10MediaWiki-Vagrant, 5Patch-For-Review: Forwarded ports are bound only to localhost - https://phabricator.wikimedia.org/T115139#1716668 (10bd808) 5Open>3Resolved Changes in MediaWiki-Vagrant and operations/puppet should fix this now. If you have an instance where running `... [22:42:15] homeslessness is fine.. it's the credit card that is the issue :p [22:42:38] mutante: my address is already set to the WMF office in a lot of places [22:42:57] yuvipanda: been there, all you have to accept is delivery times of a few weeks [22:43:08] mutante: yeah, plus there's always madhuvishy [22:43:35] the only problem is you cant use that for your ID card [22:43:43] because you wont have a utility bill [22:44:00] well [22:44:03] I don't have an ID card :P [22:44:13] I don't have a utility bill now either [22:46:01] this might suck if you want to buy guns, but yea :) [22:46:18] I don't think yuvipanda needs guns [22:46:25] he's too cute to hastle [22:46:43] ^ that [22:46:44] *hassle [22:46:54] I also have an octopus plushie and now a panda plushie too [22:46:56] should be enough [22:47:57] !log tools kill NFS on tools-puppetmaster-01 with https://wikitech.wikimedia.org/wiki/Hiera:Tools/host/tools-puppetmaster-01 [22:48:01] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/SAL, Master [23:43:01] hello yuvipanda [23:43:15] hello leila [23:43:26] leila: I totally forgot to send a reminder to labs-announce :( [23:43:30] so, shall we look at the survey together some time today or you're done with it? [23:43:33] but we do have about 110 responses [23:43:55] yuvipanda, no worries. I remembered it, but you had a lot of responses, so I think there is no need to pull more. [23:43:59] yeah [23:44:01] ok [23:46:12] yuvipanda, so we stop it from the form now? [23:47:11] Okay, turned it off yuvipanda [23:47:21] leila: wooo [23:47:23] thanks [23:47:25] :D [23:47:27] :D [23:47:31] leila: I'm not sure if it's too late for you to read it together... [23:47:46] let's see what I can do. checking it now. [23:47:54] ok [23:48:17] This is sooo exciting, yuvipanda. dataaaa! [23:48:23] when is your offiste? [23:48:24] offsite? [23:48:35] leila: monday! :( [23:48:44] ooooo, a lot of time. :D [23:48:54] okay, let me move to a comfortable place and work on it a bit. [23:49:13] leila: ok! don't subject yourself to reading the comments alone! [23:49:18] I /think/ it's best if you start reading the comments for now, yuvipanda, and summarizing those, and I start plotting stuff. [23:49:21] although maybe I'm expecting way too less and will be pleasantly surprised [23:49:25] leila: yup that sounds good [23:49:26] yuvipanda: any way to share the survey results? I'm super curious [23:49:38] once I'm done with those, I'll see how much energy I have for the comments, yuvipanda. [23:49:51] leila: +1 [23:49:55] and yay plots [23:50:07] chasemp: we should definitely update the research page with all the results once we're done analyzing. [23:50:19] would that be good or you want to see them now, chasemp? ;-) [23:51:09] leila: he is ops anyway, I added access to him on gdoc [23:51:33] leila: my curiosity killed the cat impulse is strong :) instead of eating dinner now I'll read this for far too long [23:51:34] that's okay, yuvipanda. I just wanted to make sure if chasemp is asking for raw data or results. ;-) [23:51:51] +1 [23:51:58] yuvipanda, now that chasemp is reading it, loop him in for the comment section [23:52:05] maybe you can divide the work. [23:52:13] curiosity has always a cost, chasemp. ;-) [23:52:16] :D [23:53:20] nothing quite like drinking from the hose :)