[00:07:26] [bz] (8RESOLVED - created by: 2Carl Fürstenberg, priority: 4Normal - 6normal) [Bug 49366] MariaDB lacks help - https://bugzilla.wikimedia.org/show_bug.cgi?id=49366 [15:41:17] hi [15:42:47] hey Veertje [15:42:59] can anyone help me get access to my project space on Toollab? [15:43:15] I can't seem to get this SSH FTP thing going [15:44:09] !tooldocs [15:44:09] https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/Help [15:44:17] Veertje: did you read that? [15:44:35] I tried https://wikitech.wikimedia.org/wiki/Help:Access_to_ToolLabs_instances_with_PuTTY_and_WinSCP [15:44:47] ah, windows! [15:44:51] perhaps petan can help? [15:44:56] Ohh.. [15:45:05] Yeah. Just a sec... [15:45:16] I'll make you some coffee ;) [15:45:28] Veertje: do you have your keys made? [15:45:33] yes [15:45:38] with PuttyGen [15:45:51] And your public key is on wikitech? [15:45:51] and my project is listed: https://wikitech.wikimedia.org/wiki/Special:NovaProject [15:45:56] yes [15:46:04] 2048 key? [15:46:12] let's check that [15:46:26] Puttygen does 1024 by default and wouldn't work for me [15:46:34] yes, that seems to be the default setting [15:46:44] and SSH-2 RSA [15:47:13] Hrrm.. let me see what I did... I just went through this a couple weeks aho myself. [15:47:46] I vaguely remember switching to SSH-r RSA last weekend [15:48:05] I mean SSH-2 RSA [15:49:11] Veertje: You have a shell account I assume. What it your wikitech username? [15:49:37] 1Veertje [15:50:00] https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/Access_Request/1Veertje [15:50:04] and what is your shell username? [15:50:19] isn't that 1Veertje too? [15:50:58] Maybe.. go check on https://wikitech.wikimedia.org/wiki/Special:Preferences "Instance shell account name:" [15:51:16] bottom of Basic information section on first page [15:51:24] ah, I guess it isn't [15:51:41] it's from Alice in Wonderland instead [15:52:28] Okay, that is the username you will need to use to login to the server from PuTTY [15:52:31] !putty [15:52:32] official site: http://www.chiark.greenend.org.uk/~sgtatham/putty/ | how to tunnel - http://oldsite.precedence.co.uk/nc/putty.html [15:52:38] hrmm. [15:52:40] ah, now we're getting somewhere [15:52:55] yeah, that threw me for a bit too at first. [15:53:11] !windows [15:53:11] shiny, but fragile and expensive [15:53:14] lol [15:53:34] I'm trying to find the two links that you need to set up PuTTy correctly... [15:53:42] Is that wm-bot reply to what Windows is? [15:54:02] !windows [15:54:02] shiny, but fragile and expensive [15:54:05] lol [15:54:41] is it a problem that my shell username is the same as my secret passphrase, or is this common? [15:54:43] https://wikitech.wikimedia.org/wiki/Help:Putty --> https://wikitech.wikimedia.org/wiki/Help:Access_to_ToolLabs_instances_with_PuTTY_and_WinSCP --> https://wikitech.wikimedia.org/wiki/Help:Access_to_instances_with_PuTTY_and_WinSCP [15:55:07] Those are the three PuTTy pages... and using all three, you should be able to piece together what you need to make it work.. [15:55:07] it looks like I can now start uploading files throug WinSCP [15:55:21] Cool. :) [15:55:41] * T13 wanders off thinking that Veertje is kinda cute... ;) [16:02:08] gcc-4.6.real: internal compiler error: Terminated (program cc1 < well, that's always a fun error to get [16:02:14] 'It's not your code, it's me!' [16:23:05] oh. [16:23:21] actually it was killed by the ram-eating-processes-killer [16:46:20] valhallasw: compile in -dev then? :) [17:05:36] YuviPanda: I copied /usr/lib/python2.7/site-packages/lxml to my venv [17:05:46] YuviPanda: which also works [17:05:51] valhallasw: oh, pip install didn't? [17:05:56] ooh, pip install OOM'd? [17:06:07] yeah [17:06:23] I guess I should just login to -dev by default ;-) [17:51:12] YuviPanda: what's up [17:52:17] valhallasw: -login is really poor on memory, -dev is really better to run resource expensive jobs [17:52:31] -login should be only used to control bots or ssh somewhere else [17:57:14] whoever is running yasbot it needs to be moved to grid [17:59:07] Sweet merde.... How many instances of yasbot are needed? [17:59:17] !log tools petrb: killing all python processes of yasbot on -login, this bot needs to run on grid, -login is constantly getting OOM because of this bot [17:59:20] Logged the message, Master [18:00:33] !log tools petrb: freed 1600mb of ram by killing yasbot processes on -login [18:00:42] Logged the message, Master [18:00:57] And there was much rejoicing! [18:01:08] petan: oh, was just pinging because someone wanted to ask about WinSCP [18:01:11] I don't really care about number of instances, as long as they run on grid :/ [18:01:20] YuviPanda: aha... is that someone still here? [18:01:28] nope, I think T13 helped them [18:01:33] ok thanks [18:02:06] !tooldocs [18:02:06] https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/Help [18:02:40] petan: yeah, so basically -dev is better as login host ;-) [18:03:02] not in fact, -dev has same amount of ram as login [18:03:15] once people start using -dev instead of -login it will start to have same troubles, if not worse :D [18:03:25] primary problem is that people are running bots on -login, that is wrong [18:03:43] especially when these bots need to spawn 140 python processes, each running 80mb of resident ram [18:04:33] people should be allowed to run almost everything but bots on bastion hosts [18:04:40] or tools of course [18:04:49] Nothing like a batch fed jsub... [18:04:55] petan: she was trying to use her wikitech password to login to shell... [18:05:34] T13|needsCoffee well that doesn't work... it would be helpful if system just rejected password auth instead of responding with "invalid password" [18:06:30] I pointed her to look for her shell username on her preferences page.. [18:06:45] :) that seems to be a common mistake. [18:21:28] wow -login works so much better when it doesn't need to swap all time :D [18:21:35] my terminal stopped randomly lagging [18:35:00] mmm, no scfe_de [18:35:01] sigh [18:43:23] YuviPanda: what u need? [18:43:37] oh, he was working on debianizing an nginx package for me :) [18:46:32] aha [18:55:00] petan: so yeah, I need an nginx package :) [19:36:13] hello there ! is there any PHP graph/chart library installed on tools instance ? [19:46:52] @T13 hi? [19:48:06] Hi. Veertje [19:48:46] So, I finally got a SFTP connection to labs, 3:56 h ago [19:49:06] (there is a clock ticking in the GUI, might as well use it to be precise) [19:49:35] Great. :) [19:49:36] my application needs a database, but not a clone of the entire wikipedia db [19:50:36] I figured I need a command line connection for this, so I've managed to connect through Putty [19:51:03] Okay. [19:51:49] Is there a manual on how to set up a MySQL database? [19:52:11] maybe I could look for that off of the wikitech wiki, might be something SSH specific [19:52:44] !mysql [19:52:51] !mySQL [19:52:56] hrmm. [19:53:00] !MySQL [19:53:07] I don't know [19:53:18] And wm-bot doesn't either it seems. [19:53:23] I guess I could clone the whole db and not use it [19:53:29] not use the tables I mean [19:53:38] just create my own tables next to it [19:53:45] Maybe petan or Coren|Sleep ? [19:53:54] !toolsodc [19:53:56] err [19:53:58] Or YuviPanda even [19:53:58] !toolsdoc [19:53:59] https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/Help [19:54:22] Veertje: https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/Help#Steps_to_create_a_user_database_on_tools-db [19:54:24] is what you need [19:54:53] ok [19:56:06] hi [19:56:31] !db is https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/Help#Steps_to_create_a_user_database_on_tools-db [19:56:31] This key already exist - remove it, if you want to change it [19:56:38] !db [19:56:38] http://bots.wmflabs.org/~petrb/db/%23wikimedia-labs.htm [20:32:04] Hello, does anyone know why a job might not run (no output/log/action)? [20:33:41] Hazard-SJ: submitted from cron? you could check if it's still in queue (qstat or on tools.wmflabs.org) [20:36:00] valhallasw: Yes, from cron, and it isn't in queue [20:36:10] and some others run [20:36:38] what happens if you manually run it? [20:39:26] memory issues, perhaps? [20:39:30] Hazard-SJ: submit it with more memory? [20:42:48] !tdb is https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/Help#Steps_to_create_a_user_database_on_tools-db [20:42:49] Key was added [20:50:17] YuviPanda: That shouldn't be the issue [20:50:53] Did you include the special extra path parm? [20:50:54] valhallasw: I submitted a job manually earlier, I got no result from the job [20:51:07] the only times that has happened to me it got killed OOM [20:51:28] it still doesn't send mails on OOM kills by default? [20:51:44] it did? [20:52:00] I have "No mails." [20:52:55] YuviPanda: I'm not sure, that's why I ask ;-) (although my way of asking could have been... clearer) [20:53:03] I don't think it does [20:53:12] it d idn't the last time my stuff was killed, at least :) [20:53:23] ah :-) [20:55:54] * T13|needsCoffee kindly asks the OOM killah to send das emails from now on. [20:57:30] valhallasw / YuviPanda: is it possible to use cd in a job? [20:58:01] change to a particular directory? yes, sure. [20:58:11] use absolute paths though :) [20:59:44] Did you include "PATH=/usr/local/bin:/usr/bin:/bin [21:00:47] YuviPanda: :/ But it tries to use cd as the path itself :/ [21:01:01] Hasteur|Away: Where? [21:01:21] is this a job that can be run as a continuous one rather than a cron? [21:02:16] The job currently in question is "jsub -once -N github-updater cd tools && git pull" [21:02:37] output: "/data/project/hazard-bot/cd: No such file or directory" [21:04:25] and if I try "jsub -once -N github-updater tools && git pull" I get "/data/project/hazard-bot/tools: not an executable file", YuviPanda [21:04:59] Hazard-SJ: right. cd is a shell construct, not an executable file on itself [21:05:02] use the full path? [21:05:06] to tools? [21:05:08] #0 1 * * 1 cd $HOME/g13bot_tools && jsub -cwd -once -N g13_db_maint_driver g13_db_maint_driver.sh [21:05:22] Example from the hasteurbot invocation [21:05:30] YuviPanda: giving git a path is... possible, but problematic [21:06:03] easier: make a shell script update_hazard_bot.sh that contains #!/bin/bash cd tools git pull [21:06:05] put this in a bash file, do whatever you want, and cron the bash file? :) [21:06:07] heh yeah [21:06:22] The bash file does a slew of jsubs from the first level [21:07:04] Hazard-SJ: injsubtion? [21:07:11] argh. [21:07:15] Hasteur|Away: injsubtion? [21:07:16] * Hazard-SJ tries [21:07:30] * Hazard-SJ laughs [21:17:11] OK, thanks, it's working now [22:24:18] hehe, insubjtion [23:33:17] Is it possible to run a Java-based Wikipedia bot on WMFlabs? [23:49:34] KittyReaper, I think so, yes