[01:26:00] Warning: There is 1 user waiting for shell: Magog the Ogre (waiting 0 minutes) [01:39:31] Warning: There is 1 user waiting for shell: Magog the Ogre (waiting 13 minutes) [01:52:52] Warning: There is 1 user waiting for shell: Magog the Ogre (waiting 26 minutes) [02:06:13] Warning: There is 1 user waiting for shell: Magog the Ogre (waiting 40 minutes) [02:09:00] damned straight, wm-bot [02:09:12] ;) [02:14:28] I have a toolserver account, and I have both web services and bots, and they both reference the same code. I see these are two different projects on Labs. Does that mean I'll have to maintain my code in two different places? [02:19:35] Warning: There is 1 user waiting for shell: Magog the Ogre (waiting 53 minutes) [02:32:56] Warning: There is 1 user waiting for shell: Magog the Ogre (waiting 67 minutes) [02:46:18] Warning: There is 1 user waiting for shell: Magog the Ogre (waiting 80 minutes) [02:57:17] petan, you about? [02:58:56] FastLizard4, are you about? [02:59:32] Yes, what can I do for you? [02:59:39] Warning: There is 1 user waiting for shell: Magog the Ogre (waiting 93 minutes) [02:59:56] Help installing MediaWiki. How do I connect the SQL database? [03:00:01] on labs. [03:00:42] FastLizard4, ^ [03:01:17] What do you mean by "How do I connect the SQL database?" [03:01:57] When you first load the MediaWiki site, it takes you through a configuration page. [03:02:39] I need to connect to a database. What do I enter? [03:03:49] FastLizard4, ^ [03:04:31] Whatever system you've set up your database on [03:04:49] I don't know how to answer your question in any more detail [03:05:09] Can you help me with that. I haven't setup a database in ages. How do I setup a database in Labs? [03:06:23] Just set up an instance and check the appropriate boxes in puppet config [03:06:48] By database setup I mean install MySQL [03:13:00] Warning: There is 1 user waiting for shell: Magog the Ogre (waiting 107 minutes) [03:26:29] Warning: There is 1 user waiting for shell: Magog the Ogre (waiting 120 minutes) [03:39:52] Warning: There is 1 user waiting for shell: Magog the Ogre (waiting 133 minutes) [03:53:22] Warning: There is 1 user waiting for shell: Magog the Ogre (waiting 147 minutes) [04:06:43] Warning: There is 1 user waiting for shell: Magog the Ogre (waiting 160 minutes) [04:20:13] Warning: There is 1 user waiting for shell: Magog the Ogre (waiting 174 minutes) [04:33:38] Warning: There is 1 user waiting for shell: Magog the Ogre (waiting 187 minutes) [04:47:05] Warning: There is 1 user waiting for shell: Magog the Ogre (waiting 201 minutes) [05:00:35] Warning: There is 1 user waiting for shell: Magog the Ogre (waiting 214 minutes) [05:13:57] Warning: There is 1 user waiting for shell: Magog the Ogre (waiting 228 minutes) [05:27:27] Warning: There is 1 user waiting for shell: Magog the Ogre (waiting 241 minutes) [05:40:57] Warning: There is 1 user waiting for shell: Magog the Ogre (waiting 255 minutes) [05:54:28] Warning: There is 1 user waiting for shell: Magog the Ogre (waiting 268 minutes) [06:07:58] Warning: There is 1 user waiting for shell: Magog the Ogre (waiting 282 minutes) [06:21:32] Warning: There is 1 user waiting for shell: Magog the Ogre (waiting 295 minutes) [06:34:57] Warning: There is 1 user waiting for shell: Magog the Ogre (waiting 309 minutes) [06:48:31] Warning: There is 1 user waiting for shell: Magog the Ogre (waiting 322 minutes) [07:01:57] Warning: There is 1 user waiting for shell: Magog the Ogre (waiting 336 minutes) [07:15:31] Warning: There is 1 user waiting for shell: Magog the Ogre (waiting 349 minutes) [07:20:55] hi [07:27:30] !log bots syncing list with tools [07:27:32] Logged the message, Master [07:32:34] petan: you can create new projects on tools right? [07:32:45] probably [07:32:49] oh yes I can [07:32:56] I thought you said delete lol [07:33:12] I can surely create them ^^ [07:33:16] :P [07:33:25] can you create one called "wikidatastats" with me, addshore, and yuvipanda in it? [07:33:32] ok [07:34:06] !log tools creating project wikidatastats for legoktm addshore and yuvipandianablah :P [07:34:07] Logged the message, Master [07:35:35] ty :) [07:36:26] !toolsdocs [07:36:26] http://www.mediawiki.org/wiki/Wikimedia_Labs/Tool_Labs/Help [07:39:02] legoktm it's almost done, do you want to use db on bots or tools [07:39:30] tools i think? [07:41:02] ok... I need to find out how to create db [07:41:14] btw bots server is surely better configured ^^ but on other way... it's loaded [07:42:17] well right now addshore and me are using stathat for a bunch of things, but the problem is that is non-free [07:42:25] okok [07:42:50] so i want to set up something similar with limn (which yuipanda has experience with :D), so we dont have to worry about privacy when linking people to it [07:44:22] WTF [07:44:24] Coren|Food ping [07:44:35] legoktm I /think/ your account was created [07:44:42] working on DB now... [07:44:53] but on UNIX you /maybe/ have it [07:44:57] :D [07:45:06] these scripts that are supposed to create it are evil [07:45:25] local-wikidatastats@tools-login:~$ echo "Hello world" [07:45:25] Hello world [07:45:26] :D [07:50:31] legoktm ok db account is created [07:50:37] :D [07:50:40] thanks petan [07:50:57] I need to copy parts of Coren|Food $HOME to my own :P [07:51:24] maybe you should just have a "tooladmin" user thats used to create accounts and stuff? [07:51:40] or maybe we just need to document this all [07:51:57] so that I don't need to find out stuff by browsing home of someone else :P [07:54:39] LOL [07:54:47] mysql server on tools is really bad [07:54:54] it doesn't even have datafile per db [07:55:04] so all db's are in one huge file... [07:55:16] hope it never break then [08:04:45] heh I asked a stupid question on stack overflow... it got +80 upvotes and now I got reward for asking notable questions XD [08:20:23] any one know how to lookup edit count in talk page using the api ? [08:25:18] yeah [08:25:21] give me a sec [08:25:58] https://en.wikipedia.org/w/api.php?action=query&list=users&ususers=Jimbo%20Wales&usprop=blockinfo|groups|editcount|registration|emailable|gender [08:26:00] Oren_Bochman: ^ [08:26:09] https://www.mediawiki.org/wiki/API:Users [08:27:38] nice but I need to split the edit count by mainspace, and talk space [08:28:18] oh [08:28:23] you need db access for that [08:28:28] what are you trying to do? [08:28:56] I'm making a new user tracker [08:30:05] to get feedback on students in the MOOC I'm developing [08:31:05] ok well you should probably know that the editcount from the API is not likely to be accurate [08:31:33] thanks [08:31:39] https://www.mediawiki.org/wiki/Manual:User_table#user_editcount [08:31:53] np [08:33:51] I was thinking of using http://toolserver.org/~tparis/pcount/index.php to do this if I could not get the api to give a quick answer [08:34:17] any chance it has been ported to labs ? [08:35:13] well no, because labs doesn't have db access yet... [08:40:05] I thought the new tools project was going to have a replicated DB access [08:41:37] perhaps I need to do this on the toolsever [08:43:06] they will [08:43:14] its just not ready yet [08:43:20] ok [08:44:14] I can wait with this project a bit while developing the MOOC [08:44:56] or I can analyse the fulledit histories - which was phase III [09:07:53] local-wikidatastats@tools-login:~$ npm install [09:07:53] The program 'npm' is currently not installed. To run 'npm' please ask your administrator to install the package 'npm' [09:07:56] * legoktm pokes petan  [09:39:16] legoktm: [09:39:21] Hi [09:39:32] i was going to do the same thing with something for stats >.< [09:39:43] I alredy created a db design and thought of most of the backend jobs... [09:39:48] nooo [09:39:50] lets use limn [09:39:54] link ?? :P [09:40:05] https://github.com/wikimedia/limn [09:40:12] join #wikimedia-analytics too [09:41:14] all we do is a simple python cgi script that appends to the csv file [09:41:35] and we can have a simple token authentication system [09:41:54] basically the same thing as the stathat api, just to a different end point [09:42:32] awesome :) [09:42:41] lits do it? :) [09:42:58] i spent a while googling for things but never came across limn :D [09:44:02] got a rpoject for it? :) [09:44:14] yeah [09:44:20] become wikidatastats [09:44:42] ahh, a projects on tools ;p [09:44:48] we just need to set it up limn [09:44:53] and npm isnt installed [09:45:01] petan: :) [09:45:14] I wonder if Coren|Food will be back from his food today ;p [09:46:01] hey legoktm, for once I have all of my web tools all in one place ;p http://tools.wmflabs.org/addshore/ [09:47:37] :D [09:53:37] legoktm: these stats are gonna be awesome? ;p [09:53:44] :DDD [10:17:19] Hello. Can someone run 'svn update' at pywikipedia rewrite branch directory on bots project? [10:17:45] * legoktm looks [10:17:54] It hasn't updated for 1 month [10:18:03] and has many bugs! [10:18:05] legoktm@bots-bnr2:/data/project/pywikipedia/rewrite$ svn up [10:18:05] The program 'svn' is currently not installed. To run 'svn' please ask your administrator to install the package 'subversion' [10:19:20] legoktm@bots-gs:/data/project/pywikipedia/rewrite$ svn up [10:19:20] svn: Can't open file '.svn/lock': Permission denied [10:20:13] gimmie a sec [10:20:42] perhaps we should look at cron as well. I thought that it updates pywikipedia daily, but it doesn't. [10:21:01] yeah [10:21:18] addshore: can you set up a root cron or something? [10:21:24] Ill add it to a cron in just a few ticks :) I would have thought somebots would have already :P [10:21:29] Updated to revision 11442. [10:22:28] great :) [10:22:35] Thanks :) [10:29:08] !log bots addshore: update svn of pywikipedia rewrite and trunk [10:29:10] Logged the message, Master [10:29:24] !log bots addshore: added svn up to cron for both pywikipedia rewrite and trunk [10:29:26] Logged the message, Master [11:07:24] Warning: There is 1 user waiting for shell: Dbeet (waiting 0 minutes) [11:14:47] BACK [11:14:52] legoktm k [11:15:09] :) [11:15:29] !log tools petrb: installing npm to -login instance [11:15:30] Logged the message, Master [11:20:49] Warning: There is 1 user waiting for shell: Dbeet (waiting 13 minutes) [11:26:58] [bz] (ASSIGNED - created by: Chris McMahon, priority: Highest - normal) [Bug 46459] [OPS] lucene-search-2 uses too much memory on labs - https://bugzilla.wikimedia.org/show_bug.cgi?id=46459 [11:32:14] !log tools wikidatastats attempting to install limn [11:32:16] Logged the message, Master [11:33:09] petan: can projects on tools be renammedd? :P [11:33:31] technically it's possible :P I just don't know about any working process [11:33:34] what do you need to rename [11:33:46] I would need to create new entry in ldap and delete old one [11:34:05] rename all folders, and change the permissions of all existing files [11:34:15] Warning: There is 1 user waiting for shell: Dbeet (waiting 26 minutes) [11:34:21] update the apache configuration and eventually recreate all databases [11:34:45] well maybe its just easier to delete the current one and make a new one? we barely started using it [11:34:52] or that [11:34:54] :D [11:35:43] ok, wanna delete "wikidatastats" and make a new "stats"? [11:35:49] ok [11:35:51] [= [11:37:52] !log tools petrb: created new project stats and cloned acl from wikidatastats, which is supposed to be deleted [11:37:54] Logged the message, Master [11:38:13] ok let me know when I can delete it [11:38:46] i already rm -rf'd it [11:38:53] or everything in it [11:39:01] :D [11:39:57] ok [11:43:52] hmm [11:43:53] npm ERR! Error: EACCES, mkdir '/usr/lib/node_modules' [11:44:02] we need to install it locally [11:44:52] In global mode (ie, with -g or --global appended to the command), it installs the current package context (ie, the current working directory) as a global package. [11:45:09] petan, how do I create a database for myself? [11:46:00] so uh [11:46:01] Cyberpower678: on bots or tools? [11:46:02] server is running [11:46:15] tools I think. [11:46:20] Definitely tools. [11:46:30] its already created [11:46:40] How do I access it? [11:46:41] look for my.cnf in your tools directory [11:46:49] thats would be your password [11:46:55] just type mysql ;p [11:46:57] just type in mysql [11:47:09] just have your mysql wrapper read from .my.cnf [11:47:12] it specifics the db [11:47:44] I'm trying to install MediaWiki on to peach [11:47:47] *peachy [11:47:49] Warning: There is 1 user waiting for shell: Dbeet (waiting 40 minutes) [11:48:18] addshore: ok if you cd limn [11:48:21] and run npm start [11:48:24] it starts the server [11:48:31] kk [11:48:38] im just not sure where the web end point is? [11:49:12] hmmmh [11:49:54] zz_YuviPanda said that milimetric in -analytics was the one who set it up for him, so i pinged him earlier but im guessing he's on SF time [11:50:19] the readme doesnt help ;p [11:51:27] How do I tell MediaWiki that? [11:51:48] I can't open the my.cnf file [11:53:06] ok [11:53:11] what exactly are you trying to do? [11:53:31] im not sure installing mediawiki into tools is the best of ideas…. [11:53:37] Install MediaWiki and connect it to Peachy's database. [11:54:01] Cyberpower678: is peachy a project within labs or within tools? [11:54:13] tools [11:54:19] no like what are you trying to do overall? whats the end goal? [11:55:05] Create a platform to document Peachy and use it as a test platform to help me further develop peachy and create a custom extension for the Wiki. [11:55:51] Is there a PHPmyAdmin or something? [11:56:04] How can I see the database? [11:57:54] Nooo phpmyadmin is disabled [11:58:18] How can I look at the database? [11:58:27] mysql commandline! [11:58:57] Now what? [11:58:58] I'm thinking you'd be better off with a separate project [11:59:06] as do I [12:00:50] legoktm, I did mysql commandline. Now what? [12:01:19] Warning: There are 2 users waiting for shell, displaying last 2: Dbeet (waiting 53 minutes) Asdert (waiting 6 minutes) [12:01:32] show databases; [12:02:02] use DBNAME; [12:02:56] addshore, ' [12:02:56] ERROR 1064 (42000): You have an error in your SQL syntax; check the manual that corresponds to your MariaDB server version for the right syntax to use near 'mysql commandline [12:02:56] show databases [12:02:56] show databases' at line 1 [12:02:56] MariaDB [peachy]> use DBNAME; [12:02:56] ERROR 1044 (42000): Access denied for user 'peachy'@'%' to database 'DBNAME' [12:02:56] MariaDB [peachy]> [12:03:23] not literally [12:03:29] > show tables; [12:03:30] .. do 'show databases;' to find out what your db is called :p [12:03:37] select * from page limit 1; [12:04:16] rememebr ever command needs a semi colon after it [12:05:01] -> show databases; [12:05:01] ERROR 1064 (42000): You have an error in your SQL syntax; check the manual that corresponds to your MariaDB server version for the right syntax to use near 'commandline [12:05:01] show databases' at line 1 [12:05:01] MariaDB [peachy]> [12:05:46] [bz] (NEW - created by: T. Gries, priority: High - normal) [Bug 32163] Please list the fingerprint(s) of the server - https://bugzilla.wikimedia.org/show_bug.cgi?id=32163 [12:06:19] show databases; [12:06:24] type that exactly [12:06:35] I'm copying and pasting it. [12:06:50] [bz] (REOPENED - created by: Faidon Liambotis, priority: Normal - normal) [Bug 39784] Labs infrastructure work (tracking) - https://bugzilla.wikimedia.org/show_bug.cgi?id=39784 [12:07:03] [bz] (NEW - created by: Peter Bena, priority: High - enhancement) [Bug 34685] Enable irc feed for labsconsole.wikimedia.org site - https://bugzilla.wikimedia.org/show_bug.cgi?id=34685 [12:07:43] I had to do it twice for it to work [12:07:58] then you can see all the databases you have access to [12:08:16] information_schema and peachy [12:08:27] type "use peachy" and it will switch to it [12:08:30] I obviously use peachy [12:08:42] if you type "show tables;" it will show you have tables you have in your db [12:09:11] It's empty. :p [12:09:19] [bz] (ASSIGNED - created by: m.p.roppelt, priority: High - blocker) [Bug 45078] fcron not working on bots-4 - https://bugzilla.wikimedia.org/show_bug.cgi?id=45078 [12:09:21] thats because you havnt made anything ;p [12:09:45] [bz] (NEW - created by: Peter Bena, priority: Normal - major) [Bug 45768] console doesn't show proper errors - https://bugzilla.wikimedia.org/show_bug.cgi?id=45768 [12:09:58] [bz] (NEW - created by: Krinkle, priority: Normal - major) [Bug 45827] Labs: Mails from cron should not go to ops-wikimedia - https://bugzilla.wikimedia.org/show_bug.cgi?id=45827 [12:10:15] How do I access the database username and password? [12:10:22] petan: whats happeneing to wm-bot ? [12:10:38] its in my.cnf [12:10:45] peten: are you there? I have sent you a message about suexec problem a week ago. Did you get it? [12:10:48] I can't open it. :p [12:11:24] Cyberpower678: make sure you are local-peachy [12:11:38] Do I access it from the terminal? [12:11:43] The problem is, it is not only me who face this problem. Now drtrigon's tool also crash because of this misconfiguration. See http://bots.wmflabs.org/~drtrigon/cgi-bin/panel.py [12:11:43] Or scf? [12:12:00] terminal, otherwise you wont be your tool [12:12:11] command? [12:12:31] try nano my.cnf [12:12:36] "nano my.cnf" [12:13:03] petan: I typed your name incorrectly again :( [12:13:25] [bz] (NEW - created by: anubhav, priority: Low - normal) [Bug 46951] Unable to Create a New Developer Account - https://bugzilla.wikimedia.org/show_bug.cgi?id=46951 [12:13:27] addshore, I see a blank screen with new file on the bottom. [12:13:59] .my.cnf : [12:13:59] :p [12:14:40] yes [12:14:50] also Cyberpower678 go to https://wikitech.wikimedia.org/wiki/Special:NovaProject and add my as a memebr to peachy ;p [12:14:59] Warning: There are 2 users waiting for shell, displaying last 2: Dbeet (waiting 67 minutes) Asdert (waiting 19 minutes) [12:15:39] addshore, All in good time. [12:15:39] [bz] (NEW - created by: T. Gries, priority: Low - enhancement) [Bug 45214] When installing instances, starting puppet runs etc.: ping the developer by mail about the status - https://bugzilla.wikimedia.org/show_bug.cgi?id=45214 [12:15:46] :) [12:15:52] [bz] (NEW - created by: Krinkle, priority: Low - normal) [Bug 46475] Labs: Ganglia down due to aggregator1 OOMing - https://bugzilla.wikimedia.org/show_bug.cgi?id=46475 [12:17:32] addshore, got past the database part. [12:18:12] :P [12:19:37] [bz] (NEW - created by: Ryan Lane, priority: Low - normal) [Bug 46819] Change network configuration to network-node per compute-node - https://bugzilla.wikimedia.org/show_bug.cgi?id=46819 [12:19:38] [bz] (NEW - created by: Michelle Grover, priority: Low - enhancement) [Bug 46621] SSL Support on betalabs - https://bugzilla.wikimedia.org/show_bug.cgi?id=46621 [12:19:39] [bz] (NEW - created by: Michelle Grover, priority: Low - normal) [Bug 46620] Automatic mobile redirects for MobileFrontend on Betalabs - https://bugzilla.wikimedia.org/show_bug.cgi?id=46620 [12:19:40] [bz] (NEW - created by: Ryan Lane, priority: Low - normal) [Bug 46175] Have a short link to the signup page - https://bugzilla.wikimedia.org/show_bug.cgi?id=46175 [12:19:41] [bz] (NEW - created by: silke.meyer, priority: Low - normal) [Bug 45897] puppet has a problem with versions - https://bugzilla.wikimedia.org/show_bug.cgi?id=45897 [12:19:42] [bz] (NEW - created by: Andrew Bogott, priority: Low - normal) [Bug 45203] Dumb error message on account creation shell name collision - https://bugzilla.wikimedia.org/show_bug.cgi?id=45203 [12:19:43] [bz] (NEW - created by: Ryan Lane, priority: Low - enhancement) [Bug 44722] Have two LDAP servers per datacenter - https://bugzilla.wikimedia.org/show_bug.cgi?id=44722 [12:19:44] [bz] (NEW - created by: Ryan Lane, priority: Low - enhancement) [Bug 43890] Allow instance resizes - https://bugzilla.wikimedia.org/show_bug.cgi?id=43890 [12:19:45] [bz] (NEW - created by: Ryan Lane, priority: Low - normal) [Bug 43649] Disable stored configs on labs puppetmaster - https://bugzilla.wikimedia.org/show_bug.cgi?id=43649 [12:19:46] [bz] (NEW - created by: Ryan Lane, priority: Low - normal) [Bug 43526] Invalidate the nscd group cache of instances in a project when a user is added or removed - https://bugzilla.wikimedia.org/show_bug.cgi?id=43526 [12:19:47] [bz] (NEW - created by: Ryan Lane, priority: Low - normal) [Bug 43503] Need nagios alert for failures in authorized_keys creation script - https://bugzilla.wikimedia.org/show_bug.cgi?id=43503 [12:19:48] [bz] (NEW - created by: Ryan Lane, priority: Low - normal) [Bug 40023] Improve ganglia metrics for Labs infrastructure - https://bugzilla.wikimedia.org/show_bug.cgi?id=40023 [12:19:49] [bz] (NEW - created by: Ryan Lane, priority: Low - normal) [Bug 39819] Set project group as default gid for instances in a project - https://bugzilla.wikimedia.org/show_bug.cgi?id=39819 [12:19:50] [bz] (UNCONFIRMED - created by: Emw, priority: Low - normal) [Bug 44837] Enable development on environments resembling that of Wikimedia Commons - https://bugzilla.wikimedia.org/show_bug.cgi?id=44837 [12:19:54] FLOOOOOOOOOOOOOOOOODDD [12:20:06] [bz] (NEW - created by: Ryan Lane, priority: Low - normal) [Bug 46824] Switch DNS to gdnsd - https://bugzilla.wikimedia.org/show_bug.cgi?id=46824 [12:20:07] [bz] (NEW - created by: Ryan Lane, priority: Low - normal) [Bug 46822] Shrink gluster volumes from 4 bricks to 2 bricks - https://bugzilla.wikimedia.org/show_bug.cgi?id=46822 [12:20:08] [bz] (NEW - created by: Ryan Lane, priority: Low - normal) [Bug 46818] Switch DNS middleware to Moniker - https://bugzilla.wikimedia.org/show_bug.cgi?id=46818 [12:20:09] [bz] (NEW - created by: Andrew Bogott, priority: Low - normal) [Bug 46656] Allow service users to be added and removed from sudo policies - https://bugzilla.wikimedia.org/show_bug.cgi?id=46656 [12:20:10] [bz] (NEW - created by: Krinkle, priority: Low - enhancement) [Bug 46471] Implement log rotation for jstart - https://bugzilla.wikimedia.org/show_bug.cgi?id=46471 [12:20:11] [bz] (NEW - created by: Antoine "hashar" Musso, priority: Low - normal) [Bug 46093] virt0 puppet master lacks GeoIP files - https://bugzilla.wikimedia.org/show_bug.cgi?id=46093 [12:20:12] [bz] (NEW - created by: Krinkle, priority: Low - enhancement) [Bug 45829] Labs: Let mail (from cron and perhaps other defaults) go to project forwarder by default - https://bugzilla.wikimedia.org/show_bug.cgi?id=45829 [12:20:13] [bz] (NEW - created by: Ryan Lane, priority: Low - normal) [Bug 45670] Set ulimits on bastion - https://bugzilla.wikimedia.org/show_bug.cgi?id=45670 [12:20:14] [bz] (NEW - created by: Ryan Lane, priority: Low - enhancement) [Bug 45456] Have shell requests marked as uncompleted or completed automatically - https://bugzilla.wikimedia.org/show_bug.cgi?id=45456 [12:20:15] [bz] (NEW - created by: Ryan Lane, priority: Low - normal) [Bug 44723] Upgrade OpenDJ to 2.5 - https://bugzilla.wikimedia.org/show_bug.cgi?id=44723 [12:20:16] [bz] (NEW - created by: Ryan Lane, priority: Low - normal) [Bug 44720] Only list LDAP servers location in the same datacenter in the nslcd configuration - https://bugzilla.wikimedia.org/show_bug.cgi?id=44720 [12:20:17] [bz] (NEW - created by: Ryan Lane, priority: Low - enhancement) [Bug 44173] Add "open for all" project feature - start with bastion - https://bugzilla.wikimedia.org/show_bug.cgi?id=44173 [12:20:18] [bz] (NEW - created by: Ryan Lane, priority: Low - normal) [Bug 44167] Synchronize mediawiki groups with LDAP have all projects require shell group - https://bugzilla.wikimedia.org/show_bug.cgi?id=44167 [12:20:19] [bz] (NEW - created by: Andrew Bogott, priority: Low - normal) [Bug 44077] cut down on nagios spam - https://bugzilla.wikimedia.org/show_bug.cgi?id=44077 [12:20:20] [bz] (NEW - created by: Damian Z, priority: Low - normal) [Bug 40945] Sudo policies don't work for new instances - https://bugzilla.wikimedia.org/show_bug.cgi?id=40945 [12:20:22] FLOOOOOOOOOOOOOOOOOOOOODD [12:20:26] Again [12:20:37] [bz] (NEW - created by: Ryan Lane, priority: Low - normal) [Bug 46825] Write a Moniker backend for gdnsd - https://bugzilla.wikimedia.org/show_bug.cgi?id=46825 [12:20:38] [bz] (NEW - created by: Ryan Lane, priority: Low - normal) [Bug 46823] Replace glusterfs - https://bugzilla.wikimedia.org/show_bug.cgi?id=46823 [12:20:39] [bz] (NEW - created by: Ryan Lane, priority: Low - normal) [Bug 46821] Add BGP support to Quantum for floating IP addresses - https://bugzilla.wikimedia.org/show_bug.cgi?id=46821 [12:20:40] [bz] (NEW - created by: Ryan Lane, priority: Low - normal) [Bug 46817] Upgrade OpenStack to the Folsom release (tracking) - https://bugzilla.wikimedia.org/show_bug.cgi?id=46817 [12:20:41] [bz] (NEW - created by: Ryan Lane, priority: Low - enhancement) [Bug 45455] Cleanup and enable UserFunctions extension on labsconsole - https://bugzilla.wikimedia.org/show_bug.cgi?id=45455 [12:20:42] [bz] (NEW - created by: Ryan Lane, priority: Low - normal) [Bug 43795] Change upper-bound system uid range to 499 - https://bugzilla.wikimedia.org/show_bug.cgi?id=43795 [12:20:43] [bz] (NEW - created by: Ryan Lane, priority: Low - normal) [Bug 43650] Switch instance bootstrapping to use salt - https://bugzilla.wikimedia.org/show_bug.cgi?id=43650 [12:20:44] [bz] (NEW - created by: Ryan Lane, priority: Low - normal) [Bug 43508] Run a script to add all members of the shell mediawiki group to the bastion project - https://bugzilla.wikimedia.org/show_bug.cgi?id=43508 [12:20:45] [bz] (NEW - created by: Ryan Lane, priority: Low - normal) [Bug 43028] Nagios checks needed for labs-ns0/labs-ns1 - https://bugzilla.wikimedia.org/show_bug.cgi?id=43028 [12:20:46] [bz] (NEW - created by: Nemo, priority: Low - normal) [Bug 41967] GlusterFS performance problems - https://bugzilla.wikimedia.org/show_bug.cgi?id=41967 [12:20:47] [bz] (NEW - created by: Ryan Lane, priority: Low - normal) [Bug 40022] Add nagios checks for all nova, glance, and keystone related services - https://bugzilla.wikimedia.org/show_bug.cgi?id=40022 [12:20:56] -.- [12:21:12] that is andre__ doing some cleanup :D [12:21:24] cleanup O_o [12:24:38] addshore, how do I upload a file via terminal? [12:24:56] scp [12:25:12] legoktm, I don't want scp in this case. [12:25:16] Oh. [12:26:35] Is there a command for that? [12:28:29] Warning: There are 2 users waiting for shell, displaying last 2: Dbeet (waiting 81 minutes) Asdert (waiting 33 minutes) [12:28:55] back [12:29:02] what is going on nullzero [12:31:16] Cyberpower678 yes there is a command [12:31:30] Cyberpower678 scp file server:target_file [12:31:42] like scp /home/petanb/blah bots-1:blah2 [12:32:56] nullzero if you sent me a message week ago it got lost [12:33:51] Cyberpower678: you can upload via your ftp client [12:33:56] as you are a member of peachy-local [12:34:12] then just change the owner with chown [12:34:20] nope [12:34:27] petan: nope? O_o [12:34:27] chown can be used by root only [12:37:08] [bz] (NEW - created by: Jan Luca, priority: Low - major) [Bug 47336] "Failed to create service group" error when creating service groups but group appears in list on Special:NovaProject - https://bugzilla.wikimedia.org/show_bug.cgi?id=47336 [12:37:12] addshore: http://unix.stackexchange.com/questions/27350/why-cant-a-normal-user-chown-a-file [12:37:17] petan: I'm back [12:37:26] wb [12:38:21] Last week, I noticed that suexec log has errors about other users' tools. [12:38:34] aha [12:38:40] that's quite possible [12:38:42] For example, [2013-04-16 07:09:52]: command not in docroot (/data/project/DrTrigonBot/public_html/cgi-bin/panel.py) [12:39:02] hm... I don't really know how Coren|Food configured the apache server [12:39:14] there is some wrapper I never saw [12:39:59] nullzero reason may be even that the file is owned by wrong user, etc [12:40:06] Well, I will contact Coren|Food and explain this problem to him. [12:40:27] [bz] (NEW - created by: Peter Bena, priority: Normal - normal) [Bug 47101] Project filter on "Instance list" lists service groups showing up as projects - https://bugzilla.wikimedia.org/show_bug.cgi?id=47101 [12:41:01] !mail | nullzero, this is even better [12:41:01] nullzero, this is even better: we have a mailing list labs-l@lists.wikimedia.org feel free to send a message there, don't forget to subscribe [12:41:23] ok :) [12:41:23] !log deployment-prep on searchidx01 iptables -t nat -I OUTPUT --dest 208.80.153.219 -j DNAT --to-dest 10.4.0.17 (see {{bug|45868}} ) [12:41:23] Logged the message, Master [12:42:03] Warning: There are 3 users waiting for shell, displaying last 3: Dbeet (waiting 94 minutes) Asdert (waiting 46 minutes) Tritesters (waiting 6 minutes) [12:42:59] [bz] (NEW - created by: Nemo, priority: Low - normal) [Bug 41095] Missing perl dependencies? ("Can't locate LWP/UserAgent.pm at ias3upload.pl") - https://bugzilla.wikimedia.org/show_bug.cgi?id=41095 [12:44:19] [bz] (NEW - created by: Krinkle, priority: Low - major) [Bug 45519] [Regression] Editing "Documentation" page for labs project not working - https://bugzilla.wikimedia.org/show_bug.cgi?id=45519 [12:44:20] [bz] (NEW - created by: silke.meyer, priority: Low - minor) [Bug 44035] Instance failed to build but stays in list after deletion - https://bugzilla.wikimedia.org/show_bug.cgi?id=44035 [12:44:21] [bz] (NEW - created by: Matthew Flaschen, priority: Low - normal) [Bug 43653] Allow applying LocalSettings changes after puppet's main version - https://bugzilla.wikimedia.org/show_bug.cgi?id=43653 [12:44:22] [bz] (NEW - created by: Jan Gerber, priority: Low - normal) [Bug 41123] glusterfs /data/projects 0-deployment-prep-project-replicate-0: background entry self-heal failed - https://bugzilla.wikimedia.org/show_bug.cgi?id=41123 [12:44:23] [bz] (NEW - created by: Damian Z, priority: Low - normal) [Bug 40943] Fix the instance types - https://bugzilla.wikimedia.org/show_bug.cgi?id=40943 [12:44:24] [bz] (UNCONFIRMED - created by: Damian Z, priority: Low - normal) [Bug 39792] Labsconsole session is omnipresent - https://bugzilla.wikimedia.org/show_bug.cgi?id=39792 [12:44:27] I will not talk in here until you disable this [12:44:30] tvm [12:44:32] :P [12:55:06] Output will be no longer suppressed now [12:55:34] Warning: There are 4 users waiting for shell, displaying last 4: Dbeet (waiting 108 minutes) Asdert (waiting 60 minutes) Tritesters (waiting 20 minutes) Colbyroblox99 (waiting 12 minutes) [12:56:29] I have power! [12:56:54] Coren: YAY [12:57:05] heh [12:57:22] Coren I was packing some batteries for you [12:57:32] :P [12:57:39] Effing idiot truck driver. [12:57:40] like 400000 [12:57:51] heh [12:57:51] :D [12:58:15] petan: http://lists.wikimedia.org/pipermail/labs-l/2013-April/001158.html ;) [12:58:16] Coren: ! :D [12:58:33] I even fired up my generator before I realized that he also ripped cable out. My 'net is cable. [13:00:31] cable is better than wifi :P [13:00:41] well, not in this case :P [13:01:26] Coren [13:01:33] is there a reason for public_html to be... [13:01:36] in home? [13:01:37] :D [13:01:51] :D [13:01:58] some people want to make their home 700 [13:02:15] I mean tool home [13:02:24] not all tools are so open [13:02:24] I just test because error message says something about my home directory. [13:03:10] in bots project there is /data/project/public_html and $HOME/public_html -> /data/project/public_html/$USER [13:03:23] Well, so that the entire tool tree lives under a single point; what I would recommend they do is place more sensitive stuff under a directory and make /that/ 700 [13:03:40] Coren, So how was your 36 hour meal. :p [13:03:48] Cyberpower678: Dark. :-) [13:04:20] ~/public_html, ~/private and so on. [13:04:56] We have a backup generator. Sure helped us in the big storm of 2010 and the snowstorm of 2011. [13:05:02] :p [13:05:21] And through both hurricanes [13:05:32] Cyberpower678: So do I; not all that useful when you have not pipe going outside. Even more fun: my phone is VOIP. :-) [13:06:10] I don't quite follow. :/ [13:06:31] I lost power /and/ net connection. [13:06:56] Yea. They tend to hang on the same poles ;p [13:07:12] [bz] (ASSIGNED - created by: Antoine "hashar" Musso, priority: Low - enhancement) [Bug 41285] foreachwiki on beta use all.dblist instead of all-wmflabs.dblist - https://bugzilla.wikimedia.org/show_bug.cgi?id=41285 [13:07:44] Coren, whenever wo lose power, we retain internet for another 12 hours, then it goes out as well. [13:08:50] Yeah, in theory I can keep the 'net up indefinitely but the actual wires were broken in the poles. :-) [13:09:11] Warning: There are 4 users waiting for shell, displaying last 4: Dbeet (waiting 121 minutes) Asdert (waiting 73 minutes) Tritesters (waiting 33 minutes) Colbyroblox99 (waiting 25 minutes) [13:15:33] petan, cna you change ownership of /data/project/peachy/public_html/PeachyFrameworkLogo.png ? [13:15:44] yes [13:15:59] addshore, Peachy Wiki successfully set up. [13:16:10] For the most part. [13:17:06] !log tools petrb: sudo chown local-peachy PeachyFrameworkLogo.png [13:17:08] Logged the message, Master [13:17:18] Cyberpower678 done [13:21:29] [bz] (RESOLVED - created by: Chris McMahon, priority: High - normal) [Bug 46166] Add automated browser tests to beta labs (tracking) - https://bugzilla.wikimedia.org/show_bug.cgi?id=46166 [13:24:41] !log migrating Cluekie from Toolserver to labs [13:24:41] is not a valid project. [13:24:44] addshore, don't forget to create an account. [13:25:03] !log cvn migrating Cluekie from Toolserver to labs [13:25:05] Logged the message, Master [13:25:19] ;p [13:25:19] Cyberpower678: link? [13:25:29] http://tools.wmflabs.org/peachy/wiki/ [13:31:09] addshore, I see you. [13:32:06] addshore: I like your efficiency with bugs: open a bug, then close it yourself WONTFIX a few hours later. :-) [13:33:18] Coren: Was it you that fixed common-interests yesterday? [13:35:52] Coren: I know ;p [13:42:27] greenrosetta: No, it's me who fixed it this morning. :-) I'm not sure why, ,but that tool didn't get added to the web redirection list. Odd. It's the first with a - in its name so I'll check if there's a broken regex somewhere. [13:42:36] ty [13:42:43] btw, can you do me a big favor? [13:42:52] can you install mercurial on tools? [13:43:22] I'd like to have an easy way of pulling in my source code which is already in hg [13:44:48] Coren: could you have a look at http://lists.wikimedia.org/pipermail/labs-l/2013-April/001158.html , petan said that you configured the apache2 and you might be able to solve this problem. [13:46:48] nullzero: I'm in email catch-up mode atm, so I'll likely reach that soon. :-) [13:46:58] greenrosetta: Eeew. hg. :-) Sure. [13:47:30] im very new to python, so I've no idea on how to actually deploy my app [13:47:45] the guys on pocoo are saying to use mod_wsgi. Is that installed? [13:47:46] Coren: okay, thanks a lot. [13:48:27] greenrosetta: No wsgi support yet; that's considerably complicated in a grid environment. It's in the "Would be nice to have" future plans, but not short term. [13:48:43] ok, so how would I get a python app running? [13:50:36] greenrosetta: That's a... wide question. :-) wsgi is for middleware-like stuff that keeps state; in general web applications tend to be written to be stateless. If you just want to keep a long-running program running, you can use jsub/jstart to keep it running. I'd need to know what you're trying to do before I can really tell you how to do it. :-) [13:51:22] I wrote a small python tool using the Flask famework [13:51:57] and I'm trying to deploy it to the common-interests folder [13:55:08] ah, ty for hg already :D [13:56:04] * legoktm pokes Coren about postgresql [13:56:08] Flask is... an interesting choice. You realize that what it does is make a web /server/ that persistently runs and answers requests? That's a model which is overkill in 99.95% of cases. [13:56:53] legoktm: This'll need some discussion and architecture; I like the idea and I want it implemented, but I doubt it's realistic to expect it before a bit. [13:56:53] its a simple tool [13:57:39] Coren: ok, thats fine then :) [13:58:13] Coren: I dont see how it is any different than any of the other toolserver like tooks [13:58:26] greenrosetta: most ts tools are just CGI scripts [13:58:41] ima [13:58:43] you make a request and the script is executed when you call it [13:58:44] greenrosetta: Almost all tools are CGI scripts, they don't run their own web server. :-) [13:58:56] but flask is a webserver running and answers when you make a request [13:59:34] ok, but is there a problem with using this? [14:00:37] greenrosetta: It's /possible/ to make it work, but it would be complicated and would need a compelling reason to consume this much resource and effort to have it run reliably; we'd need a dynamic proxy setup, a means to communicate between Flask and apache, and a darn compelling use case to justify it. :-) [14:01:33] Warning: There is 1 user waiting for shell: Karim.rayani (waiting 0 minutes) [14:02:01] i understand the complicaed part, but the resources are extremely tiny [14:03:56] !log cvn rebooted by krinkle due to out of memory [14:03:57] Logged the message, Master [14:05:30] greenrosetta: What you're proposing is to keep a python webserver running continuously just to answer web requests; this can be required for some kinds of complicated stateful middleware, but I very much doubt your tool is anywhere near that. [14:06:17] And python is anything /but/ tiny. It consumes hundreds and hundreds of megs of ram just to get started. :-) [14:07:19] greenrosetta: I'm a bit busy for this week on infrastructure, but I'd be glad to sit town and help you retool your tool to use CGI. [14:07:28] ok, ty for the offer [14:08:16] greenrosetta: http://flask.pocoo.org/docs/deploying/cgi/ might help [14:08:37] Ignore the parts about server setup, that's already done. [14:09:00] ah, that might work. [14:15:08] Warning: There is 1 user waiting for shell: Karim.rayani (waiting 13 minutes) [14:21:34] so Coren we are getting rid of gluster tomoroowoww? :D [14:22:41] addshore: Provided no vehicles destroy part of my home's infrastructure again, yes. :-) [14:22:47] :D [14:22:59] cant happen two days in a row right? ;p [14:23:05] that doesn't sound good Coren [14:23:10] did someone drive into your house? :P [14:23:14] well now you've jinxed it addshore. [14:23:18] ;p [14:23:40] * addshore is going to make a webpage front end for various bot tasks :P [14:23:54] it shall have buttons [14:23:55] and stuff [14:24:35] Thehelpfulone: A truck managed to rip out the power/phone/cable in front of my home. [14:25:05] addshore: Will it have shiny colourful indicators? [14:25:14] potentially :D [14:25:23] just gonna draw up a plan now [14:25:34] Coren: do I have access to the apache config file? [14:26:10] greenrosetta: No, though some you can cover from .htaccess. In theory, though, you shouldn't have to change anything to make a cgi work. [14:26:14] ahh Coren I have just remembered a question I have for you :) [14:26:30] how does the proxy change the ip from the actual IP to localhost? [14:27:11] and could we potentially alter it so that it creates some sort of unique hash for each ip rather than just setting everything to 127.0.0.1? [14:27:25] addshore: It doesn't; the "true" logs have its (the proxy's) address in 'em, I just uniformize then to localhost when the logs are split. [14:27:53] Coren, I'm trying to run through that Python/CGI link you showed me [14:27:55] so instead of uniformizing them can you hash them? :D [14:27:56] addshore: No, hashes are also a no-no: we don't want to allow saying "this user and that user are from the same address" [14:28:06] mhhm [14:28:12] should I just create a cgi-bin directory in my public_html folder? [14:28:32] greenrosetta: You already /have/ a cgi-bin directory. :-) [14:28:38] Warning: There is 1 user waiting for shell: Karim.rayani (waiting 27 minutes) [14:28:43] I dont see one :( [14:28:51] greenrosetta: It's outside the public_html for security reasons [14:29:15] at the root of "common-interests"? [14:29:38] ... wait, why didn't it get created? I expect that's the same reason your site wasn't linked. [14:29:57] fix't [14:30:49] can you just kill "common-interests" and then recreate it? [14:31:08] think of the kittens! [14:31:25] hush... my kitten heard you [14:31:38] addshore: The rules for the Tool Labs are the same as the wikis in re. privacy; you'd need checkuser-equivalent to have IP info. :-) [14:31:49] greenrosetta: No need, I've already fixed it. [14:32:07] mhhm, but Coren you can see what ips have carried out what actions on wiki ;p [14:32:08] you have a cgi-bin in ~local-common-interests now [14:32:21] Core, so I should just dump my python code into cgi-bin and then create a cgi to call it? [14:32:52] an yway :P [14:33:13] greenrosetta: As far as I know, your python code doesn't need to be there at all, just the CGI that invokes it. [14:33:38] ok, so shouldnt I be able to exceute my python code from the shell then? [14:34:05] addshore: Yeah, but there is no registered user equivalent in labs. Consider: an el on a wiki that links to a tool that logs IP = "stealth checkuser" [14:35:00] greenrosetta: Yes, you should, provided you invoke it the "right" way -- by default, a Flask app will try to start as a webserver, you need to call it differently to have it behave as a CGI. (Also, invoking a CGI on the command-line is rarely useful) [14:36:09] I'm back. [14:36:24] I can't figure out why my logo isn't appearing. [14:36:41] greenrosetta: Which is why the cgi you write /imports/ your application. [14:36:57] And runs it through CGIHandler() [14:36:58] ok, maybe I'll take you up on your offer to help me convert this [14:37:03] when you get some time [14:37:10] im sure its probably simple [14:37:23] I might have a bit Friday, otherwise I'm all yours next week. [14:37:29] oo baby [14:37:37] Cyberpower678: Want make to look at it? [14:37:55] Sure. [14:38:06] You can find it in Peachy [14:38:48] Cyberpower678: There's your problem! $wgLogo needs to be an URL, not a path to the file. :-) [14:39:13] Cyberpower678: Just change it to "/wiki/PeachyFrameworkLogo.png"; [14:39:22] ? It asked for a path during the installation. [14:39:49] ... that might be an instruction fail. :-) [14:40:48] Still doesn't work. [14:41:08] I'm going to try something. [14:41:16] Oh, my bad: [14:41:28] The url should be "/peachy/wiki/..." not just "/wiki" [14:42:03] Cyberpower678: ^^ [14:43:07] That did it. [14:43:12] Thanks. [14:43:50] What permission code equals rwxr-xr-x [14:44:04] 755 [14:44:38] Just found a way to figure that out. :p [14:44:47] Long live octal. :-) [14:45:56] What file has the rights? [14:46:35] Coren, ^ [14:46:45] What file has what rights? [14:47:00] The rights for the Wiki. [14:47:32] Ah, you mean userrights and such? Everything lives in LocalSettings.php [14:49:16] Ah [14:49:42] * Coren grumbles. [14:49:48] Cyberpower678: Check http://www.mediawiki.org/wiki/Manual:User_rights_management out [15:00:52] Warning: There is 1 user waiting for shell: Jpcarmona (waiting 0 minutes) [15:11:10] Coren, how do I get jstart to work? [15:12:19] Cyberpower678: jstart the_thing [15:12:45] I did, but nothing's happening. [15:13:10] Cyberpower678: Which tool? [15:13:27] PCbot.php located in /data/project/cyberbot/bots [15:14:01] What is the exact command line you are trying to use? [15:14:18] jstart continuous /data/project/cyberbot/bots/PCbot.php [15:14:23] Warning: There is 1 user waiting for shell: Jpcarmona (waiting 13 minutes) [15:15:24] Coren, ^ [15:15:27] Ah. Well, first error, it would have been '-continuous' not 'continuous' (options start with a dash). But also, jstart implies '-continuous' so you wouldn't need it at all. What you did is try to start a job for 'continuous', which doesn't exist. Look in the tool's home, there's a continuous.err file. :-) [15:16:06] Just: jstart /data/project/cyberbot/bots/PCbot.php [15:18:04] How do I make it continuous then? [15:18:50] Incoming: [15:18:53] usage: jstart [options...] program [arg...] [15:18:53] Options include many (but not all) qsub options, along with: [15:18:53] -stderr Send errors to stderr rather than the error [15:18:53] output file. [15:18:53] -mem Request amount of memory for the job. [15:18:53] jstart does so implicitly. [15:18:54] (number prefixed by 'k', 'm' or 'g') [15:18:56] -once Only start one job with that name, fail if [15:18:58] another is already started or queued. [15:19:00] -continuous Start a self-restarting job on the continuous [15:19:02] queue (default if invoked as 'jstart') [15:19:04] Unlike qsub, if you do not specify output and error files, output is appended [15:19:06] by default to files named .err and .out in your home directory [15:19:08] (without job numbers), including errors from starting the job itself. [15:19:10] Additionally, you need to provide an executable on the command line, [15:19:12] jstart will not read a script from standard input. [15:19:22] See the bit that says 'default if invoked as jstart'? [15:19:26] :-) [15:19:43] /facepalm [15:19:58] You /could/ have specified -continuous anyways, it'd have been harmless, but the dash is necessary. :-) [15:20:22] Aha. [15:20:33] What is arg... [15:20:47] arguments you may want to pass to your script, if it takes any. [15:20:53] PHP scripts rarely do. [15:21:05] Any idea what could cause Closing Link: 208.80.153.192 (Too many user connections (global)) [15:21:19] I'm trying to determine exactly what limit is reached [15:21:32] Krinkle: Where are you hitting that message? [15:21:34] Is it a limit on my instance? or with the server I'm connecting to [15:21:40] Coren, how do I cancel previously assigned jstart tasks. [15:21:49] Coren: It isn't in tool labs, but in the cvn project, but I hope you can help regardless [15:21:55] I'm tryig to start a bot [15:22:01] whenever I start it it hits that [15:22:08] immediately at the first attempt to make a connection [15:22:16] Krinkle: Connection to what? [15:22:38] Coren: irc.cluenet.org and irc.freenode.net [15:22:56] Cyberpower678: You don't have any running, none of them were successfuly queued. [15:23:14] Coren, is there a way I can see it? [15:23:26] Cyberpower678: 'qstat' [15:23:28] The queue of tasks I started. [15:23:29] The bot is "Cluekie" and acts as a bridge between English Wikipedia's ClueBot_NG (which is a mediawiki bot hosted by ClueNet and has an irc server) - and this bot connects to that feed to do some other countervandalism stuff here in #cvn on freenode [15:23:37] but anyhow, that aside [15:23:59] Coren, does nothing. [15:24:14] Which server gives you the limit? That doesn't look like something I've seen on freenode [15:24:32] Cyberpower678: Which is normal if you have no running or queued jobs. :-) [15:24:59] WHAT AM I DOING WRONG. *Cyberpower bangs his head. [15:25:17] Look at you PCbot.err [15:25:24] Coren: When the Cluekie bot is started on cvn-app1.wmflabs and it opens 2 sockets (one to each of those 2 irc servers) after a second the link is closed with that message [15:26:02] Sure, but they're not both giving you that message. [15:26:19] One of the connection is erroring out. [15:26:50] sorry, gotta go, brb in 20 minutes. Thanks! [15:27:16] Cyberpower678: I see a few obvious errors: [15:27:34] Cyberpower678: (1) your script isn't exectuable [15:27:52] Cyberpower678: (2) It doesn't have a #! start. [15:27:59] Warning: There is 1 user waiting for shell: Jpcarmona (waiting 27 minutes) [15:28:04] Cyberpower678: Likely, you want to start it by invoking php explicitly: [15:28:20] jstart php /data/project/cyberbot/bots/PCbot.php [15:28:51] Even more useful would be to give the job a name, too: [15:29:48] jstart -N pcbot php /data/project/cyberbot/bots/PCbot.php [15:33:22] Coren, I'm on iPhone now. [15:33:44] CP678|iPhone: Did you miss my last messages? [15:33:50] Cyberpower678: Likely, you want to start it by invoking php explicitly: [15:33:52] jstart php /data/project/cyberbot/bots/PCbot.php [15:33:53] Even more useful would be to give the job a name, too: [15:33:54] jstart -N pcbot php /data/project/cyberbot/bots/PCbot.php [15:34:45] I got your second point. [15:35:26] What is -N [15:36:11] It gives a name to the job, makes it easier to identify with qstat and simpler to manage with job/jstop [15:36:36] By default, the job is named what the progam is, which in your case would be just 'php' [15:36:48] Which isn't all that clear. :-) [15:37:12] http://www.mediawiki.org/wiki/Wikimedia_Labs/Tool_Labs/Help#Job_names [15:37:21] I'm back [15:39:09] So yeah, try: jstart -N pcbot php /data/project/cyberbot/bots/PCbot.php [15:39:33] I saw it running, but now it's dead. [15:39:50] Ah. You ran out of memory. [15:40:00] No. I deleted it. [15:40:16] Ah, okay. [15:40:46] I inadvertantly pasted the same junk as I did a little moment ago here. [15:40:53] It somehow started. :p [15:41:08] <^demon> /nick ^demon|lunch [15:41:30] Warning: There is 1 user waiting for shell: Jpcarmona (waiting 40 minutes) [15:41:47] Coren, before I start, how can I direct the output to the CyberbotII folder? [15:42:16] -o $HOME/something.log [15:42:22] You can specify the output and error files with -o and -e respectively. [15:42:29] and there's another command to merge them into one [15:42:35] i forget what it is though [15:42:36] legoktm: -j [15:45:02] What is $HOME? [15:45:34] jn [15:45:55] $HOME is the environment variable that contains the path to your... home. :-) [15:46:07] /data/project/ [15:46:08] ? [15:46:16] For a tool, yeah. [15:46:21] Coren, I meant how far does the path go. :p [15:46:30] Ok. [15:52:03] Change on 12mediawiki a page Wikimedia Labs/Tool Labs/Help was modified, changed by Addshore link https://www.mediawiki.org/w/index.php?diff=677238 edit summary: [+501] /* Access */ puttygen help [15:52:50] Coren, I'm not seeing evidence that it's running. [15:52:50] Coren: do you think that addition to the help page looks alright? Or should I add it inside a collapsable box? [15:53:13] Cyberpower678: running a task on the grid? [15:53:26] I'm trying. [15:53:27] addshore: It looks good for contents; I don't think it's that needed to collapse it unless you add screenshots. [15:53:27] 1029 0.25000 PCbot local-cyberb r 04/24/2013 15:49:15 continuous@tools-exec-02.pmtpa 1 [15:53:41] Cyberpower678: type 'qstat' [15:53:46] No output log nor any file modification. [15:54:20] -rw-r--r-- 1 cyberpower678 local-cyberbot 7 Apr 23 15:24 PCrun.txt [15:55:41] I'm not sure I get the beginning of your code; you're comparing timestamps? [15:56:20] I'm getting ready to remove that. [15:56:40] Wait a minute, is this meant to run continuously or at interval? [15:56:53] Continuously. [15:57:09] Okay, then that guard code is apparently what's preventing it from running now. [15:57:21] So it just keeps being restarted in a loop. :-) [15:58:28] : q [15:59:24] That's wierd. [15:59:36] It works perfectly on toolserver though. [15:59:47] Shouldn't I still be getting output. [16:00:16] Possibly, though by default PHP is very quiet on a die and such. [16:00:33] I'm telling the die to tell me something. [16:00:35] :P [16:00:44] You might want to put and "echo 'started blah blah';" at the very start while you are debugging, just to see when it tries. [16:01:33] Yeah, but on the TS you are invoking from cron at interval and need a guard to prevent duplication, jstart sets up a restartable job instead. [16:02:11] Change on 12mediawiki a page Wikimedia Labs/Tool Labs/Help was modified, changed by Addshore link https://www.mediawiki.org/w/index.php?diff=677239 edit summary: [+66] /* Generating a key in Windows and Putty */ add a link [16:02:31] The guard code should still let it through. [16:02:36] I removed it now. [16:03:06] Still no output. [16:03:40] Ah, no, it's being killed for running out of memory. [16:03:48] ???? [16:03:54] Say what? [16:03:56] Check your PCbot.err [16:04:04] I don't see it. [16:04:26] There's no output at all. [16:04:31] Look at /data/project/cyberbot/PCbot.err [16:05:16] That error, about abort and pthread_cancel? That's the way php (unhelpfully) dies when it runs out of memory. [16:05:19] Try this: [16:05:25] Stop the job, then: [16:05:38] Change on 12mediawiki a page Wikimedia Labs/Tool Labs/Help was modified, changed by Addshore link https://www.mediawiki.org/w/index.php?diff=677241 edit summary: [+72] /* Simple, one-off job */ add a further example [16:05:58] Done [16:06:03] jstart -mem 1G -N pcbot php /data/project/cyberbot/bots/PCbot.php [16:06:28] Also tell me how to direct output. Obviously when I tried, it failed. [16:06:31] Once it's running, you can see how much memory it /actually/ uses with 'qstat -j ' [16:07:07] Add -e /data/project/cyberbot/whereveryouwanterror and/or -o /data/project/cyberbot/errorsthere :-) [16:07:17] Output, not error, for -o [16:07:37] I did that and it blatently ignored me. :( [16:07:44] o_O? [16:07:50] Show me the exact command line you used? [16:08:23] Oh wait. FAIL [16:08:30] CyberbotII.err? [16:08:47] CyberbotII.out? [16:08:48] LOL [16:10:32] Ok. Nothing's happening. [16:10:55] * Cyberpower678 is starting to question labs. [16:11:03] Show me your exact command line, please. :-) [16:11:06] * Cyberpower678 or his abilities [16:11:16] Change on 12mediawiki a page Wikimedia Labs/Tool Labs/Help was modified, changed by Addshore link https://www.mediawiki.org/w/index.php?diff=677242 edit summary: [+19] /* Continuous tasks (such as bots) */ this will be easier to expand [16:11:20] jstart -mem 1G -N pcbot php /data/project/cyberbot/bots/PCbot.php -o $HOME/CyberbotII/PCBot.out -e $HOME/CyberbotII/PCBot.err [16:11:41] Response was: Your job 1030 ("pcbot") has been submitted [16:11:52] qstat shows nothing. [16:11:58] Ah. Okay, -o and -e need to go /before/ php, you're trying to give those options to your script rather than jstart this way. :-) [16:12:10] your bot needs a gig of ram....? [16:12:21] legoktm: No, just being generous to see actual usage. [16:12:32] oh ok [16:12:34] :) [16:12:35] legoktm, not really. I don't know what's causing that. [16:12:48] Cyberpower678: Want me to try it myself as your bot user and work it out? [16:12:48] Must be a memory leak. [16:13:01] I need to learn this. [16:13:32] legoktm, feel free to create an account on the Peachy Wiki. :p [16:13:41] Do this: jstart -mem 1G -N pcbot o $HOME/CyberbotII/PCBot.out -e $HOME/CyberbotII/PCBot.err php /data/project/cyberbot/bots/PCbot.php [16:14:05] I prefer: jstart -mem 1G -N PCbot o $HOME/CyberbotII/PCBot.out -e $HOME/CyberbotII/PCBot.err php /data/project/cyberbot/bots/PCbot.php [16:14:16] Oh, typo [16:14:22] Do this: jstart -mem 1G -N pcbot -o $HOME/CyberbotII/PCBot.out -e $HOME/CyberbotII/PCBot.err php /data/project/cyberbot/bots/PCbot.php [16:14:25] Note the - [16:14:55] BTW, your invocation /did/ work (without -o -e working, look at your pcbot.out in the home, it's full for work.) :-) [16:15:13] Change on 12mediawiki a page Wikimedia Labs/Tool Labs/Help was modified, changed by Addshore link https://www.mediawiki.org/w/index.php?diff=677245 edit summary: [+214] /* Job Status */ expand with output [16:15:13] submitted [16:15:53] Cyberpower678: Allright, see how your job is 'E' state? [16:16:08] No [16:16:08] Cyberpower678: That's error state. if you: qstat -j 1031 [16:16:25] If you do qstat you don't see your job in E state [16:17:51] o_O [16:17:54] *I* see it! [16:17:56] Coren, It can't open output [16:18:02] ? [16:18:44] drwxr-sr-x 2 cyberpower678 local-cyberbot 6 Apr 23 16:36 /data/project/cyberbot/CyberbotII/ [16:19:01] That'd be because your bot doesn't actually have write permission to that directory! :-) [16:19:18] chmod g+w /data/project/cyberbot/CyberbotII [16:19:42] Coren, local-cyberbot@tools-login:~$ chmod -R 775 $HOME/CyberbotII [16:19:47] Operation not permitted [16:20:03] Cyberpower678: Look who the owner /is/ :-) [16:20:23] You created that directory with your /own/ account, not the tool. :-) [16:20:50] There you go. [16:21:17] You can clear the error and have the job restart but easier still is to just: [16:21:19] jstop PCbot [16:21:22] jstart ... [16:21:39] jrestart? [16:21:49] I don't have that one. :-) [16:22:04] jrestart would have to guess what arguments you gave to jstart [16:22:35] Coren, not really. You give it the job ID [16:22:49] That's a suggested update. [16:23:29] At any rate, let's try to fix your immediate problem first. :-) [16:30:17] Coren, r state now. [16:33:07] Coren, it died again. [16:36:15] Coren? [16:36:30] Change on 12mediawiki a page Wikimedia Labs/Tool Labs/Help was modified, changed by Addshore link https://www.mediawiki.org/w/index.php?diff=677250 edit summary: [+1544] /* Job Status */ extr infomation [16:38:04] Coren died. [16:38:38] Change on 12mediawiki a page Wikimedia Labs/Tool Labs/Help was modified, changed by Addshore link https://www.mediawiki.org/w/index.php?diff=677252 edit summary: [+57] /* Job Status */ rename some stuff [16:40:47] Change on 12mediawiki a page Wikimedia Labs/Tool Labs/Help was modified, changed by Addshore link https://www.mediawiki.org/w/index.php?diff=677253 edit summary: [-16] this flows better [16:41:12] Coren: if there was anything you wanted to add to the help page tell me now and I will see if I can cram it in [16:44:55] Change on 12mediawiki a page Wikimedia Labs/Tool Labs/Help was modified, changed by Addshore link https://www.mediawiki.org/w/index.php?diff=677255 edit summary: [+144] /* Database access */ add some about accessing dbs [16:46:44] Cyberpower678: Actually, coren went to fetch a sandwich. :-) [16:47:24] Change on 12mediawiki a page Wikimedia Labs/Tool Labs/Help was modified, changed by Addshore link https://www.mediawiki.org/w/index.php?diff=677256 edit summary: [+190] /* Published directories */ Not about public_html [16:48:21] mhmm, I think some images may make this page more readable [16:48:43] addshore: Probably, especially for the windows clients' instructions. [16:48:48] yep [16:50:46] Change on 12mediawiki a page Wikimedia Labs/Tool Labs/Help was modified, changed by Coren link https://www.mediawiki.org/w/index.php?diff=677259 edit summary: [+1] /* Getting access to the Tool Labs */ SFTP != FTP (the latter is not enabled, nor will it ever be) [16:52:02] hehe [16:52:39] hello [16:53:10] Hello, Pyfisch [16:53:47] I have to use MySQLdb for my bot, can it be installed? [16:55:28] Yes, as long as you don't need access to the wikimedia databases (that comes in a while) [16:56:07] Coren: no I don't need access to other databases, I want to have my own to save some bot data [16:56:28] Pyfisch: You get a database set up by default for every tool for free. :-) [16:57:43] Change on 12mediawiki a page Wikimedia Labs/Tool Labs/Help was modified, changed by Addshore link https://www.mediawiki.org/w/index.php?diff=677262 edit summary: [+51] standardizze headings [16:58:14] Pyfisch: see http://www.mediawiki.org/wiki/Wikimedia_Labs/Tool_Labs/Help#Database_access ;p [16:59:19] addshore, Coren: I don't need database access that way, I have to use a Python module to access the database from my bot [16:59:47] this module is named "MySQLdb" and it can't be imported yet [16:59:58] Coren!! [17:00:03] Pyfisch: Oh, you need a specific python module! [17:00:06] I need your help [17:00:14] It died after 2 runs. [17:00:15] hey [17:00:18] Cyberpower678: Gimme a min and I'm all yours. [17:00:35] Oh. I get to have Coren all to myself. [17:00:35] Cyberpower678: how did it die? :) [17:00:52] Cyberpower678, it just disappeared from qstats [17:01:16] are you running it as continuous? [17:01:17] Pyfisch: That's odd, because that module /is/ installed on the tools project. What happens when you try importing it? [17:01:42] addshore, yes [17:01:52] what was the final output in the output file? [17:02:37] Cyberpower678: Err, I just looked at your bot's source and it's not continuous at all; it gets a list of pages, does stuff, then exits. [17:02:44] Coren: maybe I import it "wrong", I try to use it on bots-4 [17:03:00] Pyfisch: Oh, you're on *bots*. [17:03:10] * Coren points at Petan. That's all his fault. :-) [17:03:41] Heh. Perhaps that package isn't installed on bots-4. Seriously, petan is the right dude to ask. :-) [17:03:56] hi [17:04:10] petan: where is the python module "MySQLdb" installed? [17:04:27] (is pywikibot-rewrite installed?) [17:04:31] Pyfisch why in the world are you using bots-4 which is flagged for deletion [17:04:41] I need to update motd [17:04:59] I dont know but probably not on bots-4 [17:05:05] let me check [17:05:32] petan: which instance should I use? I am new here and I don't no things like that, sry [17:06:42] no need to be sorry :P [17:06:59] oh Coren submission server (-login) and the web servers.; [17:07:07] -dev isnt set up as a submit server ;p [17:07:25] well, I dont really know what you are up to, but given that bots, in mysterious future, will become a staging area of tools project, you should be either using tools project OR grid on bots [17:07:53] addshore: My bad, it should have been. I'm still waiting for a bikeshed discussion about puppet class naming before I can push the config. [17:07:59] Pyfisch so: if you want to do that on bots, see bots-gs instance [17:08:03] kk ^^ [17:08:03] !botsdocs | Pyfisch [17:08:04] Pyfisch: https://wikitech.wikimedia.org/wiki/Nova_Resource:Bots/Documentation [17:10:34] Coren, I thought continuous, means it simply restarts once it finishes. [17:11:21] Cyberpower678: It restarts as long as it does not exit with success, which a bot (the archtypical continuous task) never does unless you ask it to. [17:11:22] petan: on bots-gs I also can't import "MySQLdb" :/ [17:11:38] ok which packages you need for it? [17:11:52] Cyberpower678: What you want is to run your task at interval; you don't want to to restart all the time and spin around when it has nothing to do. :-) [17:12:07] petan: python-mysqldb [17:12:14] ok [17:12:19] Hello all! [17:12:27] petan: (or python2.7-mysqldb if he does 2.7) [17:12:30] Hello, dr0ptp4kt [17:12:30] Coren, I want it to tag and untag immediately. [17:12:33] DrTrigon: [17:12:41] !log bots petrb: installing python-mysqldb everywhere [17:12:43] Logged the message, Master [17:12:50] hello, Coren [17:13:05] Why is cgi on http://bots.wmflabs.org/ not working anymore? Any idea? [17:13:24] DrTrigon exactly? [17:13:34] Cyberpower678: Then you're not doing it in a way that's reasonable on resource use; you want to watch a recent change feed or something like that, and sleep at interval. Otherwise, your tool just constantly hammers on the wiki for no work. [17:13:57] dr0ptp4kt: Heh. I said hello due to broken tab autocomplete, but hello anyways. :-) Didn't mean to ping you, sorry. [17:13:59] It could be an error of mine, but http://bots.wmflabs.org/~drtrigon/cgi-bin/panel.py should work, since I did not change anything... [17:14:22] Coren, thanks. and hello anyways to you, too :) [17:14:30] Coren: No problem - was a kind gesture... ;) [17:14:31] Pyfisch try now [17:14:44] petan: You have a problem with the suexec document root; check labs-l [17:14:56] ok [17:15:24] petan: I think that's what's biting DrTrigon [17:15:47] Well. Back to Cron. [17:17:04] ok [17:17:20] hm I doubt that only way is to recompile apache :/ [17:17:29] Coren how you configured it on tools? [17:18:12] petan: I use suphp, not suexec. :-) [17:18:26] Girl: I love you. Guy: Well duh. [17:18:28] aha [17:18:43] petan: suphp has the document root configured from /etc [17:19:17] petan: But I'm looking at upgrading to apache 2.4 and using mod_provileges instead. [17:19:26] (Which would also neatly solve my error log issue) [17:19:40] mod_privileges* [17:20:18] Change on 12mediawiki a page Wikimedia Labs/Tool Labs/Help was modified, changed by Addshore link https://www.mediawiki.org/w/index.php?diff=677277 edit summary: [+385] various changes including 'Suspending and unsuspending jobs' [17:20:42] Coren, Are there any differences in the crontab here and that of toolserver? [17:20:56] How direct outputs? [17:21:17] Cyberpower678: Well, we're not using cronie, so you need to use crontab -e to edit the crontab [17:21:26] Cyberpower678: And the canonical way to start a job is: [17:21:52] jsub -once [the same stuff you tried with jstart] [17:21:59] Coren, I don't use -e. I modify a file and upload it to the cron. [17:22:07] Cyberpower678: That also works. :-) [17:22:19] Works better. [17:23:11] Cyberpower678: But yeah, if you use jsub -once and do like you did to redirect -e and -o, it'll "just work" right out of the gate. [17:24:08] DrTrigon itś fixed, sorry [17:24:19] CronTab set [17:25:04] petan: aaaa - here we go... THANKS A LOT! :) [17:25:33] Change on 12mediawiki a page Wikimedia Labs/Tool Labs/Help was modified, changed by Addshore link https://www.mediawiki.org/w/index.php?diff=677278 edit summary: [+389] /* Setting your SSH key */ ==== Generating a key in Linux==== [17:25:37] petan: was this related to bots4 or to apache? [17:25:43] Coren, program running. [17:25:46] apache [17:25:56] ok - thanks! [17:26:56] Cyberpower678: No, use jsub to submit the job; don't run stuff on the bastion hosts. [17:27:12] Huh? [17:27:33] Cyberpower678: Oh, and you're requesting a run every minute! [17:27:44] * Coren cringes. [17:28:07] That's how it ran on Toolserver/ [17:28:16] Change on 12mediawiki a page Wikimedia Labs/Tool Labs/Help was modified, changed by Addshore link https://www.mediawiki.org/w/index.php?diff=677279 edit summary: [+176] /* Getting access to the Tool Labs */ single point of access [17:28:25] It executes in 2.9 seconds. [17:28:25] coren is my last change correct? :) [17:28:26] Cyberpower678: I'm surprised DaB didn't beat you up over it! [17:29:09] addshore: It's correct but pointless; users should also not be going directly on other instances in the first place. :-) [17:29:22] It hardly uses any resources. [17:29:26] true [17:29:33] Cyberpower678: If you really must run it every minute, then please turn your task into an actual continual bot that sleeps between runs. :-) [17:29:57] Cyberpower678: It uses a LOT of resources. Starting Python is expensive. [17:29:58] You'll need to teach me how to do that at some point. [17:30:01] Change on 12mediawiki a page Wikimedia Labs/Tool Labs/Help was modified, changed by Addshore link https://www.mediawiki.org/w/index.php?diff=677281 edit summary: [-109] /* Getting access to the Tool Labs */ I guess I will cut this tiny bit out then Coren *ping* [17:30:26] Cyberpower678: put it in a big while look ;p [17:30:31] *loop [17:30:39] btw Coren I have another why u have -once instead of --once so that you follow GNU conventions [17:30:39] Coren, PHP? Not Python [17:30:53] PHP too (although yes, less expensive than Python) [17:31:17] not that I would follow them heh [17:31:20] Cyberpower678: addshore has it right; it should be as simple as making a big while loop around it and adding a sleep. :-) [17:32:08] and Coren we should probably install that packaged version of j* stuff [17:32:09] petan: Because I need to follow the qsub/q* braindamaged single-dash long options if I want to maintain compatibility. [17:32:15] petan: thank you! [17:32:16] so that we get manual :D [17:32:26] Coren: I am nearly ready to migrate all of my bot scripts over finally ;p [17:32:39] petan: Yes, as soon as I get that discussion within ops about the right class names for the tool labs config over with. :-) [17:32:53] k [17:35:44] CP678|away: But more importantly, even if you do still run this thing in cron you really really *must* use cron only to start a job on the grid, not have it run on whichever host happens to be doing the cron job. [17:40:44] petan: sorry again, what about http://bots.wmflabs.org/~drtrigon/DrTrigonBot/rewrite/script_wui-bot.log ? Why do I get a 403 ? [17:47:17] A wild Sumanah appeared! [17:47:28] :) [17:49:05] Coren: I enjoyed your phrasing "My 2 currency subunits" [17:49:18] sumanah: Currency-neutral. :-) [17:50:07] mhhm quick question when doing somehting such as 'jsub -once -N jobname php /data/project/tool/task/execute.php' do I actually need to include php? [17:50:18] or ca it just be 'jsub -once -N jobname /data/project/tool/task/execute.php' [17:52:34] addshore: You can use a shebang and make the script +x, and that'd work. [17:52:43] [= [17:55:52] *petan vanished* ... :( [18:03:38] here [18:04:11] bingo, 2 tasks running :0 [18:04:47] DrTrigon because apache can t read it? [18:05:56] [bz] (ASSIGNED - created by: m.p.roppelt, priority: High - blocker) [Bug 45078] fcron not working on bots-4 - https://bugzilla.wikimedia.org/show_bug.cgi?id=45078 [18:06:23] do I have a database at the beginning? [18:06:46] or do I have to create one? [18:06:51] so Coren continuous is continuous unless the code ends corrently? [18:07:03] Pyfisch: on bots or tools? [18:07:15] addshore: bots [18:07:23] it should be automatically create for you [18:07:32] look for my.cnf [18:07:56] addshore: Yeah, like the doc says, it'll stop restarting if it ends with an exit status of 0 (success); this is to allow an "out" for things like IRC bots. [18:08:29] going to modify my wikidata interwiki bot so it can run on tools [18:08:35] oh wait >.< [18:08:45] there is still some limit on number of slots right..? [18:11:15] addshore: where should I look for my.cnf, I have not found it in my home directory [18:11:21] hmmm [18:11:36] sorry .my.cnf [18:11:40] so ls -a [18:11:44] should show it [18:13:46] pyfisch@bots-gs:~$ ls -a [18:13:48] . .bash_logout .mysql_history .pywikibot .viminfo [18:13:50] .. .bashrc .profile pywikipedia-rewrite wikidata [18:13:51] .bash_history .cache pwrn.tgz .ssh wikidata.tar [18:13:53] pyfisch@bots-gs:~$ exit [18:13:54] logout [18:13:56] Connection to bots-gs closed. [18:13:57] pyfisch@bastion1:~$ ls -a [18:13:59] . .bashrc .profile wd2.tar [18:14:00] .. .cache pwrn.tgz wikidata [18:14:02] .bash_history Django-1.5.1.tar.gz .ssh wikidata.tar [18:14:03] .bash_logout \home\pyfisch user-config.py x [18:14:05] pyfisch@bastion1:~$ [18:14:06] there is no ".my.cnf" [18:16:48] Pyfisch: there is db by default [18:16:52] !botsdocs [18:16:52] https://wikitech.wikimedia.org/wiki/Nova_Resource:Bots/Documentation [18:17:07] in documentation you can read how to create it [18:17:16] * there is not a db by default [18:17:34] you only get a db server access by default [18:20:21] ok, what is that?? [18:20:23] ERROR 2002 (HY000): Can't connect to local MySQL server through socket '/var/run/mysqld/mysqld.sock' (2) [18:21:20] Warning: There is 1 user waiting for shell: Steinsplitter (waiting 0 minutes) [18:21:22] Pyfisch try again [18:21:32] I think that our cron died [18:21:38] I restarted the script by hand [18:22:03] Pyfisch you can do mysql -h bots-bsql01 [18:22:24] ok work [18:22:38] there you call tha command from documentation [18:22:46] to create new databases, you can have as many as you need [18:24:18] addshore|food did u restart sql server? [18:25:22] [bz] (NEW - created by: Ryan Lane, priority: Low - normal) [Bug 46175] Have a short link to the signup page - https://bugzilla.wikimedia.org/show_bug.cgi?id=46175 [18:29:01] I'm back [18:29:05] For a bit [18:29:19] petan: nope [18:29:23] I see [18:29:25] it died OOM [18:29:32] heh :P [18:29:41] * Cyberpower678 eats addshore  [18:29:44] 21gb of ram wasn enough [18:29:54] petan: says its been up 44 days? [18:29:55] I really want to know what was running there lo [18:29:59] or did just the service die? [18:30:08] addshore yes but mysqld process was killed [18:30:12] ahh [18:30:14] it ate some 20+ gb of ram [18:30:27] i feel the conf may need a little tweak? [18:30:27] syslog ;) [18:30:34] idk [18:30:40] the conf seems ok to me [18:30:43] trim a few GB of ram here and there [18:30:46] rather a bug in maria? :P [18:30:49] lol [18:31:20] addshore, want to help me out with Peachy documentation? [18:31:34] [bz] (NEW - created by: T. Gries, priority: Normal - normal) [Bug 32163] Please list the fingerprint(s) of the server - https://bugzilla.wikimedia.org/show_bug.cgi?id=32163 [18:31:43] Cyberpower678: maybe;p [18:32:00] :/ cant connect to bsql01 Error 1045 [18:32:11] lol [18:32:19] The project namespace is Peachy [18:32:24] some idiot set the sort buffer to 2gb :D [18:32:28] that had to be some petan lol [18:32:36] xD [18:32:52] silly petan [18:32:57] [bz] (RESOLVED - created by: Damian Z, priority: Low - normal) [Bug 40943] Fix the instance types - https://bugzilla.wikimedia.org/show_bug.cgi?id=40943 [18:33:37] [bz] (RESOLVED - created by: Damian Z, priority: Low - normal) [Bug 39792] Labsconsole session is omnipresent - https://bugzilla.wikimedia.org/show_bug.cgi?id=39792 [18:34:51] Warning: There is 1 user waiting for shell: Steinsplitter (waiting 13 minutes) [18:36:09] petan: take a look at https://bugzilla.wikimedia.org/show_bug.cgi?id=45078 [18:36:22] https://wikitech.wikimedia.org/wiki/GiftBot#Dependencies needs to be on the grid instances [18:36:53] and on bots-4 :O [18:41:51] [bz] (RESOLVED - created by: Ryan Lane, priority: Low - normal) [Bug 43508] Run a script to add all members of the shell mediawiki group to the bastion project - https://bugzilla.wikimedia.org/show_bug.cgi?id=43508 [18:43:01] [bz] (RESOLVED - created by: Ryan Lane, priority: Low - normal) [Bug 43650] Switch instance bootstrapping to use salt - https://bugzilla.wikimedia.org/show_bug.cgi?id=43650 [18:43:53] [bz] (NEW - created by: Ryan Lane, priority: Low - normal) [Bug 46821] Add BGP support to Quantum for floating IP addresses - https://bugzilla.wikimedia.org/show_bug.cgi?id=46821 [18:43:57] !log bots petrb: installed fcron to -gs [18:44:00] Logged the message, Master [18:44:19] [bz] (RESOLVED - created by: Ryan Lane, priority: Low - normal) [Bug 46822] Shrink gluster volumes from 4 bricks to 2 bricks - https://bugzilla.wikimedia.org/show_bug.cgi?id=46822 [18:44:33] [bz] (RESOLVED - created by: Ryan Lane, priority: Low - normal) [Bug 44723] Upgrade OpenDJ to 2.5 - https://bugzilla.wikimedia.org/show_bug.cgi?id=44723 [18:46:18] [bz] (RESOLVED - created by: Ryan Lane, priority: Low - normal) [Bug 43649] Disable stored configs on labs puppetmaster - https://bugzilla.wikimedia.org/show_bug.cgi?id=43649 [18:47:24] [bz] (RESOLVED - created by: T. Gries, priority: Low - enhancement) [Bug 45214] When installing instances, starting puppet runs etc.: ping the developer by mail about the status - https://bugzilla.wikimedia.org/show_bug.cgi?id=45214 [18:47:48] squash all the bugs! [18:48:21] Warning: There are 2 users waiting for shell, displaying last 2: Steinsplitter (waiting 27 minutes) Buddhiprabha (waiting 10 minutes) [18:49:01] * ^demon pokes Ryan_Lane [18:49:08] * Ryan_Lane dodges [18:49:41] * ^demon tries again [18:49:45] what's up? [18:49:54] fucking bugzilla is timing out on me :( [18:49:58] <^demon> puppet stuffs. [18:50:22] I have lunch with erik in 10 mins [18:50:29] did you add me as a reviewer? :) [18:50:36] <^demon> Most of them, yeah [18:51:10] <^demon> Now all. [18:51:31] [bz] (RESOLVED - created by: Faidon Liambotis, priority: Normal - normal) [Bug 39784] Labs infrastructure work (tracking) - https://bugzilla.wikimedia.org/show_bug.cgi?id=39784 [18:51:57] [bz] (RESOLVED - created by: Ryan Lane, priority: Unprioritized - normal) [Bug 40030] Split sensitive configuration out of Labsconsole config, and add config to git - https://bugzilla.wikimedia.org/show_bug.cgi?id=40030 [18:51:58] [bz] (RESOLVED - created by: Ryan Lane, priority: Unprioritized - normal) [Bug 40028] Remove the m1.tiny flavor - https://bugzilla.wikimedia.org/show_bug.cgi?id=40028 [18:51:59] [bz] (RESOLVED - created by: Ryan Lane, priority: Unprioritized - normal) [Bug 39783] Move from nfs instance to project storage (the home share) for home directories - https://bugzilla.wikimedia.org/show_bug.cgi?id=39783 [18:52:00] [bz] (RESOLVED - created by: Ryan Lane, priority: Unprioritized - enhancement) [Bug 39781] Add a new openstack network in pmtpa - https://bugzilla.wikimedia.org/show_bug.cgi?id=39781 [18:52:01] [bz] (RESOLVED - created by: Faidon Liambotis, priority: Unprioritized - normal) [Bug 39782] Switch instances to use virtio network adapters - https://bugzilla.wikimedia.org/show_bug.cgi?id=39782 [18:52:02] [bz] (NEW - created by: Ryan Lane, priority: Low - normal) [Bug 40023] Improve ganglia metrics for Labs infrastructure - https://bugzilla.wikimedia.org/show_bug.cgi?id=40023 [18:52:03] [bz] (NEW - created by: Ryan Lane, priority: Low - normal) [Bug 40022] Add nagios checks for all nova, glance, and keystone related services - https://bugzilla.wikimedia.org/show_bug.cgi?id=40022 [18:52:04] [bz] (NEW - created by: Ryan Lane, priority: Low - normal) [Bug 39819] Set project group as default gid for instances in a project - https://bugzilla.wikimedia.org/show_bug.cgi?id=39819 [18:52:05] [bz] (NEW - created by: Faidon Liambotis, priority: Normal - enhancement) [Bug 39789] Add eqiad as a production region - https://bugzilla.wikimedia.org/show_bug.cgi?id=39789 [18:52:06] [bz] (NEW - created by: Ryan Lane, priority: Normal - enhancement) [Bug 39788] Enable passwordless sudo for instances - https://bugzilla.wikimedia.org/show_bug.cgi?id=39788 [18:52:07] [bz] (NEW - created by: Faidon Liambotis, priority: Normal - enhancement) [Bug 39787] Add more network nodes - https://bugzilla.wikimedia.org/show_bug.cgi?id=39787 [18:52:08] [bz] (NEW - created by: Faidon Liambotis, priority: Normal - major) [Bug 39785] Create a labs SMTP smarthost - https://bugzilla.wikimedia.org/show_bug.cgi?id=39785 [18:52:09] [bz] (NEW - created by: Peter Bena, priority: Normal - enhancement) [Bug 35947] Enable ipv6 on labs - https://bugzilla.wikimedia.org/show_bug.cgi?id=35947 [18:52:11] FLOOOOOOOOOOOOOOOOOOOODD [18:52:12] hahaha [18:52:13] spammy [18:52:59] I will not talk in here until you disable this [18:54:12] meeh [18:54:20] meeeh [18:54:24] I guess you need access [18:54:35] oh wait.. xD [18:54:37] it suppress even ¨permission denied¨ :D [18:54:39] addshore, incoming DCC [18:55:10] /DCC Cyberpower678 pr0n [18:55:13] oh wait [18:55:32] I just pushed sumana out :/ [18:55:37] should have not speak of pr0n [18:56:16] addshore, you are the first to receive this copy of Peachy. :) [18:56:36] does ti work? ;p [18:56:42] yes. [18:56:46] what should i write as host to connect to a database at bot-gs? [18:56:58] try bots-bsql01 [18:57:36] addshore, are you going to download it? [18:57:37] I'll try [18:58:14] Cyberpower678: where? :P [18:58:36] Output will be no longer suppressed now [18:58:40] I DCCd it to you. You have to accept the download. [18:58:46] Permission denied [18:58:53] Cyberpower678: i dont do dcc ;p [18:59:02] addshore, oh. [18:59:03] im not even sure irccloud can xD [18:59:08] because he doesn use as cool irc client as I do :D [18:59:14] written in c# [18:59:27] he prefer some shit on web [18:59:27] I use XChat [18:59:37] petan: does your client handle dcc? :P [18:59:46] addshore no, but ssssh [19:00:29] addshore you can implement it :D [19:01:57] Warning: There are 2 users waiting for shell, displaying last 2: Steinsplitter (waiting 40 minutes) Buddhiprabha (waiting 24 minutes) [19:04:17] addshore, http://tools.wmflabs.org/cyberbot/Peachy-Releases/Peachy-2-alpha-2.zip [19:06:00] addshore, does that work? [19:09:19] petan: ... or does not have access - you are right! [19:09:55] petan: I tried to change with chown but get "drtrigon is not allowed to run sudo on i-000000e8. This incident will be reported." ... why that ? [19:10:34] DrTrigon it has been at least 2 months since sudo was revoked from bots project as part of merge with tools [19:10:57] do you really need sudo for that? [19:12:08] petan: "need" no - but untill now this was one of the big advantages over TS... ;)) [19:12:23] yes I know... :/ [19:13:05] so as it is bots4-nr now actually - is it also considered to be stable? also regarding /data/projects? [19:14:25] petan: ^^^ [19:14:59] well... it is scheduled for removal... [19:15:04] as you can read in motd [19:15:09] you should use grid [19:15:27] Warning: There are 2 users waiting for shell, displaying last 2: Steinsplitter (waiting 54 minutes) Buddhiprabha (waiting 37 minutes) [19:15:29] or u mean bots-bnr4? [19:15:40] @labs-resolve bots- [19:15:40] I don't know this instance - aren't you are looking for: I-0000009e (bots-cb), I-000000a9 (bots-1), I-000000af (bots-sql2), I-000000e8 (bots-4), I-0000015e (bots-labs), I-00000190 (bots-dev), I-00000457 (bots-salebot), I-000004fc (bots-apache01), I-00000533 (bots-analytics), [19:15:46] there are many of these [19:15:59] @labs-resolve bots-bn [19:15:59] I don't know this instance - aren't you are looking for: I-0000056f (bots-bnr1), I-00000629 (bots-bnr2), I-00000633 (bots-bnr3), I-00000647 (bots-bnr4), [19:17:15] btw DrTrigon the fact that not everyone has sudo doesnt really mean YOU can not have sudo - it just not given to all by default [19:17:43] there are regular users in bots project and admins, who are volunteers [19:18:12] if one wants to be admin, has knowledge of linux and is trustworthy they can be that [19:18:38] petan: have a look at "ls -la /home/drtrigon/public_html/" in cannot do a chown on the "root" ones ... [19:18:48] ah [19:19:02] I will chown that then [19:19:03] petan: as you like - you kan give me the rights, or I will nag you all the time... ;)) [19:19:13] (cool thanks!) [19:19:57] petan: the grid thing you pointed out before - can you point me to some docu? [19:20:30] !botsdocs [19:20:30] https://wikitech.wikimedia.org/wiki/Nova_Resource:Bots/Documentation [19:20:36] btw chowned [19:22:16] petan: ...and that is related to bots4 or mounts? (as I asked before?) [19:22:45] huh? [19:22:53] what u mean [19:23:18] that documentation is related to whole project [19:23:35] (21:13:04) DrTrigon: so as it is bots4-nr now actually - is it also considered to be stable? also regarding /data/projects? [19:23:35] (21:14:19) mdale [~dale@unaffiliated/mdale] hat den Raum betreten. [19:23:35] (21:14:24) DrTrigon: petan: ^^^ [19:23:36] (21:14:58) mdale hat den Raum verlassen (quit: Client Quit). [19:23:36] (21:14:58) petan: well... it is scheduled for removal... [19:23:36] (21:15:03) petan: as you can read in motd [19:23:36] (21:15:08) petan: you should use grid [19:23:49] that is related to bots-4 [19:24:00] as you can notice all bots-N except for bots-4 are gone [19:24:16] bots-4 will be removed as soon as all bots are gone from it [19:24:43] cu [19:24:55] petan: ...so I have to use bots-gs for login? [19:25:07] you should :P [19:25:13] you don t have to [19:25:30] bots-gs is submit host [19:25:35] you can use it to submit jobs to grid [19:26:01] petan: so but I should not use bots4 - then what is the "right" one? [19:26:22] right one is to submit your jobs using bots-gs [19:26:44] petan: and which one to login for other work? [19:26:58] what you mean by login for other [19:27:25] not everything is "submit jobs" - e.g. setup, testing, ... [19:27:39] setup can be done on bots-gs as well [19:27:41] back [19:27:47] and testing can be done on grid as well [19:27:53] I don t know what testing u mean [19:27:57] addshore, does the link work? [19:28:01] where? ;p [19:28:10] I seeeeee ... ;)) [19:28:12] you set up the bot, then you run it and that is a test at some point :P [19:28:16] yep [19:28:22] addshore, http://tools.wmflabs.org/cyberbot/Peachy-Releases/Peachy-2-alpha-2.zip [19:28:35] Is this supposed to be more or less "the final setup" or will it change again soon ... ;))) [19:29:02] well, this is a final setup, but in future the bots project will be likely considered a staging area for tools project [19:29:02] Warning: There are 2 users waiting for shell, displaying last 2: Steinsplitter (waiting 67 minutes) Buddhiprabha (waiting 51 minutes) [19:29:31] Cyberpower678: works :) [19:29:36] in mysterious future [19:29:49] petan: ...which means...? [19:30:01] however, tools project is even more restricted, so if u don t like the way how sudo doesnt work on bots, you wont like tools either [19:31:03] DrTrigon that means the tools project will be considered the stable production while bots project will be considered a testing environment, I believe both will work though... bots project will be more open and changes will be likely applied there first [19:31:11] if it works, they will go to tools project [19:31:22] tools project is supposed to be conservative and stable [19:31:27] Petan doth speakest sooth. [19:31:34] Yes for sure - in fact I am fine with that, as long as you do the install I need... ;) What I do not like at TS at the moment is the stability - but that might be related to money and politics... :))) [19:31:36] sooth? my english suck [19:32:24] petan: Truth. Very obsolete dialect, near-Elizabethan. You weren't expected to know it. :-) [19:32:29] DrTrigon that is actually related to number of sysadmins IMHO [19:32:46] Coren ok tell us the truth then :P [19:32:49] Cyberpower678: do you have any documentation yet? :P [19:32:56] no [19:32:59] petan: I said you /did/ speak it already. :-) [19:33:07] That's why I need help. :p [19:33:13] ah [19:33:25] I thought its petan doesnt speak truth :P [19:33:27] addshore, I just set up the Wiki. [19:34:04] And X! deleted all of his earlier documentation. [19:34:22] petan: I asked my questions because I'd like to find out how (the hell ;) I have to setup my bots here in order not to hvae to re-setup them all x months ... ;)) [19:34:49] addshore, I would recommend starting a Getting Started page [19:34:55] heh [19:35:14] DrTrigon I understand that ;) hopefully this setup will stay for some time [19:35:36] (to be honest I had to once until now... so it's not that worse... ;) [19:35:43] I am definitely not trying to force people to resetup their bots, that is why bots-4 still works [19:35:57] cool! thanks! ;)) [19:36:29] I know the pain of changing stuff that works for silly reason... have to face that every day in my work [19:36:52] pecan, really? like what? [19:36:59] we got systems with uptime of several years... everytime someone want to install some patch there, I am having nightmares [19:37:36] ;))))) [19:37:52] shutting down server with uptime 800+ days is easy, but getting it up is worse [19:38:16] Most of the time one way is easy... :) [19:38:37] pecan, Why is starting up a server with a tremendous uptime so difficult? [19:38:44] at least that's what entropy says... [19:38:45] some clustered db is hard to shutdown as well :P [19:39:30] petan, ^^^ [19:39:40] ...so I will go and study the new docu and start migrating - when I run into problems I will come to knock on your door... ;)) [19:40:01] petan: btw. are the same packages installed on bots-gs as on bots4 ? [19:40:07] Cyberpower678 heh the most simple reason is that all people who were there when the box was starting up, are already not employed here :D so nobody really knows if the documentaton how to start it up is correct [19:41:03] then of course, not all services are starting up smoothly always [19:41:19] petan, what is your primary language? [19:41:48] hm... Czech but I work for American company, so I am kind of speaking english on workplace [19:42:03] I see. [19:42:04] :p [19:42:33] Warning: There are 2 users waiting for shell, displaying last 2: Steinsplitter (waiting 81 minutes) Buddhiprabha (waiting 64 minutes) [19:43:56] DrTrigon not same, there are more of them on bots-gs actually, but you should be interested in execution nodes because that is where your bot will run [19:44:06] these contains all packages that were on bots-4 + some more [19:45:02] petan: good to hear! a last question again regarding the storage; which shall I use? projects? [19:45:26] probably /data/project/userdata is fine but... it is gluster [19:45:36] if it is small, I would go for /mnt/secure [19:45:46] that is nfs, but only like 20gb [19:46:29] gluster works most of time;) [19:46:37] just sometimes it doesnt :P [19:46:48] petan: I need something to install my bot into and with about lets say max 1GB... [19:47:01] ...and backup [19:47:04] ;))) [19:47:10] backup should be ok on gluster [19:47:24] because it never looses data, it just isnt accessible randomly [19:47:39] nfs is always on or since I installed it it was [19:48:01] you can use either of these 2 storages, but just keep at least 2gb of free space on nfs... [19:49:16] ...ok so I will stay with /data/project/DrTrigonBot ... (for the moment... ;))) thanks for your help!! (why 2gb free? for moving stuff around or internal usage or ...?) [19:50:25] small but important files are being created there and 2gb is a good reserve [19:50:45] like I wouldnt sleep well if there were just 20mb free :P [19:50:50] but it would probably work [19:56:10] Warning: There are 2 users waiting for shell, displaying last 2: Steinsplitter (waiting 94 minutes) Buddhiprabha (waiting 78 minutes) [20:00:09] * Damianz eyes gries for spamming him [20:00:16] Also lol for year old bugs we fixed [20:00:41] addshore, how's the framework working out so far? [20:09:36] Warning: There are 2 users waiting for shell, displaying last 2: Steinsplitter (waiting 108 minutes) Buddhiprabha (waiting 91 minutes) [20:23:10] Warning: There are 2 users waiting for shell, displaying last 2: Steinsplitter (waiting 121 minutes) Buddhiprabha (waiting 105 minutes) [20:34:59] Change abandoned: Ottomata; "Mmk, I'm going to use sandboxes for now." [operations/puppet] (refs/meta/config) - https://gerrit.wikimedia.org/r/59162 [20:36:46] Warning: There are 3 users waiting for shell, displaying last 3: Steinsplitter (waiting 135 minutes) Buddhiprabha (waiting 119 minutes) Kiran mathew koshy 1993 (waiting 5 minutes) [20:50:21] Warning: There are 3 users waiting for shell, displaying last 3: Steinsplitter (waiting 149 minutes) Buddhiprabha (waiting 132 minutes) Kiran mathew koshy 1993 (waiting 18 minutes) [21:03:47] Warning: There are 3 users waiting for shell, displaying last 3: Steinsplitter (waiting 162 minutes) Buddhiprabha (waiting 146 minutes) Kiran mathew koshy 1993 (waiting 32 minutes) [21:17:04] She sells seashells down by the addshore. [21:17:10] Warning: There are 3 users waiting for shell, displaying last 3: Steinsplitter (waiting 175 minutes) Buddhiprabha (waiting 159 minutes) Kiran mathew koshy 1993 (waiting 45 minutes) [21:30:36] Warning: There are 3 users waiting for shell, displaying last 3: Steinsplitter (waiting 189 minutes) Buddhiprabha (waiting 172 minutes) Kiran mathew koshy 1993 (waiting 59 minutes) [21:44:07] Warning: There are 3 users waiting for shell, displaying last 3: Steinsplitter (waiting 202 minutes) Buddhiprabha (waiting 186 minutes) Kiran mathew koshy 1993 (waiting 72 minutes) [21:57:38] Warning: There are 3 users waiting for shell, displaying last 3: Steinsplitter (waiting 216 minutes) Buddhiprabha (waiting 199 minutes) Kiran mathew koshy 1993 (waiting 86 minutes) [22:11:00] Warning: There are 3 users waiting for shell, displaying last 3: Steinsplitter (waiting 229 minutes) Buddhiprabha (waiting 213 minutes) Kiran mathew koshy 1993 (waiting 99 minutes) [22:24:27] Warning: There are 3 users waiting for shell, displaying last 3: Steinsplitter (waiting 243 minutes) Buddhiprabha (waiting 226 minutes) Kiran mathew koshy 1993 (waiting 113 minutes) [22:24:33] addshore, have you had the chance to look at the code? [22:37:59] Warning: There are 3 users waiting for shell, displaying last 3: Steinsplitter (waiting 256 minutes) Buddhiprabha (waiting 240 minutes) Kiran mathew koshy 1993 (waiting 126 minutes) [22:51:26] Warning: There are 3 users waiting for shell, displaying last 3: Steinsplitter (waiting 270 minutes) Buddhiprabha (waiting 253 minutes) Kiran mathew koshy 1993 (waiting 139 minutes) [23:04:51] Warning: There are 3 users waiting for shell, displaying last 3: Steinsplitter (waiting 283 minutes) Buddhiprabha (waiting 267 minutes) Kiran mathew koshy 1993 (waiting 153 minutes) [23:18:22] Warning: There are 3 users waiting for shell, displaying last 3: Steinsplitter (waiting 297 minutes) Buddhiprabha (waiting 280 minutes) Kiran mathew koshy 1993 (waiting 166 minutes) [23:31:55] Warning: There are 3 users waiting for shell, displaying last 3: Steinsplitter (waiting 310 minutes) Buddhiprabha (waiting 294 minutes) Kiran mathew koshy 1993 (waiting 180 minutes) [23:45:21] Warning: There are 3 users waiting for shell, displaying last 3: Steinsplitter (waiting 324 minutes) Buddhiprabha (waiting 307 minutes) Kiran mathew koshy 1993 (waiting 193 minutes) [23:58:43] Warning: There is 1 user waiting for shell: Steinsplitter (waiting 337 minutes)