[02:10:03] hey everyone, can an admin please run "sudo chmod 777 /home/vacation9/VoxelBot/logininfo.pyc" for me [02:10:07] on bots-4 [02:10:15] since we don't have root any more [02:10:23] actually, just chown'ing it would work [02:11:06] but i'm obviously not a labs admin :) [02:11:33] true [02:12:00] sudo chown vacation9 /home/vacation9/VoxelBot/logininfo.pyc on bots-4 if any labs admins are here [02:12:33] Gimme a sec. [02:12:44] You're lucky I was walking in front of the screen right that moment. :-) [02:13:51] Coren|Sleep: heh... thanks [02:14:12] ... if bots-4 lets me in. It was slow. [02:14:19] {{done}} [02:14:37] thanks you :) [02:14:45] * Coren|Sleep goes back to idle. [05:35:51] * legoktm hugs Coren|Sleep  [06:06:23] Coren|Sleep pong [06:16:44] Ryan_Lane: hi [08:08:26] !log account-creation-assistance updated packages on all instances [08:08:29] Logged the message, Master [09:13:12] * addshore pangs Coren|Sleep [09:16:37] addshore ping [09:16:44] I created qdeploy tol [09:16:46] tool [09:16:54] it install packages across cluster [09:17:03] so you can use it to install some package on all servers [09:17:18] @notify ceradon [09:17:18] I will notify you, when I see ceradon around here [09:17:41] @notify Coren [09:17:41] I will notify you, when I see Coren around here [09:20:05] oh cool [09:49:16] !botsgrif [09:49:18] !botsgrid [09:49:28] !gridb [09:49:28] http://helms-deep.cable.nu/~rwh/blog/?p=159 [09:54:39] !log bots petrb: created new queue for irc bots [09:54:43] Logged the message, Master [09:59:22] @notify addshore [09:59:22] This user is now online in #huggle so I will let you know when they show some activity (talk etc) [10:22:16] @notify andrewbogott_afk [10:22:16] This user is now online in #wikimedia-labs so I will let you know when they show some activity (talk etc) [10:25:35] wtf addshore o.O [10:28:37] ? [10:28:54] mhm it seems that qsub randomly submit jobs to any queue [10:29:01] I thought that there is default queue [10:29:04] main.q [10:29:22] some of addshore jobs were submitted to minimalload [10:29:33] What's the difference between the queues? [10:29:51] minimalload is for irc bots - it contains server where should be almost no load [10:30:06] it's for interactive bots [10:30:17] which need to respond quickly and not be affected by system load at all [10:31:41] This should be documented somewhere (is it already ?) [10:31:55] Ah, lunchtime. [10:32:10] I am setting that queue up now [10:32:13] will document it once it works [10:36:01] !log bots petrb: changed addshore's cron so that it does not affect minimal server [10:36:04] Logged the message, Master [10:37:40] petan i know how to fix that [10:37:52] there is a setting somehwere ;p [10:38:22] but qsub by itself should be fine... you can select the queues for qsub to use as default [10:38:31] currently it just uses the whole list of queues [12:10:27] addaway how? [12:10:30] @notify addaway [12:10:30] This user is now online in #huggle so I will let you know when they show some activity (talk etc) [12:10:39] not sure :P [12:10:56] i saw it when i was looking through everything the other day [12:10:57] ok [12:11:03] I couldn't find it [12:31:43] !log bots petrb: qdeploy python-irclib [12:31:45] Logged the message, Master [13:07:23] legoktm ping [13:07:28] pong [13:07:36] there is something of you [13:07:39] running on bots-3 [13:07:44] yes [13:07:47] my cron is on there [13:07:48] is it possible to move that to grid? [13:07:51] ergh [13:07:55] i need to do that [13:08:00] ok, no rush [13:10:14] @seenrx [Mm]ad[mM]an [13:10:14] petan: Last time I saw RogueMadman they were quitting the network with reason: no reason was given at 11/17/2012 6:21:49 AM (118.06:48:25.1352900 ago) (multiple results were found: RogueMadman|2, AMadman, AMadman[food], AMadman[nap], AMadman[cranky|c and 3 more results) [13:10:37] @seenrx madman [13:10:37] petan: I have never seen madman [13:10:46] @seenrx ^[Mm]ad[mM]an$ [13:10:47] petan: I have never seen ^[Mm]ad[mM]an$ [13:10:56] 118 days... that's a while [13:11:03] He's usually AMadman [13:11:09] @seenrx ^A[Mm]ad[mM]an$ [13:11:09] petan: Last time I saw AMadman they were quitting the network with reason: Ping timeout: 276 seconds at 3/7/2013 1:16:51 AM (8.11:54:17.4018660 ago) [13:11:10] @seen amadman [13:11:10] legoktm: Last time I saw amadman they were quitting the network with reason: Ping timeout: 276 seconds N/A at 3/7/2013 1:16:51 AM (8.11:54:18.1109390 ago) [13:11:21] @notify amadman [13:11:21] I will notify you, when I see amadman around here [13:12:29] you two guys are each having 1 job on bots-2 and bots-3 :P [13:12:45] which is only reason why we still have them :D [13:14:28] o.O [13:14:34] well it shouldnt be too hard to move them [13:15:00] addshore I created queue for irc [13:15:02] can OG access stuff in my homedir? [13:15:08] but I didn't find a single bot to move there :D [13:15:27] legoktm OG can't but YOUR user which is running the task through OG can [13:15:39] so if you qsub a job, that job will have access there [13:15:42] so…. [13:15:42] ok [13:15:45] er wait [13:15:59] should be the same if my crontab qsub's it right? [13:16:12] and did the "qcronsub" thing ever get set up? [13:16:15] your crontab has access to your home as well [13:16:21] I am working on it [13:16:36] problem is that the script in mail isn't complete and I wasn't told what is purpose of that [13:16:51] have you talked to Merlissimo? [13:17:04] I already wrote a script which check if a job is already running, it's a 2 line script, so... [13:17:10] no I didn't, I don't know who he is [13:17:19] neither where he is [13:18:40] well he's in this channel :P [13:18:48] Merlissimo ping [13:18:57] @notify Merlissimo [13:18:57] This user is now online in #wikimedia-tech so I will let you know when they show some activity (talk etc) [13:19:00] :P [13:33:58] :O [13:34:41] !log deployment-prep -squid shows a ton of stalled `redirector` processes. Killed them all. [13:34:43] Logged the message, Master [13:38:14] !log deployment-prep -squid ran puppet manually which deployed the new redirector from https://gerrit.wikimedia.org/r/53935 [13:38:16] Logged the message, Master [13:39:11] !log deployment-prep -squid started puppet service [13:39:13] Logged the message, Master [13:39:18] !deployment-prep -squid restarting squid [13:39:18] deployment-prep is a project to test mediawiki at beta.wmflabs.org before putting it to prod [13:41:03] !log deployment-prep -squid killed nrpe and restarted it (just to be sure) [13:41:07] Logged the message, Master [13:45:53] Coren hey [13:45:55] you wanted me [13:46:07] I will again, in about 15. :-) [13:46:11] k [13:46:42] !log wikidata-dev wikidata-dev-9: Installed Scribunto extension on dev client [13:46:46] Logged the message, Master [13:46:50] addshore ping [13:47:06] we have 3 irc bots and I failed to move all of them [13:47:18] they are too complex for grid :/ [13:47:36] too complex? [13:47:39] yes [13:47:53] one of them needs to listen on static IP address [13:48:05] second one is debianized as system service using data in local etc [13:48:11] third is just too complex :D [14:03:03] hey andrewbogott [14:03:17] do you think it's possible to rewrite labs-morebots so that it doesn't run as a service? [14:03:26] Sorry for the delay; some bozo was attempting to DOS my SIP. [14:03:27] so that it can be run from grid [14:03:41] people DoSing my boxes every week :P [14:04:04] btw there was a good blacklist somewhere [14:04:12] but it banned like half of planet [14:04:22] at least whole asia [14:04:29] There are several, but eagle830.startdedicated.com. seems like some bozo got a vps. [14:04:37] :/ [14:10:12] petan: hi. [14:10:40] Yes, it would be possible. I don't think we've decided where the official wikitech bot should live yet... [14:10:49] making that decision will largely dictate how it should be designed. [14:11:09] ok [14:11:20] I wanted to move current morebots but it doesn't seem to be possible :/ [14:11:50] Yeah, it's pretty entrenched as it is now. [14:12:12] Hm… I presume there's a way to run bots on the grid engine while still keeping things like passwords moderately secure? [14:12:34] andrewbogott: Yes to both grid architectures. :-) [14:12:48] (Through different means) [14:13:14] OK. petan, I'll make a note to review the morebot setup again… meanwhile probably best to just ignore those instances if that's OK [14:13:28] petan: pm check? :-) [14:18:49] !log wikidata-dev wikidata-dev-9: I had the same non-responsiveness again that we saw on Wednesday during demo time. Restarting apache helped again, though this time the server was idling around while last time apache was causing high load. Hm.... [14:18:51] Logged the message, Master [14:25:34] petan: going for lunch, also what does the i stand for in ibnr? [14:27:07] addshore interactive [14:27:20] that mean - interactive bots run there :P [14:27:40] (bots that needs to interact fast) [14:27:55] :) [14:28:08] I couldn't think of anything better :D [14:28:33] i would have just gone for nr1 ;p as its smaller also ;p [14:28:55] yes I was thinking the same, but some people might confuse it with previous nr1 which was for something else [14:29:14] "ib" stands for interactive bots while "b" is just big :D [14:29:25] haha [14:29:46] ahh xD [14:42:43] btw addshore what irc client are you using [14:42:46] :D [16:46:36] LOL [16:46:46] addshore once you figure out how to set up a default queue let me know [16:47:04] otherwise minimal become maximal soon [16:49:27] queue instance "minimalload@bots-ibnr1.pmtpa.wmflabs" dropped because it is overloaded: np_load_avg=1.010000 [16:49:31] :D [17:24:46] Coren: Are there different queues for SGE on Tools Labs? [17:25:07] Because the Toolserver has a queue for long time jobs and for short jobs [17:25:24] Jan_Luca: There are two at the moment, a "normal" one 'task' and another for long-running and continuous jobs 'continuous' [17:31:39] haha petan we will fix it :P [17:33:46] Hi guys! Can be installed git-review on bastion1? [17:35:28] Or which instance is better for submit patches on gerrit [17:35:43] beta16: For Mediawiki? [17:36:09] for an extension [17:36:22] Scribunto [17:36:50] beta16: Why you need a Labs instance and not use your own PC? [17:37:23] I think it is easier when you have not only a command line [17:39:37] beta16, um... you have a git repository on bastion? [17:40:21] I read Help:Git on wikimedia labs wiki, so I think that I can use labs [17:40:43] yes [17:40:49] but you shouldn't be doing stuff like that on bastion I don't think [17:41:33] In fact, I asked if another instance is better [17:42:01] beta16: You can request a project for this extension or use maybe mediawiki-dev project [17:43:35] ok, thanks Jan_Luca [17:43:47] for now i do in my pc. If continue I ask for a dedicated project [17:45:21] [bz] (NEW - created by: Chris McMahon, priority: Unprioritized - normal) [Bug 46166] Move automated browser tests from test2wiki to beta labs (tracking) - https://bugzilla.wikimedia.org/show_bug.cgi?id=46166 [17:46:21] [bz] (ASSIGNED - created by: Antoine "hashar" Musso, priority: Immediate - normal) [Bug 45084] autoupdate the databases! - https://bugzilla.wikimedia.org/show_bug.cgi?id=45084 [17:57:33] Coren: An idea: Could you add a wrapper around sudo -iu with the as parameter and not local-, e.g. "become "? [17:58:08] Jan_Luca: That... is surprisingly simple. :-) [17:58:31] Coren: But it reduce the confusion of new users :-) [18:06:42] Jan_Luca: {{done}} [18:06:59] Coren: The name is ? [18:07:05] Jan_Luca: 'become' [18:07:10] ok [18:07:16] Jan_Luca: Why mess with a good idea when it's a good idea? :-) [18:07:39] Coren: The idea is from Toolserver [18:07:52] Jan_Luca: Still a good idea. :_0 [18:07:52] for the MMP [18:08:14] Coren: That's right :-) [18:09:25] become also (a) checks that it's actually the name of a tool and (b) doesn't confusingly ask for a password if you're not allowed. [18:11:24] Coren: Can you install php5-cli on login and the submit hosts? [18:12:02] huh. Didn't even notice it wasn't there. [18:12:17] "The program 'php' is currently not installed. To run 'php' please ask your administrator to install the package 'php5-cli'" [18:12:52] No, I believe you, I'm just confused it's not already there. That's, like, one of the first things I install usually. :-) [18:13:26] Coren: There should be a puppet class for this ;-) [18:14:26] Yes, there should. I'm working on them, but the current cycle to get the +2 on the git review would destroy any semblance of responsiveness on my part while I'm still early in the setup. [18:14:38] Hence my taking notes whenever I make a change like this. :-) [18:14:40] Coren: I have created one... [18:16:21] Oh right... It was never merged... (https://gerrit.wikimedia.org/r/#/c/29975) [18:19:06] Coren: Do you already have a change for your puppet classes? When yes, I could review them [18:19:53] Jan_Luca: There is, but just a skeleton while I repackage some pips. [18:21:22] Coren: Now php5-cli is installed but php-mysql not... ;-) [18:21:51] Coren: Repackage = to .debs? [18:22:02] scfc_de: Aye. [18:22:38] Jan_Luca: I don't know what you're talking about. php5-mysql appears to be installed. Mysteriously. :-) [18:23:11] Coren: Now it is ... [18:23:44] Jan_Luca: How... mysterious. :-) [18:24:28] Coren: If your assembly line is running smoothly, you could add oursql and wikitools (abandoned ITP: http://bugs.debian.org/cgi-bin/bugreport.cgi?bug=594130) to your queue :-). [18:25:18] (Debian Policy is tedious compared to Fedora.) [18:25:29] oursql is already on my list of pips to debianize, so is a more recent version of requests [18:26:07] Change on 12mediawiki a page Wikimedia Labs/Tool Labs/Needed Toolserver features was modified, changed by Beta16 link https://www.mediawiki.org/w/index.php?diff=660225 edit summary: [+128] /* Database */ [18:26:26] Jan_Luca: Speaking of user-friendly, I now have a better way to start grid jobs (that includes qcronsub-like functionality): jsub [18:28:45] Coren: When you have some debs done, please drop a note (duplication of efforts :-)). [18:28:58] scfc_de: Ayup. [18:29:12] scfc_de: I'll have the pushed to the labs repo too. [18:29:43] Coren: Past, present, future, what? :-) [18:29:54] scfc_de: future. :-) [18:30:12] scfc_de: I.e.: as soon as they are tested. [18:30:55] Coren: The labs repo is enabled on all projects? [18:31:52] scfc_de: I think it is by default. [18:31:57] Coren: libgcc_s.so.1 must be installed for pthread_cancel to work [18:32:09] The first try of jsub :-( [18:32:16] o_O? [18:32:30] jsub works for me. That error message is... strange. [18:32:52] Wait, did you get that from your job in the .err file? [18:32:58] yes [18:33:17] Ah. Jsub worked, but your actual job didn't. [18:33:35] When call the script directly it works [18:33:55] o_O [18:34:35] -rw-r--r-- 1 root root 88384 Apr 15 2012 /lib/x86_64-linux-gnu/libgcc_s.so.1 [18:34:37] mlitn: https://github.com/MrMEEE/bumblebee-Old-and-abbandoned/commit/a047be85247755cdbe0acce6f1dafc8beb84f2ac#diff-1 [18:34:48] Probably the best single-character bug ever [18:34:59] ouch [18:35:05] wow that's harsh [18:35:34] That... ow! [18:35:57] Jan_Luca: Oh, wait, how much memory does that code of yours eat up? :-) [18:36:00] I of course meant to send that to -tech [18:36:02] Coren: do you think you can "install" the software described in https://wikitech.wikimedia.org/wiki/GiftBot#Dependencies on tools in a reasonable timeframe? [18:36:04] But irssi had other ideas :P [18:36:38] giftpflanze: 'fcron'? Whyfor? [18:36:44] Coren: I don't know, I have to show [18:36:58] Coren: i need timezone enabled cron, that's all [18:37:11] FastLizard4: I think that would have warranted to bump the major version :-). [18:37:22] scfc_de: Hehe, ikr [18:37:23] i haven't found it in the used distributions [18:37:30] giftpflanze: That's a breaking change, possibly, so I have to look into it before I can answer you. Can you open a bz for it, please? [18:37:38] Bugfix: Installing won't destroy operating system [18:37:40] :P [18:37:52] mh [18:38:03] Jan_Luca: Try to jsub with, say, '-m 1g' [18:38:39] Coren: is it better to backport cron or to install fcron? [18:38:52] BTW, fcron was (at least for quite some time) rather unmaintained. I think making it work with cronie should be much better. [18:39:44] giftpflanze: I don't know yet, that's why I need to look into it. Open a bz with your actual requirement and the fcron suggestion, and I'll try out and examine alternatives on a throwaway VM to find the best solution. [18:39:59] ok, thx [18:40:11] what about the tcl8.6 branch? [18:40:23] giftpflanze: That shouldn't pose a major issue. [18:40:32] ok :) [18:40:53] what about time deadline? [18:40:56] I think I could use the one from Raring. [18:41:12] what's Raring? [18:41:16] giftpflanze: Depending on the cron issue, I can probably have this all up for you sometime next week. [18:41:35] giftpflanze: the 13.04 release of Ubuntu. [18:41:44] oh, i forgot … [18:41:48] Coren: Now it works [18:42:01] What's the problem [18:42:23] Jan_Luca: The default maximum memory usage is a bit conservative. :-) [18:42:39] Jan_Luca: Once your job is done, you can use qacct to see how much memory it actually needed. [18:43:25] ... if accounting worked, which I haven't yet tested. [18:43:27] :-/ [18:44:01] Ah. Doesn't work from random submit hosts, only from the queue master. I'll write a wrapper for it. [18:44:05] Coren: /var/lib/gridengine/default/common/accounting: No such file or directory [18:44:26] Jan_Luca: What was your job number? [18:44:41] 102 [18:44:47] or name "linky" [18:46:22] giftpflanze: If the requirement for fcron is only the time zone bit, I think it's much easier to schedule your jobs for hours 22,23 and then test in your script if it is hour 0 in :Europe/Berlin. [18:46:59] scfc_de: true, but i want to avoid that [18:47:03] Jan_Luca: maxvmem 140.641M [18:47:03] Jan_Luca: the default max is 128M :-) [18:47:35] i'm not responsible for ubuntu being so super-stable ;) [18:47:39] Coren: The most of this is php [18:47:43] itself [18:48:11] Jan_Luca: Hm. good point, php has a fairly large footprint. I'll bump the default up to 256M [18:48:21] Since there'll be a lot of small php stuff [18:48:57] … and not keen on reinventing the wheel [18:48:58] Jan_Luca: Should work now with no need to -m [18:49:07] Ok I test it [18:50:20] * Coren is not entirely surprised that php doesn't deal well with ulimits [18:50:45] For some stupid reason, error checking has never been a forte of the php devs. [18:51:24] Coren: Waiting for immediate job to be scheduled. [18:51:24] Your qsub request could not be scheduled, try again later. [18:51:41] Jan_Luca: Did you try a continuous job? [18:51:43] giftpflanze: Last time I looked, fcron didn't work with SELinux enabled, and for a system daemon that's usually not a good sign. [18:51:48] yes [18:52:01] Jan_Luca: Hm. From your /tool/ account? [18:52:05] yes [18:52:40] Damn. I know why it did that. Silly -now semantics. Gimme a sec [18:53:02] Jan_Luca: You should be able to do it now. [18:53:09] A moment please [18:53:29] Jan_Luca: I tried something to make it less strange for users, but it doesn't quite work like I would have hoped. [18:54:12] Jan_Luca: Undocumented feature: non-tool users cannot run continuous tasks. There is no message, your job will just sit forever quietly in queue and never run. [18:54:22] scfc_de: i don't require it, it just was the only tz one easily available on bots before it was broken (although i like some details of fcrontab(5) :)) [18:54:28] Jan_Luca: I'll find a workaround to tell the user why it's not working. [18:55:06] Coren: Now it works but when using -once there is no error when tring to queue it a second time [18:55:24] ... really? [18:55:36] yes [18:55:36] Does it actually start? [18:56:05] Because, by default, the error will have been put in the .err file, not on the console. :-) [18:56:06] Coren: Uups, there error is in the .err file [18:56:51] Jan_Luca: Yeah, that's because the typical use of -once is from cron, and you (a) don't want email spam and (b) want to have a trace that it failed. :-) [18:57:09] (You can add -stderr if you want to see the fail on console) [18:57:30] Coren: But why is the output of "echo ...;" in the .err file and not in the .out one? [18:57:48] Do you use "-j y"? [18:58:36] Jan_Luca: Not by default - but if you're talking about the echo /in the script/, notice the >&2 at the end. :-) [18:58:57] It's an error message, so I send it to stderr. :-) [18:59:40] Wait, no it isn't. [18:59:41] Hm [18:59:55] Coren: PHP's echo is a error message? [19:00:02] Oh! php's [19:00:14] Oh. No. I see the bug now. [19:00:50] Coren: In jsub there is the line: '-a' => 1, '-b' => 1, '-cwd' => 0, '-e' => 1, '-hard' => 0, '-i' => 1, !!!! '-j' => 1, !!!! [19:00:51] Fixed. Future jobs won't mix output with input. I used the wrong default if you didn't use an explicit -o option. [19:01:23] Jan_Luca: Yes, that line is there. Why? :-0 [19:01:44] I mean the "'-j' => 1" [19:01:58] this seems to set -j to true [19:02:12] Jan_Luca: Ah. You misunderstand; that is the list of /allowed/ qsub options. :-) [19:02:24] The 1 means 'takes argument' [19:02:40] OK [19:03:04] There was a bug where I accidentally set -o to the error file if you didn't specify one manually. That's been fixed now. [19:03:29] So future jobs won't mix output and error. [19:06:35] Coren: Now it's goog [19:06:54] good [19:08:03] Yeay! [19:08:28] BTW: Other shortcut: [19:08:35] job [19:08:56] Give the job number if that job is running [19:09:05] job -v is the human readable version [19:09:36] Coren: On Toolserver, a major hassle was PATHs being different in interactive and cron environments. cron sets PATH to /usr/bin:/bin, so it would be nice if your scripts - properly packaged :-) - would be installed to /usr/bin. [19:10:43] scfc_de: That breaks the FHS [19:11:07] Coren: Why? [19:13:02] scfc_de: Machine-local stuff is supposed to always be under /usr/local. Though I admit I'm probably more anal than most about the FHS. :-) [19:14:18] * Coren is the kind of dude that makes the careful distinction between /var/spool, /var/run and /var/cache :-) [19:16:37] Coren: Well, the FHS just says "The /usr/local hierarchy is for use by the system administrator when installing software locally." That fits *all* installed software :-), and for example SGE is installed in /usr/bin (and if you can live with log files in $HOME - *brrr* - I don't think you're that anal :-)). [19:19:47] scfc_de: What makes you think that I don't abhor the stupid SGE log file stupidity? :-) [19:20:12] * Coren needs to afk for a bit. BBL [19:21:09] scfc_de: But, honestly, you should /never/ rely on $PATH in a crontab. [19:32:42] Coren: The location is configurable in SGE, and *you* put the httpd logs there as well :-). The problem on Toolserver was (and is) that the interactive PATH changed from time to time and on Solaris included for example version numbers of various packages. So I think it is very useful to have all programs in /usr/bin as that PATH will be in crontab and will not need to be updated anytime (or update cronie to include /usr/local/bin in [19:32:42] PATH). [19:34:11] scfc_de: Yeah, I'm not sure I don't prefer making sure that cronie knows about /usr/local/bin instead, but I'll think about it and see if I can do something elegant yet simple. :-) [19:34:22] And now, I leave for real [19:35:11] Okay :-). [19:43:14] * Damianz reads 'it would actually be nice if we had a cPanel or Webmin setup ' and stabs a kitten [19:57:12] [bz] (NEW - created by: m.p.roppelt, priority: Unprioritized - normal) [Bug 46170] Evaluate installing timezone aware cron - https://bugzilla.wikimedia.org/show_bug.cgi?id=46170 [19:57:13] [bz] (NEW - created by: Chris McMahon, priority: High - normal) [Bug 46166] Add automated browser tests to beta labs (tracking) - https://bugzilla.wikimedia.org/show_bug.cgi?id=46166 [20:22:39] Coren|AFK: drdee: did you hear where the next pycon is? hint: very short commute :) [20:24:04] wtf is hashar doing in topic [20:24:24] that was a while ago [20:24:36] I need to make wm-bot log topic [20:24:37] and if you read the topic so much then you should have seen it earlier!! [20:24:38] :D [20:24:47] what was there [20:25:05] (petan was saying he reads it often) [20:25:22] I didn't say that [20:25:24] but I don't have backlog [20:25:27] I restarted bnc [20:25:29] :/ [20:25:37] because of lmao bug [20:25:43] 15 19:55:38 < petan> at least I am reading them when i join :P [20:25:54] I created a perfect constructor :D [20:26:09] * jeremyb_ runs away [20:26:13] jeremyb_ yes but usually I am not joining [20:26:18] because I am idle for days [20:26:39] 15 15:21:38 -!- petan [~pidgeon@wikimedia/Petrb] has quit [Remote host closed the connection] [20:26:45] indeed [20:26:47] 15 15:21:38 -!- petan [~pidgeon@wikimedia/Petrb] has quit [Remote host closed the connection] [20:26:51] gah [20:26:58] 15 19:03:10 -!- petan [~pidgeon@wikimedia/Petrb] has quit [Read error: Connection reset by peer] [20:26:59] I said I made a funny bug [20:27:01] that's better [20:27:06] today [20:27:08] so I had to [20:27:09] fix it [20:27:42] I am working on teh irc client all day [20:28:08] !hashar [20:28:08] [10:15:12] !log WMFLabs seems to have recovered now [20:28:17] o.- [20:28:31] ? [20:28:40] I was attempting to say hi [20:28:41] :D [20:29:44] * Damianz pats hashar hi [20:29:51] harshkothari: eh? was there some issue? [20:30:07] whoops [20:30:09] wrong person [20:30:14] hashar: was there some labs issue? [20:30:17] Ryan_Lane: no problem :) [20:30:25] harshkothari: :) [20:30:35] Ryan_Lane: not that I known off. I have been mostly working on breaking the contint website though [20:30:57] and I wasn't connected this morning [20:30:58] oh. I was just noticing the message that popped up from you [20:31:08] maybe that was really old, then? [20:31:16] petan: your bot causes confusion ;) [20:31:24] my bot? [20:31:40] !hashar [20:31:40] [10:15:12] !log WMFLabs seems to have recovered now [20:31:46] oh that :D [20:31:49] why would it say that? [20:31:52] !hashar del [20:31:53] Successfully removed hashar [20:31:54] when is that log message from? [20:31:56] I don't remember [20:31:57] oh [20:31:58] hahaha [20:32:03] ... [20:32:03] but it's very old [20:32:07] * Ryan_Lane nods [20:32:08] from days where labs began [20:32:12] * when [20:32:22] however I could have tell you the date if I didn't delete it lol [20:32:24] I remember those dark days [20:33:21] yes, Damianz I think there was a storm and all that, but then the light appeared and all these [20:33:25] you know [20:33:27] when we still used gluster for instance storage? :) [20:33:35] Oh yes [20:33:38] * Ryan_Lane shudders [20:33:51] Those days when a split brain meant turning off everything [20:33:57] :D [20:34:11] unicorn split [20:37:26] WIN, I ordered a medium pizza and got a large... though I'm not really that hungry [20:43:05] Damianz: you should create a pizza labs project for that .. https://github.com/coryarcangel/Pizza-Party-0.1.b/ ;) [20:43:30] =D [21:16:59] addaway [21:25:32] [bz] (NEW - created by: Ryan Lane, priority: Unprioritized - normal) [Bug 46175] Have a short link to the signup page - https://bugzilla.wikimedia.org/show_bug.cgi?id=46175 [21:31:13] Change on 12mediawiki a page Wikimedia Labs/Account creation improvement project was modified, changed by Ryan lane link https://www.mediawiki.org/w/index.php?diff=660260 edit summary: [+106] /* Current account creation process */ [21:36:35] !log voxelbot could you check for cronspam from python: can't open file '/data/project/voxelbot/VandalismInformation/bot.py': [Errno 2] No such file or directory .. thanks [21:36:35] voxelbot is not a valid project. [21:36:51] hmm , i thought so because it was in /data/project/voxelbot/ [21:43:18] Ryan_Lane: https://wikitech.wikimedia.org/w/index.php?title=User:Dzahn/feed-test&action=edit [21:44:12] !log bots Fox_Wilson/voxelbot could you check for cronspam from python: can't open file '/data/project/voxelbot/VandalismInformation/bot.py': [Errno 2] No such file or directory .. thanks [21:44:14] Logged the message, Master [21:46:42] Most certainly. [21:47:56] That should be fixed now. [21:49:39] Also, do we want a Toolserver User Screening Control-ish thing for tools project? [21:49:57] Coren: ^ :-) [21:50:03] (maybe you've been watching THIS WHOLE TIME) [21:50:20] you may as well set up your IRC client to ping you whenever someone says "toolserver" [21:52:02] wait... [21:52:10] why would he want to do that :) is there something that I'm missing? [21:52:31] fwilson: Coren is the contractor working on Tool Labs. [21:53:09] Oh, that would make sense :) but do we want that? I could (probably) code one or modify the source of the toolserver one if we want [21:53:44] fwilson: I suggest you email labs-l to ask, if you haven't already [21:54:16] fwilson: I think OpenID (provider) might be available in a few weeks. [21:54:29] !help [21:54:29] !documentation for labs !wm-bot for bot [21:54:38] !wm-bot [21:54:38] http://meta.wikimedia.org/wiki/WM-Bot [21:54:47] scfc_de: Oh, cool. [21:55:18] @rss+ wikitech https://wikitech.wikimedia.org/wiki/Special:Ask/-5B-5B:%2B-5D-5D/-3FModification-20date/format%3Drss/sort%3DModification-20date/order%3Ddesc/searchlabel%3DRSS/title%3DSemantic-20MediaWiki/description%3DRC-20from-20Labs-20Wiki/offset%3D0 [21:55:19] Item was inserted to feed [21:55:27] @rss-on [21:55:28] Permission denied [21:55:33] :) [21:55:45] petan: can haz? [21:56:38] fwilson: thank you, wasn't aware you were on the channel when called fox :) [21:56:42] [bz] (8 - created by: 2, priority: 4 - 6) Server access responsibilities - https://wikitech.wikimedia.org/wiki/Server_access_responsibilities [21:56:45] Successfuly added .*@wikimedia/mutante [21:56:45] @trustadd .*@wikimedia/mutante admin [21:56:53] @rss-on [21:56:54] Rss feed is enabled on this channel [21:56:59] @rss-on [21:56:59] Rss feed is enabled on this channel [21:57:08] that means it was already enabled :P [21:57:10] mutante: heh I tend to appear just before people need me [21:57:28] petan: thanks, so am i doing that right? adding a feed and then just "on", not saying which channel i am turning on? [21:59:31] petan: https://wikitech.wikimedia.org/wiki/Special:Ask/-5B-5B:%2B-5D-5D/-3FModification-20date/format%3Drss/sort%3DModification-20date/order%3Ddesc/searchlabel%3DRSS/title%3DSemantic-20MediaWiki/description%3DRC-20from-20Labs-20Wiki/offset%3D0 [21:59:48] petan: this is generated by semantic mediawiki [22:00:22] yes you are doing it right [22:00:33] problem is that default template for rss is borked in this channel [22:00:40] Type @commands for list of commands. This bot is running http://meta.wikimedia.org/wiki/WM-Bot version wikimedia bot v. 1.10.6.8 source code licensed under GPL and located at https://github.com/benapetr/wikimedia-bot [22:00:44] ah, ok [22:01:42] Value $name $title $author $link $description was stored into style-rss to config [22:02:29] mutante I don't know how you want the feed to look [22:02:38] maybe if you send me some example I will convert it to template [22:02:59] wikitech Server access responsibilities https://wikitech.wikimedia.org/wiki/Server_access_responsibilities Server access responsibilities,15 March 2013 22:02:58 [22:03:03] wow, config via bot as well.. didnt expect that [22:03:28] wikitech Server access responsibilities https://wikitech.wikimedia.org/wiki/Server_access_responsibilities Server access responsibilities,15 March 2013 22:03:24 [22:03:29] wikitech Server Admin Log https://wikitech.wikimedia.org/wiki/Server_Admin_Log Server Admin Log,15 March 2013 22:03:25 [22:03:37] it works, wee [22:03:56] wikitech Server access responsibilities https://wikitech.wikimedia.org/wiki/Server_access_responsibilities Server access responsibilities,15 March 2013 22:03:54 [22:03:56] petan: that format looks good, it should be like a regular wiki RC page [22:04:07] Value $name [[$title]] $link $description was stored into style-rss to config [22:04:20] aha [22:04:31] if this is too much for the channel, tell me, i just wanted to test the basic functionality (how to create custom feeds using Semantic mediawiki and then how to add to IRC bot) [22:05:15] @rss-setstyle wikitech wikitech [[$title]] $description: $link [22:05:15] Item now has a different style you can restore the default style by removing this value [22:05:38] we can actually have multiple styles per rss item :P [22:05:50] I just always forgot the commands [22:05:54] forget [22:06:04] !help rss [22:06:04] !documentation for labs !wm-bot for bot [22:06:15] Unknown command type @commands for a list of all commands I know [22:06:19] o.O [22:06:19] how about making !help take arguments for separate [22:06:21] ah..:) [22:06:31] it doesn just it doesn't have the descriptions in db [22:06:41] Info for trusted: Display access list for this channel [22:06:49] Info for rss-on: Turn on a rss feed [22:23:00] wikitech [[Server Admin Log]] Server Admin Log,15 March 2013 22:22:53: https://wikitech.wikimedia.org/wiki/Server_Admin_Log [22:23:27] wikitech [[Server Admin Log]] Server Admin Log,15 March 2013 22:23:15: https://wikitech.wikimedia.org/wiki/Server_Admin_Log [22:23:42] wikitech [[Server Admin Log]] Server Admin Log,15 March 2013 22:23:34: https://wikitech.wikimedia.org/wiki/Server_Admin_Log [22:24:41] fwilson: I just replied to your email on labs-l [22:24:49] just got it :) [22:24:52] (Sorry for the delay, I was out for dinner) [22:24:55] is it already deployed? [22:25:28] fwilson: Real Soon Now(tm). We had to fix a bug first, but it's almost ready. [22:25:36] :) awesome [22:25:48] wikitech [[Server access responsibilities]] Server access responsibilities,15 March 2013 22:25:43: https://wikitech.wikimedia.org/wiki/Server_access_responsibilities [22:26:04] This server access responsibilities link seems very familiar... [22:28:28] wikitech [[Server access responsibilities]] Server access responsibilities,15 March 2013 22:28:24: https://wikitech.wikimedia.org/wiki/Server_access_responsibilities [22:29:12] Change on 12mediawiki a page Wikimedia Labs/Tool Labs/Notepad was modified, changed by MPelletier (WMF) link https://www.mediawiki.org/w/index.php?diff=660271 edit summary: [+11] php5-cli to run env, also php5-mysql [22:29:42] wikitech [[Server access responsibilities]] Server access responsibilities,15 March 2013 22:29:28: https://wikitech.wikimedia.org/wiki/Server_access_responsibilities [22:32:22] wikitech [[Lightning deployments]] Lightning deployments,15 March 2013 22:32:19: https://wikitech.wikimedia.org/wiki/Lightning_deployments [22:33:34] wikitech [[Server Admin Log]] Server Admin Log,15 March 2013 22:33:33: https://wikitech.wikimedia.org/wiki/Server_Admin_Log [22:35:40] wikitech [[Server Admin Log]] Server Admin Log,15 March 2013 22:35:29: https://wikitech.wikimedia.org/wiki/Server_Admin_Log [22:35:49] mutante these sal could be maybe in tech [22:38:52] petan: yea, i agree, this is a bit much here and maybe not that useful, it was more proof-of-concept that we can create custom feeds and add them to channels (now i learned even with the formatting we prefer). wanna remove it again for now? [22:39:19] that's up to you ;) [22:39:33] it's @rss- wikitech [22:39:59] @rss- wikitech [22:39:59] Item was removed from db [22:53:50] Coren how did you implement user per tool [22:54:01] you have own ldap? or you create multiple users [22:54:47] petan: https://bugzilla.wikimedia.org/show_bug.cgi?id=45119 is the "real" solution on the roadmap. Atm, the users are created locally on the run environment. [22:55:19] did you override the sshd config so that you can use keys? [22:55:28] because currently it's set to gluster storage which is read only [22:55:34] labs wide [22:56:01] petan: No keys; the users are reached through sudo according to group membership. [22:56:13] oh [22:56:18] petan: Every tool has a group, members of that group are the tools' maintainers. [22:56:32] so tasks are submited from user account? [22:56:33] or tool [22:56:37] petan: tool [22:56:45] petan: The grid is set to do HBA [22:56:47] aha [22:57:05] petan: (Part of the reason why roots are restricted) [22:58:49] petan: Look at ~marc/bin/addtool [22:58:58] petan: It's retchworthy, but it does the job. :-() [23:00:01] these script should go to gerrit :P [23:01:17] btw there is a trick with tee [23:01:28] so that you don't need to do echo "echo... | sudo [23:01:30] :P [23:01:31] petan: Yes, they should. Actually, I should really have a repo created for all of the stuff and wrappers I've been writing. It's on my short-term todo. ;-) [23:01:58] petan: For >>? (append, note) [23:02:13] yes, tee can append too afaik [23:02:25] Huh. [23:02:32] let me check [23:02:39] Would you believe I had *no* idea? I just checked. [23:03:08] * Coren adds 'sudo tee' to his repertoire. [23:04:06] http://stackoverflow.com/questions/82256/how-do-i-use-sudo-to-redirect-output-to-a-location-i-dont-have-permission-to-wr [23:04:08] Change on 12mediawiki a page Wikimedia Labs/Account creation improvement project was modified, changed by Ryan lane link https://www.mediawiki.org/w/index.php?diff=660278 edit summary: [+187] /* Current account creation process */ [23:04:10] ah yes, the awesome tee :) [23:04:17] petan: Btw, you might want to look at /usr/local/bin/j* on bots-login, they're probably just as usable for your own grid. [23:04:30] ok [23:05:36] petan: jsub allows 'qcronsub' functionality with a few extra bells and whistles. [23:06:05] petan: job is low-level, but can be useful. [23:06:26] aha [23:07:01] I still didn't fully get what that cronsub was for, as far as I understood - checking if job already runs and if not submit it - sounds like a 2 line script to me [23:07:31] petan: It's actually a bit trickier than that, especially if you want to avoid email spam from cron. [23:07:41] petan: (because of the log file mess, etc) [23:08:06] petan: that's what the jsub -once option is for; but the primary point of jsub is "easy interface for 99% of uses" [23:08:18] ok [23:09:01] And it has saner output files for the general case (not by job number) [23:09:33] For the few really baroque cases, users can still use qsub directly. [23:10:15] Honestly, if your usage is complicated enough that you need to fiddle with the more exotic qsub options, you probably are capable of using qsub directly. :-) [23:11:18] The good part is for the typical bot: 'jsub -once -continuous the_bot', 'job -v the_bot' and 'jstop the_bot' are all that's needed. [23:13:13] for that matter 'jstart -once the_bot' is a valid shortcut. [23:14:05] does it handle crashing too? [23:14:13] petan: yep. [23:14:18] nice [23:16:44] I'm pretty sure that short of deleting the queue master (and the shadow once it's up), that job will keep going until the heat death. :-) [23:17:03] Though it's going to be queued if there are no exec hosts. [23:20:34] petrb: Would you like a tool user so you can start playing with it? [23:20:44] petan: ^^ [23:24:33] I think I have one [23:24:36] or not? [23:25:02] you can create petan-bot1 [23:25:09] because name of bot is too long :D [23:25:32] but it require working mono [23:25:35] Well, it's going to be annoying to type all the time, and 'local-petan-bot1' seems like a mouthful. :-) [23:25:51] why local- [23:26:03] bot1 is too common name [23:26:28] name of bot is ArticlesForCreationBot [23:26:30] :D [23:26:31] To avoid clashes with the global users, all the per-project users will have a prefix. I've talked about it with Ryan, and 'local-' seems the least troublesome. [23:26:37] afcbot? [23:26:43] or that [23:26:45] "Petrobot" seems nice though. :-) [23:26:57] omg [23:26:57] :D [23:27:00] afcbot, then? [23:27:00] that's too female for me [23:27:11] ok [23:27:23] female? There has to be a linguistic queue I'm not seeing; sounds male to me. [23:27:33] cue* [23:27:36] "Petra" is czech version for female Peter [23:27:42] Petro is how you would call her [23:27:57] :D [23:28:09] Ah. [23:29:33] [bz] (RESOLVED - created by: MZMcBride, priority: Unprioritized - normal) [Bug 42131] Special:UserLogin on labsconsole.wikimedia.org shows a useless "Token" field - https://bugzilla.wikimedia.org/show_bug.cgi?id=42131 [23:29:34] {{done}} [23:29:45] I mean it doesn't sound female - bot but more like if I was a girl :P [23:29:53] ok, cool [23:29:57] There is a friendly shortcut for you: 'become afcbot' [23:30:07] ok [23:30:13] alias for sudo -iu [23:30:15] ? [23:30:35] Mostly. It also has a bit more friendly proof against typo and doesn't require adding local- [23:30:54] hm and does it pass the arguments to sudo? [23:30:58] Newbies get confused if sudo asks for a password because of a typo [23:31:06] heh [23:31:09] true [23:31:52] No arguments, most people will prefer switching to a shell rather than running commands, but that's a good idea. Ima add that. [23:32:39] done. That wasn't complicated. [23:33:03] marc@tools-login:~$ become sample id [23:33:03] uid=8000(local-sample) gid=7000(tools) groups=7000(tools),8000(local-sample) [23:34:04] how I transfer ownership of files to tool [23:34:24] ... I didn't consider that. [23:34:26] Hm. [23:34:33] group? [23:34:34] Easy way: become tool then copy -r [23:34:53] what about putting user in same group as tool [23:35:01] making a group for user and add tools to that [23:35:10] petan: That's already the case. [23:35:13] Coren: so, netapp change isn't happening [23:35:21] Ryan_Lane: Why not? [23:35:34] Coren: and based on that, I think it's time to start the project users sprint soon [23:35:39] monday or so we can start [23:35:53] Coren: because it also hosts private data [23:36:03] and people are wary to use it, even with vfiler [23:36:25] we'll do something that isn't gluster, but it's not going to be really soon, so, yeah [23:37:33] Ryan_Lane: Aw. Allright. We'll look into gluster alternatives later. [23:37:40] Ryan_Lane: I'm all yours for the sprint Monday. [23:37:44] great [23:37:50] I think we can get it done relatively quickly [23:37:59] especially if we bring andrewbogott in on the sprint [23:38:50] 'project users sprint'? [23:39:01] * andrewbogott looks at the sprint page [23:39:10] heh [23:39:14] another ou [23:39:20] that will hold users and groups [23:39:30] well another top level ou [23:39:35] each project will have an ou below it [23:39:48] uid and gid ranges can overlap between projects [23:39:57] and a wikitech interface to manage those. [23:40:04] and we'll configure ldap in each project to include that project ou [23:40:18] we'll have a prefix, like local-, for the users and groups [23:40:45] and it'll be within a specific uid and gid range that will be blacklisted from normal user/group ranges [23:41:01] this way project admins can create project-specific service users [23:41:23] users added into the groups will be able to sudo to the user [23:41:31] Coren: that summary sound correct? [23:41:47] Ryan_Lane: Sounds right. Also want users in the group to be able to manage group membership. [23:42:01] that's doable [23:42:34] that's how project membership currently works [23:42:36] I need to change that [23:42:42] no one uses them that way [23:42:58] "no one"? [23:43:07] everyone asks the projectadmins to be added [23:43:30] I suspect no one even knows that another project member can add them [23:43:33] Oh, project members can add project members? *I* didn't know that. :-) [23:43:39] see ;) [23:44:14] To be fair, that's not "usual". [23:44:21] it's a little non-intuitive and the fact that people don't know means it's likely bad from a security perspective [23:44:44] Yes, especially if they trust on "only X can add other project members" [23:44:53] indeed [23:45:05] let me open a bug [23:45:37] So, a service user will differ from a 'user' in that they will exist as a system user but not have an account in ldap? [23:45:40] I don't really consider this a security issue, but it's not being used [23:45:56] andrewbogott: it'll be ldap accounts [23:46:07] andrewbogott: but it'll be ldap accounts in an ou that's project specific [23:46:15] andrewbogott: They'll have ldap accounts, but in a project-local OU [23:46:16] and they aren't used for authentication [23:46:26] Ah, ok. So, users that exist only within a single project. [23:46:31] yep [23:46:35] andrewbogott: Right. [23:46:37] per-project user/groups [23:46:38] To own crontabs and such [23:46:56] Coren's idea. a good one, too :) [23:47:08] andrewbogott: Yep. Right now, I do it on tools- with an ugly for ... in hosts; do adduser; done hack [23:47:35] So these users will correspond to roles or tasks rather than to actual humans, right? [23:47:42] andrewbogott: Right. [23:47:50] yeah, ok, makes sense. [23:48:03] andrewbogott: I expect the semantics will differ between projects, on tools- it meants "one tool with a set of maintainers" [23:48:10] means* [23:48:23] yeah. other projects may have other uses for them [23:48:35] So they'll be used as subprojects, almost? [23:48:48] I'm going to send an email about this now [23:48:49] andrewbogott: That's a good nutshell in my case. [23:49:02] ok [23:49:02] we're not doing a great job of discussing changes before we make them [23:49:07] Coren there is no mono but it was very hard to debug it [23:49:18] for some reason there was no output going from jsub [23:49:31] so I had to ssh to exec-01 to find out by hand why it didn't start [23:49:42] petan: Wait, what? [23:49:59] petan: The errors didn't end up in the tool's home in *.err? [23:50:08] empty files [23:50:13] petan: That's a bug then. [23:50:17] just as on bots [23:50:20] we have the same bug [23:50:29] at least I have it [23:50:32] dunno if others too [23:50:34] petan: How.. sucky. [23:50:39] but none of my jobs produces outputs [23:50:49] petan: how odd. [23:50:50] unless I redirect them by hand insinde of wrapper [23:50:58] like [23:51:01] some shell [23:51:04] script [23:51:12] it's late here I will go sleep [23:51:18] Good night! [23:51:31] if I redirect it in script I can see some logs but for some reason the error not [23:51:43] I don't know if program mono is not installed is error or stdout [23:51:53] dunno how this ubuntu hack works [23:51:53] Should be stderr [23:52:06] normally it's bash: mono not found [23:52:22] or mono: command not found [23:52:27] whatever [23:52:51] IMHO you should remove that package from system I hate it [23:52:53] It's worth looking into; it might be mono-specific and we can find a workaround. [23:53:02] What package? [23:53:03] sudo apt-get remove command-not-found [23:53:05] :P [23:53:09] that ubuntu hack [23:53:24] which start looking through repositories instead of telling you not found [23:53:26] which takes ages [23:53:36] Coren: what were we going to call the new ou? [23:53:39] project-users? [23:53:42] wait [23:53:42] no [23:53:44] that's terrible [23:53:58] I thought just OU=theproject,OU=Projects,... [23:54:03] oh [23:54:08] TheProject :D [23:54:08] yeah. that makes a ton of sense [23:54:40] Coren: well, kind of [23:54:43] I have a better idea [23:54:46] Ryan_Lane: I mean, there's no reason we might not want to stuff project specific entries in there that aren't users eventually. [23:55:00] we already have: dns like: cn=testlabs,ou=projects,dc=wikimedia,dc=org [23:55:17] under that we have dns like: dn: ou=sudoers,cn=testlabs,ou=projects,dc=wikimedia,dc=org [23:55:18] Coren how non roots are supposed to install packages [23:55:23] is there a puppet class [23:55:43] so, we can use: ou=people,cn=testlabs,ou=projects,dc=wikimedia,dc=org and ou=groups,cn=testlabs,ou=projects,dc=wikimedia,dc=org [23:56:14] that way, if we delete a project, the users/groups go away with it [23:56:23] petan: I'm workin' on it, but we really need change request management for package installing, not just trust a +2 in gerrit. [23:56:30] Ryan_Lane: That is most logical. [23:56:50] Coren +2 is given by wmf ops [23:56:57] if you don't trust them who do you trust :D [23:57:59] petan: Yes, but while they'll catch "good ideas" like cPanel, they won't know whether installing X is a virtual package that'll clobber Y and break bots. We need a staging area and do test installs before we okay new packages. [23:58:58] right [23:59:16] staging sounds like the "all root" part of once proposed bots [23:59:19] !bots [23:59:19] http://www.mediawiki.org/wiki/Wikimedia_Labs/Create_a_bot_running_infrastructure proposal for bots [23:59:52] however I go sleep, my bots don't run without mono :/