[00:01:01] [bz] (8ASSIGNED - created by: 2Maarten Dammers, priority: 4Normal - 6normal) [Bug 48851] Database inserts are slow at the replicated databases - https://bugzilla.wikimedia.org/show_bug.cgi?id=48851 [00:01:07] @seen scfc_de [00:01:07] YuviPanda: Last time I saw scfc_de they were quitting the network with reason: Quit: ERC Version 5.3 (IRC client for Emacs) N/A at 8/24/2013 1:57:20 AM (9d22h3m46s ago) [01:17:54] 'in project [[Nova Resource:Openstack]]' We totally need better email formatting [01:40:10] @link [01:40:10] http://enwp.org/Nova_Resource:Openstack [01:40:41] This value can't be stored [01:40:52] Channel config was reloaded [01:41:00] This value can't be stored [01:41:15] This value can't be stored [01:44:46] Value wikitech was stored into default-link-wiki to config [01:44:57] Ahh. Whitespace issue. [01:45:01] @link [01:45:01] https://wikitech.wikimedia.org/wiki/meaow [01:46:49] [[Nova Resource:Openstack]] [01:46:57] @link [01:46:57] https://wikitech.wikimedia.org/wiki/Nova_Resource:Openstack [01:47:03] There we go. [02:07:26] [bz] (8NEW - created by: 2James R., priority: 4Unprioritized - 6normal) [Bug 53694] Install perl packages - https://bugzilla.wikimedia.org/show_bug.cgi?id=53694 [02:56:23] Hi all, I'm moving my wiki bots from toolserver to labs, and have a few questions. Where do you recommend locating the scripts, username and password files, and what permissions should be set to maintain security of the username/password? [02:58:39] oh hey! [02:58:41] you're alive :D [02:59:09] legoktm: indeed ;) [02:59:12] basically on tool labs (tools.wmflabs.org), you create a "tool" aka service group [02:59:34] the homedir for your tool is /data/project/toolname/ [02:59:48] if you want to save a password, just chmod 700 [03:00:07] so everything goes into the project directory? [03:00:12] yes [03:00:26] and jobs are submitted via the grid, which is pretty similar to how it is done on the toolserver [03:00:54] TheLetterE: It allows you the ability to have backup maintainers if you go walkabout and the tool starts misbehaving [03:01:23] Hasteur, I see. I will see how I go :) [03:02:31] I created some clever tools for submitting upwards of 500 jobs to the compute cluster. [03:02:39] I giggled with glee [03:06:22] Hasteur: Oh. I have a wrapper that submits a job for every wiki, so about 800 jobs ;) [03:07:18] I could expand the wrapper to do 365*4 years, but that would be overkill [03:12:17] Hmm… when trying to run a script I'm getting permissions error. [03:12:25] I've done "become toolname" [03:12:28] ah [03:12:33] Did you register the tool first? [03:12:36] you might need to "take" the file? [03:12:44] $ take scriptname.ext [03:12:55] if you created the file as your account, not your tool account [03:13:00] Just the script, or everything? [03:13:11] Like I have a directory where it lives. [03:13:12] whatever your script needs :P [03:14:08] Grr… what's this all about? "You need to share a group with the file" [03:14:25] * TheLetterE is confused [03:14:33] i er. [03:14:37] where did you get that from? [03:15:28] local-james@tools-login:~$ take /data/project/toolname/tool [03:16:19] hm. [03:16:23] * legoktm pokes YuviPanda ^ [03:21:04] Now I can't even access the data. Eh. [03:24:51] legoktm: I've managed to lock myself out of it now! [03:24:55] i uh [03:24:56] Ah well. [03:24:57] :D [03:25:10] heheh [03:26:04] Alright, I think I see what I did now. [03:46:02] Success at last legoktm! [03:46:08] :D [03:53:06] So I have a script that looks at the database of enwiki_p however I'm getting an error... [03:53:15] _mysql_exceptions.ProgrammingError: (1146, "Table 'enwiki_p.user_ids' doesn't exist") [03:53:29] that's not a real table... [03:54:14] oh god [03:54:35] TheLetterE: yeah, so that table only exists on the toolserver. it's not a real mediawiki table... [03:55:02] hm, so I'm going to have to rewrite it for labs? [03:55:06] you should get the same info from the user table [03:55:15] select user_id from user where user_name="blah"; [04:16:53] [bz] (8ASSIGNED - created by: 2Maarten Dammers, priority: 4Normal - 6normal) [Bug 48851] Database inserts are slow at the replicated databases - https://bugzilla.wikimedia.org/show_bug.cgi?id=48851 [09:00:40] Hello. How do I send email from inside a shell script to be run with jsub on Tool Labs? I tried creating a shell script with the line "echo test | mail -s test ", which works fine when ran directly, but does not do anything when ran via jsub: no error message, exit code of mail is 0, but no mail arrives in my account. [09:00:43] Any ideas? [09:10:56] [bz] (8NEW - created by: 2James R., priority: 4Unprioritized - 6enhancement) [Bug 53694] Install perl packages - https://bugzilla.wikimedia.org/show_bug.cgi?id=53694 [11:30:00] re [11:30:47] Since I cannot create a DB on tools-db, is there anything that speaks against doing this on the local instance? [11:31:20] except that I don't have permissions for this either :-/ [11:32:06] So, the correct question is: How can I create an own DB for a tool on tool labs? [11:32:17] why you can't create it? [11:32:25] you should be able to do that [11:35:34] petan: It still says permission denied. [11:35:45] as which user you do that? [11:36:05] after becoming lifeweb (project name of my tool) [11:36:45] ok so the username is in replica.my.cnf [11:36:52] you need to use that username as a prefix [11:36:57] it's something like u59468206262 [11:37:42] tbh I don't see replica.my.cnf in home there [11:37:47] o.O [11:37:54] that kind of doesn't make sense [11:37:57] did you remove it? [11:38:22] yes, I said that yesterday, isn't this because it is not a labs project but just a tool? No, I did not remove anything (afair). [11:39:08] no it's not because of that [11:39:09] you definitely should have that replica file in home... let me check [11:39:21] Coren|Away: can you check if replica generator is up? [11:39:35] this is something I don't have access to, it runs directly on nfs server /I think/ [11:39:56] Coren|Away: I mean that credential generator [11:40:48] petan: Okay :) glad to hear. [11:42:03] [bz] (8NEW - created by: 2Peter Bena, priority: 4Unprioritized - 6normal) [Bug 53702] tool lifeweb doesn't have replica.my.cnf - https://bugzilla.wikimedia.org/show_bug.cgi?id=53702 [11:42:28] ^ [11:44:37] Thank you! [11:47:57] [bz] (8RESOLVED - created by: 2Legoktm, priority: 4Normal - 6normal) [Bug 45895] Use "_p" suffix on databases to make them readable by all users - https://bugzilla.wikimedia.org/show_bug.cgi?id=45895 [11:47:57] [bz] (8RESOLVED - created by: 2Liangent, priority: 4High - 6normal) [Bug 48751] jsub with -once doesn't work - https://bugzilla.wikimedia.org/show_bug.cgi?id=48751 [11:51:26] [bz] (8RESOLVED - created by: 2Daniel Schwen, priority: 4Unprioritized - 6normal) [Bug 52903] Please remove service group 'qicbot' - https://bugzilla.wikimedia.org/show_bug.cgi?id=52903 [11:52:41] [bz] (8NEW - created by: 2Peter Bena, priority: 4Unprioritized - 6normal) [Bug 53704] Packages to be added to gerrit - https://bugzilla.wikimedia.org/show_bug.cgi?id=53704 [11:55:11] [bz] (8ASSIGNED - created by: 2m.p.roppelt, priority: 4Unprioritized - 6normal) [Bug 51129] install tdbc and tdbc::mysql - https://bugzilla.wikimedia.org/show_bug.cgi?id=51129 [11:55:12] [bz] (8NEW - created by: 2DrTrigon, priority: 4Unprioritized - 6normal) [Bug 53624] Install python module scipy - https://bugzilla.wikimedia.org/show_bug.cgi?id=53624 [11:55:41] [bz] (8NEW - created by: 2DrTrigon, priority: 4Unprioritized - 6enhancement) [Bug 53626] Install python module rsvg (gnome-python2-rsvg) - https://bugzilla.wikimedia.org/show_bug.cgi?id=53626 [11:55:55] [bz] (8NEW - created by: 2DrTrigon, priority: 4Unprioritized - 6enhancement) [Bug 53627] Install C++ header boost-python - https://bugzilla.wikimedia.org/show_bug.cgi?id=53627 [11:55:56] [bz] (8NEW - created by: 2Daniel Schwen, priority: 4Unprioritized - 6enhancement) [Bug 52902] Please install libfcgi-dev - https://bugzilla.wikimedia.org/show_bug.cgi?id=52902 [11:58:40] [bz] (8NEW - created by: 2DrTrigon, priority: 4Unprioritized - 6enhancement) [Bug 53625] Install python module opencv (v1 and v2) - https://bugzilla.wikimedia.org/show_bug.cgi?id=53625 [11:58:55] [bz] (8ASSIGNED - created by: 2Maarten Dammers, priority: 4Normal - 6normal) [Bug 48851] Database inserts are slow at the replicated databases - https://bugzilla.wikimedia.org/show_bug.cgi?id=48851 [12:00:56] [bz] (8ASSIGNED - created by: 2This, that and the other, priority: 4Low - 6enhancement) [Bug 49937] Clean up list of projects on Tool Labs home page - https://bugzilla.wikimedia.org/show_bug.cgi?id=49937 [12:03:49] :o [12:36:15] [bz] (8ASSIGNED - created by: 2Daniel Schwen, priority: 4Unprioritized - 6blocker) [Bug 52944] Please enable mod_fastcgi support - https://bugzilla.wikimedia.org/show_bug.cgi?id=52944 [13:07:17] [bz] (8NEW - created by: 2Ryan Lane, priority: 4Normal - 6normal) [Bug 51581] Deployment-prep deploys from master and uses a submodule with submodules - https://bugzilla.wikimedia.org/show_bug.cgi?id=51581 [13:19:10] petan: the .cnf is there now :) [13:25:03] (repeated from four hours ago) Hello. How do I send email from inside a shell script to be run with jsub on Tool Labs? I tried creating a shell script with the line "echo test | mail -s test ", which works fine when ran directly, but does not do anything when ran via jsub: no error message, exit code of mail is 0, but no mail arrives in my account. [13:33:10] hi jitse-niesen! would you like for me to fwd your question to the labs-l list in case people respond there? [13:33:59] thanks for the offer, but I'll do that myself if nobody replies anytime soon [13:34:12] I should probably sign up to that list anyway [13:44:47] jitse-niesen: Yes you should. :-) [13:45:53] jitse-niesen: As for your substantive problem, it's not immediately clear to me how that could happen at first glance. Do you happen to know which exec host that mail was sent from so I can check the logs? [13:49:48] jitse-niesen: got it. Good luck! [13:50:01] Coren, ping [13:50:12] pong. [13:50:27] Coren, has Asher gotten back to you about Archive? [13:51:00] Cyberpower678: Haven't talked to him since. I expect he'll be back from vacation now, so I'll try to corner him once he's in. [13:51:13] @seen binasher [13:51:13] Cyberpower678: Last time I saw binasher they were quitting the network with reason: Quit: binasher N/A at 8/29/2013 2:22:26 AM (5d11h28m47s ago) [13:51:38] @notify binasher [13:51:38] I'll let you know when I see binasher around here [13:52:08] That's a long time to be offline. [13:52:45] Coren: just tried again. host was tools-exec-07 (I hope that's what you mean), time was 13:49 UTC today, script is ~local-jitse-bot/foo.sh [13:57:16] jitse-niesen: It was. Checking. [14:00:06] jitse-niesen: odd, I don't even see the attempt in the logs (but I just tried from the command line and it did work from that host). Can you add -v to mail and try again? [14:03:21] Coren: now on tools-exec-02, mail -v says "LOG: MAIN \n <= local-jitse-bot@tools.wmflabs.org U=local-jitse-bot P=local S=558 \n delivering 1VGrAa-0008KV-2e" [14:05:09] Ah, that time I saw the attempt on -02, but the mail delivered locally to the tool (which won't work) seems to hint at a bounce. [14:05:22] * Coren investigates. [14:07:05] Ah, no, queued but not delivered. Checking why. [14:12:30] 2013-09-03 14:09:59 1VGrIk-0006A0-JI => jitse@maths.leeds.ac.uk R=dnslookup T=remote_smtp H=amsta.leeds.ac.uk [129.11.36.1] [14:12:39] It /should/ have been delivered. [14:12:55] yes, got it [14:14:01] ... but you didn't get the previous ones? [14:14:24] no, there are more ... [14:14:46] three in total [14:15:31] that's all I sent, I think [14:18:23] thanks for your help [14:18:36] I'm not sure I actually helped. :-) [14:55:17] !log deployment-prep upgrading PHP5 package on deployment-bastion [14:55:20] Logged the message, Master [14:59:55] !log deployment-prep upgrading PHP5 ( 5.3.10-1ubuntu3.7+wmf1 ) on deployment-apache32, deployment-apache33 and deployment-jobrunner08 [14:59:58] Logged the message, Master [16:08:30] hey petan [16:08:43] i saw a ping from you, but lost scrollback and have no idea what you asked [17:02:52] [bz] (8NEW - created by: 2Jack Phoenix, priority: 4Unprioritized - 6normal) [Bug 53635] div.navbar-inner obscures content on Internet Explorer 10 - https://bugzilla.wikimedia.org/show_bug.cgi?id=53635 [17:06:07] [bz] (8ASSIGNED - created by: 2Maarten Dammers, priority: 4Normal - 6normal) [Bug 48851] Database inserts are slow at the replicated databases - https://bugzilla.wikimedia.org/show_bug.cgi?id=48851 [17:22:57] Which labs subdomains have valid SSL certificates? [17:23:55] I know tools.wmfslabs.org does. Do any others? [17:24:00] *wmflabs [17:26:33] PiRSquared, "I'm not. I want to make a better tool than X!'s edit counter." [17:26:42] Something like that. [17:27:12] Obviously he wants to use the technology behind it for the foundation of the tool. [17:27:28] Good luck extracting the code. [17:27:41] T13, ^ [17:30:26] Cyberpower678, extracting the code? you mean it's not already open source? [17:31:02] Krenair, it is. The code is just hard to follow and read. [17:31:16] ah [17:44:45] I saw the original post Cyberpower678, I've been following. [17:49:30] HAH WHAT [17:49:44] lol [17:50:09] open source, but hard to read? hopefully not intentionally obfuscated... [18:13:08] anyone around familiar with python and qt4 ? [18:16:50] Betacommand: #qt [18:17:30] PiRSquared: I it was worth asking here before I started to look elsewhere [20:36:09] hey andrewbogott. [20:36:14] did you see my labs-l question about labsdebrepo [20:36:38] I did… did Ryan's followup not help? [20:37:03] or, rather, antoine's [20:37:15] i did have it added [20:37:17] and ran puppet multiple times [20:37:22] Ryan didn't do a follow up :) [20:37:31] i've even restarted it a while for good measure [20:37:36] I responsed to antoine I thouht? [20:39:29] Are you going to be awake for a bit? I can look after I finish the patch I'm on now. [20:39:43] andrewbogott: sure! [20:40:10] andrewbogott: I reset my sleep cycle yesterday, but that didn't even last a day - I'm now back to a nocturnal cycle again. [20:40:12] I thought you were back on solar time again… middle of the night there isn't it? [20:40:18] Alas! [20:40:32] I lost a Monday, but gained a tuesday (of sorts?) [21:10:55] Ah. At least, FCGI is going to work fine. [21:11:19] 'going to'? [21:13:29] andrewbogott: i'm still around, let me know when you finish on the patch and have some time available [21:21:14] Coren: Is the sql utility available on the exec nodes? [21:21:38] legoktm: It should be, but probably isn't all that useful there -- it's really intended for interactive use. Why? [21:21:55] I just wanted to do jsub -once sql enwiki_p < superlongquery.sql [21:22:10] Hm. Operative word: "should" [21:22:25] local-legobot@tools-login:~$ cat sql.err [21:22:26] -bash: /usr/bin/sql: No such file or directory [21:22:53] Normally, I'd recommend using mysql explicitly on the nodes, but sql not being there is a bug. [21:24:01] Should be everywhere now. [21:24:05] thanks [21:24:49] hm [21:24:53] sql.out doesn't have any output... [21:26:07] Coren: ^ do you know why? [21:26:31] That's not all that much information to go on. [21:28:11] Oh wait, did you do that exact jsub above? [21:28:15] i did [21:28:16] local-legobot@tools-login:~$ jsub -once sql enwiki_p < /data/project/legobot/test.sql [21:28:36] so the output should go to sql.out and sql.err [21:28:45] both files are empty [21:28:49] That's why you don't get output. You have sent no queries: jsub doesn't magically send your standard input. :-) [21:29:09] You may give a file for the job's standard input with -i though, which will do what you want in this case. [21:29:45] (I.e.: jsub -i ...test.sql -once sql enwiki) [21:31:53] ah. [21:37:40] Coren: worked, thanks! [21:49:47] Coren: https://www.mediawiki.org/wiki/Wikimedia_engineering_report/2013/August [21:49:48] andrewbogott: https://www.mediawiki.org/wiki/Wikimedia_engineering_report/2013/August [21:49:55] please add some details [21:49:58] for labs [21:50:08] @seen Cyberpower678 [21:50:08] CP678|iPad: Last time I saw Cyberpower678 they were quitting the network with reason: Quit: Leaving N/A at 9/3/2013 5:45:01 PM (4h5m7s ago) [21:50:19] Coren: tool labs stats definitely need to be filled in [21:50:35] it would be good if there was somewhere I could get the stats to update the page with myself [21:50:41] @seen CP678|iPad [21:50:41] CP678|iPad: are you really looking for yourself? [21:50:48] :D [21:50:57] @seen binasher [21:50:58] CP678|iPad: Last time I saw binasher they were joining the channel, they are still in the channel #wikimedia-operations at 9/3/2013 7:41:00 PM (2h9m57s ago) [21:51:02] Coren, andrewbogott: today is the deadline to update that, btw [21:51:33] Coren: were you able to get in touch with Asher? [21:51:43] I think on account of wikimania+holiday I didn't do anything labswise. [21:51:59] * Ryan_Lane nods [21:52:04] yeah, i didn't do much either [21:52:07] yuvipanda, I haven't fixed the actual source of the problem yet but your repo should be working now. [21:52:35] Ryan_Lane: I use, simply enough, "getent group|grep ^local-|wc -l" and "getent group project-tools|sed -e 's/,/ /g'|wc -w" :-) [21:52:54] andrewbogott: let me check [21:52:59] Coren: can you add that to the tools.wmflabs.org page? [21:53:08] as a stats link or something? [21:53:17] Coren: . [21:53:23] in wikitech I'd be able to do this via a SMW query ;) [21:53:34] If a file has ensure=>present with no other directives will puppet just touch the file? [21:54:00] Ryan_Lane: stats are looking effing fake this week: 256 tools, 300 users. :-) [21:54:08] :D [21:54:10] well, wikimania [21:54:37] Coren: ping [21:54:47] CP678|iPad: Brief pong. [21:55:01] 17:51 CP678|iPad Coren: were you able to get in touch with Asher? [21:55:45] CP678|iPad: He's not around, not sure why, but Sean has taken the issue over. [21:56:13] Cool. Does he have an ETA. [21:56:14] . [21:56:18] . [21:56:19] . [21:56:22] ? [21:56:39] Jesus, that was way too complicated. :/ [21:57:16] . [21:58:07] CP678|iPad: I don't know of a specific ETA, no. I know it depends on schema changes (which he also is the owner of). [21:58:37] Coren: where can fuck Sean. [21:58:41] OMG!!! [21:58:44] Find [21:59:14] Yeah, double check Happy Fun Autocomplete/correct before hitting "send". :-) [21:59:18] See, this is why I keep buying phones with chiclet keyboards [22:00:04] CP678|iPad: labs-l is probably your best bet if you want news. Also email. [22:00:19] you must not be using iphone [22:00:33] it will never autocomplete to that :) [22:00:58] I can't stop laughing right now. That's about the worst autocorrect that's ever happened to me? [22:01:57] Coren: he's not labs . [22:01:59] ? [22:02:32] Ryan_Lane: Must be iOS 7. [22:02:35] I'm sorry, I don't know what you mean by "he's not labs" [22:02:54] *on [22:03:01] CP678|iPad: He's in Australia. Not always in this channel and also in an unusual timezone. [22:03:15] IRC nick? [22:03:44] springle [22:03:45] I can't type tomorrow. [22:03:53] *today [22:04:00] :/ [22:04:17] andrewbogott: cool thanks. [22:04:30] @seen Pringles [22:04:30] CP678|iPad: I have never seen Pringles [22:04:40] Gahhhhhhh [22:05:01] I swear I'm about to toss this thing out the window. [22:05:25] @seen springle [22:05:25] CP678|iPad: springle is in here, right now [22:07:54] andrewbogott: hi [22:08:45] springle, CP678|iPad was asking about you, I don't know regarding what. [22:10:08] YuviPanda, https://gerrit.wikimedia.org/r/#/c/82532/ [22:10:40] andrewbogott: woot! [22:10:51] Working properly now? [22:11:28] yeah, apt-cache shows properly [22:12:10] andrewbogott: apt-get install nginx-extras still installs 1.19 [22:12:30] err [22:12:33] the older version [22:12:43] and not the one in the labsdebrepo [22:13:10] apt-cache show nginx-extras shows me 1.5 ppa one tho [22:13:26] hm, I wonder how it chooses... [22:13:35] I'd think it would pick the newest [22:13:40] yeah, me too [22:13:43] apt-cache shows the ppa first [22:14:50] andrewbogott: apt-cache policy nginx-extras shows me soething which I'm trying to parse properly now [22:15:01] it still says the candidate is 1.1.19 [22:15:28] andrewbogott: the priority for the wmf version seems higher than the ones for everything else [22:17:28] Ryan_Lane, can you explain? How does apt choose among competing entries in sources.list? [22:22:19] andrewbogott: https://wiki.debian.org/AptPreferences perhaps? [22:23:04] hm, I thought pinning operated within a repo not between them... [22:23:14] probably I thought wrong [22:25:36] yuvipanda, can you just explicitly name the package? nginx-extras-1.whatever? [22:25:49] in puppet, I mean [22:25:54] yeah, I could [22:25:57] but that seems hacky [22:32:25] andrewbogott: you can pin a package to a repo [22:32:30] there's a weight associated with it [22:32:44] you can also pin an entire repo [22:32:59] the local repo should always be pinned higher than the wikimedia one [22:33:14] Where do pins actually reside? [22:34:13] andrewbogott: /etc/apt/preferences.d [22:34:22] wikimedia is pinned to 1001 priority [22:34:55] local's at 500 [22:35:57] that's a silly priority :) [22:36:05] it's local, it should maybe be 1500 or so [22:36:13] It must be the default, it isn't specified at all as far as I can see. [22:36:49] and why is there a 'wikimedia' and a 'wikimedia.pref' each pinning the same repo with the same priority? [22:36:54] he asked rhetorically [22:38:51] So in our case, what is the 'release' for the local rep? [22:40:01] YuviPanda, try it now? [22:40:06] doing [22:40:29] andrewbogott: grr, now it doesn't install at all [22:40:38] ? What's it say? [22:40:43] ln: failed to create symbolic link `/etc/nginx/sites-enabled/default': No such file or directory [22:41:03] * YuviPanda prges [22:41:18] wait, that's during install of the package... [22:41:26] which package is it installing? [22:42:56] andrewbogott: I have no idea why there's both, I think .pref is the one actually used [22:43:05] andrewbogott: when I had uninstalled nginx-extras, it didn't uninstall nginx-common [22:43:11] andrewbogott: so can't re-install nginx-extras, not sure why [22:43:21] andrewbogott: I uninstalled nginx-common as well, and it seems to re-install [22:43:24] andrewbogott: but still installing 1.19 [22:43:26] 1.1.19 [22:43:36] ok, I don't know how to do this then [22:43:57] andrewbogott: So in our case, what is the 'release' for the local rep? [22:44:34] andrewbogott: apt-cache policy nginx-extras still shows local at 500 [22:44:38] (I did an update) [22:47:34] Coren: so, surprise.... [22:47:44] Manage Service Groups was just deployed [22:47:49] Ryan_Lane, the .pref file says Pin: release o=Wikimedia but where is the release 'Wikimedia' named? the string 'Wikimedia' doesn't appear anywhere in the sources. [22:47:52] I needed to upgrade wikitech [23:05:39] YuviPanda, if you can figure out how to a) give a name to the local repo, and b) refer to that name in preferences, then I can implement that in puppet. But at the moment I'm stumped. [23:09:28] andrewbogott: not sure, perhaps poke paravoid?