[00:00:11] on some filesystem it is not possible to use it at all, because they have no owners [00:00:13] like fat [00:00:25] That failed the first time I tried. [00:00:34] What did you use to do that for me. [00:00:46] I used sudo... [00:00:51] so I did it as root [00:00:52] I figured. [00:00:58] :p [00:01:07] root can change the owner to any existing or non existent user id [00:01:22] by default on most filesystems [00:02:03] I got to get my essay done. [00:02:26] as I said, you can't compare unix and windows when it comes to file permissions, that is like comparing a... typewriter and computer [00:02:41] unix is old [00:02:59] I thought they're the same thing. :p [00:03:13] they both have keyboards and type. [00:03:18] yes [00:03:19] :P [00:05:07] I'm hungry [00:05:28] [bz] (NEW - created by: Riley Huntley, priority: Unprioritized - normal) [Bug 47808] internal_api_error when running bot on en.wikipedia.beta.wmflabs.org - https://bugzilla.wikimedia.org/show_bug.cgi?id=47808 [00:07:18] Riley, stop creating bugs! :p [00:26:37] addshreo: Hey, nice status stuff. :-) [01:07:21] * jeremyb_ sees good mail from Ryan_Lane [01:07:29] especially that last line... [01:07:30] heh [01:07:41] > If folks work with us rather than fight with us, we'll get things done faster, together. [01:08:47] I don't see the point in people fighting each other [01:09:28] the benefactors of TS don't want to support it. nothing I can do about it. we're working at setting up an environment they can move to. if they work with us, it'll make everyone's life easier [01:09:42] if not, it just makes everything slower [01:09:47] and harder [01:10:57] errr, you're leaving something out. it's better than that. :) [01:11:52] oh? [01:12:14] you're doing it in a very open way (e.g. w/ a public puppet repo that anyone can submit to and comment on) so if someone does want to compete with you they can resuse what you're doing [01:12:43] the main things they'd be missing are money and DBs [01:12:51] yep [01:13:12] well, that's one of the reasons I built labs this way to begin with [01:13:24] if people want to fork our sites as a whole I want to help with that [01:13:40] yeah... that's a whole different ball of wax :( [01:14:03] would love cheap branching like git has [01:14:15] for what? [01:14:42] then you can e.g. tell enwiki editors with COI to make edits on a branch and link to the branch from master's talk page and write a note about their proposals [01:15:01] instead of either having them just edit master or just describe what they're proposing [01:15:30] among other use cases [01:15:52] oh. yeah. heh. I think they've purposely avoided branching in content [01:16:38] who/why? [01:17:11] btw, are you familiar with ikiwiki? [01:17:39] nope [01:17:55] I've heard numerous devs say they don't want branching of articles in the past [01:18:01] on channels and likely in lists [01:18:04] i have some uses planned (none of what i have in mind so far is related to WMF stuff) [01:18:13] huh. :-( [01:21:16] Article branching would be a catastrophe, jeremyb_; things are bad enough with POV forks as it is. [01:21:52] Coren: how so? and what do you mean POV fork? [01:22:05] * Coren puts on his enwp hat. [01:22:07] https://en.wikipedia.org/wiki/Wikipedia:POV_fork [01:22:28] to be clear uses planned was re ikiwiki not branching [01:22:34] Basically if you don't win the edit war, you split the article into another one that expresses your point of view [01:23:00] huh, people do that? [01:23:02] ewww [01:23:10] Consensus is all about finding the neutral middle ground where everything is presented in blanace to their real-life prominence; allowing forks just create walled gardens of propaganda. Almost all of the really *big* long lasting disputes are caused by things like that. [01:24:01] Coren: they wouldn't be first class citizens... people would generally only see master [01:24:26] what do you think about the COI use case i mentioned? [01:24:42] jeremyb_: Right, but then the master would simply end up tilting the other way; and the prople with the fork would fight all that harder against it so that *their* truth is what is visible to the world. [01:25:46] jeremyb_: Remember I've worked on ArbCom for years -- enwp (and I expect the other projects) are battlegrounds for real-life PR battles; NPOV is hard as hell, and forks would make things worse. [01:25:57] another use would be for {{editprotected}}. you could just make a branch instead of giving instructions. (or making a manual copy like https://en.wikipedia.org/wiki/User:Jeremyb/geonotice.js) [01:26:25] we have /sandbox 's for that [01:26:28] jeremyb_: Well, that's even better served with flagged revisions. We all know how well /that/ idea got loved. :-) [01:26:50] Coren: i don't know if i like the flagged revs model... [01:27:05] i *do* think i like the git model [01:27:27] the git model doesnt really work if you're trying to write an article [01:27:46] huh? [01:27:58] i'm saying almost everyone would still write directly to master [01:28:20] jeremyb_: The git model only works if everyone is trying to pull in the same direction; not when they are working at odds with each other. The only result would be to move the war from the editing towards who "wins" pull requests. :-) [01:40:05] Ryan_Lane: Hm. There was no conclusion to the puppet class bikeshed discussion. What do I do now? :-) [01:40:37] I really need to start putting all that stuff in puppet. [01:42:48] link to the shed? [01:52:38] I'm going to bed. Got a final tomorrow. So not ready. :( [01:52:44] Good night everyone. [01:55:48] good luck! [01:56:52] Matthew_: look at 2013042810007052 again :) [01:57:07] ohh, ww [01:57:08] Kk [02:37:51] Warning: There is 1 user waiting for shell: Hahc21 (waiting 0 minutes) [02:51:21] Warning: There are 2 users waiting for shell, displaying last 2: Hahc21 (waiting 13 minutes) White Master (waiting 8 minutes) [03:04:47] Warning: There are 2 users waiting for shell, displaying last 2: Hahc21 (waiting 27 minutes) White Master (waiting 22 minutes) [04:04:33] Hi, can any help me? [05:15:28] Warning: There is 1 user waiting for shell: Vvv214wth (waiting 0 minutes) [05:28:54] Warning: There is 1 user waiting for shell: Vvv214wth (waiting 13 minutes) [05:42:24] Warning: There are 2 users waiting for shell, displaying last 2: Vvv214wth (waiting 27 minutes) Exklamationmark (waiting 8 minutes) [05:55:49] Warning: There are 2 users waiting for shell, displaying last 2: Vvv214wth (waiting 40 minutes) Exklamationmark (waiting 22 minutes) [06:09:23] Warning: There are 3 users waiting for shell, displaying last 3: Vvv214wth (waiting 54 minutes) Exklamationmark (waiting 35 minutes) Kpytang (waiting 5 minutes) [06:22:55] Warning: There are 3 users waiting for shell, displaying last 3: Vvv214wth (waiting 67 minutes) Exklamationmark (waiting 49 minutes) Kpytang (waiting 18 minutes) [06:36:31] Warning: There are 3 users waiting for shell, displaying last 3: Vvv214wth (waiting 81 minutes) Exklamationmark (waiting 62 minutes) Kpytang (waiting 32 minutes) [06:50:01] Warning: There are 3 users waiting for shell, displaying last 3: Vvv214wth (waiting 94 minutes) Exklamationmark (waiting 76 minutes) Kpytang (waiting 45 minutes) [07:03:31] Warning: There are 3 users waiting for shell, displaying last 3: Vvv214wth (waiting 108 minutes) Exklamationmark (waiting 89 minutes) Kpytang (waiting 59 minutes) [07:08:35] wikimedia-dev [07:17:01] Warning: There are 3 users waiting for shell, displaying last 3: Vvv214wth (waiting 121 minutes) Exklamationmark (waiting 103 minutes) Kpytang (waiting 72 minutes) [07:30:26] Warning: There are 3 users waiting for shell, displaying last 3: Vvv214wth (waiting 135 minutes) Exklamationmark (waiting 116 minutes) Kpytang (waiting 86 minutes) [07:43:56] Warning: There are 3 users waiting for shell, displaying last 3: Vvv214wth (waiting 148 minutes) Exklamationmark (waiting 130 minutes) Kpytang (waiting 99 minutes) [07:53:38] !sh [07:53:38] http://bit.ly/10eZZoa [08:40:13] [bz] (NEW - created by: Jan Luca, priority: High - blocker) [Bug 47773] Puppet does not run on new instances: err: Could not retrieve catalog from remote server: Error 400 on SERVER: Must pass gmond_port to Class[Ganglia_new::Monitor::Config] - https://bugzilla.wikimedia.org/show_bug.cgi?id=47773 [08:40:43] Warning: There is 1 user waiting for shell: Dracorp (waiting 0 minutes) [08:54:17] Warning: There is 1 user waiting for shell: Dracorp (waiting 13 minutes) [09:07:42] Warning: There is 1 user waiting for shell: Dracorp (waiting 27 minutes) [09:21:13] Warning: There is 1 user waiting for shell: Dracorp (waiting 40 minutes) [09:34:43] Warning: There are 2 users waiting for shell, displaying last 2: Dracorp (waiting 54 minutes) Jiabao (waiting 11 minutes) [09:48:17] Warning: There are 2 users waiting for shell, displaying last 2: Dracorp (waiting 67 minutes) Jiabao (waiting 24 minutes) [10:01:47] Warning: There are 2 users waiting for shell, displaying last 2: Dracorp (waiting 81 minutes) Jiabao (waiting 38 minutes) [10:15:17] Warning: There are 2 users waiting for shell, displaying last 2: Dracorp (waiting 94 minutes) Jiabao (waiting 51 minutes) [10:28:43] Warning: There are 2 users waiting for shell, displaying last 2: Dracorp (waiting 108 minutes) Jiabao (waiting 65 minutes) [10:42:16] Warning: There are 2 users waiting for shell, displaying last 2: Dracorp (waiting 121 minutes) Jiabao (waiting 78 minutes) [10:55:38] Warning: There are 2 users waiting for shell, displaying last 2: Dracorp (waiting 135 minutes) Jiabao (waiting 92 minutes) [11:09:03] Warning: There are 2 users waiting for shell, displaying last 2: Dracorp (waiting 148 minutes) Jiabao (waiting 105 minutes) [11:22:29] Warning: There are 2 users waiting for shell, displaying last 2: Dracorp (waiting 162 minutes) Jiabao (waiting 119 minutes) [11:35:59] Warning: There are 2 users waiting for shell, displaying last 2: Dracorp (waiting 175 minutes) Jiabao (waiting 132 minutes) [11:49:26] Warning: There are 2 users waiting for shell, displaying last 2: Dracorp (waiting 188 minutes) Jiabao (waiting 146 minutes) [12:02:48] Warning: There are 2 users waiting for shell, displaying last 2: Dracorp (waiting 202 minutes) Jiabao (waiting 159 minutes) [12:08:00] does someone know whether it is possible to use an SFTP software as Cyberduck in order to transfer files on instances ? [12:16:19] Warning: There are 2 users waiting for shell, displaying last 2: Dracorp (waiting 215 minutes) Jiabao (waiting 173 minutes) [12:25:37] Toto_Azero yes [12:26:13] how should I do ? [12:26:23] where you need to upload the stuff? [12:27:00] into bots instance (scripts for my bot) [12:27:21] !tunnel [12:27:21] ssh -f user@bastion.wmflabs.org -L :server: -N Example for sftp "ssh chewbacca@bastion.wmflabs.org -L 6000:bots-1:22 -N" will open bots-1:22 as localhost:6000 [12:27:27] you need to create a tunnel [12:27:44] you can do that in putty [12:27:50] @search putty [12:27:50] Results (Found 1): putty, [12:27:56] !putty [12:27:56] https://wikitech.wikimedia.org/wiki/Help:Access_to_instances_with_PuTTY_and_WinSCP [12:28:42] ok :/ but I use Mac OS and putty isn't available for Mac OS :s [12:28:54] do you know if it is possible with something like Cyberduck ? [12:29:29] yes it is [12:29:36] you need to do same on mac [12:29:44] just open the tunnel using software you use for ssh [12:29:47] Warning: There are 2 users waiting for shell, displaying last 2: Dracorp (waiting 229 minutes) Jiabao (waiting 186 minutes) [12:29:55] ok great :) [12:30:20] you can probably use that command [12:30:25] !tunnel | Toto_Azero [12:30:25] Toto_Azero: ssh -f user@bastion.wmflabs.org -L :server: -N Example for sftp "ssh chewbacca@bastion.wmflabs.org -L 6000:bots-1:22 -N" will open bots-1:22 as localhost:6000 [12:30:48] ok thanks :) I'll try ! [12:31:02] ssh totazero@bastion.wmflabs.org -L 6000:bots-gs:22 -N [12:31:08] in terminal [12:43:17] Warning: There are 2 users waiting for shell, displaying last 2: Dracorp (waiting 242 minutes) Jiabao (waiting 199 minutes) [12:52:56] petan: sorry but i can't manage doing it :/ once the tunnel is creating, what must I do ? [12:53:14] after you create a tunnel you can connect to localhost:6000 [12:53:18] using scp [12:55:08] it was what I was trying to do, but I must have done something wrong… [12:55:15] Toto_Azero what you did? [12:55:48] I ran ssh -f totoazero@bastion.wmflabs.org -L 6000:bots-gs:22 -N and then I was trying to connect using Cyberduck… [12:56:19] ok, did that command work? [12:56:26] you should see it running now [12:56:35] if you do ps -ef or whatever you need [12:56:36] in mac [12:56:47] Warning: There are 2 users waiting for shell, displaying last 2: Dracorp (waiting 256 minutes) Jiabao (waiting 213 minutes) [12:56:59] if it's running you should have open localhost:6000 tunneling to bots-gs:22 [12:57:24] yes it does run [12:57:30] try doing ssh localhost -p 6000 [12:57:40] if it works problem is in duck [12:58:02] Permission denied (publickey). [12:58:09] that's good [12:58:18] then problem is in duck? [12:58:21] what it does [12:59:09] actually, nothing :p I don't know what to put as username and server [12:59:45] server is localhost [12:59:47] username is your [13:00:32] yes I've tried localhost:6000 and my username but it doesn't work [13:00:41] that means? [13:00:43] what it did? [13:01:01] it says "DNS error" [13:01:09] lol [13:01:19] ok, try 127.0.0.1 [13:01:22] instead of localhost [13:01:34] "network error" x) [13:01:45] * CP678|Zzzzz witnessed petan loling [13:01:59] which port you are using? [13:02:02] 22 [13:02:06] use 6000 [13:02:13] Morning everybody [13:02:18] hi [13:02:24] Toto_Azero 22 won't work [13:02:54] it says host unknown :/ [13:03:07] which host you have? [13:03:22] that software suck [13:03:27] try to fill in local ip there [13:03:35] * Cyberpower678 thinks something on Toto_Azero's end is broken. Want to fill me in? [13:04:25] ok just allowed the software to use this host :/ [13:04:30] hello [13:04:43] Pyfisch, hi [13:05:06] great it works :) [13:05:12] many thanks petan :) [13:05:28] Does anybody here know PHP? [13:05:33] Segmentation fault (core dumped) :-( [13:05:46] Cyberpower678 no we only know LSD [13:06:13] I'll have some LSD. :p [13:06:27] What's LSD? [13:07:10] petan, ^ [13:07:17] http://en.wikipedia.org/wiki/Lysergic_acid_diethylamide [13:08:46] Started bot on bots-bnr3 at Sun Apr 28 18:58:23 UTC 2013 [13:08:48] Sleeping for 5.0 seconds, 2013-04-28 19:36:06 [13:08:50] Sleeping for 5.0 seconds, 2013-04-28 19:36:06 [13:08:52] Logging in to wikidata:wikidata as FischBot [13:08:53] Page [[wikidata:User:FischBot/Logs/Completed]] saved [13:08:55] Segmentation fault (core dumped) [13:08:57] Stopped the bot at Sun Apr 28 20:03:19 UTC 2013 [13:09:26] I don't think that my Bot consume that much memory :-/ [13:09:35] that's hard to tell [13:09:45] Pyfisch: gdb for the win :D [13:09:45] maybe it's a bug in library u use? [13:09:50] Pyfisch, looks like it didn't have its morning coffee yet. [13:09:57] hashar gdb works on python? [13:10:17] well if you have python compiled with symbols, surely [13:10:22] Warning: There are 2 users waiting for shell, displaying last 2: Dracorp (waiting 269 minutes) Jiabao (waiting 227 minutes) [13:10:40] Pyfisch that error is a native binary error, that means it is either error in python or its libraries [13:10:53] I am no expert on python [13:11:19] ...but an expert of of labs you should say [13:11:34] you have problem with python not labs :P [13:11:48] I can have a look on that dump though [13:12:34] do you want the full dump? [13:15:05] I will have a look [13:16:06] bots-gs:/data/project/userdata/FischBot/wikidata/syslog [13:16:19] petan: theire you will find it [13:17:11] but I don't see a core dump :o [13:17:24] there should be core file somewhere [13:17:43] probably in WD [13:18:23] hm if u find it let me know, otherwise you need to ask python guru [13:23:52] Warning: There are 2 users waiting for shell, displaying last 2: Dracorp (waiting 283 minutes) Jiabao (waiting 240 minutes) [13:29:31] [bz] (NEW - created by: Antoine "hashar" Musso, priority: Unprioritized - normal) [Bug 47827] beta: Setup a Wikidata wiki - https://bugzilla.wikimedia.org/show_bug.cgi?id=47827 [13:37:30] Warning: There are 2 users waiting for shell, displaying last 2: Dracorp (waiting 297 minutes) Jiabao (waiting 254 minutes) [13:38:14] * Cyberpower678 uploads petan to Wikipedia [13:38:25] Cyberpower678 I am already there [13:39:14] So that explains why it's already been crashing. :p [13:39:21] ;) [13:39:38] * Cyberpower678 uploads Coren to Wikipedia [14:59:24] petan: The problem is that what the users /want/ isn't always what is /best/ either. People want solid replication, and they want replication like on the toolserver. The problem is that replication like on the toolserver is /why/ it's not stable. [14:59:44] Coren agree [15:00:13] You know what I'm proud of? [15:00:19] that make it a challenge [15:00:21] nope [15:00:31] you are proud of unicorns? [15:00:32] :D [15:00:34] 157 0.75000 ecmabot-wm local-ecmabo Rr 04/25/2013 18:57:18 continuous@tools-exec-02.pmtpa 1 [15:00:43] Job 157 was actually started in /March/ [15:00:51] cool [15:01:10] it say 04/25 [15:01:12] It has kept on running though at least 3 complete restarts of the project, and a filesystem switch. [15:01:25] That's because it was /re/started when I changed the filesystems. :-) [15:01:27] that reminds me [15:01:33] how can I switch bots project to nfs [15:02:10] petan: In theory, it's as easy as override your autofs config and reboot. Look at /etc/auto.* on tools [15:02:24] petan: I'm going to put it in puppet this week. [15:02:28] are you sure? [15:02:34] no need to create some separate folders etc? [15:02:46] like is there /data/project folder on nfs dedicated to bots? [15:03:04] don't I need to move existing data there as well? [15:03:08] petan: Well, you'll need to /copy/ the contents of your current filesystems of course, but that can be done before the switch with rsync [15:03:27] I still don't understand how to access that nfs server directly [15:03:28] petan: You can mount the NFS manually while copying stuff. [15:03:34] like if I wanted to copy files there now [15:03:38] I would need to be able to access it [15:03:48] aha [15:04:41] so /bots/project folder exist? [15:04:45] on nfs [15:04:52] or it's auto created on access? [15:05:05] It's created by a script on the nfs server. [15:05:14] ok [15:05:35] labnfs.pmtoa.wmnet:/bots/{project,home} should already be available [15:05:40] pmtpa* [15:07:16] Ah, one point though: [15:07:42] You need to do this on the instance before it works perfectly: [15:07:44] echo 1 >/sys/module/nfs/parameters/nfs4_disable_idmapping [15:07:53] Otherwise, local users won't be able to own files. [15:09:55] I've but that in the rc.local of my instances. It's ugly, and I'll make an upstart script for it eventually instead, but it works. [15:46:05] andrewbogott: Should I rebuild my instance to get the bugfix of bug:47773? [16:10:49] i haad to restore my machine so I lost some settings [16:11:10] how can I SCP into tools-login and copy a file there? [16:11:52] i can SSH into tools-login and do a "become" and get into what I need [16:11:56] but I can't copy files [16:13:02] greenrosetta: You have write permission directly to your tool's home. [16:13:12] im trying [16:13:26] Hm. What do you use for SCP? Openssh? [16:13:43] winscp [16:13:51] Im getting a permission denied [16:13:53] Lemme go look at its docs for a minute. [16:14:10] What directory are you trying to write to, exactly? [16:15:10] test [16:15:20] * greenrosetta says /data/project/common-interests [16:15:24] stupid slah [16:15:39] Coren, when replication is setup, how will I be able to access it from cyberbot? [16:15:42] and im logging into tools-login.wmflabs.org [16:15:54] ive also tried logging into bastion as well [16:16:52] but from bastion I can't see tools-login projects [16:17:07] Cyberpower678: Your tools mysql credentials (in ~/.my.sql) will work on the DB clusters to connect to the shards. [16:17:39] greenrosetta: Bastion is really only for interactive sessions; it's possible to tunnel through it but more complicated than necessary since tools-login is a directly accesible bastion. [16:17:41] Coren, what about database cluster names? [16:17:58] Jan_Luca: You shouldn't need to rebuild, just force a puppet run. [16:18:25] Cyberpower678: That's still open to question. I'm gunning to make aliases for things like 'enwp.db.foo.bar' to simplify finding the right cluster. [16:18:37] Are they the same as toolserver's? If I can know how to connect to them once they are set up, I can already rewrite adminstats to get it ready for labs. [16:18:49] Coren: take a leaf from the toolserver [16:19:10] Cyberpower678: Actually, I will definitely provide TS-equivalent aliases to simplify things. [16:19:57] Betacommand: Which page in particular? I'm honestly not all that familiar with the replica setup since all of my tools were API-based. [16:20:59] Coren: sql _p [16:21:08] made access easy [16:21:16] sql enwiki_p [16:22:13] and sql-s1-user.toolserver.org [16:22:25] or sql-s1.rrdb.toolserver.org [16:29:46] Coren, does that mean I will need to change anything. [16:29:48] ? [16:29:55] Warning: There is 1 user waiting for shell: Balloonguy (waiting 0 minutes) [16:43:28] Warning: There are 2 users waiting for shell, displaying last 2: Balloonguy (waiting 13 minutes) Mooeypoo (waiting 7 minutes) [16:46:29] Betacommand: That sounds sane; I'll definitely make sure to support those names. [16:46:43] Coren: I saw the above from greenrosetta, and did a little investigation. It looks like something with NFS and secondary groups is b0rken. By default my login is group 500(wikidev), and I cannot create a test file in my tool's folder. But if I use newgrp to switch my effective gid to the tool's gid, then it works. [16:46:47] Cyberpower678: Probably not, since the TS has something that's easy to implement. [16:47:13] anomie: ... secondary groups being improperly supported. Ay! [16:47:44] anomie: Zounds; need to debug this first now. [16:56:57] Holey sheets. [16:56:58] Warning: There are 2 users waiting for shell, displaying last 2: Balloonguy (waiting 27 minutes) Mooeypoo (waiting 21 minutes) [16:57:05] We're hitting the 16 group limit. [16:58:14] Coren: is there some way to limit the spam from wm-bot ? [16:58:22] @requests-off [16:58:22] Permission denied [16:58:26] :( [16:58:28] @requests-off [16:58:28] Permission denied [16:58:34] FAIL [16:58:36] @trusted [16:58:36] I trust: petan!.*@wikimedia/Petrb (2admin), .*@wikimedia/.* (2trusted), .*@mediawiki/.* (2trusted), .*@wikimedia/Ryan-lane (2admin), .*@wikipedia/.* (2trusted), .*@nightshade.toolserver.org (2trusted), .*@wikimedia/Krinkle (2admin), .*@[Ww]ikimedia/.* (2trusted), .*@wikimedia/mutante (2admin), [16:58:40] Betacommand: I wisk. [16:58:42] coren, any idea on why I can't acccess common-interests? [16:58:51] I have a wikipedia cloak.... [16:59:01] greenrosetta: I know exactly why. *fixing* it is going to be... "fun". I'm on it. [16:59:06] ah [16:59:43] greenrosetta: Ugly temporary workaround; copy stuff to your own account then copy it /from/ the tool account. But this sucks and I need to find a better way. [17:00:01] I cant even do that [17:00:01] Stoopid SUN. [17:00:16] if you are talking about my bastion home directory that is [17:00:33] greenrosetta: tools-login home. You shouldn't but stuff on bastion at all. :-) [17:01:22] permission denbied [17:01:26] whoa [17:01:30] where is my home directory on tools? [17:01:46] nvm [17:01:47] found it [17:04:12] I put the file in my home dir on toolserver. I'm still getting a permission denied when trying to copy a file to common-interests [17:04:34] greenrosetta: did you become the tool first? [17:04:45] greenrosetta: For the moment, you'll need to copy it /from/ common-interests (i.e. become, then copy it) [17:04:59] I think I found a workaround. Thank the nfs-kernel-server maintainers. :-) [17:05:14] beta, I tried both [17:05:25] after become, I can't access my home directory [17:09:14] greenrosetta: As your login user on tools-login (i.e. without using "become"), use the command "newgrp local-common-interests". Then you should be able to write the tool's directory. Or wait for the bug to get fixed. [17:10:35] Warning: There are 2 users waiting for shell, displaying last 2: Balloonguy (waiting 40 minutes) Mooeypoo (waiting 34 minutes) [17:12:17] anomie: that did it [17:15:14] Coren: I don't _think_ my user was hitting the 16-group limit. I only have 9 groups. [17:15:54] anomie: That's not the trouble, the trouble is the workaround /for/ the 16 group limit which backdelegates gids to the NFS server which doesn't know about the local groups. [17:16:18] is there a script that will log me into the mysql database so I dont have to type that funky password each time? [17:16:32] greenrosetta: Just typing 'mysql' should do. :-) [17:16:40] oh, will that read my conf settings? [17:16:44] * Coren nods. [17:16:53] greenrosetta: Don't forget to become the tool first [17:17:25] from within mysql, how can I execute a sql script/ [17:17:46] since this is command line based [17:18:52] greenrosetta: what is your goal? [17:19:12] I put the world.sql script that is the sample DB from MYSQL in my directory [17:19:22] Now I want to run it so my DB has tables to work with [17:20:53] ahh.. mysql greenrosetta on none of the projects you need to type a password for mysql [17:24:07] Warning: There are 3 users waiting for shell, displaying last 3: Balloonguy (waiting 54 minutes) Mooeypoo (waiting 48 minutes) Ed Lane (waiting 7 minutes) [17:25:49] wth... mysql is case sensitive? [17:26:46] depends [17:27:01] username is not, password is [17:27:34] no, the table names are [17:27:52] eh, nope [17:28:09] you can't create table a and A [17:28:09] actually that depends as well [17:28:19] http://dev.mysql.com/doc/refman/5.0/en/identifier-case-sensitivity.html [17:28:20] well, I just did a "select * from city" and it went TU [17:28:20] go go bananas! [17:28:25] but "select * from City" worked [17:28:47] Although database and table names are not case sensitive on some platforms, you should not refer to a given database or table using different cases within the same statement. [17:29:03] By default, table aliases are case sensitive on Unix, but not so on Windows or Mac OS X. [17:29:14] not an alias however [17:29:17] * andrewbogott innovates in the field of ugly logos [17:29:31] "lower_case_table_names system variable, which you can set when starting mysqld. " [17:30:31] I don't think I can do that for my tool [17:30:46] Would have to get an admin to do that as I probably dont have permission [17:31:00] In any case, I can just rename my scriptsm but this is gonna be a pain in the ass [17:31:15] greenrosetta which project [17:31:21] common-interests [17:31:30] tools? [17:31:36] yes sir [17:32:13] greenrosetta: that link also has some examples further down in the comments, where people use scripts to rename all tables to lower case [17:32:24] i have no idea which tables you are working on though. ack [17:32:42] i was hoping there is a setting that would just make all tables case insensitive [17:33:46] b/c when wikipedia-en becomes available, I can see it being very easy to use the "wrong" table name by case [17:33:54] Unless WMF wants to make me uber-root [17:33:56] :D [17:35:30] speakig of wikipedia-en, replication should be in place mid-May still? My project is almost ready to go except for the actual db being ready [17:37:44] Warning: There are 3 users waiting for shell, displaying last 3: Balloonguy (waiting 67 minutes) Mooeypoo (waiting 61 minutes) Ed Lane (waiting 20 minutes) [17:39:32] greenrosetta: did you install this mysql server yourself? [17:51:14] Warning: There are 3 users waiting for shell, displaying last 3: Balloonguy (waiting 81 minutes) Mooeypoo (waiting 75 minutes) Ed Lane (waiting 34 minutes) [17:59:54] RobH thanks for the meeting links! [18:04:38] [bz] (NEW - created by: Chris McMahon, priority: Unprioritized - major) [Bug 47838] Extension versions not being updated reliably - https://bugzilla.wikimedia.org/show_bug.cgi?id=47838 [18:08:55] greenrosetta: Try this now? [18:13:06] Coren: Works for me [18:20:28] Coren: Would anything have changed in the past 24h relating to do with cgi scripts/qsub? I have a script thats now failing with no explanation [18:20:36] Its a CGI script that submits a job [18:21:06] legoktm: Nothing I changed, at least. Lemme go check the logs. [18:23:03] [01:22:45 PM] legoktm-- output = 'Unable to run job: denied: "9cfd3a981b053200bae9...bject name (cannot start with a digit).\nExiting.\n' [18:23:10] Coren: Job names cant start with a number? [18:23:34] Hm. That's possible; gridengine is strange this way. [18:23:53] heh [18:24:05] I'll just stick a "a" in front of all my jobs then [18:24:32] That'd work. :-) [18:25:08] val = 'a' + h.hexdigest() :P [18:31:01] Anyone have feedback regarding storage performance, BTW? Working right? [18:32:56] I can tell you it's not broken :P [18:39:56] "not broken" is good. [18:42:30] :D [18:47:10] hey ^demon [18:47:15] <^demon> Hi [18:47:19] trying to create a gerrit repo [18:47:30] it'll be analytics/user_metrics and I have two questions [18:47:40] are underscores not allowed? [18:47:59] and I see that command line is preferred over web GUI, but what should i set "owner" to? [18:48:19] <^demon> For analytics, "analytics" is a fine owner. [18:48:20] (referencing this: http://www.mediawiki.org/wiki/Git/Creating_new_repositories) [18:48:27] k [18:48:35] <^demon> I can't see any reason underscores wouldn't be allowed, but we tend to use hyphens. [18:49:40] k, no it just said "Please note name must be made of either latin letters (a-z), roman numbers (0-9) or dashes ( - )." [18:51:14] <^demon> Ah, I might've written that to enforce a naming convention :) [18:51:24] <^demon> If you reallllly need a _, it should be okie dokie [18:51:29] ok, so when i try to actually issue that command, I get "Permission Denied (publickey) [18:53:14] <^demon> Well, that sounds like your key's not loaded in your agent :\ [18:54:22] any instructions for me to do that or is that something you have to do? [18:54:33] Warning: There is 1 user waiting for shell: Boki3 (waiting 0 minutes) [18:56:45] <^demon> milimetric: `ssh-agent -l` and see what it says. [18:57:36] ssh-agent: illegal option -- l [18:57:36] :P [18:57:41] Change on 12mediawiki a page Wikimedia Labs/Tool Labs/Help was modified, changed by MPelletier (WMF) link https://www.mediawiki.org/w/index.php?diff=680692 edit summary: [+372] /* Web services */ +landing page [18:58:17] Change on 12mediawiki a page Wikimedia Labs/Tool Labs/Help was modified, changed by MPelletier (WMF) link https://www.mediawiki.org/w/index.php?diff=680693 edit summary: [+24] /* Tool Labs's landing page */ moar clearer [18:58:28] sorry, I have a very low understanding of ssh tools and paraphernalia ^demon [18:59:10] the gerrit monster probably has my key since I can use git-review just fine [18:59:24] <^demon> Bah, ssh-add -l. [18:59:26] <^demon> Typo my fault. [18:59:34] 2048 96:e3:2b:a8:fd:7c:c8:5f:4f:d5:c3:d1:dd:98:c2:f5 dan@DAndreescu-ThinkPad-T420s (RSA) [19:00:15] <^demon> Hrm. [19:00:35] <^demon> Ohhh, duh [19:00:40] <^demon> mea culpa. [19:01:11] nihil est [19:04:16] <^demon> Try now cap'n ;-) [19:08:04] Warning: There is 1 user waiting for shell: Boki3 (waiting 13 minutes) [19:09:20] I still get permission denied ^demon, i'll take this into pm [19:21:35] Warning: There is 1 user waiting for shell: Boki3 (waiting 27 minutes) [19:34:49] Coren: I don't see a cluster group in ganglia for labsnfs [19:35:08] ... I'm pretty sure I added it some ways back. [19:35:10] Warning: There is 1 user waiting for shell: Boki3 (waiting 40 minutes) [19:35:40] it's not listed on ganglia.wikimedia.org [19:35:48] I do see a group in ganglia.pp [19:36:08] and I see one in site.pp [19:36:12] hm [19:36:15] I might have forgotten a step? [19:36:27] I'm not sure if gmetad is handled by puppet yet [19:36:39] and/or not known about it in the first place. :-) [19:37:08] yeah. it's not listed in the gmetad config [19:37:21] the config says it's managed by puppet.... [19:38:37] hm [19:38:40] there's a data source list [19:38:44] it should automatically update [19:39:11] oh [19:39:12] hah [19:39:15] it's not there :) [19:41:03] sucks thats a different config [19:42:15] For future ref, where should it have been? [19:42:55] ugh [19:42:56] hold on [19:42:58] pushing in a change [19:43:25] [bz] (NEW - created by: Antoine "hashar" Musso, priority: Unprioritized - normal) [Bug 47827] beta: Setup a Wikidata wiki - https://bugzilla.wikimedia.org/show_bug.cgi?id=47827 [19:46:46] Coren: https://gerrit.wikimedia.org/r/61429 [19:47:21] Ah! Needs an entry there too! [19:48:41] Warning: There is 1 user waiting for shell: Boki3 (waiting 54 minutes) [19:50:14] Coren: so, +2/merge that (and on sockpuppet) [19:50:19] and then run puppet on nickel [19:50:56] Ryan_Lane: Yeah, still waiting on Jenkins to Verify [19:55:31] Coren... still no go [19:56:05] greenrosetta: How odd. Can I switch to your user to test it? [19:56:20] If you know how, yes [19:58:49] greenrosetta: That's really odd! For some reason, my fix seems to have been undone. [20:02:18] Warning: There is 1 user waiting for shell: Boki3 (waiting 67 minutes) [20:02:37] Ryan_Lane: Ganglia still doesn't look like it sees it [20:02:59] it's listed in the gmetad config [20:03:26] https://ganglia.wikimedia.org/latest/?r=hour&cs=&ce=&s=by+name&c=Labs%2520NFS%2520cluster%2520pmtpa&tab=m&vn= [20:03:32] only labstore3 shows up [20:03:51] Oh, duh, of course it would. [20:07:12] greenrosetta: Should be (re)fixed. Apparently, something doesn't work right when I try to automate it. Looking into it [20:07:13] Coren, did you re-apply your fix? [20:07:28] nope... still getting permission denited [20:07:45] greenrosetta: There is some caching; not sure how long it will hold. Lemme see if I can flush it. [20:07:48] ill relog [20:08:43] greenrosetta: flushed. [20:08:59] yay! [20:09:00] works [20:09:18] and my tool is online. http://tools.wmflabs.org/common-interests/cgi.py [20:09:25] too bad it doesnt do anything without a DB [20:09:44] Soon(tm) [20:09:56] Real Soon Now™ Even :-) [20:10:00] no sample wiki db's anywhere for me to play with? [20:10:13] greenrosetta: There are XML dumps; likely not what you need. [20:10:18] nope [20:15:50] Warning: There is 1 user waiting for shell: Boki3 (waiting 81 minutes) [20:19:56] Coren: If you're not too busy to explain, what's the fix for the nfs group issue? [20:20:06] * anomie likes to learn stuff [20:20:39] anomie: I simply needed to have the groups visible on the NFS server, and set its moundt to --manage-gid locally. [20:20:53] The former required some trickery to construct an /etc/group from ldap [20:21:33] mountd* [20:22:00] Coren: Nifty. I wonder if puppet wants to overwrite your /etc/group though. [20:22:36] anomie: It doesn't. But I had to rejigger the script to be smarter about when it flushes the kernel cache. [20:22:47] Coren: you're adding stuff into /etc/groups? [20:22:58] on the server, or the clients? [20:23:30] or is that something you were doing and are no longer doing? [20:23:37] Ryan_Lane: On the server alone. More precisely, I'm merging /etc/group with a list constructed from LDAP that has the group names substituted for local-xxx to avoid name clashes. [20:23:54] what's the need for that? [20:23:59] Ryan_Lane: Otherwise, we hit the 16 group limit. [20:24:15] 16 group limit? is that still an issue? [20:24:41] Ryan_Lane: For NFS it is, unless you turn on --manage-gids -- which is why I need to have group membership visible on the server. [20:24:42] <^demon> You mean in MW groups? [20:24:53] ^demon: nah. filesystem [20:24:58] <^demon> Ah, nvm then. [20:25:02] <^demon> I was like "We fixed that..." [20:25:19] ^demon: heh. yeah. a couple releases ago :) [20:25:24] hm [20:25:28] no. last release [20:25:34] --manage-gids bypasses the 16 group limit by using the groups from the server; but that means the server needs to know the groups (obviously) [20:25:54] Coren: how's that going to work with multiple projects? [20:26:12] Ryan_Lane: Not an issue since the group /ids/ don't overlap even if the names can. [20:26:26] the group ids don't overlap? [20:26:37] the local ones specifically do [20:27:00] I know, right? I was all "bummer, that can't work" untill andrewbogott told me he had to change that some weeks back to take from the same pool as the global ones. :-) [20:27:23] …. [20:27:25] wait. what? [20:28:21] so now every local group has a unique gid? [20:28:26] and every local user does too? [20:28:55] this is a problem [20:29:10] lookup for this is going to be a nightmare [20:29:25] Warning: There is 1 user waiting for shell: Boki3 (waiting 95 minutes) [20:29:35] oh. I know why. uniqueness plugin for uids [20:30:00] I can't set that for gidnumber, though [20:31:30] Ask andrewbogott, he already did it some weeks back: https://gerrit.wikimedia.org/r/#/c/59769/ [20:32:14] Ryan_Lane, I don't follow. Why is lookup harder this way? [20:32:29] hm. I guess not. [20:32:36] it just worries me to have them in the same pool [20:32:45] I guess as long as our code is always good it's not a problem ;) [20:33:00] however, the current code does a search for all objects with a gid [20:33:12] it's going to have issues with number of results returned [20:33:52] it would be really nice to have atomic way of setting this in ldap [20:34:20] [bz] (ASSIGNED - created by: Antoine "hashar" Musso, priority: High - enhancement) [Bug 36648] replicate HTTPS architecture - https://bugzilla.wikimedia.org/show_bug.cgi?id=36648 [20:34:42] Coren, you were asking before why I only use even numbered gids… there's a comment in the code that says '# Ensure groups are always even, since they'll be used for namespaces as well.' [20:34:55] yeah [20:34:59] we can probably drop that [20:35:19] I was originally going to do that, but found out that it's impossible with mediawiki as it currently is written [20:35:50] also, it'll probably suck to have so many namespaces [20:35:57] OK. I'll remove the %2 check just as soon as I understand how it works. [20:36:11] it's just a mod 2 :) [20:36:19] it ensures an even number [20:36:45] Yep, I'm trying to figure out if changing this will randomly reuse odd numbers in the middle of the pool... [20:36:52] I guess if it does that's a good thing. [20:36:54] I don't think so [20:37:00] because it looks for the highest number [20:37:34] the current code isn't the most efficient thing in the world and it has issues with scale [20:37:42] at some point we're going to be forced to refactor [20:37:50] Oh, the sort. That's what I was missing. [20:38:00] when the number of users or the number of groups > 5000 [20:38:09] and that's local + global users or groups [20:38:28] either that or we'll need to add paging support to the queries [20:38:34] but it's inefficient [20:38:57] probably need to come up with some better way of handling this [20:39:18] I wonder if it's possible to do > or < searches [20:39:21] on that attribute [20:39:28] Ryan_Lane: Oh, we were planning on one wikitech namespace per project? How... amusingly atrocious. :-) [20:39:49] Coren: well, I wasn't assuming we'd have so many projects when I originally wrote it :) [20:41:11] yeah. >= searches work [20:41:21] so, we could store the last number in the database [20:41:31] then do searches by >= that number [20:41:33] and sort that [20:41:41] it still obviously has a race condition [20:41:54] There's a way to do atomic with LDAP [20:41:59] Coren: how? [20:42:08] most servers don't have transaction support [20:42:56] It's ugly; store the "next id" in an attribute, and use a delete-add to change it. It works because if you attempt to delete the attribute with the value you read, and it throws a NoSuchAttributeException, you know someone else messed with it while you were incrementing it. [20:42:57] Warning: There is 1 user waiting for shell: Boki3 (waiting 108 minutes) [20:44:30] that's not necessarily true [20:44:38] Coren, Ryan_Lane, for starters: https://gerrit.wikimedia.org/r/#/c/61466/1/nova/OpenStackNovaUser.php [20:44:40] you don't know what you are deleting is what you read [20:44:56] Yes, because when you delete you specify by value. [20:45:06] I don't believe you can do that [20:45:43] hmmmm [20:45:52] Are atomic operations possible on memcache? [20:46:06] I think there's an increment and set, yes [20:46:15] err [20:46:18] read and increment [20:46:25] increment and read :D [20:46:31] :D [20:47:04] Hm, maybe that doesn't help. [20:47:06] I've tested it before and it works fine. In C, you use modifyAttributes() with a REMOVE_ATTRIBUTE specifying the value and an ADD_ATTRIBUTE with the new value. [20:47:22] yeah, was looking at the docs [20:47:25] andrewbogott: it could [20:47:44] of course, that assumes memcache sticks around [20:48:15] BasicAttribute("gidNumber", old_value) as arg to REMOVE_ATTRIBUTE [20:48:35] (or "uidNumber") [20:48:44] so, the race condition doesn't matter if I can set the uniqueness plugin for this :) [20:48:54] Indeed. :-) [20:49:00] I think it can be set on basedn [20:49:08] which means I can limit it to group and project [20:49:22] it only matters for primary gid [20:49:56] it's been a problem in the past because of users having the same primary gid [20:50:03] that's not an issue for service users and groups [20:54:41] ok... [20:54:47] enabled that on virt0 [20:54:51] now for virt1000 [20:56:32] Warning: There is 1 user waiting for shell: Boki3 (waiting 122 minutes) [20:57:33] uuuuggghhh. virt1000 is missing indexes [20:57:42] that's super annoying [20:57:50] * Ryan_Lane adds its indexes [21:00:30] !log deployment-prep updated MobileFrontend manually to 9356d00ac5 [21:00:33] Logged the message, Master [21:01:53] Ryan_Lane, what would a >= search look like? Apparently not "(objectclass=posixgroup)(gidNumber >= 50433)" [21:10:03] Warning: There are 2 users waiting for shell, displaying last 2: Boki3 (waiting 135 minutes) Cyrus (waiting 10 minutes) [21:14:29] Ryan_Lane, nm, that works just fine if I remember the & [21:23:34] Warning: There are 2 users waiting for shell, displaying last 2: Boki3 (waiting 149 minutes) Cyrus (waiting 23 minutes) [21:37:00] Warning: There are 2 users waiting for shell, displaying last 2: Boki3 (waiting 162 minutes) Cyrus (waiting 37 minutes) [21:50:34] Warning: There are 2 users waiting for shell, displaying last 2: Boki3 (waiting 176 minutes) Cyrus (waiting 50 minutes) [22:13:53] I had some outage [22:14:27] @seenrx Ryan_ [22:14:27] petan: Last time I saw Ryan_Lane they were quitting the network with reason: Quit: Leaving. at 4/29/2013 10:05:55 PM (00:08:32.3100000 ago) (multiple results were found: Ryan_Lane1, Ryan_Vesey, Ryan_Lane_away, Ryan__, Ryan_Lane2) [22:14:32] damn [23:01:58] [bz] (NEW - created by: Chris McMahon, priority: Unprioritized - major) [Bug 47852] beta labs down with magic word issue - https://bugzilla.wikimedia.org/show_bug.cgi?id=47852 [23:20:55] so, yeah [23:20:59] that change I made isn't gonna work :D [23:21:28] because the users and groups are both going to have gidNumber set under the same ou [23:21:34] the project one [23:21:49] and we can't have the plugin configured for every single project ou [23:22:58] so, I just disabled that [23:37:11] Coren: so, yeah. delete+add is likely the best winner here [23:55:07] someone appears to have broken betalabs [23:56:01] on http://en.wikipedia.beta.wmflabs.org/wiki/Main_Page im seeing "Error: invalid magic word 'pagesusingpendingchanges'" [23:56:46] awjr: yep, stopped me in my tracks https://bugzilla.wikimedia.org/show_bug.cgi?id=47852 [23:57:03] awjr: a different magic word brought down test2 earlier today [23:57:10] argh [23:57:17] looks like it might be from FlaggedRevs [23:57:22] i'll ping aaron [23:57:26] thanks awjr