[00:31:56] 6Labs, 6operations: Manual creation of labs account - https://phabricator.wikimedia.org/T125172#1980416 (10Cobi) 3NEW [01:08:58] 6Labs, 6operations: Manual creation of labs account - https://phabricator.wikimedia.org/T125172#1980554 (10Krenair) Instructions in T83042, LDAP admins CC'd [02:05:13] whee, progress on the annoying-wikitech-session-bug [02:09:33] I think I've got it [02:09:39] yay [02:09:47] maybe now the 'remember me on this computer' will not be a lie [02:11:34] the downside: we now log you out immediately and throw a login-required error instead of giving you an empty list [02:11:45] hah [02:11:49] that almost seems less frustrating [02:12:37] hmm [02:12:41] I think I can do better though [02:12:51] the issue is not the unscoped token breaking, it's the project token [02:13:16] I tried setting my unscoped token to blank, and it generated an error telling me to ask a nova admin to create credentials for me [02:13:51] so we need to detect the token failing, and purge the project token, then retry [02:14:09] (to generate an unscoped token we need the user's password, so it can only happen during login) [02:14:51] the project token failing* [02:20:50] and indeed nova sends us HTTP 401 when this happens [02:27:56] YuviPanda: still about? [02:28:52] chasemp: yup [02:29:11] I would like to let this roll out https://gerrit.wikimedia.org/r/#/c/267204/ [02:29:21] * YuviPanda clicks [02:29:29] http://graphite.wmflabs.org/render/?width=834&height=440&_salt=1454034432.42&target=tools.tools-bastion-01.nfsiostat.mounts.home.read.kilobytes&target=tools.tools-bastion-01.nfsiostat.mounts.home.write.kilobytes [02:29:38] example though brief data as I nuked all my testing data [02:29:40] basically [02:29:47] aaah [02:29:50] we will be able to see actual nfs stats per mount per vm [02:29:50] right [02:30:05] but you'll end up with the mount_nfs vs mount_nfs_volumes clusterfuck [02:30:17] I don't grok the whole mount_nfs thing [02:30:21] right so [02:30:22] that's a big part of why I'm asking :) [02:30:27] mount_nfs_volumes [02:30:30] is *per project* [02:30:34] hmph [02:30:44] so it returns data solely based on the project instance is in [02:30:46] but [02:30:48] for tools [02:30:51] we want to turn off NFS for specific instances [02:31:03] like https://wikitech.wikimedia.org/wiki/Hiera:Tools/host/tools-k8s-master-01 [02:31:13] so that's what mount_nfs is for [02:31:16] so mount_nfs is per-instance [02:31:21] and mount_nfs_volumes is per project [02:31:25] I think I got it [02:31:33] right thing to do is to make mount_nfs_volumes take the instance namei nto consideration too somewhow [02:32:06] chasemp: so as written, it'll add the collector to basically all the instances ever, except the few in tools where we've explicitly disabled NFS [02:32:34] so it might as well not be inside mount_nfs [02:32:43] I'm ok w/ that but probably sane to just add it to instances as they could add nfs? I have verified it's a noop on non-nfs mount hosts [02:32:45] right ok [02:32:49] and we can circle back when we untangle [02:33:25] yeah [02:33:44] 6Labs, 10MediaWiki-extensions-OpenStackManager, 10wikitech.wikimedia.org, 5Patch-For-Review: Wikitech often loses track of internal openstack/nova session - https://phabricator.wikimedia.org/T101199#1980698 (10Krenair) a:3Krenair [02:33:48] chasemp: put a comment to that effect maybe, and just don't put the if in there [02:33:52] since $mount_nfs defaults to true [02:39:20] chasemp: :D thakns! [02:39:24] chasemp: I'll file a bug about mount_nfs [02:42:27] np thanks for explaning [02:42:37] this collector took me so much longer than I thought [02:43:17] doesn't everything always for everyone :) [02:43:30] truly [02:49:20] PROBLEM - Puppet failure on tools-worker-1003 is CRITICAL: CRITICAL: 16.67% of data above the critical threshold [0.0] [02:54:13] RECOVERY - Puppet failure on tools-worker-1003 is OK: OK: Less than 1.00% above the threshold [0.0] [03:07:10] YuviPanda: spot checked some randoms in various places seems ok [03:07:13] thanks [03:07:18] http://graphite.wmflabs.org/render/?width=834&height=440&_salt=1454034432.42&target=highestAverage%28tools.tools-*.nfsiostat.mounts.home.read.kilobytes,%203%29&target=highestAverage%28tools.tools-*.nfsiostat.mounts.home.write.kilobytes,%203%29 [03:13:36] chasemp: cool! [04:23:58] 10MediaWiki-extensions-OpenStackManager, 7I18n: GENDER support in openstackmanager-addedto, openstackmanager-failedtoadd - https://phabricator.wikimedia.org/T99063#1980776 (10MtDu) a:3MtDu I'll take care of this soon. Thanks, MtDu [05:38:35] Well I did it. Waiting to see who wants to revert first :) -- https://wikitech.wikimedia.org/wiki/Main_Page [05:42:36] bd808: yay nice [05:58:56] 6Labs, 10wikitech.wikimedia.org, 7Epic: [EPIC] Make wikitech more friendly for the multiple audiences it supports - https://phabricator.wikimedia.org/T123425#1980873 (10bd808) [05:58:58] 6Labs, 10wikitech.wikimedia.org, 15User-bd808: Create Portal namespace on wikitech to give a place for audience specific landing pages - https://phabricator.wikimedia.org/T123427#1980870 (10bd808) 5Open>3Resolved a:3bd808 For now I've decided to go with the simplest thing that will work which is follow... [06:14:34] hey guys, is it likely request for installing an extra package on labs would be accepted? for an application we like to have hunspell package installed but I am not sure if that would happen if I request [06:15:07] bd808: okey. and if I want to enable emails in my labs-wiki, is there an option ? [06:16:32] ebraminio: if it is packaged for Ubuntu/Debian it will probably happen pretty quickly [06:17:14] tonythomas: well... that's a good question [06:17:38] bd808: :) heh. earlier it seems to send emails, though [06:17:43] * bd808 looks at some puppet code to find out [06:17:50] bd808: okey :) [06:20:21] bd808: Oh, thank you then [06:20:47] ebraminio: I'd suggest filing a request in Phabricator [06:20:59] Sure, I am on it :) [06:22:19] tonythomas: this puppet class sets up the default MTA -- https://phabricator.wikimedia.org/diffusion/MWVA/browse/master/puppet/modules/postfix/manifests/init.pp [06:23:01] tonythomas: and this template is the part that traps all the mail -- https://phabricator.wikimedia.org/diffusion/MWVA/browse/master/puppet/modules/postfix/templates/virtual.erb [06:23:16] bd808: okey. so it was postfix running [06:23:19] 6Labs, 10Labs-Infrastructure: Install hunspell on tools - https://phabricator.wikimedia.org/T125193#1980922 (10Ebraminio) 3NEW [06:23:30] now wonder I tried checking for exim4 [06:23:46] so, everything gets routed to the vagrant user. [06:24:26] yeah. which is the safe and sane thing to do in a development environment, but not so good in your use case [06:25:33] with some fancy puppet magic you can highjack the contents of /etc/postfix/virtual and replace them with another virtual user map (like an empty one) [06:25:49] let me see if I can find an example of how to do that [06:25:54] bd808: true. and I believe we setup something like a labs mail server last time [06:26:14] let me check for the mail, which I sent to wikitech on that [06:27:37] oh. it was for beta, mx.beta.wmflabs.org [06:28:37] 6Labs, 10Labs-Infrastructure: Install hunspell on tools - https://phabricator.wikimedia.org/T125193#1980935 (10Ebraminio) Also we are not intrested on language packs hunspell provides, such as hunspell-fr, as we like to use our own dictionaries here. [06:30:40] tonythomas: found it. Check out the code comment in this revision -- https://gerrit.wikimedia.org/r/#/c/244821/6/puppet/modules/mediawiki/manifests/apache.pp,unified [06:31:43] You can use a "resource collector" to override the file contents from a manifest that is applied later in the dependency chain [06:33:02] The easiest way to do that for your instance would be to add a local manifest in puppet/modules/local/manifests and then apply it via hieradata/local.yaml [06:35:27] tonythomas: there is a short tutorial on local manifests starting at https://www.mediawiki.org/w/index.php?title=File:MediaWiki-Vagrant_Tech_Talk_2014Q4.pdf&page=21 [06:42:01] bd808: thanks for that. I will try setting that up, or I will try messing up a bit with exim to make it route through the wikimedia mail servers ( is it even posible ? ) [06:53:01] tonythomas: if should be possible to get to an external MX but exim and postfix will end up being in conflict I think [06:53:42] tonythomas: also the new Mediawiki-vagrant stuff in labs happens inside the LXC container so don't forget to do your messing around after `vagrant ssh` to get inside the container [06:53:44] bd808: yeah - so - is it like none else tried sending emails from their labs wiki ? [06:54:09] *shrug* I haven't [06:54:27] okey. then it might not be a likely testcase [06:54:28] :\ [07:00:02] tonythomas: well email *does* get delivered and you can look at it in the vagrant user's mail spool. That's just not very helpful for people who are expecting actual emails in their inbox [07:21:21] bd808: true. for the usual case, this seems to be enough. [09:38:48] bd808: awesome redesign, thanks :-) [10:39:01] 6Labs, 10Labs-Infrastructure: Install hunspell on tools - https://phabricator.wikimedia.org/T125193#1981140 (10Ebraminio) This is somehow is in continuation to T123192 but we don't need the python binding installed here and just vanilla hunspell and its headers package which are in widely use on other software... [10:40:21] 6Labs, 10Tool-Labs, 5Patch-For-Review: Install python-hunspell (and dictionaries?) - https://phabricator.wikimedia.org/T123192#1923416 (10Ebraminio) Somehow similar T123192 but not the exactly the same. [10:44:56] Hello [10:46:02] here is a new labs user, now trying to connect databases. [10:48:35] Youni: Feel free to ask, if you have a problem [10:53:28] thanks, i connect MariaDB in the tool.vocabulary-index than i reach a Describe command on the page table of enwiki_p [10:54:43] but y-verciti can't connect, i guess the pb is arround the rights of replica.cnf file [10:56:29] -r---w---- 1 tools.vocabulary-index tools.vocabulary-index 52 Jan 27 14:18 replica.my.cnf [10:57:11] the replica.my.cnf stand in the vocabulary-index directory [11:09:17] Sorry i mean the tool.shell is connecting via "sql enwiki_p", but the user shell doesn't it ask me a password [11:46:47] Youni: Have you changed the permissions of replica.my.cnf in your user (not tool) directory [12:04:33] hi jogo, to be honest there is no replica.my.cnf. So i'm going to cp replica.my.cnf from tool.dir to user.dir ; than i could change the permissions. Isn't it [12:11:32] Thanks jogo-obb, i cp the replica file in the user.dir than it's connecting. Abraço [12:19:16] Youni: Normaly there should had been one, maybe you deleted it. The content should be user='u14037' and password='???' [12:20:54] Youni: A labs admin maybe can reset the pw for you [12:33:32] I get my replica file creating the tool account, than the file cames here. I check the user id... [12:34:44] oups my user id is "s52859" [13:11:27] Youni: ask jynus [13:11:40] for resettinng the password [13:16:11] i can access data base in y-verciti shell since i cp the replica file from tools.vocabulary-index. Do you mean it's better two reset the password of y-verciti? [13:17:30] ? [13:17:55] Youni: Thats the userid of your tool, I don't know if it has sideeffekts to work with user shell and tool mysql credentials [13:18:06] there's none [13:19:22] at least afaik, db username is just a name, nothing hardcoded to be related to shell user id [13:20:12] in the pmtpa time they were like u****g**** [13:23:09] So l ask jynus to do it via the irc user dialogbox now... [13:29:33] (03PS2) 10Aude: Add wikidata/.* to wikidata-feed [labs/tools/grrrit] - 10https://gerrit.wikimedia.org/r/247831 (owner: 10Addshore) [13:30:07] (03CR) 10Aude: Add wikidata/.* to wikidata-feed (031 comment) [labs/tools/grrrit] - 10https://gerrit.wikimedia.org/r/247831 (owner: 10Addshore) [13:55:02] Youni: jynus can't help you. Please file a bug in phabricator under the #labs project [13:55:32] zhuyifei1999_: the username is u + numeric userid (for users) or g + numeric group id (for service groups / tools) [13:56:25] yeah, I meant it's not hardcoded to have a permanent relationship [13:56:32] oups i'm creating the phabricator user and trying to join an already created ticket... [13:56:59] zhuyifei1999_: huh? it /is/ a permanent relationship -- your numeric userid doesn't change [13:57:20] it's still two names, one created from the other [13:58:26] but one cannot conclude that from a username of u1234 the actual user id is 1234 [13:58:52] yes, you can. [13:59:21] well, an admin can create a user named u1234 [14:00:31] anyways, this discussion is off topic [14:01:55] 6Labs, 10Tool-Labs: [Tool Labs] Database credential file replica.my.cnf missing in my home directory on Tool Labs (/home/wiki13). - https://phabricator.wikimedia.org/T122657#1981490 (10Youni) Hello, i'm new lab user. It seems to be something wrong with my /home/y-verciti/replica.my.cnf. I first get a replica... [14:03:39] "user will act with a bad id" why? [14:06:48] Sorry i supposed, so i comment the T122657 on phabricator. But anyway the connection to database occure with both account and i will try to configure Git now. [14:47:52] (03CR) 10Addshore: [C: 031] Add wikidata/.* to wikidata-feed [labs/tools/grrrit] - 10https://gerrit.wikimedia.org/r/247831 (owner: 10Addshore) [15:41:50] 6Labs, 6operations: evaluate possibility for nscd use with useldap - https://phabricator.wikimedia.org/T124991#1981692 (10mark) [15:42:04] 6Labs, 6operations: evaluate possibility for nscd use with useldap - https://phabricator.wikimedia.org/T124991#1971715 (10mark) [16:30:30] So i have git installed on my local station [16:31:38] but i'm can't find the right way to configure it. [16:33:02] I have a local directory with the files project, i mean main python script and 3 modules. [16:35:57] i believe that git is abble to sychronise file between the local directory and the remote /data/project/vocabulary-index [16:45:53] reading man gittutorial i see that i need a tarball of the project [16:51:27] (03CR) 10Purodha: [C: 031] Add PLURAL support to LOGEVENT_RENAMEUSER message [labs/tools/crosswatch] - 10https://gerrit.wikimedia.org/r/265647 (https://phabricator.wikimedia.org/T114876) (owner: 10MtDu) [17:12:19] sorry, i found a french doc on git-scm.com ;-P [18:46:45] Is this tool (http://tools.wmflabs.org/image-resize-calc/) down because Labs-error, or error in the tool? Could someone restart it perhaps? [19:23:41] kaldari, ping [20:54:46] hi kaldari [21:21:13] chasemp: do you think you'll have time to look at tools-worker-1002 today? [21:21:47] I've been trying to get to it and stuck in a hole here, I'll take a quick look here [21:21:58] sorry I thought it was just parked until whenever [21:22:47] chasemp: yeah, it is just parked till whenever :D just was curious, is ok to wait [21:22:56] chasemp: it's long term concerning but not on fire [21:23:19] oh ok in that case, I hope to but I'm not sure [21:23:40] chasemp: I'm ok with keeping it in its current state until we can look closely [21:23:54] chasemp: if you can document the way to get a shell on it with VNC or whatever, I can take a look too [21:23:59] but can certainly wait a week or two :) [21:24:07] I've pooled in a new node in the meantime [21:25:10] !log tools restarted image-resize-calc manually, no service.manifest file [21:25:14] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/SAL, Master [21:25:34] YuviPanda: I was going to try salt [21:25:36] and go from there [21:26:30] chasemp: ok