[00:06:57] New patchset: Platonides; "Make dir a normal fd." [labs/toollabs] (master) - https://gerrit.wikimedia.org/r/70110 [07:16:05] zz_YuviPanda . [07:54:34] zz_YuviPanda you have admin on toolsbeta, getting yourself root is a first task you need to pass to prove you are ready for it :P [07:57:23] !log tools petrb: 50527 4186 22830 1 Jun23 pts/41 00:08:54 python fill2.py eats 48% of ram on -login [07:57:26] Logged the message, Master [07:58:29] henna ping [07:58:38] henna: can you consider moving this job to grid? :P [07:58:46] or -dev at least... [08:08:04] grrr Cannot login in AWB o-O [08:49:44] a930913: still want help with flask on cgi? [08:53:14] a930913: you can see https://github.com/addshore/dumpscan/blob/master/dumpscan.py [08:55:52] petan: the second sentence confused me. [08:56:01] petan: admin != root? [08:56:08] YuviPanda no [08:56:12] ok [08:56:14] so I have admin [08:56:15] but not root [08:56:17] YuviPanda admin == being able to grant root [08:56:23] .. [08:56:23] ahh [08:56:47] so I don't have root but I can grant myself root? :) [08:56:51] yes [08:57:08] and if you can't do that simple task you probably don't deserve it :D [08:58:48] :P [08:58:49] right [08:59:02] petan: is toolsbeta puppetized? [08:59:09] like, are the various components built from puppet? [08:59:10] or hand? [08:59:37] toolsbeta is using same stuff as tools [08:59:42] same puppet classes [08:59:53] check the puppet config of instances [08:59:59] as admin you apparently can change instances too [09:00:03] ah, sweet [09:25:26] YuviPanda: Ta. I got it working, though gave it up after I realised it wasn't a daemon. [09:25:35] ? [09:25:38] petan: Is py3 -dev installed? [09:25:47] ? [09:25:57] what is that? [09:26:03] is that a library or some program? [09:26:16] why there is space between py3 and -dev [09:26:33] YuviPanda: Flask cgi is loaded per webpage hit. [09:26:44] that's a CGI issue, yeah :) [09:26:54] everything is :) [09:26:54] petan: Because I'm tired :p [09:26:58] should be better with wsgi, maybe even fastcgi [09:27:05] a930913 I have no idea what you want [09:27:15] YuviPanda: I've settled for running a daemon that is queried by the cgi. [09:27:21] are you worried about 'performance implications' of loading flask everytime? [09:27:26] hmm, how are you running the daemon? [09:27:27] petan: python-dev for python 3. [09:27:30] continuous task? [09:27:39] YuviPanda: Atm, in a screen on login. [09:27:53] Coren doesn't like that, IIRC :) [09:28:06] YuviPanda: Hey, I'm developing it. [09:28:10] hehe [09:28:14] :) [09:28:21] When it works, I'll migrate it to the grid :) [09:28:28] I'm going to have to do some celery stuff to have a core framework [09:28:39] of how to do this kinda 'hand off stuff to grid and then wait' tools [09:30:08] petan: I tried pip installing for python 3, and it complained of no Python.h [09:30:13] ok sec [09:30:19] you want that on -dev I guess [09:31:16] petan: i think he's looking for the package 'python3-dev' [09:31:25] yes I knwo [09:31:26] which gives header files for python3 [09:31:27] ok [09:32:23] installed [09:32:32] petan: I've only used -login. I never really learnt what was out there, nor how to connect. [09:32:52] -dev is a place to build stuff at [09:33:08] -login is only supposed to be used for ssh / management of grid jobs etc [09:39:58] petan: Ah, kk. [09:40:19] Well, now to work out what's causing the next error D: [09:44:16] a930913: summarized: don't use -login, use -dev, unless -dev is overloaded and you quickly need to start a job :-p [09:44:57] valhallasw: Might want to make that clearer on the wiki, if it isn't already. :) [10:08:11] !log wikidata-dev wikidata-dev-9 installed "WikibaseDataModel" in "/srv/devrepo/w/extensions" [10:08:13] Logged the message, Master [10:11:14] !log wikidata-dev wikidata-dev-9 installed "WikibaseDataModel" in "/srv/devclient/w/extensions" [10:11:15] Logged the message, Master [10:11:52] !log wikidata-dev wikidata-dev-9 updated crontab to pull "WikibaseDataModel" [10:11:53] Logged the message, Master [10:19:33] petan: ping [10:19:37] how do I give myself root? [10:19:44] sudo nor su work, so can't really visudo [10:20:35] YuviPanda: probably by adapting sudoers in the puppet config? [10:20:41] not sure, though [10:20:56] or something something ldap [10:21:07] well, that would require someone to merge that, and petan said I just need to be member of admin group [10:21:07] hmm [10:21:36] maybe there is a root service group or something? [10:22:46] hmm [10:22:49] * YuviPanda looks at wikitech [10:25:06] hmm I can edit config in wikitech [11:07:01] !sudo [11:07:01] You have sudo in any project that you are a member of, excluding global projects (like bastion). Your sudo password is your labsconsole wiki password. [11:07:06] mhm [11:07:19] YuviPanda: did you try sudo groups? :P [11:07:21] in wikitech [11:07:30] grr, didn't click that [11:07:43] YuviPanda I recommend you to read labsconsole help [11:08:43] !log Granted yuvipanda root on toolsbeta [11:08:43] Granted is not a valid project. [11:09:08] !log toolsbeta Granted yuvipanda root on toolsbeta [11:09:10] Logged the message, Master [11:09:15] mmm :) [11:13:52] petan: that !sudo message makes no sense- I doubt I have sudo at tools :P [11:14:18] valhallasw: heh, that makes sortof sense for labs in general, tho [11:14:21] not for tools-labs [11:14:28] valhallasw it's from times when labs started [11:14:34] old several years I guess [11:14:43] yeah [11:14:51] so please update it to make sense ;-) [11:15:03] valhallasw: [[WP:BB]] [11:15:06] something like 'where you are in the root sudo group' [11:15:07] "If you are wondering if you have sudo, you don't" [11:15:14] valhallasw broken? fix it! [11:15:25] petan: except I don't know how it works [11:15:34] valhallasw it's broken because you didn't fix it :P [11:15:41] read help, educate yourself :P [11:15:45] This bot is running http://meta.wikimedia.org/wiki/WM-Bot version wikimedia bot v. 1.10.8.15 source code licensed under GPL and located at https://github.com/benapetr/wikimedia-bot [11:16:06] petan: 'it' = sudo on labs, not wm-bot [11:16:07] geez. [11:17:03] it's pretty enough to link it to https://wikitech.wikimedia.org/wiki/Help:Sudo_Policies [11:17:15] !sudo is https://wikitech.wikimedia.org/wiki/Help:Sudo_Policies [11:17:15] This key already exist - remove it, if you want to change it [11:17:23] !remove sudo [11:17:34] ugh. Whatever. [11:18:12] !sudo del [11:18:12] Successfully removed sudo [11:18:14] !sudo is https://wikitech.wikimedia.org/wiki/Help:Sudo_Policies [11:18:15] Key was added [11:18:29] happy now? You could have, of course, done that in about 1/10th of the time it took me. [11:20:18] * YuviPanda gives valhallasw ice cream [11:20:28] Thanks. [11:32:41] valhallasw yes I could, but in that case you would never learn it :P [11:32:56] that's how wikipedia works - it's broken? fix it [12:13:35] addrest, ping [12:43:19] http://deployment.wikimedia.beta.wmflabs.org/w/index.php?title=Special:AbuseLog&wpSearchFilter=8 [12:43:32] i hav locked som spambots global som day ago. [12:43:45] But the spambots continuing to spamming o_O Bug? [12:46:00] *ping* Hashar [12:53:36] Steinsplitter: pong [12:55:53] see above, hashar. seems to be a bug [13:00:58] Steinsplitter: sounds to me they are still trying [13:01:04] despite receiving a warning and a disallow [13:01:25] jepp. But the accounts ar globaly locked? [13:01:25] the page http://simple.wikipedia.beta.wmflabs.org/wiki/User:Christinab2l has no content [13:01:54] jep. The filter :). But locked accounts cannot perform any actions.? [13:01:57] I am not sure what the 'Disallow' action is [13:02:03] maybe it does not block the user [13:02:10] also global blocking might not be working [13:02:48] Disallow = do not save the page [13:03:23] what is strange is that http://simple.wikipedia.beta.wmflabs.org/wiki/User:LolaHarrington [13:03:32] does not seem to be an account on the simple wiki [13:03:41] jepp. [13:03:51] hashar: cu is disalowed on beta? [13:03:58] cu ? [13:04:07] CheckUser [13:04:13] ah yeah [13:04:14] it is [13:04:17] as well as oversight [13:04:29] that scared some people apparently [13:04:50] :----( [13:05:08] at least the filter block the edits \O/ [13:05:21] jepp [13:07:01] hmpf... seems to be a bug in the global filter (Lola Harington). i ask later hoo_man [13:07:16] Does a puppetmaster need a special security group? [13:26:05] Steinsplitter: LolaHarrington is a global user on labswiki apparently [13:26:34] ah [13:41:35] scfc_de try to use take on /tmp/take-test [13:41:38] cd /tmp/take-test [13:41:40] take * [13:41:48] on -login [13:42:01] !log toolsbeta Created toolsbeta-puppetmaster. [13:42:03] Logged the message, Master [13:42:45] "05-role-role--labs--tools--webproxy: You need to share a group with the file" -- and? [13:42:56] (That's not "file not found".) [13:43:10] !log toolsbeta Made scfc root. [13:43:19] Logged the message, Master [13:44:04] scfc_de hold on [13:44:24] try now [13:45:16] Okay, I see that error. [13:51:19] "take 05-role-role--labs--tools--webproxy 40-infrastructure-banner 40-infrastructure-banner-beta 99-footer addtool continuous" works, "take 05-role-role--labs--tools--webproxy 40-infrastructure-banner 40-infrastructure-banner-beta 99-footer addtool bin continuous" doesn't. [13:51:57] "take bin" works, "take bin continuous" doesn't. [13:54:02] So we fchdir() to the subdirectory in line #130, but don't change back. [14:26:43] scfc_de: still reading through puppet docs, but I guess now that we have a puppetmaster locally, we can put our scripts in there and have the other instances update from that? [14:29:22] YuviPanda: I have read the Puppet docs, but have to read up on puppetmaster::self :-) (and especially how to set clients to another puppetmaster in the instance config). I'm waiting for Ryan_Lane or andrewbogott to come online. [14:29:33] ah, wonderful [14:32:19] @notify Coren [14:32:19] This user is now online in #wikimedia-labs. I'll let you know when they show some activity (talk, etc.) [14:39:33] New patchset: coren; "take.cc: Fix argument evaluation (directories)" [labs/toollabs] (master) - https://gerrit.wikimedia.org/r/70170 [14:47:37] !log toolsbeta petrb: rebooting exec-01 to fix the grid weird info [14:47:39] Logged the message, Master [14:47:55] !petan [14:47:55] Petr Bena - http://enwp.org/User:Petrb [14:48:02] hey [14:48:11] !Coren [14:48:12] Coren is dead. petan killed him. He now roams about as a zombie. [14:48:19] :D [14:48:45] petan, why? ^ [14:49:28] I'm not really here today (statutory holiday) but I thought I might point out the mysterious appearance of s7. [14:49:51] Coren|DayOff, really? :):):):) [14:50:22] Coren|DayOff you promised to review new take :o [14:50:25] Not centralauth itself though, that one is still missing its views (the automated system couldn't work for it). The wikis on it are though. [14:50:35] it's just like 200~ lines of code :3 [14:51:35] Coren|DayOff, what about legal? [14:52:47] petan: well, it is his day off :) [14:53:17] YuviPanda :( [14:56:37] petan, you are hereby promoted to Acting Coren. [14:56:46] Coren|DayOff urgent PM [14:57:00] petan, now get to work. :D [14:58:17] Cyberpower678: :DS [14:58:22] without S, actually [14:59:17] valhallasw, I just gave my Peachy framework the ability to update itself. [15:02:32] hi, my bot instance (bots-salebot) is not responding... can an admin restart it? [15:02:40] (do I have the rights to do that myself?) [15:03:51] gribeco: Are you talking of the Bots project? [15:04:13] scfc_de: the instance is part of the bots project, yes [15:07:12] gribeco: I think only admins can do that. [15:07:49] gribeco, you could try Coren but... [15:07:51] !Coren [15:07:51] Coren is dead. petan killed him. He now roams about as a zombie. [15:09:26] petan: could you reboot bots-salebot and/or Coren? [15:10:33] petan can't reboot Coren, I think [15:10:48] here [15:10:53] gribeco yes [15:11:03] petan: cool, thanks [15:11:13] gribeco you really want to move that bot there to tools project... [15:11:28] ok [15:11:51] * Cyberpower678 reboots petan  [15:15:11] !log bots rebooting salebot instance [15:15:13] Logged the message, Master [15:17:16] New patchset: Tim Landscheidt; "take.cc: Fix argument evaluation (directories)" [labs/toollabs] (master) - https://gerrit.wikimedia.org/r/70170 [15:20:00] petan: looks a lot better now; thanks! [15:21:17] petan: Are all tools supposed to have new replica.my.cnf? Or just users? [15:26:02] oh, sorry, my mistake [15:26:06] all users [15:26:08] tools are fine [15:26:11] I will update my email [15:27:17] anomie ^ [15:27:53] hashar: do you have any thoughts on why this might be happening in beta? https://bugzilla.wikimedia.org/show_bug.cgi?id=49911 [15:29:31] chrismcmahon: maybe search is dead :) [15:30:10] hashar: it's the expand/collapse on the left side missing that worries me more [15:31:19] that sounds like two different bugs to me [15:31:36] the expand collapse might be a regression in the Vector skin / extension [15:31:42] or in the mediawiki configuration [15:31:49] the search is probably because search is dead [15:37:53] !log deployment-prep upgrading -searchidx01 and refreshing puppet manifests [15:37:55] Logged the message, Master [15:38:18] !git operations/puppet [15:38:18] For more information about git on labs see https://labsconsole.wikimedia.org/wiki/Help:Git [15:38:50] petan, S7 seems to be frozen. When I did sql metawiki, everything stopped responding. [15:39:06] And the edit counter still isn't working with it either. [15:39:43] petan, [15:39:44] ERROR 2003 (HY000): Can't connect to MySQL server on 'metawiki.labsdb' (110) [15:39:44] Make sure to ask for a db in format of _p [15:40:10] labsdb.metawiki_p ? [15:40:20] hashar: does manybubbles know that search is dead? [15:40:37] hashar, hih? [15:40:44] huh? [15:40:45] long live search? [15:40:46] Cyberpower678: maybe metawikiwiki? [15:40:48] sumanah: no and he doesn't have to care about it :-) [15:40:58] sumanah: that is the old lucene install being broken in beta :-D [15:40:58] oh ok [15:41:02] nevermind [15:41:12] sumanah: thanks =) [15:41:13] I do care - it makes me want to replace it even more! [15:41:21] Cyberpower678 I would try just meta, or find out what the name is [15:41:26] you will see it in /etc/hosts [15:41:41] these special wiki's like meta were aliased in sql so that it's easier to get to them [15:41:51] local-xtools@tools-login:~$ sql metawiki [15:41:51] ERROR 2003 (HY000): Can't connect to MySQL server on 'metawiki.labsdb' (110) [15:41:51] Make sure to ask for a db in format of _p [15:41:51] local-xtools@tools-login:~$ ^C [15:41:51] local-xtools@tools-login:~$ sql metawikiwiki [15:41:54] This is unknown db to me, if you don't like that, blame petan on freenode [15:41:54] manybubbles: yeah it is a bit unstable in beta, the java daemon dies from time to time and I don't think we have any monitoring :-] Will fix it up manually [15:41:56] Make sure to ask for a db in format of _p [15:42:00] local-xtools@tools-login:~$ sql meta [15:42:02] This is unknown db to me, if you don't like that, blame petan on freenode [15:42:02] Cyberpower678 I said "meta" [15:42:04] Make sure to ask for a db in format of _p [15:42:06] ok [15:42:09] let me find out [15:42:22] From what I'm seeing, it's metawiki [15:42:40] !log deployment-prep restarted lucene-search-2 on searchidx01 [15:42:42] Logged the message, Master [15:42:45] Cyberpower678 sql metawiki works to me [15:43:02] which is s7 [15:43:05] that doesn't work :P [15:43:07] java.io.IOException: Server returned HTTP response code: 403 for URL: http://de.wikivoyage.beta.wmflabs.org/w/index.php?title=Special:OAIRepository&verb=ListRecords&metadataPrefix=mediawiki&from=2001-01-01 [15:43:08] oh yeah [15:43:32] petan, Like I said. S7 is frozen. [15:44:09] not anything I can fix :/ [15:44:13] Coren|DayOff, S7 mysteriously appeared broken. [15:44:21] :p [15:44:50] chrismcmahon: search is fixed up :-) [15:45:13] ok thanks hashar. those issues showed up at exactly the same time last week [15:45:26] !log tools petrb: changed colors of root prompt productions vs testing [15:45:28] Logged the message, Master [15:46:59] chrismcmahon: for the sidebar "triangles", I do got them using Safari 6.0.5 and http://en.wikipedia.beta.wmflabs.org/wiki/Main_Page [15:47:13] or not hmm [15:47:56] chrismcmahon: yeah I got some javascript errors in my console :( [15:48:02] Exception thrown by skins.vector.js: 'undefined' is not a function (near '...;}}).collapsibleTabs();});(function($){v...') [15:48:21] hashar: nice. I don't know that I saw that reliably last week. [15:48:29] looking again [15:48:41] though using ?debug it doesn't show [15:48:42] http://en.wikipedia.beta.wmflabs.org/wiki/Main_Page?debug [15:48:52] so that must be some page which is staleld [15:49:00] I guess the bits cache is not properly purged [15:50:37] petan: does wm-bot also allow logging for service groups? [15:50:47] huh [15:50:49] logging of what [15:51:11] oh wait, that's labs-morebots that does that, now wm-bot [15:51:43] and logging as in !log [15:51:54] logging as !log is morebots [15:52:03] wm-bot is just relaying !log messages from terminal [15:52:13] so that I don't need to switch windows [15:52:19] I am very lazy if you didn't notice yet [15:52:24] I am famous for that [15:53:16] hashar: bits cache? [15:53:53] chrismcmahon: sorry was merely speaking to myself. The bits cache hold the javascript and css files, that is not related to the issue [16:02:35] chrismcmahon: ahhh [16:02:39] Vector has not been updated :-] [16:14:19] hashar: well, I'm glad it's not a production bug, but it is breaking a lot of my builds :) [16:20:40] I am not able to get onto parsoid.wmflabs.org -- get kicked out right away [16:28:35] paravoid, can you help me? [16:39:14] New review: Platonides; "I considered whether take folder in the non-recursive case should change the folder owner or not (or..." [labs/toollabs] (master) - https://gerrit.wikimedia.org/r/70059 [16:41:01] scfc_de: do poke me when you start doing stuff with the puppetmaster :) [16:43:14] New review: Platonides; "(1 comment)" [labs/toollabs] (master) - https://gerrit.wikimedia.org/r/70058 [16:44:05] hello ops folks, once again .. I am not able to get onto parsoid.wmflabs.org -- get kicked out right away because of this: "Unable to create and initialize directory '/home/ssastry'" .. Roan and Gabriel cannot get on either because of similar issues. [16:45:23] * subbu goes back to writing tests [16:47:41] chrismcmahon: will attempt to have a look at it tongiht [16:47:51] chrismcmahon: seems to be some cache related issue. I might just clear the cache [16:54:27] YuviPanda: Will do. [16:54:31] ty [17:04:06] New patchset: Platonides; "take.cc: Fix argument evaluation (directories)" [labs/toollabs] (master) - https://gerrit.wikimedia.org/r/70170 [17:04:59] New review: Platonides; "PS3: Fixed space indentation, and skipped fchdir() when unneeded." [labs/toollabs] (master) C: 1; - https://gerrit.wikimedia.org/r/70170 [17:07:58] Can someone tell me the external hostname of the replication databases? [17:09:36] Cyberpower678: You can't access them from outside. [17:09:48] scfc_de, grrrr. [17:11:02] Cyberpower678: Why do you want to do that anyway? You have been shown multiple times how to use ssh tunnels. [17:11:24] scfc_de, I can't seem to get them to work. [17:14:25] hi, it seems that gluster seems to have issues again- we still get login failures on parsoid-spof [17:16:39] after a reboot of the VM services that depend on gluster did not come back up again either [17:19:06] andrewbogott, Ryan_Lane: ^ [17:19:14] gwicke: try now [17:19:22] I fixed it for you about 10 mins ago [17:19:53] thanks, trying.. [17:20:14] fixed, thanks! [17:20:17] yw [17:20:27] we'll be switching to NFS for homedirs this week [17:20:31] and project storage later on [17:22:33] back to good old NFS ;) [17:22:56] well, till we find a DFS that does multi-tenancy reliably :) [17:23:30] Ryan_Lane: I am trying to puppetize Redis for tools labs, do take a look at https://gerrit.wikimedia.org/r/#/c/70212/ and its dependency when you can :) [17:23:39] Ryan_Lane: Re puppetmaster::self, can (and how do) I direct other instances to pull their puppet config from a project puppetmaster, i. e. "toolsbeta-puppetmaster". I see a variable $::puppetmaster, but I don't see how I could set it in the instance configuration (Special:NovaInstance...). [17:24:11] YuviPanda: well, it has a −1 from jenkins ;) [17:24:21] hmm, what did I do now [17:25:10] YuviPanda: Missing "{"? [17:25:22] No. [17:25:41] no [17:25:58] scfc_de: I haven't set this up, I don't know [17:26:02] Ryan_Lane: https://gerrit.wikimedia.org/r/#/c/70064/3 is a dependent commit, and doesn't have a -1 :) [17:26:05] i'm looking at the -1 now tho [17:26:14] it may be that we need to add a global variable for this [17:26:33] andrewbogott: Did you write puppetmaster::self? [17:26:35] I'll ask ottomata when he gets on [17:27:30] Ryan_Lane: ottomata designed puppetmaster::self? [17:27:50] he changed it to allow instances to point to a central instance [17:28:08] Ryan_Lane: -1 gone :) https://gerrit.wikimedia.org/r/#/c/70212/ [17:28:22] scfc_de: I... had $s there. [17:28:27] Ryan_Lane: Okay. [17:32:57] /data/project is mounted by automount? [17:33:07] yes [17:35:03] Ah, I missed setting a role for that instance. That makes sense. [17:36:29] YuviPanda: I added a comment [17:37:27] is Labs already considered stable enough for productiony stuff? last year, we used a dedicated server for WLM, can it be different this year? [17:37:50] MaxSem: labs is not meant for production at all [17:37:59] Ryan_Lane: hmm, I was a little confused about .each vs .each_pair, so opted for safer alternative. [17:38:03] * YuviPanda 's ruby is nonexistant [17:38:04] Ryan_Lane: fixing [17:38:27] MaxSem: if this is a production need, then it should go in production [17:38:36] Ryan_Lane, yet is hosts Tool labs:) [17:38:38] tool labs is not production ether [17:38:41] *either [17:39:06] it has slightly better support than TS, but not the same as production [17:39:40] yep, so WLM was just a way to run TS stuff on a more stable server [17:40:50] if I recall correctly, you guys were doing some weird crap with moving data from TS to a production machine [17:41:01] pretty sure we weren't fans of that [17:41:08] we neither;) [17:41:23] labs isn't the answer for that [17:41:25] we aren't doing any of that, IIRC. [17:41:30] this year, I mean [17:41:35] ah. good [17:41:41] they're moving all their stuff to WikiData [17:41:44] so, what's the need for labs hosting, then? [17:42:06] tfinc confirmed that we aren't doing it about 5 seconds ago :P [17:42:06] so [17:42:12] MaxSem asked it before, I guess. [17:42:29] ok, so no need for hosting anything in labs, then? [17:42:34] yup [17:42:38] sweet [17:42:42] much easier :) [17:43:06] keeping production things out of labs is one of my responsibilities ;) [17:43:11] :) [17:43:44] Ryan_Lane: updated patchset https://gerrit.wikimedia.org/r/#/c/70064/3 [17:43:54] Ryan_Lane, actually Asher asked last year if this stuff can be run from Labs [17:44:33] MaxSem: talking about labs, what happened to the OSM stuff? [17:44:55] blocked on ops [17:45:05] someone was going to setup a dedicated db for this [17:45:16] for the db access anyway [17:45:27] tile server is going to be in production, not labs [18:14:37] New review: Petrb; "-g is useful if you are overtaking files created by your tool. You may want to change the group as w..." [labs/toollabs] (master) - https://gerrit.wikimedia.org/r/70058 [18:19:15] New review: Petrb; "Why are you using c style and c standard functions in c++ source code?" [labs/toollabs] (master) - https://gerrit.wikimedia.org/r/70058 [18:26:56] Because c is cooler than c++? :P [18:27:48] Ryan_Lane: But a openstack deployment for running prod stuff on would be cool :P [18:29:29] Damianz: virtualization for some things would be nice [18:30:11] New review: Platonides; "Is that a serious question??" [labs/toollabs] (master) - https://gerrit.wikimedia.org/r/70058 [18:30:16] As long as it's not databases :D [18:43:23] New review: Tim Landscheidt; "(1 comment)" [labs/toollabs] (master) - https://gerrit.wikimedia.org/r/70058 [19:00:34] New review: Petrb; "(1 comment)" [labs/toollabs] (master) - https://gerrit.wikimedia.org/r/70058 [19:59:54] legoktm: ping? [20:00:01] pong [20:00:41] legoktm: wikidata question [20:00:51] sure, whats up? [20:00:52] legoktm: is querying things possible now? [20:01:09] define "querying things" [20:01:09] legoktm: like, 'items with property X = value Y' [20:01:42] not yet, butttt [20:01:56] magnus has a tool somewhere that lets you do that [20:02:39] legoktm: ah, link? [20:02:43] legoktm: also, it is 'coming soon'? [20:02:49] for some definition of 'soon' [20:03:49] * legoktm finding [20:03:53] is finding* [20:05:20] found it [20:05:23] YuviPanda: http://208.80.153.172/api_documentation.html [20:05:41] ah [20:05:45] http://208.80.153.172/wdq/ is more humanized [20:05:48] mm, nice [20:06:02] legoktm: do you know if this is coming to wikidata.org at all? [20:06:07] or will this always remain 'tool'ized? [20:06:13] it will be a feature "soon" [20:06:55] okay :) [20:06:59] bbl lunch :D [20:07:07] ah, he's reading them from dumps [20:07:07] ok [20:07:41] YuviPanda go sleep [20:07:52] petan: it's only 2 AM! [20:07:55] lol [20:08:02] I am going to sleep soon [20:08:08] and I have like 23 [20:08:17] (11PM) [20:08:18] :P [20:08:23] i woke up at 2pm [20:08:24] so [20:08:29] damn [20:08:32] petan: plus the daytime heat is unbearable, so I prefer being late [20:08:35] I want to work for wmf too :( [20:08:51] I want to live in india :/ [20:09:05] India is pretty nice [20:09:08] I love warm :P [20:09:08] this particular city isn't tho [20:09:11] weather [20:09:11] <^demon> YuviPanda: Hot here too :\ [20:09:14] <^demon> Humid, which I hate. [20:09:15] warm != hot [20:09:19] it's always cold here and it suck [20:09:24] and raining [20:09:29] whole year [20:09:33] ^demon: yeah, here too. But there's also no air-conditionaing, and i'm at my parents' right now, which has asbestos roofing [20:09:37] just cloudy or raining [20:09:44] or snowing [20:09:54] I hate it [20:09:59] heh [20:10:06] everyone hates where they are, looks like [20:10:13] if I could I would move to africa or somewhere where it is hot every day in year [20:10:53] petan: want to merge https://gerrit.wikimedia.org/r/#/c/70103/ [20:10:54] ? [20:10:56] I heard of that girl from Rwanda, she said she had 35 C no clouds every day [20:11:08] <^demon> I'm moving to where it's foggy and cool all year around. [20:11:14] <^demon> I can't wait to leave 95 + humid behind [20:11:16] YuviPanda I have no powers :P [20:11:18] ^demon: 12 days, I heard :) [20:11:23] you need Coren for +2 [20:12:04] <^demon> YuviPanda: omgiknowrite? [20:12:12] :D [20:12:13] YuviPanda what if you replaced it with working class XD [20:12:16] dat roadtrip! :P [20:12:16] removing is easy [20:12:30] but writing working code is hardwork [20:12:46] petan: you mean like https://gerrit.wikimedia.org/r/#/c/70212/ and https://gerrit.wikimedia.org/r/#/c/70064/3 [20:12:46] ? [20:12:46] :) [20:12:53] ok [20:13:30] petan: I don't think SASL is going to be useful for us [20:13:38] what would be useful is landing those patches in memcached [20:13:45] YuviPanda how you can handle so many people on so small area like India :P [20:13:54] :P [20:13:56] it's like 1b+ of people [20:13:56] we don't [20:14:02] I can't imagine that [20:14:26] ^demon: can you tell me why https://gerrit.wikimedia.org/r/#/c/70212/ 's dependent commit says 'outdated'? [20:14:29] we have like 500m in europe and it's still bigger, and US are even more big and they have less people than europe :P [20:14:31] 'depends on' commit? [20:14:42] do I need to rebase? [20:14:51] <^demon> YuviPanda: Because parent was updated, and child wasn't rebased on new parent. [20:15:04] hmm, right. [20:15:09] that's done now. [20:15:10] <^demon> So it still knows about the change, just that you couldn't merge as-is. [20:15:11] <^demon> :) [20:15:12] speaking Gerritish :o [20:15:28] commit dependencies are hellish. grr [20:16:06] * petan speaks cish... malloc strtok! strcmp [20:16:20] :) [20:56:21] ^demon / Ryan_Lane / Coren, why can't we have a service doing the git project creation? [20:56:34] Platonides: so, I was discussiong this with ^demon [20:56:47] we could have a MW repo for this [20:56:48] err [20:56:53] a MW extension for it [20:56:54] MW? :S [20:56:55] <^demon> ping attack. [20:56:55] ah [20:57:05] especially for tools [20:57:26] <^demon> Tools & extensions [20:57:38] and we could have the repo creation as an action for tools under the tools actions [20:57:49] looks good [20:58:16] we are currently creating the tools users manually? [20:58:22] I think it should probably look like this: labs// [20:58:33] nope. that's automated [20:58:40] basically everything is automated [20:58:59] I mean, there's an interface for that? [20:58:59] http://www.opscode.com/blog/wp-content/uploads/2012/02/automate-all-the-things.png [20:59:00] YuviPanda has a bot that can take in github pull requests and turn them into gerrit changesets [20:59:05] Platonides: yep [20:59:11] or that would be a feature for that extension? [20:59:21] yeah, and we're using it 'in production' at the apps team [20:59:23] (the boot, that is) [20:59:45] tool users are created via "create service group" [20:59:57] Ryan_Lane: That opensource? Could be interesting [21:00:03] it's not tools specific, it's a labs feature available in any project [21:00:47] Damianz: YuviPanda ^^ where's the bot hosted? github? [21:00:54] yeah, github [21:01:00] github.com/yuvipanda/SuchABot [21:01:06] I could / should move it to Gerrit at some point [21:01:24] well, if we make tool repos, it could live there :) [21:01:47] indeedy [21:01:51] hm. I guess gerrit doesn't really understand the concept of roles, which makes this a little harder [21:02:04] and since tools-repos also replicate to github, that'll work fine with the bot for contributors too [21:02:06] Cool, uses gh api - 2 way comment sync/issue close on merge magic? [21:02:13] Damianz: yup [21:02:23] Neat [21:02:28] Damianz: though the github -> gerrit magic isn't in yet, because of the fact that there's no python gerrit api wrapper [21:02:35] so it would be adding an action "Create git repository" [21:02:37] Damianz: it listens to gerrit stream-events to do gerrit -> github stuff [21:02:42] Platonides: yeah [21:02:50] better to only create a repo when requested [21:03:08] doesn't look too complex [21:03:25] * YuviPanda gently nudges Ryan_Lane with https://gerrit.wikimedia.org/r/#/c/70212/ again [21:03:43] Special:NovaProject adds entries to Special:Log ? [21:03:48] yep [21:03:53] hm [21:03:55] well, it should [21:04:00] if it doesn't [21:04:15] I don't see an appropiate category for it :P [21:04:24] most nova actions via wikitech go into the log [21:04:27] I guess it doesn't so far [21:04:42] yeah, it may not. adding that is easy, though [21:05:04] gerrit has a rest api, so adding support shouldn't be horrible [21:06:18] I was thinking in the ssh api [21:06:34] that should be even easier [21:06:53] rest api looks easier: https://gerrit-review.googlesource.com/Documentation/rest-api-changes.html [21:07:07] Just want to point to out that the mapping between tools and repos is n:m :-). [21:07:09] whoops, wrong link [21:07:58] https://gerrit-review.googlesource.com/Documentation/rest-api-projects.html#create-project [21:09:02] setting the right owners could be picky [21:09:14] that's going to be the hard part [21:10:00] we would need to create a group with the tool? [21:10:04] possibly [21:10:18] and maintain it too [21:10:24] then, give the creator access to that group and allow to add more people [21:10:28] I don't know if it requires gerrit at all. Just setting up repos + gitblit might be okay... [21:10:36] as well as a generic people with access to the parent repo [21:10:48] YuviPanda: what if people want review? [21:10:50] especially considering that most tools don't really have multiple people doing pre-merge review [21:11:09] most don't. They can create repos on Gerrit if they do [21:11:36] most people won't have peers reviewing their code [21:12:25] I'd very much not like to have yet another git service [21:12:34] what's a permission-only project ? [21:12:44] permission-only project? [21:12:54] oh, in gerrit? [21:12:55] we already run gitblit [21:12:56] A project that doesn't have a repo [21:13:08] YuviPanda: yeah, and it's replicated to from gerrit [21:13:31] gitblit is sexy [21:13:41] hmm, true. we can definitely tell people that they can configure direct push for tools though [21:13:44] gerrit manages the repos and the access [21:13:47] review push is definitely overkill [21:13:52] for most [21:13:55] yes, the default would be direct push [21:14:09] and if they want, they'd have an option to require review [21:14:48] ah, yes. good :) [21:15:01] access is still an issue [21:15:48] we'd need to maintain gerrit groups [21:16:25] Can't Gerrit query LDAP? [21:16:41] it can, but service groups are per project [21:16:52] Prefix with project name? [21:17:23] if we maintain groups we'd do that [21:17:51] but that wouldn't work for gerrit searching groups [21:19:34] What do you mean by that? [21:19:53] service groups are under project specific OUs [21:20:14] two different projects can have a service group with the same name [21:20:34] hm. you know.... [21:20:49] tools- # sorted [21:21:06] Can't we adapt the Gerrit/LDAP connector? [21:21:10] Damianz: that probably would have been a good idea [21:21:17] I wonder if its too late to change [21:21:31] <^demon> scfc_de: Right now not easily. [21:21:38] <^demon> It's not a proper plugin, it's littered about core. [21:21:48] Which is why ssh keys suck ass [21:21:49] I think we can do this without modifying gerrit [21:21:50] :( [21:22:19] 1. we can rename service groups from local- to - [21:22:30] which would affect the currently running tools [21:22:46] or 2. add another attribute to the groups with a gerrit-friendly name [21:22:49] I prefer 1 [21:23:07] me too [21:23:15] I don't think it is too early to change (1) [21:23:15] Only problem them is, are service groups per projects and projects per region - can I have the same project/service group in 2 regions, with 1 ldap setup [21:23:36] * Damianz can never remember what's globally unique and what's per region [21:23:38] Damianz: groups are unique across everything [21:23:45] That works then :D [21:23:45] that won't be per region [21:23:53] authn/z is global [21:24:00] for sanity sake :) [21:24:27] ^demon: I'll write up a proposal and send it to labs-l and wikitech-l [21:24:32] sanity? that's clearly asking for too much... :) [21:24:36] YuviPanda: :) [21:24:36] I do hope enough people will use Gerrit afterwards for such a potential of disruption :-). [21:24:43] heh [21:24:52] scfc_de: even without Gerrit, it in general seems a good-idea (tm) [21:24:52] well, thankfully tools is pretty new [21:25:04] and yeah, this seems like a good change to make [21:25:30] I really need to remove myself from some projects [21:25:38] Assuming you don't mind restarting stuff on tools - nothing should notice really [21:25:54] http://pastebin.com/RDU9wBuP [21:26:14] so, with gerrit, we'd change the search base for groups to the tree [21:26:36] pastebin is slow these days [21:26:49] when we have openid I'm going to add a paste service to labs [21:26:59] that uses git (like gist) [21:27:25] And stores its repos in gerrit? (lets blow the server up!) [21:27:28] heh [21:27:31] no. not for that :) [21:27:42] it should simply be: uid=553(laner) gid=500(wikidev) groups=0(god) [21:27:49] Platonides: heh [21:27:54] It would be funny to film ^demon while creating like 500k of repos [21:28:50] why should it be hard? ;) [21:28:51] for i in `seq 1 500000`; do ssh gerrit create-repo `random-name`; done [21:28:58] :) [21:29:09] scripting ftw [21:29:11] pretty sure github would block us pretty quickly [21:29:22] <^demon> I've hit github api limits before. [21:29:29] <^demon> When I was first replicating all the repos over [21:29:30] I found out the other day if you want to make gerrit really, really grumpy tell it to flush all caches [21:29:39] 'GitHub blocks non-profit Wikimedia Foundation, is the NSA involved? 42% of americans say Yes!' [21:29:56] YuviPanda: Don't worry - we don't need the internet archive anymore, nsa does it for free! [21:30:15] :) [21:30:20] * YuviPanda nudges people in general about https://gerrit.wikimedia.org/r/#/c/70212/ [21:30:54] (and https://gerrit.wikimedia.org/r/#/c/70064/3) [21:30:55] <^demon> Ryan_Lane: We're going to upgrade gerrit this week. [21:31:01] ldapsearch -x -D 'cn=proxyagent,ou=profile,dc=wikimedia,dc=org' -w '(&(cn=*)(objectclass=posixgroup))' [21:31:01] <^demon> I need it done before I'm gone. [21:31:05] # numEntries: 387 [21:31:15] still well under any search limits :) [21:31:22] ^demon: just let me know when [21:31:34] <^demon> Trust, I will :) [21:32:01] will this be using the new packages, or the old ones? [21:32:20] <^demon> Old ones still, nobody's reviewed the new ones but me. [21:32:36] <^demon> Unless you're volunteering to get that done this week :) [21:33:23] looking at ops/puppet makes me sad... it's so messy [21:33:45] ^demon: no, I was worried it was the new ones :) [21:33:57] <^demon> Haha [21:33:57] Damianz: andrewbogott is working on making it all modules :) [21:34:13] <^demon> He should do that with the gerrit manifest :p [21:34:17] * Damianz orders andrewbogott 1 psychiatrist for when he's done [21:34:25] * YuviPanda never managed to get a local test environment for operations/puppet done [21:34:32] ^demon: it'll eventually happen [21:34:39] YuviPanda: puppetmaster::self ? [21:34:43] I pretty much found ops/puppet doesn't work outside labs [21:34:49] Which sucks ass [21:34:50] Damianz: it doesn't [21:35:09] Ryan_Lane: everyone keeps saying that, but I've not read enough into puppet to know how to setup a proper master / agent thing with puppetmaster::self [21:35:16] Ryan_Lane: also there were issues with missing private repos [21:35:32] YuviPanda: https://wikitech.wikimedia.org/wiki/Help:Self-hosted_puppetmaster [21:35:32] puppetmaster::self is such a huge hack that should be done with environments... but we'd need modules for that :( [21:35:34] should find some time before next weekend, I hope. [21:35:46] Damianz: hence the move toward modules :) [21:35:48] <^demon> puppetmaster::self always wfm. [21:35:51] Ryan_Lane: wooo, i didn't know that exists :) [21:35:53] *existed [21:36:24] I wouldn't mind ::self so much if it auto merged upstream back in so servers didn't get months out of date [21:36:27] we could use puppet apply rather than a centralized puppetmaster if everything was modules, too [21:36:42] Damianz: trust me, that's one of the reasons I really hate it [21:36:58] we spent a couple days recently getting puppet running on all instances [21:37:03] so that salt was working on all of them [21:37:20] mmm salt [21:37:38] * Ryan_Lane grumbles [21:37:50] salt-run manage.up | wc [21:37:50] 336 336 8400 [21:38:01] vs how many instances we have… that didn't take long [21:38:36] I need to write a runner to give me back a list of instances that are broken [21:41:28] !log whatcanido deleted instance now as it wasn't being use (yet) [21:41:30] Logged the message, Master [21:44:23] Ryan_Lane: sweet, that help page was helpful :) [21:44:29] let me test those two patches then [21:44:32] \o/ [21:46:19] After I execute "ssh @tools-login.wmflabs.org", it is shown a screen with some links, one of these points to http://tools.wmflabs.org/?Rules, but this redirects to an inexistent page [21:46:37] https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/Rules [21:46:47] Can this be fixed? [21:46:47] Where? [21:48:24] helderwiki: that should be in puppet repository, I Think [21:48:56] !log stats deleting stats-limn001 , moving to somethign else [21:48:58] Logged the message, Master [21:54:53] !log stats created stats-cube01 , precise , small [21:54:54] Logged the message, Master [21:56:49] !log stats pub ip given to stats-cube01 [21:56:50] Logged the message, Master [21:59:05] addshore: when you create or delete instances, other members of the project will get an echo notification [21:59:12] true! [21:59:17] so, it may not be necessary to record it via the log :) [21:59:22] * addshore has many from petan recently :P [21:59:28] heh [22:00:43] * anomie turned off echo notifications for instance creation/deletion, too annoying [22:01:53] !log deployment-prep clearing memcached , that might cleanup some resource loader cache causing {{bug|49911}} "nab collapse missing in beta" [22:01:56] Logged the message, Master [22:02:19] anomie|away: were you getting them for projects you were a projectadmin in, or for projects you were just a member of? [22:02:28] it should only target project admins, I think [22:02:33] if not we need to adjust it [22:05:46] is there a log of echo notifications? [22:06:02] probably not [22:06:09] they are meant to be ephemeral [22:09:47] Ryan_Lane: if the file isin class ./modules/toollabs/manifests/redis.pp [22:09:57] shouldn't the classname be toollabs::redis [22:09:57] ? [22:13:39] Ryan_Lane: Looks like I am an admin on deployment-prep, so yeah. [22:14:20] * addshore points someone on tools at this :> [22:14:23] request page: https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/Access_Request/tarrow?action=edit talk page: https://wikitech.wikimedia.org/wiki/User_talk:tarrow?action=edit§ion=new&preload=Template:ToolsGranted link: https://wikitech.wikimedia.org/w/index.php?title=Special:NovaProject&action=addmember&projectname=tools [22:18:30] Could not find dependency Service[autofs] for File[/data/project/.system/store] at /etc/puppet/modules/toollabs/manifests/init.pp:35 [22:18:34] any idea why that could be happening? [22:22:50] sorry (previous links were wrong ) :> request page: https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/Access_Request/Tarrow?action=edit talk page: https://wikitech.wikimedia.org/wiki/User_talk:Tarrow?action=edit§ion=new&preload=Template:ToolsGranted link: [22:22:50] YuviPanda, do you have a patch in progress for context? [22:22:50] https://wikitech.wikimedia.org/w/index.php?title=Special:NovaProject&action=addmember&projectname=tools [22:22:59] andrewbogott: yes, moment [22:23:07] andrewbogott: https://gerrit.wikimedia.org/r/#/c/70212/ + its dependency [22:23:43] andrewbogott: i enabled puppetmaster::self on toolsbeta-mc, copied my changes to it (cumbersome), and ran [22:23:43] puppet apply -e 'include toollabs::redis' [22:24:15] mind if I log in and poke around? [22:24:34] andrewbogott: sure! [22:24:44] this is like, my second day of using puppet [22:24:50] i must clearly be doing something wrong... :) [22:25:32] Not necessarily -- sometimes puppet has an implicit order that makes things work even though they strictly shouldn't. So you might be running into something like that. [22:25:41] Can you add me to the project? [22:26:02] andrewbogott: ah, moment [22:26:58] andrewbogott: your username is andrewbogott? [22:27:08] maybe 'andrew bogott'? [22:27:30] andrewbogott: added [22:27:33] and admin'd [22:27:39] th [22:27:41] thx [22:28:19] andrewbogott: also CR on the patch (and perhaps a merge :D) would be aweosme too :) [22:28:41] YuviPanda, btw, I'm not sure that that puppet module is actually running anyplace or known to work… do you know? [22:28:53] andrewbogott: which puppet module? [22:28:55] tools::redis? [22:28:59] err [22:29:01] toollabs [22:29:02] toollabs::redis? [22:29:26] well, I see modules for webserver, exec node, etc [22:29:35] so I am assuming rest of tool-labs runs from tose modules [22:29:37] Yeah, but… [22:29:39] I think it doesn't. [22:29:42] toollabs::redis is new, I just built it [22:29:44] I mean, that's a reasonable thing to think. [22:29:48] andrewbogott: o_O, really? [22:29:50] * YuviPanda looks [22:30:05] But I think that toollabs is actually hand-rolled, and that what you're seeing is a work in progress for puppetizing same [22:30:40] hmm, I can't see classes 'coz I'm not admin on tools [22:30:46] andrewbogott: grr, that... is problematic :( [22:30:51] and might explain why it doesn't run [22:30:54] I say this because I don't see how this can have ever worked :) But, hang on, let me make sure [22:31:09] The module names look... wrong [22:32:46] well, maybe I'm wrong. tools-webserver-01 includes role::labs::tools::webserver [22:33:10] which uses toollabs::webserver [22:33:16] so, that part is used at least [22:34:01] execnode is used as well? [22:35:43] addshore, ping [22:35:52] helllo [22:36:22] YuviPanda, yes, it looks like execnode is used as well. [22:36:28] I think I have a fix for this, give me a minute [22:36:32] andrewbogott: this doesn't use anything that they don't use. [22:36:34] addshore, did you see the latest update to Peachy? [22:36:35] mmm sweeet! :) [22:36:52] Cyberpower678: nope :O [22:37:13] Go to GitHub. [22:37:49] Urgh. Memory leak on Windows. [22:37:57] andrewbogott: I also turned off monitoring (hand edited in the instance), since I assume that monitoring isn't setup for tool-labs [22:37:59] (or labs) [22:38:07] * Cyberpower678 needs to reboot his computer. [22:38:59] addshore, and? [22:41:13] YuviPanda, can you update your puppet repo and rerun puppet? I don't think I can log in until you do that [22:41:24] oh? [22:41:25] ok [22:42:02] running puppetd -tv [22:42:17] did you fetch/rebase also? [22:42:29] no, let me do that [22:42:47] https://wikitech.wikimedia.org/wiki/Help:Self-hosted_puppetmaster#FAQ <- see 'how do I update?' [22:42:54] andrewbogott: i did do that [22:42:55] no updates [22:43:03] hm [22:43:07] andrewbogott: i didn't the first time since I fetched them like, an hour ago [22:43:07] well, no matter [22:43:10] and there hasn't been anything since [22:43:28] * andrewbogott uses root key [22:43:31] andrewbogott: I updated a new patchset, disabling monitoring. [22:43:37] shouldn't matter, but still [22:44:47] um… when I run puppetd -tv I see several errors but not the one you pasted above [22:45:09] oh, wait, my fault... [22:45:57] well, yes, now I get yet a third failure :) [22:46:50] andrewbogott: I cleared out my changes [22:46:59] before running puppet for you [22:47:05] in hindsight not a good idea ;) [22:47:07] let me get them back [22:47:15] I see "Invalid parameter rename_commands at /etc/puppet/modules/toollabs/manifests/redis.pp:36 on node toolsbeta-mc.pmtpa.wmflabs" [22:47:42] andrewbogott: yeah, that's because it is missing my changes to two other files [22:47:44] which I cleared [22:47:48] ok [22:47:50] i need to get my patch [22:47:51] in there [22:47:57] I did a git reset --hard before pulling [22:48:03] not the best of ideas :) [22:48:05] let me fix that [22:49:32] andrewbogott: try now [22:49:37] petan, emergency!!! [22:49:47] not really though. :p [22:51:37] 'Invalid parameter monitoring at /etc/puppet/modules/toollabs/manifests/redis.pp:36 on node toolsbeta-mc.pmtpa.wmflabs' [22:52:11] andrewbogott: heh, typo. Fixed [22:54:30] YuviPanda: OK, I have a couple of thoughts… I presume that when you run puppet apply -e that's /only/ applying that little snippet? [22:54:44] yeah, i'm not sure how else to test it [22:55:04] (reverse-i-search)`puppet ap': puppet apply -e 'include toollabs::redis' [22:55:05] I don't use puppet apply… I suspect that you'll run into lots of problems like this, since our puppet code generally takes for granted that a bunch of classes are already loaded. [22:55:05] from history [22:55:14] andrewbogott: so how do I test this role? [22:55:48] What I do is add new classes to the exisiting node definition for an instance, and then run puppetd -tv [22:55:57] That applies everything, including whatever extra thing I've added. [22:56:09] hmm, even if it is unrelated? [22:56:20] I think this one has the 'master' role [22:56:39] andrewbogott: is there a reliable way of finding out which node definition matches current instance? [22:56:39] Well, clearly the code you're using depends the 'autofs' service being defined, and it's not defined in that module. [22:56:49] I dunno, probably it should have an explicit dependency. [22:57:06] But probably you don't want to spend your whole life chasing down dependency trees like that; that's my job :) [22:57:20] :D [22:58:05] andrewbogott: looking at Special:NovaInstance, it tells me that this instance is in the group role::labs::toolsbeta::master [?] [22:58:14] i don't see a corresponding module [22:58:37] so unsure where to add the new class to [22:58:37] Hm… you're asking me about this instance which implies that you did not create it, is that right? [22:59:39] indeed [22:59:40] i did not [22:59:43] ok. [22:59:51] So -- here's a thing which I guess I should add to the docs :( [23:00:35] It's more-or-less impossible to remove puppetmaster::self from an instance once you add it. [23:00:52] So, once you add that to an instance you've pretty much declared that that instance will be used for puppet dev and nothing else. [23:01:05] Since it no longer auto-updates, it becomes disconnected from any external management. [23:01:19] So you really need your own private instance to do puppet dev on. [23:01:27] ... ow. [23:01:30] well [23:01:33] that's okay in this case [23:01:36] And, this instance probably needs to be rebuilt by whoever built it originally. [23:01:37] since there's literally nothing there [23:01:50] so, petan built this originally so I can test it :) [23:03:19] So, you've already visited the 'configure instance' page. So can you explain what your question is? [23:03:33] In theory that page is telling you what puppet classes are part of that node def [23:04:39] andrewbogott: right, question is I can't find those classes [23:04:47] it says ' role::labs::toolsbeta::master [?] ' [23:04:53] and I added ' toollabs::redis [?] ' [23:05:09] but.. nothing [23:06:34] and you checked the box? [23:07:17] andrewbogott: yes [23:07:24] andrewbogott: master was already checked [23:07:26] redis I checked [23:07:51] Hm, it isn't checked for me [23:08:10] * addshore is having project with his instance and /data/project :/ dont seem to be able to get to it and doesnt appear to be mounted even though it is configured to be shared on nova, any tips? [23:08:15] now it is, 'cause I checked it :) [23:08:54] that's weird [23:09:07] andrewbogott: but where is the file corresponding to 'master'? [23:09:17] or specifically, labs::toollsbeta::master? [23:09:18] I don't find that [23:09:37] it's role::labs::etc [23:09:42] so probably in puppet/manifests/role [23:10:03] and, ugh, that class is causing a bunch of errors [23:10:10] will be hard to develop on a machine that already can't run puppet [23:10:32] addshore, did you change the share setting recently? [23:10:36] andrewbogott: sigh. [23:10:41] about 30 mins ago :/ [23:10:46] andrewbogott: so, I should just trash that machine and set something else up? [23:10:48] addshore, what project/instance? [23:10:59] stats stats-cube01 [23:11:25] YuviPanda, presumably if you make a new instance with role::labs::toolsbeta::master it'll be broken in all the same ways :) [23:11:40] addshore, you changed the setting after the instance was built? [23:11:49] andrewbogott: heh, sure. I'll probably make it with another name [23:12:06] I initially had but then I deleted and rebuilt the instance [23:12:15] YuviPanda, what I mean is, do you /want/ role::labs::toolsbeta::master ? [23:12:26] If not, just uncheck it [23:12:58] andrewbogott: no [23:13:06] ah [23:13:06] ok [23:13:22] andrewbogott: that's just how it was built. [23:13:32] andrewbogott: now I recheck tools::redis and re-run? [23:13:44] YuviPanda, and probably uncheck your own class as well, see if you can get a clean puppet run before you change anything [23:13:48] ok [23:15:29] addshore: I see projectstorage.pmtpa.wmnet:/stats-home on /home type fuse.glusterfs (rw,default_permissions,allow_other,max_read=131072) [23:15:48] so that seems good [23:15:57] andrewbogott: but /data/project? [23:16:10] oh, hm... [23:16:16] sorry, forgot what your problem was :) [23:16:21] ;p [23:16:40] Im guessing thats what should be created and mounted with Create shared project storage checked [23:17:41] addshore, better now? [23:17:47] :D [23:17:54] what was wrong? :> [23:17:58] I don't really know what was wrong, I just jiggled some things [23:18:04] hehe :) [23:18:17] There might be a race in our gluster code having to do with changing that setting on the fly [23:18:17] andrewbogott: okay, clean run completed fine :) [23:18:27] andrewbogott: so now I check my class, and run puppet again? [23:18:36] yep! [23:18:41] With any luck we'll get the same error as before [23:19:36] andrewbogott: also any idea where become is? :D would love it on this instance [23:19:52] andrewbogott: <3 that works! [23:20:09] cool [23:20:33] That class should probably have an explicit dependency on the ldap client class which includes the autofs service, but... [23:20:40] that's well outside the scope of what you care about anyway :) [23:20:45] :D [23:21:00] YuviPanda, ping me when you submit the next revision of your patch and I'll have a look. [23:21:01] andrewbogott: yeah, I guess fully puppetizing toolsbeta is something Coren|DayOff is on [23:21:03] * addshore will probably be looking to pupetise some stuff (such a mongodb) soon :/ [23:21:08] andrewbogott: I already submitted it :) [23:21:18] oh, ok, thought you had other things in process [23:21:22] andrewbogott: https://gerrit.wikimedia.org/r/#/c/70212/ [23:21:28] andrewbogott: no, this is it, really. [23:21:32] just minor fixes [23:21:49] the dependent commit had already gone through some minor revisions with input from other people [23:26:30] !log stats created service group and installing cube and all dependencies [23:26:31] Logged the message, Master [23:27:56] andrewbogott: thanks for the +1s. Can you +1 the other patch too? [23:28:18] YuviPanda, which? [23:28:37] andrewbogott: oh, nevermind. just saw the comment [23:28:55] andrewbogott: will read through and amend. [23:28:56] Thank you :) [23:28:59] for all the help! [23:29:01] sure [23:29:04] it's 5AM now, so I should go to sleep :) [23:29:09] ok :) [23:29:23] puppet coding is a drag, but you're off to a good start [23:29:54] andrewbogott: it's powerful, but... has warts [23:30:04] andrewbogott: where do you suggest I put the role? [23:30:09] petan, ? [23:30:24] andrewbogott: I can't find out where the current toollabs roles are defined [23:30:25] from acking [23:31:01] andrewbogott: grr, nevermind. ack doesn't search inside .pp apparently [23:32:28] addshore, did you have a look at the code? [23:33:46] andrewbogott: patchset updated :) [23:38:23] heh, syntax error [23:39:38] Any time the puppet parser says Syntax error at '}'; expected '}' an angel gets its wings [23:39:54] andrewbogott: :) [23:40:20] andrewbogott: do you know who would be comfortable enough merging the redis stufff? [23:41:12] probably just about anyone but me :) Ryan_Lane, https://gerrit.wikimedia.org/r/#/c/70064/ [23:41:24] !tooladmin [23:41:27] grr. [23:41:40] I need and experienced lab admin. [23:42:08] andrewbogott: heh :) Ryan_Lane did a -1 for aminor code-style issue a while back, I fixed that in a later patch tho [23:42:23] YuviPanda, I think you can just do "redis" rather than "::redis" [23:42:30] I'm not sure what "::redis" means actually [23:42:40] from my reading of the docs, they are exactly the same :D [23:42:46] but I saw :: being used [23:42:48] at several places [23:42:55] to indicate specifically that it is top level [23:42:58] err [23:42:58] global [23:43:01] and not a local [23:43:11] plus I was looking around in other manifests [23:43:17] Yeah, for a variable I would do that, I don't know that I would for a module [23:43:18] and a bunch of them had it explict [23:43:24] so [23:43:28] but maybe we don't have a clear style atm [23:43:45] indeed [23:44:35] andrewbogott: in fact I'm surprised now that we still have mixed space / tab stuff :) [23:44:50] andrewbogott: now that I know that 4space indents are preferred, just updated patchset to make sure that my new file is 4space indent'd [23:45:15] gerrit's dependent commit stuff is a major PITA [23:45:16] grr [23:45:23] bah, eve the upstream style guide doesn't say what to do about :: [23:45:34] *even [23:46:19] andrewbogott: :) [23:47:36] I should sleep now [23:47:37] i think [23:48:00] andrewbogott: you were very helpful, I think my puppetfu also increased a fair bit thanks to your help :) [23:48:04] thank you! [23:48:09] Hi guys. I tried many times to create an account on Wikimedia labs, but it keeps returning an error. any ideas on what might am I doing wrong? [23:48:14] i'm off now, to sleep, before sometihng else distracts me again :) [23:48:38] andrewbogott: wooo, thanks for the +2 :) [23:48:50] now the dependent commit needs somsone's +2 and then it can be merged [23:49:20] Guest40473, it's possible that the user name you want is already taken… I think our error handling is especially bad about that [23:49:47] New review: coren; "(1 comment)" [labs/toollabs] (master) - https://gerrit.wikimedia.org/r/70058 [23:50:02] andrew : I tried many user names, but it keep returning the same error. [23:50:21] Guest40473, ok, lemme get a log up here and I'll watch. [23:50:24] What error do you get? [23:50:53] error : "There was either an authentication database error or you are not allowed to update your external account." [23:51:47] try now? [23:52:11] just tried two times. [23:52:18] ok, will do one more [23:52:27] wait, hang on... [23:52:35] Ciphers-test1, is that you? [23:52:42] yep [23:52:46] New review: coren; "WFM." [labs/toollabs] (master); V: 2 C: 2; - https://gerrit.wikimedia.org/r/70110 [23:53:03] ok, lemme dig [23:53:23] ideally, I would like to get the username "Ciphers" :) [23:56:52] New review: coren; "I'm not a fan of play with getpwent() in a suid program, only for the benefit of printing out userna..." [labs/toollabs] (master) C: -1; - https://gerrit.wikimedia.org/r/70107 [23:57:26] New review: Ori.livneh; "I think Platonides may have confused me with Oren. Removing myself from reviewers as I'm not well-ve..." [labs/toollabs] (master) - https://gerrit.wikimedia.org/r/70058 [23:58:29] Guest40473, what are you using as your shell name? [23:59:26] I don't think I have shell access yet .. so I need to request one too. but I can't till I have a tool server account. chicken and egg.