[22:34:43] o/ schana [22:34:51] hey halfak [22:35:10] halfak: we should get schana on IRCCloud :) [22:35:25] :D I'm online on IRC cloud on my phone. [22:35:37] nice [22:35:40] yuvipanda: I'm there, but also quite like limechat [22:35:52] But yeah. I should really have a bouncer setup for my laptop [22:35:57] Yeah. I also like my client :) [22:36:14] yeah [22:36:29] anyway so I started running wheels [22:36:42] schana, ^ [22:36:45] pip wheel --wheel-dir=wheels/ -r requirements.txt [22:36:48] it is running in a screen [22:36:51] it's at scipy [22:37:01] Oh man. If that *just works*, I think I'm in love. [22:37:01] last time it ran out of memory trying to compile it [22:37:10] Weird. [22:37:20] Compiling code requires a lot of memory? [22:37:28] Seems like GCC would have been designed against that. [22:37:29] halfak: apparently [22:37:42] I bet it's a compiler bug ;) [22:37:46] * halfak ducks [22:37:52] halfak: but fortran :P [22:38:01] Ohhh. [22:40:00] yuvipanda, we should build ores-compute-02 as jessie. [22:40:04] Currently, it's trusty [22:40:30] * halfak starts that [22:41:10] halfak: oh [22:41:18] halfak: I didn't realize ores-compute-01 was trusty [22:41:26] I'll make an ores-compute-02 in the ores project [22:41:45] I'd like some time to migrate some generated data files from ores-compute before we kill it. [22:42:22] halfak: ok [22:42:33] o/ [22:42:36] o/ Amir1 [22:43:10] hey, how can I help? [22:43:46] Woops. Looks like I'm going to call it "ores-compute-01" since the old one is just called "ores-compute" [22:43:58] Amir1, grab any data you want from ores-compute. [22:44:06] ok [22:44:34] hmm [22:44:41] I don't need anything for now [22:50:11] yuvipanda, can you scp between instances. [22:50:12] ? [22:51:44] nope [22:53:59] Boo. K. [22:54:08] ores-compute-01.ores.eqiad.wmflabs [22:54:19] Amir1, ^ this will be the new workbench [22:54:19] ciik [22:54:21] cool [22:54:24] for building models and stuff. [22:54:34] Looks like it is all set right now. [22:54:38] The instance [22:54:38] I see [22:54:40] awesome [22:55:19] so following links is deprecated [22:55:29] we've to make our requirements.txt be the output of pip freexe [22:59:50] "following links"? [23:00:08] just thinking out loud-ish [23:00:10] gimme a bit [23:00:19] to figure out wtf i'm talking bout :) [23:00:43] kk [23:11:19] halfak: boom that works [23:11:31] OMG {{done}} [23:11:36] Thanks schana ;) [23:11:48] Here we show up to talk to you about the task and yuvipanda just does it [23:12:01] Glad that it was all easier than expected. [23:12:04] well, I suppose I'm good for something, then :) [23:12:10] halfak: well we still need to do all the things till the end [23:12:18] yeah. Good point. [23:12:20] we need to build these wheels, put them in a git repo [23:12:25] Done with one phab card. now to do the rest. [23:12:25] and move to using scap3 for deployment [23:12:33] we just did the 'investigation' :D [23:12:38] Yeah. [23:13:12] so one problem [23:13:13] is that [23:13:26] yuvipanda, please paste notes: https://phabricator.wikimedia.org/T128110 [23:13:26] there's a --process-links flag [23:13:29] ok [23:13:31] let me do that instead [23:13:32] Oh!!! [23:24:52] halfak: schana I commented [23:30:12] Trying to listen to talks and help a bit. I'll file the follow-up tasks. [23:30:33] BTW, yuvipanda, what exactly does --process-links do? [23:32:09] halfak: I think it gets the dependencies of dependencies [23:32:09] halfak: so you see the ores line in requirements.txt [23:32:20] halfak: it follows ores, and finds out its requirements.txt and adds that too [23:32:22] etc [23:32:24] that's my theory [23:32:27] am verifying that now [23:32:33] well, that's my *hypotheses* [23:33:37] https://phabricator.wikimedia.org/T108556 -- Build ORES dependencies and store objects in repo [23:34:39] that was talking about debian repos [23:34:43] and debian packages [23:34:52] should close all the debian stuff with a 'sorry for wasting your time' at some point [23:35:05] I was just changing them to be more general [23:35:13] Is it better to close and make new ones. [23:35:16] ah [23:35:16] ? [23:35:18] nah [23:35:20] modification is probably better [23:35:21] kk :) [23:35:50] halfak: moving to pip also means we can switch to latest versions of numpy / scipy / scikit-learn etc [23:36:26] Right now, we've got revscoring on the versions that I like. [23:36:34] But ORES needs to catch up to revscoring. [23:36:43] I imagine that rebuilding when we are ready will be easy [23:36:48] yeah [23:36:50] ok [23:39:24] * halfak just noticed that Yuvipanda corrected himself with theory vs. hypothesis [23:39:27] So much pride. [23:39:32] We are ruining your brain [23:39:34] Mwahahaha [23:39:45] heh [23:40:23] yuvipanda, for scap3, that will replace fabric? [23:41:23] yes [23:41:26] at least for prod [23:42:20] kk [23:43:09] https://phabricator.wikimedia.org/T128670 [23:43:16] "Move to using scap3 for deployment" [23:43:43] indeed [23:43:56] * yuvipanda is waiting for scipy wheel to build [23:45:35] Cool. schana, looks like these tasks might be a good thing to look at next. Any experience with scap3? [23:45:44] not yet [23:45:47] yuvipanda, any good examples of scap3 we could look at? [23:46:17] halfak: no idea. I don't even know if it's completed fully yet - haven't been 100% following it [23:46:40] ohhh. How come you think that ops will be happier with scap3 than fabric? [23:47:19] halfak: because scap3 is developed by the releng team... [23:47:33] and fabric doesn't work with production because our ssh settings are too secure and unsupported by fabric [23:47:51] and scap3 is supposed to be the 'services deployment solution' [23:48:16] oh! Internal software. I feel weird about that. [23:48:23] But OK. [23:48:34] heh [23:48:46] Looks like the docs say: This is just a collection of some of the documentation contained in the commit messages of merged commits that were part of the 'scap3' sprint. [23:48:50] So, no proper documentation? [23:49:08] https://wikitech.wikimedia.org/wiki/Scap3 [23:49:13] https://doc.wikimedia.org/mw-tools-scap/index.html [23:49:17] halfak ^ [23:49:27] Ahh. much better [23:49:34] I went through the same thing [23:49:46] #wikimedia-releng has people about it [23:52:16] * halfak adds links to cards.