[01:43:31] 10Quarry: Gigantic query results cause a SIGKILL and the query status do not update - https://phabricator.wikimedia.org/T172086#3491791 (10zhuyifei1999) The current storing query status in the same process as the storing query results isn't going to work. SIGKILL cannot be caught, so only the celery master proce... [19:17:52] halfak it turns out that if the IR Kernel installer fails, it'll just exit with code 0 and continue on happily :) [19:18:12] Oh! So is there something borked about my "server"? [19:19:05] halfak: nope! it's borked for everyone! It works for me because my homedir isn't clean [19:19:10] halfak: I should have a fix soon [19:20:07] gotcha. Cool. Thanks :) [19:20:42] halfak: np! [19:20:47] halfak: it's also at Python 3.6 now btw :) [19:21:55] Nice! That'll make installs using wheels much easier. [19:22:00] E.g. numpy and sklearn [19:50:48] halfak: were there not 3.4 wheels for those? [19:50:51] ah you had to manually upgrade pip first [19:50:53] right [19:50:59] yuvipanda, there were yeah [20:21:49] halfak: cool. Am trying to get automatic push-to-deploys set up for this, so in the future people can just send PRs to github.com/yuvipanda/paws (maybe a different org), and merging to master will automatically deploy [20:22:23] yuvipanda, deploy = execute all? [20:22:30] Or just make-visible [20:23:02] halfak: ah, for the infrastructure itself. So if you wanted a new library in the image, for example [20:23:15] Oh! I see [20:23:53] halfak: yeah, so you'd just be able to make a PR to the repo, and then just merging there would autodeploy in 10-15mins [20:25:20] halfak: mostly trying to make PAWS get to a self sustaining point, so it doesn't run into Quarry's issues ;) [20:25:38] Makes sense. [21:30:18] yuvipanda: in case you get push-to-deploy, I'd be very curious on how it's done [21:30:52] zhuyifei1999_: yeah, I think I'll be able to! I'm going to be using travis for it [21:31:09] * zhuyifei1999_ will look [21:31:56] (I only used travis for linting and running tests) [21:32:25] also could you clarify 'self sustaining'? [21:33:17] zhuyifei1999_: ah, that I'm not in the 'critical path' as much as possible! [21:33:28] zhuyifei1999_: if someone is blocked by something, I want to be able to empower others to be able to fix these [21:33:38] oh yeah :/ [21:33:38] zhuyifei1999_: that wasn't entirely the case with current PAWS - it was very custom [21:33:55] zhuyifei1999_: but new thing is a 'standard' install of https://z2jh.jupyter.org on a standard install of kubernetes (kubeadm) [21:34:04] ah [21:34:13] so the possible list of 'upstreams' who can help is a lot larger, and there's very little 'translation' that needs to be done [21:34:52] yeah quarry is a ton of custom code, same as many other stuffs I work on [21:35:36] yeah [21:35:45] I think that's a real problem! [21:35:51] (one of the reasons I was suggesting redash :D) [21:39:45] halfak: R kernel should be up now [21:40:23] WORKS! [21:40:25] <3 [21:40:49] halfak: cool :) should also be a newer version! [21:52:17] zhuyifei1999_: so https://github.com/yuvipanda/paws/blob/master/build.py builds the containers that need to be built, and pushes them to a registry. My next step is to have a simple webservice running on the paws cluster that can act as a web hook from travis for deployments [21:52:35] k [21:52:39] will read