[10:23:28] 10Quarry: Define in a single place the pseudoname of unnamed queries - https://phabricator.wikimedia.org/T197029 (10zhuyifei1999) How about a `@property` in the [[https://github.com/wikimedia/analytics-quarry-web/blob/master/quarry/web/models/query.py|Query]] object? [17:51:07] hey researchers! [17:51:09] qq for you [17:51:23] i'm looking at notebooks + spark stuff just beginning to try to figure out how to do it well [17:51:29] and i came across python anaconda [17:51:31] are you familiar with it? [17:51:43] if that was installed across analytics cluster and in swap notebooks [17:51:47] would that be a helpful thing? [17:51:49] anaconda is a good alternative to figuring out the baffling chain of dependencies for sci-kit and such [17:52:08] aye, so far for cluster type jobs, we use deb packages to install [17:52:10] basically it's an all-in-one python runtime environment [17:52:12] with whatever exists in debian [17:52:13] or, build our own [17:52:15] which can be nasty too [17:52:35] wondering if a .deb of anaconda for general python (and R?) installed across the whole cluster would be more useful? [17:52:45] than just python3 + whtaever random .debs people ask for [17:52:48] Is anaconda freely licensed? [17:52:51] i think it is... [17:52:53] checking' [17:52:59] It would probably be less work for everyone involved [17:53:07] I guess I'll still want to pip some stuff. [17:53:15] anaconda supports pip! [17:53:17] Are you thinking of the .deb dependencies of various libs? [17:53:39] If anaconda supports pip, what does anaconda do? [17:54:38] i am not yet sure! [17:54:39] anaconda is python + binary dependencies [17:55:33] you use it in lieu of a regular python runtime if you have nasty binary dependencies that are difficult to install [17:55:40] "Because Conda introduces a new packaging format, you cannot use pip and Conda interchangeably; pip cannot install the Conda package format. You can use the two tools side by side (by installing pip with conda install pip) but they do not interoperate either. [17:55:40] " [17:56:12] basically I ignore Conda and use pip [17:56:43] so you use the python from anaconda [17:56:50] but install python deps into the (conda?) venv with pip? [17:56:51] yes [17:57:43] anyway, ok google tangent over. back to jupyter, just interesting, hadn't really heard of it before [17:57:43] at least that's what I do; I'm sure others have come up with different workflows