[00:48:14] milimetric, csalvia: drinks? [00:49:01] I’m here with aaron and jessie at the entrance of 3 [00:49:44] Ironholds ^ [07:55:04] (PS33) Milimetric: [WIP] Run recurring reports using the scheduler [analytics/wikimetrics] - https://gerrit.wikimedia.org/r/112165 [07:55:08] (CR) jenkins-bot: [V: -1] [WIP] Run recurring reports using the scheduler [analytics/wikimetrics] - https://gerrit.wikimedia.org/r/112165 (owner: Milimetric) [11:26:47] (CR) Nuria: [C: 2] "I think this change addresses all comments. Merging to master. Please do implement puppet changes next so we can make sure things will wor" (1 comment) [analytics/wikimetrics] - https://gerrit.wikimedia.org/r/111623 (owner: Milimetric) [11:26:56] (CR) jenkins-bot: [V: -1] Add scheduler mode to wikimetrics [analytics/wikimetrics] - https://gerrit.wikimedia.org/r/111623 (owner: Milimetric) [12:14:29] (PS1) Nuria: Making code in master compliant with newer flake8 restrictions [analytics/wikimetrics] - https://gerrit.wikimedia.org/r/121040 [14:20:52] (CR) Milimetric: [C: 2] Making code in master compliant with newer flake8 restrictions [analytics/wikimetrics] - https://gerrit.wikimedia.org/r/121040 (owner: Nuria) [14:41:43] (PS16) Milimetric: Add scheduler mode to wikimetrics [analytics/wikimetrics] - https://gerrit.wikimedia.org/r/111623 [14:43:04] ok nuria, jenkins is ok with that change now ^ [14:43:12] i'll work down the chain and rebase the rest [14:43:15] very well, recheking [14:43:18] (PS13) Milimetric: Allow reports to be rerun [analytics/wikimetrics] - https://gerrit.wikimedia.org/r/111914 [14:43:29] (PS4) Milimetric: Add utility functions for scheduling [analytics/wikimetrics] - https://gerrit.wikimedia.org/r/119992 [14:43:37] (CR) jenkins-bot: [V: -1] Add utility functions for scheduling [analytics/wikimetrics] - https://gerrit.wikimedia.org/r/119992 (owner: Milimetric) [14:47:02] (CR) Nuria: [C: 2] Add scheduler mode to wikimetrics [analytics/wikimetrics] - https://gerrit.wikimedia.org/r/111623 (owner: Milimetric) [14:47:31] woo! [14:47:55] I'm gonna hang a screenshot of this on my wall [14:48:10] first change that I got through with Christian & Nuria looking at it :) [14:48:46] I am a softy compared to christian [15:03:40] (PS1) Ottomata: Using version scheme -wmf-x.x.x-SNAPSHOT, adding WMF archiva deploy information in root pom.xml [analytics/camus] (wmf) - https://gerrit.wikimedia.org/r/121078 [15:04:34] (Abandoned) Ottomata: Using version scheme -wmf-x.x.x-SNAPSHOT, adding WMF archiva deploy information in root pom.xml [analytics/camus] (wmf) - https://gerrit.wikimedia.org/r/121078 (owner: Ottomata) [15:07:11] (PS1) Ottomata: Using version scheme -wmf-x.x.x-SNAPSHOT, adding WMF archiva deploy information in root pom.xml [analytics/camus] (wmf) - https://gerrit.wikimedia.org/r/121080 [15:08:42] (Abandoned) Ottomata: Using version scheme -wmf-x.x.x-SNAPSHOT, adding WMF archiva deploy information in root pom.xml [analytics/camus] (wmf) - https://gerrit.wikimedia.org/r/121080 (owner: Ottomata) [15:18:30] (PS34) Milimetric: [WIP] Run recurring reports using the scheduler [analytics/wikimetrics] - https://gerrit.wikimedia.org/r/112165 [15:35:40] (PS1) Ottomata: Using version scheme -wmf-x.x.x-SNAPSHOT, adding WMF archiva deploy information in root pom.xml [analytics/camus] (wmf) - https://gerrit.wikimedia.org/r/121088 [15:36:15] (CR) Ottomata: [C: 2 V: 2] Using version scheme -wmf-x.x.x-SNAPSHOT, adding WMF archiva deploy information in root pom.xml [analytics/camus] (wmf) - https://gerrit.wikimedia.org/r/121088 (owner: Ottomata) [17:34:36] Hey folks. Do we have an "organization" on github. [17:34:44] Like WMF or maybe WMF-analytics? [17:35:16] halfak: no, why would we need one ? [17:35:41] Helps people find our stuff. I dunno. I'm new to github as a user. [17:35:51] halfak: there is wikimedia and wikimedia-incubator [17:36:00] I thought you said "no" [17:36:09] halfak: I said no to the WMF-analytics [17:36:57] IOW we don't have an analytics-specific org on github [17:39:17] yes we do [17:39:20] wikimedia [17:39:39] everything in gerrit is replicated there [17:39:50] halfak ^ [17:40:21] halfak, I am adding you to the org, ok? [17:40:25] https://github.com/wikimedia [17:40:28] https://github.com/wikimedia-incubator [17:40:31] That's great. thanks ottomata [17:40:31] then we'd need to stick all our one-off code in gerrit ;) [17:40:36] "halfak" @ github [17:40:54] do you want to be in the analytics team too? [17:40:59] Just so long as I can get pull requests from github, then I'm happy. [17:41:06] https://github.com/orgs/wikimedia/teams/analytics [17:41:08] Yes. Not sure what "team"s are though. [17:41:11] Thanks [17:41:17] 404 [17:41:28] done [17:41:36] i'm not sure what they are either :p [17:41:39] it is asking me [17:41:42] oh wait, we do, haha, my bad [17:41:52] average, i actually didn't know that [17:42:05] i found out just now while adding halfak, github asked me if i wanted to add him to teams [17:42:15] heh. nice. [17:43:08] Ironholds: should I add you too? [17:43:46] ottomata, sure! [17:43:52] ironholds@github, I believe. [18:24:43] (CR) Jdlrobson: "(HEAD) x ~/git/limn-mobile-data $ pep8 generate.py --config=setup.cfg" [analytics/limn-mobile-data] - https://gerrit.wikimedia.org/r/110196 (owner: Milimetric) [18:24:48] (CR) Jdlrobson: [C: -1] Fix flake8 errors [analytics/limn-mobile-data] - https://gerrit.wikimedia.org/r/110196 (owner: Milimetric) [18:28:29] (PS1) Ottomata: Setting up git-fat for this repository [analytics/kraken] - https://gerrit.wikimedia.org/r/121124 [18:30:19] (CR) Ottomata: [C: 2 V: 2] Setting up git-fat for this repository [analytics/kraken] - https://gerrit.wikimedia.org/r/121124 (owner: Ottomata) [18:30:50] (PS1) Ottomata: Adding lib/camus-example-0.1.0-wmf-0.1.0-SNAPSHOT-shaded.jar via git-fat [analytics/kraken] - https://gerrit.wikimedia.org/r/121126 [18:31:04] (CR) Milimetric: Removing cohorts from database. (5 comments) [analytics/wikimetrics] - https://gerrit.wikimedia.org/r/119343 (owner: Terrrydactyl) [18:31:21] milimetric: you there? [18:31:32] (CR) Ottomata: [C: 2 V: 2] Adding lib/camus-example-0.1.0-wmf-0.1.0-SNAPSHOT-shaded.jar via git-fat [analytics/kraken] - https://gerrit.wikimedia.org/r/121126 (owner: Ottomata) [18:31:42] will you test something for me? [18:53:41] (PS2) Milimetric: Fix flake8 errors [analytics/limn-mobile-data] - https://gerrit.wikimedia.org/r/110196 [20:14:44] (PS3) Milimetric: Fix flake8 errors [analytics/limn-mobile-data] - https://gerrit.wikimedia.org/r/110196 [20:17:50] (CR) Milimetric: "This enables tox integration with jenkins, which hashar might set up for us if we're nice to him. If done, jenkins will basically run "to" [analytics/limn-mobile-data] - https://gerrit.wikimedia.org/r/110196 (owner: Milimetric) [20:19:23] milimetric: yeah moaaaar tox [20:19:29] :) [20:19:36] i'm spreading the good gospel [20:19:45] one of these days you'll have to teach me the jenkins magic and I won't bother you anymore [20:20:00] if you have 20 free minutes ahead I can guide you to add the jobs in jenkins :D [20:20:07] sure! [20:20:33] let me grab some chocolate and water [20:20:55] :) man, that sounds awesome, wish I had some chocolate [20:21:07] you want to read the short page at https://www.mediawiki.org/wiki/Continuous_integration/Jenkins_job_builder [20:21:11] k [20:21:21] which present jenkins job builder, a python script that implements a DSL describing jobs [20:21:25] it is YAML based yum [20:22:29] hmm [20:22:37] that page is actually the whole documentation :] [20:22:48] though it does not explain our configuration files [20:22:57] hm, hashar, when I say this: [20:22:58] sudo python setup.py develo [20:23:21] File "/usr/lib/python2.7/distutils/cmd.py", line 59, in __init__ [20:23:21] raise TypeError, "dist must be a Distribution instance" [20:23:41] that was not a type-o above, I just pasted wrong, it should be "setup.py develop" [20:24:24] :-/ [20:24:33] sounds like i need a new version of easy_install or disttools or something/ [20:24:50] *distutils [20:25:10] I use pip / setup tools from pypi [20:25:35] gotta investigate some issue with Zuul/Jenkins. Ping me if you need anything [20:26:02] k, thx [20:28:27] milimetric: ! test something for me! [20:29:02] ok [20:30:09] ottomata: how can I help ^ [20:30:16] cd kraken [20:30:17] git pull [20:30:22] oh you need git fat [20:30:23] um [20:30:33] you're linux, right? [20:30:44] do you have wikimedia apt-repos? [20:30:46] configured? [20:30:51] if so you can just apt-get install git-fat [20:31:50] yes, linux, no apt-repos [20:32:27] hashar: no luck installing jenkins-job-builder, rabbit hole of python environment errors, I'm afraid to keep going right now [20:33:07] (setting up apt-repos ottomata) [20:35:16] well i mean, its just a python script [20:35:19] if you want to just dl/clone it [20:35:19] uh, ottomata, can you just send me the wikimedia apt-repository paths? The documentation is like 20 pages for some reason [20:35:28] yeah, that's be GREAT [20:35:31] https://github.com/wikimedia/git-fat [20:36:23] anyway, once you have that [20:36:25] cd kraken [20:36:26] git pull [20:36:31] git-fat init [20:36:36] git-fat pull [20:37:36] k I got lib/camus-example-0.1.0-wmf-0.1.0-SNAPSHOT-shaded.jar [20:37:54] oh wait [20:38:01] i didn't put git-fat on the path so it gave me an error [20:38:59] k just git-fat pull again i guess? [20:39:24] yep, it worked ottomata [20:39:34] and didn't download the file again [20:41:28] ls -lh lib/camus-example-0.1.0-wmf-0.1.0-SNAPSHOT-shaded.jar [20:41:36] is it megabytes? [20:41:47] 44M? [20:47:53] 45798055 ottomata [20:47:58] yep [20:48:03] awesooome [20:48:05] great, it worked! [20:48:12] now if I could only get git-deploy to do that :p [20:48:13] :) [20:48:33] i love git fat, what a great concept [20:48:34] thanks [20:48:39] super simple [20:48:47] git-annex is a little cooler, a little more git-like [20:48:49] (decentralized) [20:48:53] git-fat is 100% centralized [20:48:55] which makes is simple [20:49:06] it [21:04:35] (PS1) Theduderog: Made the removal of junk hive names not fail when the junk is not present [analytics/kraken] - https://gerrit.wikimedia.org/r/121239 [21:16:33] hey [21:16:36] :) [21:24:43] (CR) Ottomata: [C: 2 V: 2] "Awesome! Thanks for the patch (and figuring out how to make one!). Looks good to me!" [analytics/kraken] - https://gerrit.wikimedia.org/r/121239 (owner: Theduderog) [21:49:34] (PS5) Milimetric: Add utility functions for scheduling [analytics/wikimetrics] - https://gerrit.wikimedia.org/r/119992 [21:51:38] good ol' diff_datewise :p [21:53:07] (Abandoned) Milimetric: Added JSONPickle serializer to remove C_FORCE_ROOT issue [analytics/wikimetrics] - https://gerrit.wikimedia.org/r/115634 (owner: Csalvia) [22:05:19] heh, yeah, diff datewise is like Everywhere :)