[07:33:44] <grrrit-wm>	 (CR) QChris: "Ottomata told me that the labs test environment will" [analytics/camus] (wmf) - https://gerrit.wikimedia.org/r/117100 (owner: Ottomata)
[13:15:53] <grrrit-wm>	 (PS8) Milimetric: [WIP] Run recurring reports using the scheduler [analytics/wikimetrics] - https://gerrit.wikimedia.org/r/112165
[13:15:55] <grrrit-wm>	 (PS6) Milimetric: Add scheduler mode to wikimetrics [analytics/wikimetrics] - https://gerrit.wikimedia.org/r/111623
[13:15:57] <grrrit-wm>	 (PS5) Milimetric: Allow reports to be rerun [analytics/wikimetrics] - https://gerrit.wikimedia.org/r/111914
[13:24:58] <grrrit-wm>	 (PS9) Milimetric: [WIP] Run recurring reports using the scheduler [analytics/wikimetrics] - https://gerrit.wikimedia.org/r/112165
[14:15:39] <grrrit-wm>	 (PS10) Milimetric: [WIP] Run recurring reports using the scheduler [analytics/wikimetrics] - https://gerrit.wikimedia.org/r/112165
[14:49:33] <ottomata>	 cool, ok hey milimetric, https://metrics-staging.wmflabs.org/ is working in eqiad labs now!
[14:49:34] <ottomata>	 woo!
[14:49:50] <ottomata>	 well, it looks like everything except for mediawiki oauth :/
[14:49:52] <milimetric>	 ey, that's awesome
[14:50:05] <milimetric>	 lemmesee
[14:52:00] <milimetric>	 this is the problem we had before
[14:52:04] <ottomata>	 qchris, do you want to update ops/puppet and mediawiki-vagrant wikimetrics submodules?
[14:52:04] <milimetric>	 memory failing
[14:52:05] <milimetric>	 https://meta.wikimedia.org/wiki/Special:OAuth/metrics-staging.wmflabs.org?oauth_verifier=a6e2378f9f4612af1272d6efb4801cab&oauth_token=9f575556480207f087ed11ccb44df74b
[14:52:21] <milimetric>	 oh we probably just never fixed it
[14:52:26] <ottomata>	 yeah, milimetric, didn't uhhh, chris?  who runs oauth? fix that?
[14:52:32] <milimetric>	 no, he can't
[14:52:33] <ottomata>	 oh application author
[14:52:34] <ottomata>	 hm ok
[14:52:41] <ottomata>	 i thought we got that working though
[14:52:46] <milimetric>	 i thought so too
[14:53:03] <milimetric>	 lemme see the list of consumers, one sec
[14:53:54] <qchris>	 ottomata: I had prepared a change for ops/puppet as well: https://gerrit.wikimedia.org/r/#/c/117416/
[14:55:25] <qchris>	 For mediawiki/vagrant submodules ... https://gerrit.wikimedia.org/r/117415 was directly for mediawiki/vagrant (not puppet/modules/wikimetrics). Confused.
[14:55:45] <qchris>	 To what should I update mediawiki/vagrant submodules?
[14:57:50] <ottomata>	 https://wikitech.wikimedia.org/wiki/Puppet_coding#Making_changes_to_a_submodule
[14:57:58] <ottomata>	 so probably
[14:58:16] <ottomata>	 actually, ah, i'd have to do some testing to see if this would work
[14:58:18] <ottomata>	 but you might be able to do
[14:58:24] <ottomata>	 git commit puppet/modules/wikimetrics
[14:58:33] <ottomata>	 wait
[14:58:36] <ottomata>	 am i confused
[14:58:38] <ottomata>	 oh oh oh i am
[14:58:40] <ottomata>	 i'm sorry
[14:58:43] <ottomata>	 this is in the role class
[14:58:47] <ottomata>	 i am the one who is confused
[14:59:00] <qchris>	 Yes. puppet/modules/wikimetrics is unchanged.
[14:59:04] <ottomata>	 okokookokokok nm
[14:59:05] <ottomata>	 :)
[14:59:08] <qchris>	 :-D
[14:59:20] <qchris>	 I am glad that I am not the only one who got confused.
[14:59:24] <ottomata>	 haha
[14:59:30] <qchris>	 When I first saw this, I went "Whaaat?"
[15:56:07] <Snaps>	 hi
[16:08:21] <ottomata>	 hiya
[16:10:09] <ottomata>	 how'sit Snaps? :)
[16:11:26] <Snaps>	 good! sipping the friday night GT
[16:13:58] <grrrit-wm>	 (PS2) Csalvia: Added (beta) support for publically shareable reports. [analytics/wikimetrics] - https://gerrit.wikimedia.org/r/116492
[16:14:08] <grrrit-wm>	 (CR) jenkins-bot: [V: -1] Added (beta) support for publically shareable reports. [analytics/wikimetrics] - https://gerrit.wikimedia.org/r/116492 (owner: Csalvia)
[16:14:37] <milimetric>	 csalvia_: could you please add that as a patchset on your previous gerrit Change?
[16:15:04] <csalvia_>	 yeah
[16:15:06] <milimetric>	 and also it looks like jenkins is still -1ing it, so probably flake8 didn't love your change
[16:15:16] <milimetric>	 thank you :)
[16:15:16] <csalvia_>	 ok I run it thru flake8
[16:24:03] <csalvia_>	 flake8 doesn't like trailing white space
[16:37:28] <csalvia_>	 actually the previous gerrit Change was abandoned
[16:37:32] <csalvia_>	 so I can't submit a patchset to it
[16:45:39] <grrrit-wm>	 (PS3) Csalvia: Added (beta) support for publically shareable reports. [analytics/wikimetrics] - https://gerrit.wikimedia.org/r/116492
[16:46:03] <grrrit-wm>	 (CR) jenkins-bot: [V: -1] Added (beta) support for publically shareable reports. [analytics/wikimetrics] - https://gerrit.wikimedia.org/r/116492 (owner: Csalvia)
[16:47:34] <grrrit-wm>	 (PS4) Csalvia: Added (beta) support for publically shareable reports. [analytics/wikimetrics] - https://gerrit.wikimedia.org/r/116492
[16:56:41] <grrrit-wm>	 (CR) Milimetric: Added (beta) support for publically shareable reports. (3 comments) [analytics/wikimetrics] - https://gerrit.wikimedia.org/r/116492 (owner: Csalvia)
[17:17:40] <qchris_away>	 csalvia_: You can restore abandoned changes.
[17:18:10] <qchris>	 After restoring, the change is a plain normal change again
[17:18:55] <qchris>	 Just hit the �Restore Change� button on the abandoned change.
[17:54:12] <milimetric>	 no qchris, the abandoned change was abandoned on purpose
[17:54:35] <milimetric>	 because csalvia_ had submitted two subsequent Changes that should have probably been patchsets
[17:54:40] <milimetric>	 it's ok, I think he's straightened it out now
[17:54:46] <qchris>	 Ok.
[18:04:51] <qchris>	 ottomata: Since limn0 will stay on labs, operations/puppet seems to be the wrong repo to put it's setup in. Where would you want me to put it?
[18:06:40] <ottomata>	 what setup?
[18:07:01] <ottomata>	 milimetric:  and i just tried to see if we could make limn work wtiha  role class and then with the labsconsole interface this morning
[18:07:03] <ottomata>	 and we can't really
[18:07:14] <ottomata>	 so it has to be manually done on the labs instance via self hosted puppet
[18:17:33] <qchris>	 ottomata: the setup for gp.wmflabs.org (so Wikipedia Zero, public part of geowiki)
[18:18:13] <ottomata>	 hmmmMMMM
[18:18:17] <qchris>	 So everything underneath /var/lib/limn/gp on limn0
[18:18:17] <ottomata>	 i don't know.
[18:18:39] <qchris>	 Ok. Then I'll just wait until you decided for the other parts and follow that lead.
[18:18:44] <ottomata>	 qchris
[18:18:52] <ottomata>	 that is manually configured on limn0 right now, right?
[18:18:55] <ottomata>	   misc::limn::instance { 'gp':                    port => 8087, environment => 'production' }
[18:19:00] <qchris>	 I think so.
[18:19:11] <DarTar>	 milimetric: can I invite you to our Trello board?
[18:19:16] <ottomata>	 this is what milimetric is working on
[18:19:16] <ottomata>	 https://gist.github.com/ottomata/9414219
[18:19:20] <qchris>	 But milimetric said something that he can run a script to do it.
[18:19:25] <ottomata>	 he's tryign to make that work on limn1 right now
[18:19:38] <DarTar>	 I'm not going to assign you any task, but I figured it's a useful way for you to stay on top of work with some intersection with Dev
[18:19:43] <DarTar>	 :)
[18:19:45] <qchris>	 ottomata: Ok.
[18:19:46] <milimetric>	 sure DarTar, thank you
[18:19:55] <DarTar>	 do you already have an account?
[18:19:58] <milimetric>	 honestly, I'm a bit innundated with information now
[18:20:04] <milimetric>	 but yes, I have an account
[18:20:40] <DarTar>	 I hear that, there's no expectation for you to follow regularly
[18:21:05] <DarTar>	 but if we have a card with a discussion where we need to loop you in, it's handy if we can mention you and send you a link
[18:21:18] <DarTar>	 milimetric: what's your username?
[18:21:44] <DarTar>	 scrap that, I think I've found you
[18:21:56] <DarTar>	 unless there are many other danandreescu's on the planet
[18:22:06] <milimetric>	 hopefully not :)
[18:22:11] <milimetric>	 the planet would be in rough shape
[18:23:14] <milimetric>	 qchris: I'm working on limn1 right now, and by working I mean mostly staring at errors on the screen and scratching a hole into my head
[18:23:54] <milimetric>	 ottomata: any idea why there's a multimedia-metrics directory in /var/lib/limn but not a limn-multimedia upstart job?
[18:23:57] <qchris>	 milimetric: :-) Ok, so I am waiting until you're done and then I'll figure out some way to hook in the gp repos.
[18:24:13] <milimetric>	 i think once i'm done the basic repos will be there
[18:24:19] <milimetric>	 and then you can add any custom configs on top of it
[18:24:25] <qchris>	 k
[18:26:19] <ottomata>	 hm milimetric, did puppet say everything was ok?
[18:27:01] <milimetric>	 i think so, i'll run it again
[18:27:26] <milimetric>	 well, hm, the limn server seems to be up and serving
[18:27:28] <milimetric>	 so that's good
[18:32:05] <milimetric>	 ottomata: puppet runs successfully
[18:33:06] <ottomata>	 yeah i see an init script now
[18:33:07] <ottomata>	 right?
[18:33:16] <ottomata>	 oh
[18:33:16] <ottomata>	 limn-multimedia-metrics.conf
[18:33:18] <ottomata>	 is that different?
[18:33:40] <milimetric>	 no
[18:33:45] <ottomata>	 ok cool, so its working now?
[18:33:52] <milimetric>	 oh it's just called limn-multimedia-metrics?
[18:33:54] <milimetric>	 hold on
[18:34:10] <milimetric>	 doh
[18:34:28] <milimetric>	 ok, what happened was I tab-completed the name and it wasn't giving me the multimedia one
[18:34:41] <milimetric>	 (it still doesn't, actually, none of the jobs show up on tab-complete now)
[18:34:49] <milimetric>	 so tab complete for upstart jobs is just kinda broken, my bad
[18:37:14] <milimetric>	 qchris: I was getting the gp_geowiki data from:
[18:37:15] <milimetric>	 https://github.com/embr/geowiki-data.git
[18:37:21] <milimetric>	 but i'm getting a 403 on that now
[18:37:33] <milimetric>	 i'm assuming that's coming from a new source now
[18:37:45] <milimetric>	 i'll look on limn0 but let me know if there's some gotcha
[18:37:45] <qchris>	 everything is in gerrit now.
[18:38:15] <qchris>	 No gotcha that I know of.
[18:38:24] <qchris>	 Only limn0 being reaaaaaaally slow right now.
[18:38:29] <milimetric>	 https://gerrit.wikimedia.org/r/analytics/geowiki/data-public
[18:38:56] <qchris>	 yes.
[18:40:17] <qchris>	 gp-zero-data-repository -> https://gerrit.wikimedia.org/r/analytics/wp-zero/data
[18:40:20] <milimetric>	 hm, I tried http://multimedia-metrics.wmflabs.org/dashboards/mmv qchris, didn't seem too slow
[18:40:37] <qchris>	 gp-data-repository -> https://gerrit.wikimedia.org/r/analytics/global-dev/dashboard-data
[18:40:45] <qchris>	 milimetric: Then limn0 hates just me :-)
[18:41:56] <milimetric>	 thanks qchris, I had one of those wrong and one of those right
[18:42:01] <milimetric>	 my mom always said 50% is all I could hope for
[18:42:02] <milimetric>	 :P
[18:42:20] <qchris>	 :-D
[18:43:13] <Ironholds>	 milimetric, sounds about right
[18:43:20] <Ironholds>	 "you're a bay area software engineer! ...at a non-profit"
[18:43:29] <milimetric>	 ok, so qchris: all the data has been deployed via my script to limn1.eqiad.wmflabs.  I'm making sure the jobs are all set up properly, but you should be able to go in and make any changes you like right now
[18:43:31] <Ironholds>	 "you get to save the world! ...but have to work with Oliver"
[18:43:47] <milimetric>	 but... that's one of the best parts Oliver
[18:44:02] <milimetric>	 I've been super sad since yesterday when we got our hotel booked for Interlaken
[18:44:07] <qchris>	 milimetric: To which puppet repo should I submit the config?
[18:44:16] <milimetric>	 since the CC list made me remember you're not coming :(
[18:44:21] <milimetric>	 uh...
[18:44:24] <milimetric>	 puppet?
[18:44:37] <qchris>	 We're not puppetizing it?
[18:44:56] <qchris>	 I guess that's a no :-)
[18:45:03] <qchris>	 Ok. Then I'll set it up by hand.
[18:46:25] <milimetric>	 qchris: here's what I've done so far, on line 38: http://etherpad.wikimedia.org/p/analytics-tasking
[18:47:17] <qchris>	 Thanks.
[18:49:31] <milimetric>	 ok ottomata, that instance is set up 100% from my end
[18:49:48] <milimetric>	 all the limn services respond to curl localhost:<their-port>/datasources/all
[18:49:54] <milimetric>	 which means they're serving and their data is set up
[18:49:55] <Ironholds>	 milimetric, clearly the solution is for you to fly out here more often :).
[18:50:06] <Ironholds>	 that reminds me, I need to futz with using limn's geomapping capacity today
[18:50:09] <milimetric>	 I'm like, coming basically in a couple weeks
[18:50:31] <lzia>	 when milimetric? :-)
[18:50:37] <milimetric>	 so ottomata, all that's left is to make sure apache is hitting those services properly, I'll leave that on your plate for now as I'm about to eat my own arm
[18:50:55] <milimetric>	 Ironholds: geomapping! let's do it
[18:51:04] <milimetric>	 i like vega honestly if you just want to throw up a quick map
[18:51:10] <milimetric>	 bug it *can* be done in limn
[18:51:17] <milimetric>	 lzia: March 23-31
[18:51:32] <ottomata>	 ha, milimetric, um, it should be?  hm
[18:51:36] <lzia>	 Nicee! me excited.
[18:51:37] <ottomata>	 puppet should do that?
[18:51:42] <milimetric>	 me too lzia :)
[18:51:51] <milimetric>	 yeah, i mean, but how do I hit them?
[18:52:23] <ottomata>	 ok i just checked one via curl locally
[18:52:28] <ottomata>	 curl -H 'Host: mobile-reportcard.wmflabs.org' http://localhost
[18:52:31] <ottomata>	 from limn1 instance
[18:52:34] <ottomata>	 now we need proxies!
[18:52:35] <ottomata>	 hmmm
[18:53:32] <ottomata>	 ok, milimetric, can I move point debugging at limn1
[18:53:34] <ottomata>	 instead of limn0?
[18:53:43] <ottomata>	 debugging.wmflabs.org https://wikitech.wikimedia.org/w/index.php?title=Special:NovaAddress&action=removehost&id=48&project=analytics&region=pmtpa&fqdn=debugging.wmflabs.org&hostname=debugging
[18:53:45] <ottomata>	 ack
[18:53:50] <ottomata>	 debugging.wmflabs.org
[18:53:50] <ottomata>	 ?
[18:53:55] <milimetric>	 sure
[18:54:01] <milimetric>	 that's what it's for!
[18:54:12] * milimetric  pats self on back for making a debugging instance

[18:57:28] <milimetric>	 ottomata: that curl -H trick is awesome!
[18:58:42] <ottomata>	 yeah nice work!
[18:58:46] <ottomata>	 milimetric: how's this work for you?
[18:58:46] <ottomata>	 http://debugging.wmflabs.org
[18:58:54] <ottomata>	 refresh a few times if it is weird and tell me what happens
[18:59:07] <milimetric>	 it works!
[18:59:12] <ottomata>	 yeah?
[18:59:13] <milimetric>	 and yeah, i have to refresh :)
[18:59:17] <milimetric>	 weird
[18:59:18] <ottomata>	 does it keep working?
[18:59:23] <ottomata>	 or is it different when you refersh?
[18:59:23] <milimetric>	 lol, wtf
[18:59:27] <milimetric>	 hahaha
[18:59:31] <ottomata>	 do you see the dir listing too?
[18:59:34] <milimetric>	 yea
[18:59:40] <milimetric>	 i've been phished!
[19:00:06] <milimetric>	 this must be the first time that someone accidentally phished themselves
[19:00:49] <milimetric>	 sometimes the JS / CSS load, sometimes no, very very funny
[19:01:07] <ottomata>	 yeah ok, that's what I see too
[19:01:08] <ottomata>	 hmmm
[19:03:29] <ottomata>	 ok milimetric
[19:03:33] <ottomata>	 i'm going to assume that is a proxy problem
[19:03:41] <ottomata>	 if I manually tunnel and curl localally
[19:03:46] <ottomata>	 i always get full limn html
[19:03:54] <ottomata>	 dunno
[19:03:54] <ottomata>	 hm
[19:05:20] <milimetric>	 cool, you can send the url to other andrew, might help them debug
[19:23:04] <qchris>	 milimetric: Does limn1 forward some dummy domain to it's gp.wmflabs.org limn instance, so I could test it?
[19:23:18] <qchris>	 (I tried looking for something like that but could not find anything)
[19:27:31] <ottomata>	 qchris
[19:27:32] <ottomata>	 try this
[19:27:54] <ottomata>	 ssh -Nv bastion-eqiad.wmflabs.org -L 8081:limn1.eqiad.wmflabs:80
[19:27:58] <ottomata>	 then in aanotehr shell
[19:28:09] <ottomata>	 curl -H 'Host: gp.wmflabs.org' localhost:8081
[19:28:13] <qchris>	 And then setting /etc/hosts?
[19:28:16] <ottomata>	 or that
[19:28:20] <qchris>	 Oh ja. The same thing.
[19:28:21] <ottomata>	 ummmm yeah
[19:28:22] <ottomata>	 that would work
[19:28:25] <ottomata>	 set it to localhost
[19:28:26] <ottomata>	 yeha
[19:28:26] <ottomata>	 sur
[19:28:31] <qchris>	 But that tests only part of it.
[19:28:35] <qchris>	 Right?
[19:29:07] <qchris>	 Meh. Ok. That will do for a test.
[19:29:20] <qchris>	 Will leave the other part for later.
[19:29:23] <ottomata>	 yeah do that, with /etc/hosts
[19:29:24] <ottomata>	 and
[19:29:30] <ottomata>	 http://gp.wmflabs.org:8081
[20:28:17] <grrrit-wm>	 (PS11) Milimetric: [WIP] Run recurring reports using the scheduler [analytics/wikimetrics] - https://gerrit.wikimedia.org/r/112165
[22:01:47] <ottomata>	 WOOOO, archiva + git-fat are working in my labs instance, wooOoowoooo
[22:02:03] <ottomata>	 i can deploy camus to maven, and then I can git-fat pull elsewhere, wowoowooo
[22:02:11] <ottomata>	 s/maven/archiva
[22:02:24] <ottomata>	 i would show yall a link but the eqiad labs proxy still istn' working
[22:37:01] <milimetric>	 that's awesome ottomata
[22:37:36] <milimetric>	 i'm out for the weekend, see y'all later, have a good one
[22:39:12] <halfak>	 Hey ottomata.  o/
[22:40:05] <halfak>	 I just wanted to check to make sure that my answer re. stat1 --> replacement was sufficient of if you'd like me to expand on what I'd do with more processing power.
[22:41:50] <ottomata>	 naw, that's cool halfak, if they want more justification they will ask
[22:42:15] <halfak>	 OK.  Feel free to poke me if I miss any cues. :)
[23:22:14] <grrrit-wm>	 (PS3) Terrrydactyl: Add TextAreaField for paste_username, reads input [analytics/wikimetrics] - https://gerrit.wikimedia.org/r/117260