[02:05:38] i'm having trouble with the new vagrant set up. anyone around to maybe help debug? [18:27:46] milimetric: [18:27:47] https://github.com/wikimedia/limn/issues/95 [18:28:11] Also, the instance at limn0 appears to return to localhost:5000 instead of whatever the actual hostname was [18:28:49] (when you sign in via oauth) [18:29:44] right, we'd have to register a consumer for your new hostname rdwrer, but scrum of scrums now [18:31:22] Oh. Crap. [18:31:30] Ah, it's too far [19:04:01] (PS1) Milimetric: Fix Bug 62260 [analytics/wikimetrics] - https://gerrit.wikimedia.org/r/117016 [19:06:31] Anyway, milimetric [19:06:36] Things [19:06:50] things! [19:06:54] but, for now - a bit busy [19:06:58] OK no problem [19:07:11] i'll either get back to you in 20 minutes or ping you that i'm still busy [19:07:44] Heh, no worries [19:07:47] I can putz along [19:10:46] (CR) Milimetric: [C: 2 V: 2] Fix Bug 62260 [analytics/wikimetrics] - https://gerrit.wikimedia.org/r/117016 (owner: Milimetric) [19:25:50] ok rdwrer, pingback [19:25:53] ack [19:26:00] what's up? [19:26:26] Um [19:26:41] milimetric: There's the filed bug and you said "register a consumer"? [19:26:51] right! [19:26:52] I'm halfway through defining a graph for MMV [19:26:57] ok [19:27:11] so i asked you this when we set it up, if you needed to login [19:27:15] it didn't seem like you did [19:27:27] I guess I don't [19:27:34] yeah, it's kind of a useless feature atm anyway [19:27:41] But I thought the login issue would be separate [19:27:52] you could add graphs and datasources through the UI but you would do it back-end anyway [19:27:54] It shouldn't redirect to localhost:5000 at all [19:28:02] no, it redirects where you configure it to [19:28:08] Oh. [19:28:10] so right now it's using the "dev" oauth consumer [19:28:12] Well that's a silly default [19:28:13] which redirects to localhost [19:28:34] um, there are no defaults actually, we just set it up that way so it works when you're doing it locally [19:28:48] but it's not a default we can control [19:28:54] it's remotely set with the OAuth consumer [19:29:15] that way I can't make a consumer redirect to thedarkcorneroftheinternet.com [19:29:52] Ah. [19:29:56] 'kay [19:30:18] hence if you ever want this, we just have to ask Chris to approve a new consumer [19:30:22] anyway, moving on, you don't need it [19:30:33] then there's the filed bug [19:31:47] you're doing this locally? [19:31:52] rdwrer: ^ [19:32:08] btw, bugzilla is the place for bugs, github is mostly ignored [19:32:09] milimetric: Yeah, that was local [19:32:11] Oh. [19:32:16] project analytics - component limn [19:32:16] * rdwrer is so confuuuuused [19:32:19] dude [19:32:22] welcome to the party [19:32:24] :) [19:32:32] i'm Suuuuper confused [19:32:39] like whatever is twice as confused as you, that's me [19:32:56] Heh [19:33:01] i'm actually trying to drive this discussion internally [19:33:04] I'll keep that in mind [19:33:27] DarTar: can you please look at https://rt.wikimedia.org/Ticket/Display.html?id=6845 ? [19:33:33] and I thank you, btw, for your not-recent discussion about FOSS and deciding about software/hardware/etc. [19:33:57] I think it set a good tone I want keep with this project management discussion [19:34:20] ok, so the issue at hand - running locally... hm... on a clean checkout I don't get that. [19:34:28] did it work before, if so what'd you do?! [19:34:30] rdwrer: ^ [19:35:19] milimetric: It worked before I wiped my computer, I think [19:35:25] So the old install was good [19:35:35] hm... [19:35:35] It may be that I am now running a weird version of npm or node [19:35:44] yeah, that's the most likely culprit [19:35:46] did you install with apt? [19:35:54] 'cause those versions suck afaik [19:36:01] i use chris lea's ppa [19:40:44] rdwrer: ^ [19:41:06] jeremyb: I meant to follow up with you on that pig thing [19:41:20] was just curious if you ended up doing anything with it [19:41:40] I have...0.11 [19:41:43] For node [19:41:47] Maybe it's not that. [19:42:26] milimetric: I have a graph definition file in my limn0 data-repo now, how do I restart limn? [19:42:33] Or...alternatively reload or whatever [19:44:07] don't need to [19:44:22] limn reads those directories if you have the symlinked [19:44:26] which, do you? [19:44:39] and wait, "npm start" worked now rdwrer? [19:45:30] milimetric: npm start is unnecessary [19:45:47] milimetric: http://multimedia-metrics.wmflabs.org/# is still empty [19:46:06] wait, you're not giving me full info here [19:46:11] i thought you were doing this locally [19:48:52] Sorry [19:48:59] I skipped over that because it didn't work [19:49:07] Now I'm just using the live instance [19:51:29] I guess I'm assuming /var/lib/limn/multimedia-metrics/data-repository was the right thing to update [19:52:00] milimetric: Oh, do I *also* need a dashboard? [19:52:06] yes rdwrer [19:52:21] but it's not really also, what kinds of graphs are you making? [19:52:31] timeseries? [19:52:40] or ordinal? [19:53:23] One timeseries now [19:53:32] ok, you got a datafile that's gonna feed it? [19:53:34] Another timeseries and an ordinal later [19:53:38] Yeah, it's already loaded [19:53:57] ok, so with a URL to a datafile, all you need is this: [19:54:26] a dashboard with that url as one of the values in the graph_ids list [19:54:44] you're working directly on the live instance? [19:54:46] i'll log in [19:56:04] OK, I'm adding that and pushing [19:56:31] ok, when it's done let me know and I'll debug it for you [19:56:44] basically this is what I was trying to say - you don't need the metadata file [19:56:48] Pulled [19:56:52] k, checking [19:56:59] Er...wait. [19:57:00] No [19:57:34] It's not updating right [19:57:54] you're trying to pull? [19:57:59] and it's pushed to your repo? [19:58:09] Wait. [19:58:20] Oh, I've cocked it all up [19:58:28] Sec. [19:58:33] ok, slow down, I can help [19:58:53] 1. push your changes to your gitorious repository [19:59:14] milimetric: The problem is I've set analytics/multimedia as the remote for analytics/multimedia-limn [19:59:52] um, this is why the deploy script is easier [20:00:04] fab multimedia_metrics deploy.only_data [20:00:26] If you have your stuff in the multimedia repository, I can do that and wipe out the data_repository folder [20:00:30] it'll recreate it properly [20:01:10] No no [20:01:14] I'll get it sorted [20:02:03] my point is, that we have a tool for this [20:02:43] OK [20:02:50] Where do I run the tool from? [20:03:02] (also, pushing didn't work still) [20:03:30] so on your local machine, did you install the limn-deploy project? [20:03:58] I don't think so. [20:04:01] https://github.com/wikimedia/limn-deploy [20:04:05] clone that on your local box [20:04:10] pip install [20:04:23] "sudo pip install -e ." actually [20:05:04] Done [20:05:42] ok, lemme delete that directory [20:06:01] ok, done [20:06:05] so now, you can do: [20:06:16] fab multimedia_metrics deploy.only_data [20:06:37] From where? [20:06:48] your local box, where you cloned that project and pip installed it just now [20:06:56] What directory? [20:07:05] git clone ...limn-deploy [20:07:07] cd limn-deploy [20:07:09] pip install -e . [20:07:19] fab multimedia_metrics deploy.only_data [20:07:26] Warning: Command(s) not found: multimedia_metrics [20:07:37] sec [20:08:24] oops, just "multimedia" [20:08:28] fab multimedia deploy.only_data [20:08:40] Fatal error: You must specify a staging environment (prod, test_reportcard, gp, gp_zero, gp_geowiki, dev_reportcard, mobile_reportcard, mobile_reportcard_dev, ee_dashboard, gerrit_stats, stats_limn001, debugging, example, multimedia) prior to deploy! [20:09:05] Oh, my bad [20:09:08] :) [20:09:42] ...weird, it's asking for a private key unlock [20:09:48] But my key for labs is already unlocked [20:10:14] you might need to specify the user [20:10:16] with --user [20:10:27] fab --user ... multimedia deploy.only_data [20:10:56] My username is the same on this machine and labs [20:11:38] so did it work or fail? [20:11:45] after you unlocked [20:11:56] i'm doing it now [20:12:01] I don't know what key it's asking for, but it's not...hm. Sec [20:12:11] k, done [20:12:23] No, it's asking me for a key that I don't know how to unlock, which is weird [20:12:27] it's idempotent so feel free to work on that key problem [20:12:35] but that's the easiest way to deploy [20:12:44] anyway, let's get this dashboard up shall we? [20:12:55] so you want a dashboard with that single tsv rendered right? [20:12:58] one sec [20:13:26] Yeah [20:14:52] I don't understand why it can't unlock the key [20:14:58] I'm using the key to SSH to labs just fine [20:15:00] http://multimedia-metrics.wmflabs.org/dashboards/reportcard.json [20:15:04] oops, sorry [20:15:12] Huzzah [20:15:13] http://multimedia-metrics.wmflabs.org/ [20:15:23] ok, so [20:15:30] check out dashboards/reportcard.json [20:15:42] that's basically ALL you need to set up a timeseries pointing to your TSV [20:15:49] and, of course, some way to deploy it [20:15:51] FFS. [20:15:59] I can unlock the key, just not through the gui [20:16:14] But yeah, cool [20:16:18] I'll do the perf data now [20:16:23] ok, well, maybe just some ssh config [20:16:34] mine's set up so i don't need to unlock anything [20:16:38] so it's gotta be possible [20:16:43] also - IMPORTANT! [20:16:55] this dashboard is not saved anywhere, it's just some random file in that folder [20:17:18] you'd need to copy it, delete it, commit it on your local box, push it to your repo, then deploy that [20:18:20] and i'm dying of hunger, ping me if you are not afraid of getting your hand bitten off [20:18:25] * milimetric lunch [20:19:07] Sure [20:19:32] milimetric: For after-lunch: There appears to be zero data in the graph [20:20:43] And my attempt at fab'ing my new graph didn't appear to work [20:20:57] * rdwrer goes to get lunch too [20:56:47] rdwrer: i'm back and ready to debug [20:59:22] I don't see any changes in the dashboard, but let me know what you're trying to do [21:11:27] milimetric: https://gitorious.org/analytics/multimedia-limn/commit/d0ff798b3f1a3d6c0175df4d85917ebc45a4c5dc [21:11:34] milimetric: I fab'd it, but it doesn't show up [21:11:42] Er...now it does [21:11:52] But the original click one doesn't? [21:12:05] lemme see [21:12:25] what page are you looking at? [21:12:30] milimetric: http://multimedia-metrics.wmflabs.org/ [21:12:49] I'm seeing the media-viewer-performance graph I set up [21:12:51] what are you seeing? [21:13:02] milimetric: http://multimedia-metrics.wmflabs.org/dashboards/mmv.json there should be two graphs [21:13:12] ah, you made a different dashboard [21:13:14] Unless I'm completely high [21:13:19] Oh, apparently I'm completely high. [21:13:38] yeah [21:13:40] you are [21:13:40] :) [21:13:48] you just put them in separate tabs [21:13:53] I'll fix it. [21:13:55] you can put them under the same tab if you like [21:14:03] i mean, both ways make sense [21:14:21] btw, this is a bit easier to look at: http://multimedia-metrics.wmflabs.org/dashboards/mmv.json?pretty=1 [21:14:36] Ugh [21:14:43] milimetric: I have a browser plugin that does that [21:14:50] nice [21:14:51] ok, so you fabbed this up? [21:15:06] Going now [21:15:18] Uhhh, seems to be up now [21:15:25] But again, no dice for me [21:15:31] you would've had to delete the old file though, otherwise fab would break no? [21:15:35] Uh [21:15:45] because it can't pull with conflicting changes locally [21:15:49] No error messages [21:15:53] lemme see [21:19:46] ah, no commas rdwrer :) [21:19:55] it's gotta be valid json [21:20:00] I recommend syntastic if you use vim [21:20:13] Wat [21:20:14] Oh, right. [21:20:15] want me fix? [21:20:38] I will [21:20:48] If only to make sure fab works [21:21:37] OK, now what [21:21:47] http://multimedia-metrics.wmflabs.org/dashboards/mmv.json is valid [21:21:53] But...no dice [21:22:11] it's up, it looks great [21:22:12] http://multimedia-metrics.wmflabs.org/dashboards/mmv [21:22:15] what you seeing? [21:22:55] Oh, that is better [21:23:04] http://multimedia-metrics.wmflabs.org/# has nothing [21:23:10] right, i deleted that file [21:23:14] it was just temporary [21:23:28] if you want something to show up as the "default" dashboard, and this is stupid [21:23:35] it has to be named "reportcard.json" [21:23:35] * rdwrer braces self [21:23:38] Hahahaha [21:23:40] :) [21:23:41] right? [21:23:48] you're welcome to submit a pull request for that [21:23:55] Excuse me while I stab limn to death in an alley [21:23:56] it's literally been there since 2012 [21:24:11] and like, all of us are like - there are bigger fish to fry, ignore extremely stupid default [21:25:06] oh comeon, despite its flaws, this isn't horrible [21:25:16] there are worse dashboarding tools out there for sure [21:49:02] (PS1) Ottomata: Properly updating project version to 0.1.0-SNAPSHOT-wmf-2 [analytics/camus] (wmf) - https://gerrit.wikimedia.org/r/117093 [21:49:04] (PS1) Ottomata: Updating README.md with documentation about Wikimedia's fork of Camus [analytics/camus] (wmf) - https://gerrit.wikimedia.org/r/117094 [21:49:30] (CR) Ottomata: [C: 2 V: 2] Properly updating project version to 0.1.0-SNAPSHOT-wmf-2 [analytics/camus] (wmf) - https://gerrit.wikimedia.org/r/117093 (owner: Ottomata) [21:50:29] (PS2) Ottomata: Updating README.md with documentation about Wikimedia's fork of Camus [analytics/camus] (wmf) - https://gerrit.wikimedia.org/r/117094 [21:50:42] (CR) Ottomata: [C: 2 V: 2] Updating README.md with documentation about Wikimedia's fork of Camus [analytics/camus] (wmf) - https://gerrit.wikimedia.org/r/117094 (owner: Ottomata) [21:51:42] rdwrer: anything else from me? Gonna head out on time today (in about 9 minutes) [21:52:02] Uh, I think it's fine [21:52:09] We have two graphs, I know how to make the last one [21:53:47] so this trick only works for timeseries graphs right now [21:53:47] for ordinal plots you'll still have to make the graph metadata and datasource metadata [21:54:32] but you could bring this up as a desired feature and Toby might want to implement automatic detection of the type of data and creation of a sensible default visualization [22:46:24] (PS1) Ottomata: No longer depending on locally included kafka .jar file [analytics/camus] (wmf) - https://gerrit.wikimedia.org/r/117100