[17:12:32] Bryan Davis has a tech talk which will be starting in 18 min, info in topic [17:13:21] * Reedy eats quickly [17:16:34] If anyone wants an invite to the hangout directly we still have space. Let me know! :) [17:24:58] we are starting this talk in 5 min, last chance for a hangout invite! [17:25:17] otherwise following on youtube still works :) [17:28:32] "Hands-On Workshop with Elasticsearch, Logstash & Kibana" in Austin TX, $700. bd808 should raise his prices [17:30:07] just about to start [17:30:28] * Niharika stands by [17:32:10] we have started :) [17:33:10] greg-g, thanks! I did not know you could do that now. :) [17:33:22] can remote people hear? [17:33:29] Niharika ^ :) [17:33:31] Yea, sound is good [17:33:40] dynosaur: Very well. [17:33:48] great ! [17:33:59] you can ask questions at any point, just ping me and I will ask for you [17:34:45] currently 18 people watching total [17:36:59] dynosaur: yeah, that hiding thing is new, and totally awesome [17:38:10] about time! ;) [17:39:14] slides are fuzzy on youtube for me, anyone else? [17:39:39] Yea, a bit fuzzy for me too. Readable, but fuzzed. [17:41:28] Slides are okay for me (in 720p) [17:41:31] they seem clear on this end...hmm not sure if there is anything to be done for that [17:41:39] JeanFred! [17:41:56] JeanFred!! [17:43:24] JeanFred: good thinking I manually set my quality and it sorted it out [17:43:40] bd808: speaking of kafka, can logstash ingest from kafka easily? [17:44:04] guillom: dynosaur: ! [17:44:20] ottomata: asked :) [17:45:23] thank you :) [17:48:17] 26 people watching now [17:52:27] I have heard elastic say it as "kib-ahna" [17:54:41] we know what floppy disks are >.< [17:54:55] I can’t find the logstash filters ; only the input & output in operations-puppet/modules/logstash/templates/ ? [17:54:58] prove it [17:55:18] JeanFred: let me know if you want me to ask a specific question [17:56:01] Oh they are in operations-puppet/files/logstash/ [17:58:11] last saved dashboard in prod, https://logstash.wikimedia.org/#/dashboard/elasticsearch/wikidata-xml , seems to show no events [17:58:29] "type:mediawiki AND channel:fatal" does nothing in production? [18:02:08] spagewmf: I get everything 0. [18:05:41] ah, zoom out and we've had no fatals since 12:30 UTC [18:10:22] questions? [18:12:46] https://commons.wikimedia.org/wiki/File:ELK_Tech_Talk_2015-08-20.pdf [18:12:47] ^ [18:15:08] now is your chance for questions! [18:15:11] what the the 4.0 things that we don't like? [18:15:21] chasemp: I will ask [18:16:37] The new logo sucks too. [18:16:57] please rephrase as a question JF ;) [18:17:12] heh [18:17:47] thanks bd808! [18:17:51] thanks! [18:17:59] (Too late for question) Wonder how this will interact with Sentry in the future (if at all) ? [18:18:31] thanks! :) [18:18:42] bd808 ^^^ can you answer JeanFred's question here? [18:19:24] JeanFred: We would like to have logstash feed into sentry at some point. tgr and I have been thinking about how it would work [18:20:29] Thanks bd808. Unrelated question - which IRC client was that? :) [18:20:54] JeanFred: you can follow https://phabricator.wikimedia.org/T85239 if you are interested [18:21:10] So Sentry would pick up events as output from logstash ? Instead of having Raven do the monitoring ? [18:21:27] That makes sense. [18:21:29] most likely [18:21:34] Thanks bd808 tgr :) [18:22:56] Niharika: mine? it's Textual [18:23:47] tgr: So effectively you would mainly use Sentry for its interface ? Since the alerting could be done by Logstash itself no ? [18:24:10] logstash really is just a stream processor. it's hard to use it directly for alerting [18:24:26] that's one of the reasons we are piping rate data to graphite [18:25:00] It's also not particularly well suited for de-duping which is one of Sentry's strong points [18:25:22] I see. [18:26:17] alerting as in "alert when we have more than ten errors a minute" could be done with either, I think [18:26:52] more error-specific things like "alert me on new errors" or "alert me on errors affecting Extension X" would be very hard with logstash [19:05:55] bd808: where are your excellent slides (for https://www.mediawiki.org/wiki/Tech_talks) [19:06:30] spagewmf: https://commons.wikimedia.org/wiki/File:ELK_Tech_Talk_2015-08-20.pdf [19:06:45] excellent, and fine talk thanks. [19:07:19] I'm working on slurping the video down from youtube to put on commons too [19:07:27] bd808 kibana enhancement: draw a line on the graph labeled "NOW" [19:07:52] so I don't ask dumb questions :) [19:07:56] about the future [19:08:08] heh. there are no dumb questions S. you know that [19:11:04] bd808: I think "Why are there no errors in the future?" comes close :) , and with all this UTC confusion a line labeled "NOW" would really help [19:12:14] bd808: youtube-dl to slurp it and then fireogg to convert it to webm? [19:12:55] mutante: something like that. I've done it before but it's been a while [19:13:19] I think the link I'm downloading now is actually webm already [19:13:29] but I'll check when it is downloaded [19:14:12] bd808: yep, i can recommend it. i used fireogg succesfully to convert videos for commons and youtube-dl as packaged in current Debian also worked recently [19:14:28] (it didn't all the time in thepast because youtube changed stuff)