[00:05:31] Analytics-Backlog, Analytics-Dashiki: vital-signs displays wrong year on x-axis {crow} - https://phabricator.wikimedia.org/T110621#1582544 (kevinator) NEW [00:07:20] Analytics-Backlog, Analytics-Dashiki: vital-signs displays wrong year on x-axis {crow} - https://phabricator.wikimedia.org/T110621#1582555 (kevinator) Open>Invalid a:kevinator Duh! I can't read a chart right. No bug here. Time to go home. The data starts in December 2014... but the x-axis is... [00:28:44] (PS1) Madhuvishy: [WIP] Report RESTBase traffic metrics to Graphite [analytics/refinery/source] - https://gerrit.wikimedia.org/r/234453 (https://phabricator.wikimedia.org/T109547) [04:21:31] Analytics-General-or-Unknown: Create a table in labs with replication lag data - https://phabricator.wikimedia.org/T71463#1582829 (Springle) [05:02:50] Analytics-EventLogging, Database: Add index on event_type to MultimediaViewerDuration tables. - https://phabricator.wikimedia.org/T70397#1582905 (Krenair) [07:00:44] Analytics-Tech-community-metrics, ECT-August-2015: Exclude third-party / pulled upstream code repositories from metrics - https://phabricator.wikimedia.org/T103984#1582997 (Dicortazar) After closing some of the tasks related to automation of the gerrit-retrieval repositories, I'll try to detail how we all... [07:20:16] Analytics-Dashiki, Analytics-Kanban, Browser-Support-Firefox: vital-signs doesn't display pageviews graph in Firefox 41, 42 {crow} [3 pts] - https://phabricator.wikimedia.org/T109693#1583069 (Nemo_bis) Currently vital-signs.wmflabs.org doesn't load at all for me, blank page. I'll retry later. [07:34:07] Analytics-Tech-community-metrics, ECT-August-2015: "Median time to review for Gerrit Changesets, per month": External vs. WMF/WMDE/etc patch authors - https://phabricator.wikimedia.org/T100189#1583086 (jgbarah) >>! In T100189#1581570, @Aklapper wrote: >>>! In T100189#1580920, @jgbarah wrote: >> In your ca... [07:57:23] Analytics-Tech-community-metrics: Handling multiple affiliations in tech community metrics - https://phabricator.wikimedia.org/T95238#1583107 (jgbarah) I see three issues here: * (1) Defining (in the real world) which activity of a person is considered "affiliated activity" (that is, activity as a member of... [08:00:21] Analytics-Tech-community-metrics, ECT-August-2015: Exclude third-party / pulled upstream code repositories from metrics - https://phabricator.wikimedia.org/T103984#1583115 (Qgil) Thank you! I have documented this at https://www.mediawiki.org/wiki/Community_metrics#Code_review. Please review. [08:08:58] Analytics-Tech-community-metrics, ECT-August-2015: "Median time to review for Gerrit Changesets, per month": External vs. WMF/WMDE/etc patch authors - https://phabricator.wikimedia.org/T100189#1583127 (Qgil) We are happy acknowledging any real affiliation, no matter how small the organization, how small t... [08:13:53] Analytics-Tech-community-metrics, ECT-August-2015: "Median time to review for Gerrit Changesets, per month": External vs. WMF/WMDE/etc patch authors - https://phabricator.wikimedia.org/T100189#1583130 (Qgil) >>! In T100189#1581570, @Aklapper wrote: > So such orgs (and whether they should be "recognized" a... [09:36:45] Analytics-Tech-community-metrics, ECT-August-2015, ECT-September-2015, Patch-For-Review: "Age of unreviewed changesets by affiliation" shows negative number of changesets - https://phabricator.wikimedia.org/T72600#1583355 (Aklapper) p:Normal>High [09:37:55] Analytics-Tech-community-metrics, ECT-August-2015: Labeling some bots (active in Git/Gerrit) as bots - https://phabricator.wikimedia.org/T110545#1583358 (Aklapper) >>! In T110545#1580501, @Legoktm wrote: > https://gerrit.wikimedia.org/r/#/admin/groups/4,members has a list of bots. Wondering if the **list... [09:52:15] Analytics-Tech-community-metrics, ECT-September-2015: Patches with Verified -1 should not be counted as open in our code review metrics - https://phabricator.wikimedia.org/T108507#1583376 (Aklapper) p:Low>Normal @Qgil clarified "In the same way we filter CR-1; Jenkins can vote in a different and aut... [09:52:25] Analytics-Tech-community-metrics, ECT-September-2015: Patches with Verified -1 should not be counted as open in our code review metrics - https://phabricator.wikimedia.org/T108507#1583378 (Aklapper) a:Dicortazar [10:02:09] Analytics-Tech-community-metrics, ECT-August-2015, ECT-September-2015: "Median time to review for Gerrit Changesets, per month": External vs. WMF/WMDE/etc patch authors - https://phabricator.wikimedia.org/T100189#1583393 (Aklapper) Summarizing from our monthly meeting: Basically Wikimedia prefers to as... [10:13:49] Analytics-Tech-community-metrics, ECT-August-2015: Tech community KPIs for the WMF metrics meeting - https://phabricator.wikimedia.org/T107562#1583446 (Qgil) The next Metrics meeting is next Thursday. @aklapper, let's try to decide by our 1:1 on Monday what exactly we want to propose to Terry for that mee... [10:15:56] Analytics-Tech-community-metrics, ECT-August-2015, ECT-September-2015: Tech community KPIs for the WMF metrics meeting - https://phabricator.wikimedia.org/T107562#1583453 (Qgil) [10:16:04] Analytics, Engineering-Community, MediaWiki-API, Research consulting, and 4 others: Metrics about the use of the Wikimedia web APIs - https://phabricator.wikimedia.org/T102079#1583457 (Qgil) [13:51:11] joal: i would like to run an election so ka13 can come back as leader for some topics [13:51:22] should I not? and just not touch anything til monday? [13:51:23] :) [13:54:43] Analytics-Tech-community-metrics, Engineering-Community, ECT-August-2015: Check whether it is true that we have lost 40% of (Git) code contributors in the past 12 months - https://phabricator.wikimedia.org/T103292#1584061 (Aklapper) [14:00:44] Analytics-Tech-community-metrics, ECT-August-2015: Exclude third-party / pulled upstream code repositories from metrics - https://phabricator.wikimedia.org/T103984#1584078 (Aklapper) [14:00:47] Analytics-Tech-community-metrics, Engineering-Community, ECT-August-2015: Automated generation of repositories for Korma - https://phabricator.wikimedia.org/T104845#1584077 (Aklapper) [14:01:39] Analytics-Tech-community-metrics, Engineering-Community, ECT-August-2015: Automated generation of (Gerrit) repositories for Korma - https://phabricator.wikimedia.org/T104845#1584080 (Aklapper) [14:04:08] Analytics-Tech-community-metrics, Engineering-Community: Automated generation of (Git) repositories for Korma - https://phabricator.wikimedia.org/T110678#1584084 (Aklapper) NEW [14:04:25] Analytics-Tech-community-metrics, Engineering-Community, ECT-August-2015: Automated generation of (Gerrit) repositories for Korma - https://phabricator.wikimedia.org/T104845#1429335 (Aklapper) [14:06:57] Analytics-Tech-community-metrics, Engineering-Community: Automated generation of (Git) repositories for Korma - https://phabricator.wikimedia.org/T110678#1584104 (Aklapper) [14:07:00] Analytics-Tech-community-metrics, Engineering-Community, ECT-August-2015: Automated generation of (Gerrit) repositories for Korma - https://phabricator.wikimedia.org/T104845#1584105 (Aklapper) [14:08:04] Analytics-Tech-community-metrics, Engineering-Community, ECT-September-2015: Automated generation of (Git) repositories for Korma - https://phabricator.wikimedia.org/T110678#1584084 (Aklapper) [14:08:26] Analytics-Tech-community-metrics, Engineering-Community, ECT-August-2015, ECT-September-2015: Check whether it is true that we have lost 40% of (Git) code contributors in the past 12 months - https://phabricator.wikimedia.org/T103292#1386502 (Aklapper) We won't be able to find this out in August - w... [14:10:43] Analytics-Tech-community-metrics, ECT-August-2015, ECT-September-2015: Tech metrics should talk about "Affiliation" or "Organization" instead of companies - https://phabricator.wikimedia.org/T62091#1584118 (Aklapper) p:Low>Lowest [14:13:49] PROBLEM - Check status of defined EventLogging jobs on analytics1010 is CRITICAL: CRITICAL: Stopped EventLogging jobs: processor/server-side-0 processor/client-side-7 processor/client-side-6 processor/client-side-5 processor/client-side-4 processor/client-side-3 processor/client-side-2 processor/client-side-1 processor/client-side-0 [14:14:27] hey ottomata [14:14:31] heya [14:15:03] I don't think there is any risk in re-electing [14:15:23] But tonight I can't as I did yesterday (diner at friends) [14:15:27] aye [14:15:29] me neither! [14:15:32] :) [14:15:34] brother coming into town [14:15:35] So ... [14:15:42] May be monday ? [14:15:47] No errors in camus this morning [14:15:58] RECOVERY - Check status of defined EventLogging jobs on analytics1010 is OK: OK: All defined EventLogging jobs are runnning. [14:17:04] I am backfilling pageview data in another table to correct the space in page_title bug, the wrong hosts present and I have in the mean time changed the filed order (user_agent_map now before record_version and view_count) [14:17:16] So about elections, what do you think ? [14:18:02] ottomata: --^ [14:18:29] Also by the, you know I can't make it to tonight meeting [14:18:52] Do you mind spending a few minutes now for me to tell you my view point, and get some insights as well ? [14:20:02] joal, please! [14:20:09] batcave? [14:20:14] election: i thin i'm going to wait, i've had enough surprises [14:20:24] I agree :) [14:20:25] field reordering, fine with me as long as it doesn't cause any problems. not sure if it can [14:20:30] Let's do that on monday [14:20:31] batcave, gimme a few mins [14:20:41] sure, whenever [14:35:43] Analytics-Tech-community-metrics, Research consulting, Research-and-Data: Data for audit report - https://phabricator.wikimedia.org/T110067#1584199 (ezachte) @Tbayer thanks, last week we came to similar numbers in mail for 1) via the report card (not equal, as often is the case, due to different measu... [14:43:05] k joal! [14:43:30] in batcave [14:45:30] omw ottomata [14:47:37] joal: sorry if you already talked about it, but what was up with EL services getting stopped? [14:48:51] milimetric: we have not talked about yet [14:51:48] if Icinga is to be trusted, it looks like the services were stopped for a minute or so and then started back up [14:51:50] any idea why? [14:51:51] milimetric: that was on analytics1010 [14:53:44] ja, i started the new balanced consumer processes there [14:53:48] puppetized them [14:53:55] but hadn't told el to start them [14:55:00] Analytics-Kanban, Research-and-Data: Backfill pageview data correcting space in title bug - https://phabricator.wikimedia.org/T110614#1584280 (JAllemandou) [14:55:31] Analytics-Kanban, Research-and-Data: Backfill pageview data correcting space in title bug - https://phabricator.wikimedia.org/T110614#1584290 (JAllemandou) a:JAllemandou [14:55:42] milimetric: i wish that hadn't paged, since an10 is test instance :/ [14:59:36] i guess we'd need a different hiera setup for a test cluster, but if we did the hadoop cluster in beta like you want, that's probably better [15:03:07] eh? [15:03:15] milimetric: ? [15:04:16] like, we could solve "don't get alerts from an10 two ways, right? 1. set alerts based on hiera properties and create a property file special for EL on an10, then route traffic there separately [15:04:37] 2. set up the full kafka / hadoop, etc. analytics cluster on beta and do EL testing there [15:05:15] naw, milimetric, the reason we are doing this in prod is to stage and perf test this stuff [15:05:26] the puppetization is already special cased for this [15:05:36] what I should do is disable el related icinga alerts on an10 somehow [15:05:38] via puppet [15:07:41] k, it's no big deal [15:11:01] milimetric: https://gerrit.wikimedia.org/r/#/c/234546/1 [15:12:38] Analytics-Tech-community-metrics, ECT-August-2015, ECT-September-2015: Tech community KPIs for the WMF metrics meeting - https://phabricator.wikimedia.org/T107562#1584308 (Aklapper) >>! In T107562#1579585, @Qgil wrote: > I have started "moving" content to https://www.mediawiki.org/wiki/Community_metric... [15:18:04] Hey Ironholds, just read your email and you like some clarification when you have aminute [15:18:26] Ironholds: and I would like some clarification sorry [15:19:29] joal, totally! I meant the log entries on https://meta.wikimedia.org/wiki/Research:Page_view#Change_log [15:20:28] I tried to follow your pattern, or at least I thought :) [15:21:22] Ironholds: --^ [15:21:52] joal, you included new domains, yes? [15:22:09] so point me to where you note the new domains you included ;) [15:22:29] right, I get the point [15:22:41] ditto, 'updated hosts' - what are you excluding? [15:22:45] The doic has been updated once for the 3 patches (because of ignorance) [15:23:15] doic? [15:23:45] So if you look to the revision linked in the last changelog, there is everythiong documented [15:23:49] doc [15:24:09] But yes, unitary changes would have been better [15:24:39] Maybe I should make 1 changelog line explaining the bug and the doc issue? [15:25:00] Also, I am currently backfilling pageview data and removing outreach and donate [15:25:14] I'll add one changelog line when released [15:25:19] Ironholds: --^ [15:25:42] joal, and arbcom? [15:25:57] I don't know about arbcom [15:26:14] arbcom-*.wikipedia should not match [15:26:18] I'll file a phabricator task [15:26:23] hm [15:26:36] ah, I see what you mean, you made the changes in https://meta.wikimedia.org/w/index.php?title=Research%3APage_view%2FGeneralised_filters&type=revision&diff=13346981&oldid=11440263 and linked from the changelog? [15:26:41] eh that'll probably do [15:26:48] correct ! [15:27:17] But since I updated the filters doc once (with all the modifs), I didn't document the buggy one [15:27:21] That is all [15:27:48] actually I'll just submit a patch\ [15:27:50] I have a free morning [15:28:03] Ironholds: I am at the beginning of backfilling, so I can restart, but changing the def of pageview regularly doesn't help (you know it even better than I do) [15:28:17] Awesome Ironholds [15:29:48] Ironholds: Any other idea that arbcom-* before I start backfilling again ? [15:31:41] ottomata: Standup ! [15:35:09] Analytics-Kanban, Research-and-Data: Bug in pageview title extraction: change spaces to underscores after percent_decode (not only plus signs) [3 pts] {hawk} - https://phabricator.wikimedia.org/T108866#1584344 (JAllemandou) [15:35:36] Analytics-Kanban: Remove 'outreach' domain from pageview definition. [3 pts] {hawk} - https://phabricator.wikimedia.org/T109256#1584345 (JAllemandou) [15:36:02] Analytics-Kanban: Update refinery dataset-check dump script [5 pts] {hawk} - https://phabricator.wikimedia.org/T108950#1584347 (JAllemandou) [15:36:30] Analytics-Kanban: back up data used to crunch numbers - https://phabricator.wikimedia.org/T110255#1584349 (Ottomata) We got 27th and the 30th backed up, but the 26th had already begun to be deleted by the time we started backing up. :/ ``` hdfs@stat1002:/mnt/hdfs/wmf/data/archive$ hdfs dfs -du -s -h /wmf/dat... [15:36:54] Analytics-Kanban: Update refinery dataset-check dump script {hawk} [5 pts] - https://phabricator.wikimedia.org/T108950#1535196 (JAllemandou) [15:37:07] Analytics-Kanban: Remove 'outreach' domain from pageview definition. {hawk} [3 pts] - https://phabricator.wikimedia.org/T109256#1544123 (JAllemandou) [15:37:19] Analytics-Kanban, Research-and-Data: Bug in pageview title extraction: change spaces to underscores after percent_decode (not only plus signs) {hawk} [3 pts] - https://phabricator.wikimedia.org/T108866#1584355 (JAllemandou) [15:37:36] joal, not really. I'm going to go submit a patch for arbcom-*; not sure if you want to run a second backfill to get rid of that? [15:38:04] Ironholds: I have stopped current backfilling, qnd will restart (was only the beginning) [15:38:14] Ironholds: I'll restart removing arbcom [15:38:38] Ironholds: Finally, on doc, are we Ok or do you want me only to have one changelog line ? [15:39:03] Analytics, Analytics-Kanban: Transform to XML-->JSON in sorted file format [8 pts] - https://phabricator.wikimedia.org/T108684#1584358 (JAllemandou) [15:39:28] joal, I think we're okay [15:39:41] Ok great :) [15:39:59] I'll tru to be better on reagular updates instead of one offs ! [15:40:09] s/tru/try [15:40:17] s/reagular/regular [15:40:25] Big fingers today ... [15:41:05] Analytics-Kanban: Update pageview documentation to reflect current status {hawk} [3 pts] - https://phabricator.wikimedia.org/T109257#1544133 (JAllemandou) Confirmed with @Ironholds [15:46:20] Analytics-Kanban, Research-and-Data: Backfill pageview data correcting space in title bug - https://phabricator.wikimedia.org/T110614#1584388 (JAllemandou) Recompute pageview_hourly since the beginning (01 may 2015): - replace spaces with underscores in page_title and re-group them - remove projects dona... [15:46:58] (CR) Ottomata: [WIP] Report RESTBase traffic metrics to Graphite (1 comment) [analytics/refinery/source] - https://gerrit.wikimedia.org/r/234453 (https://phabricator.wikimedia.org/T109547) (owner: Madhuvishy) [15:51:22] Analytics-EventLogging, Analytics-Kanban, Patch-For-Review: Puppetize parallel eventlogging-processor {stag} [8 pts] - https://phabricator.wikimedia.org/T104228#1584397 (madhuvishy) a:Ottomata [15:53:44] Analytics-Kanban: Archive obsolete schema pages {tick} [5 pts] - https://phabricator.wikimedia.org/T110247#1584404 (madhuvishy) [15:58:23] Analytics-Kanban, RESTBase, Patch-For-Review: Productionize the Spark job that sends RESTBase stats to Graphite {hawk} - https://phabricator.wikimedia.org/T110691#1584420 (madhuvishy) NEW a:madhuvishy [16:02:09] (CR) Madhuvishy: [WIP] Report RESTBase traffic metrics to Graphite (1 comment) [analytics/refinery/source] - https://gerrit.wikimedia.org/r/234453 (https://phabricator.wikimedia.org/T109547) (owner: Madhuvishy) [16:09:39] argh [16:09:49] joal, Failed to execute goal on project refinery-core: Could not resolve dependencies for project org.wikimedia.analytics.refinery.core:refinery-core:jar:0.0.17-SNAPSHOT: Could not find artifact jdk.tools:jdk.tools:jar:1.7 at specified path /usr/lib/jvm/java-7-openjdk-amd64/jre/../lib/tools.jar -> [Help 1] [16:09:58] new laptop. Do I need to install java-6? ;p [16:11:46] Ironholds: I think you need java-7 :) [16:12:37] I have java-7 ;p [16:13:05] oh fuck I've got the jre [16:13:06] * Ironholds sighs [16:13:26] endless downloads, endless [16:16:11] Analytics-Kanban: Write scripts to track cycle time of tasked tickets and velocity [8 pts] - https://phabricator.wikimedia.org/T108209#1584466 (ggellerman) Discussed more with @mforns and @Milimetric and @JAllemandou at standup today: 1. Reviewed Kanban emphasis on finishing tasks, keeping them small (when... [16:22:13] Ironholds: java is an endless bandwith burner :) [16:22:27] Whenever it's not full downloads, it's updates ! [16:23:19] yup! [16:23:23] Now resolved; writing the patch [16:23:43] ok, backfilling restarted [16:23:47] Ironholds: --^ [16:23:55] Tnaks for the patch [16:32:37] madhuvishy: eees working! :) [16:32:38] http://grafana.wikimedia.org/#/dashboard/db/eventlogging [16:33:25] (CR) Joal: "You have chosen to use the 'parquetFile' to read data in." (2 comments) [analytics/refinery/source] - https://gerrit.wikimedia.org/r/234453 (https://phabricator.wikimedia.org/T109547) (owner: Madhuvishy) [16:35:10] (CR) Ottomata: [WIP] Report RESTBase traffic metrics to Graphite (1 comment) [analytics/refinery/source] - https://gerrit.wikimedia.org/r/234453 (https://phabricator.wikimedia.org/T109547) (owner: Madhuvishy) [16:57:12] Analytics-Backlog: Backfill pageviews to exclude arbcom wikis - https://phabricator.wikimedia.org/T110701#1584591 (Ironholds_backup) NEW [16:58:55] Analytics-Backlog: Backfill pageviews to exclude arbcom wikis - https://phabricator.wikimedia.org/T110701#1584608 (Ironholds_backup) p:Triage>Unbreak! [16:59:36] (PS1) OliverKeyes: Exclude the arbitration committee wikis from the pageviews counts [analytics/refinery/source] - https://gerrit.wikimedia.org/r/234570 [17:00:17] joal, https://gerrit.wikimedia.org/r/#/c/234570/ [17:08:09] (CR) Joal: [C: 2] "One picky comment about comment ..." (1 comment) [analytics/refinery/source] - https://gerrit.wikimedia.org/r/234570 (owner: OliverKeyes) [17:08:27] Ironholds: --^ [17:09:21] Ironholds: deploy has been done yesterday, so next one wil be later ... Will let you know when done. [17:09:55] * AndyRussG waves [17:10:28] morning milimetric! Indeed got more beta cluster EL issuez, when u have a chance to peek pls LMK? not urgent [17:10:32] (PS2) OliverKeyes: Exclude the arbitration committee wikis from the pageviews counts [analytics/refinery/source] - https://gerrit.wikimedia.org/r/234570 [17:10:41] joal, done [17:10:51] Thanks Ironholds, merge arriving [17:10:52] tl;dr: ^ events don't seem to be getting thru anywhere, maybe I'm looking in the wrong place now? [17:10:58] thx in advance! [17:11:28] joal, yay! [17:12:13] AndyRussG: checking [17:12:37] andyrussg@deployment-eventlogging02:~$ tail -f -n 1000 /var/log/eventlogging/all-events.log [17:12:59] andyrussg@deployment-eventlogging02:~$ tail -f -n 1000 /var/log/eventlogging/client-side-events.log [17:13:00] (CR) Joal: [C: 2 V: 2] "LGTM !" [analytics/refinery/source] - https://gerrit.wikimedia.org/r/234570 (owner: OliverKeyes) [17:13:39] andyrussg@deployment-eventlogging02:~$ sudo tail -f -n 1000 /var/log/upstart/eventlogging_processor-client-side-events.log [17:13:39] tail: cannot open `/var/log/upstart/eventlogging_processor-client-side-events.log' for reading: No such file or directory [17:13:41] AndyRussG: no, there's something def. wrong, all those files are empty [17:14:12] yeah... didn't know fer sure if they were the right files still 8p [17:14:24] argggg [17:14:36] milimetric: here's the updated URL to definitely generate one of our banner history events: http://en.wikipedia.beta.wmflabs.org/wiki/Main_Page?country=AQ&bannerHistoryLogRate=1 [17:14:36] not sure what's wrong here, I might get lunch before I look further [17:15:06] milimetric: fer sure! yeah no wikis are broken nor data leaking away 'cause of this :D [17:15:47] I would recommend sourdough bread with peanut butter and honey, but that's just 'cause that's what I'm eating and it's sooooooooooo good [17:16:18] ottomata / madhuvishy: I'm not sure what's going on beta cluster with EL [17:16:26] I seem to have just made everything much worse [17:16:32] https://www.irccloud.com/pastebin/8M0M838I/ [17:16:44] that's all that the forwarder says, client and server side [17:16:48] sorry milimetric I need to go :( [17:16:57] have a nice weekend joal [17:16:59] Have a good end of week a-tean [17:17:59] hm, ok looking [17:18:19] it looks like the puppet doesn't match the code, but doesn't puppet get latest always? [17:18:31] and code is on latest, I deployed myself [17:19:19] Analytics-Engineering, Editing-Analysis, VisualEditor: Provide VE-related data for the Galician Wikipedia - https://phabricator.wikimedia.org/T86944#1584705 (Jdforrester-WMF) [17:19:41] hm [17:20:41] yeah, milimetric seems like outdated code? [17:21:16] what's the deployment git deploy instance? [17:21:18] i will deploy [17:21:55] deployment-salt? [17:22:15] mmm, no idea, i just git pulled locally [17:23:11] deployment-bastion, i think [17:23:12] trying [17:23:39] ja that worked [17:25:10] Analytics-Engineering, Editing-Analysis, VisualEditor: Provide VE-related data for the Galician Wikipedia - https://phabricator.wikimedia.org/T86944#1584750 (Milimetric) The data collected around this period had problems that I'm not sure how to fix any more. If there's anything it would be in the Edi... [17:26:39] ees working now i think milimetric, AndyRussG [17:26:52] it looks like it, thx ottomata [17:26:55] so, what was up? [17:27:04] it has to be deployed through git deploy? [17:27:11] it should be, doesnt' have to be [17:27:16] dunno, it had old code deployed on it [17:27:18] it said may something [17:27:20] was the last commit [17:27:23] ... wth... [17:27:28] or, at least that was what was checked out [17:27:32] not sure if it was setup.py installed [17:27:40] i deployed from deployment-bastion, then did setup.py install [17:27:45] and restarted eventlogging [17:28:04] i checked out master, pulled, ran setup.py, and restarted [17:28:09] so weird [17:28:11] ok, thx [17:28:19] deployment-bastion [17:29:02] so ottomata I'd go here to deploy? milimetric@deployment-bastion:/srv/deployment/eventlogging/EventLogging [17:29:29] ottomata: milimetric: thx! yeah our event is now getting through to all-events.log. In a little bit I'll check the mysql [17:29:30] :) [17:29:44] Analytics-Backlog, Analytics-Dashiki, Editing-Analysis, VisualEditor, Patch-For-Review: Improve the edit analysis dashboard {lion} - https://phabricator.wikimedia.org/T104261#1584785 (Jdforrester-WMF) [17:32:18] yup milimetric right [17:34:24] thx [17:39:17] milimetric: ottomata: cool... should the events not be showing up in MySQL yet? AmI doing it right? [17:39:18] andyrussg@deployment-eventlogging02:~$ sudo mysql -h 127.0.0.1 -p [17:39:28] mysql> use log; [17:39:44] mysql> show tables; [17:40:07] (no tables corresponding to CentralNoticeBannerHistory schema) [17:40:19] AndyRussG: it inserts in somewhat hard to understand batches [17:40:27] how many events did you insert and when? [17:40:53] milimetric: just a couple... Ah the batches are by number of events, not time? K I thought it was time [17:41:15] AndyRussG: it's both [17:41:17] and did it just now, since this started working again [17:41:30] I mean, like 5 or 6 min ago [17:41:33] you either have to wait 5 minutes and insert another event [17:41:39] or you have to insert 400 events [17:41:46] if you do either of those, it'll flush [17:42:01] Ahhh K I undertand now, right... It doesn't flush on time until the next event is sent in [17:42:05] Mmm trying [17:42:51] AndyRussG: oh, nvm, problem [17:42:55] https://www.irccloud.com/pastebin/P7P6BdpM/ [17:43:03] it won't let you insert because of the nested structure somehow [17:43:38] aaargh, urgent request AndyRussG, sorry I won't be able to help with this today [17:43:51] * milimetric mili|busy [17:45:21] mili|busy: np thx, g'luck :) [18:03:27] ottomata: are you also busy w/ urgent stuff like mil-imetric? I just hope to check one thing: is it the case that the nested EL schema we have (https://meta.wikimedia.org/wiki/Schema:CentralNoticeBannerHistory) means we can't get our EL data into MySQL, as per this error pasted mil above (https://www.irccloud.com/pastebin/P7P6BdpM/) ? Sorry for the bother! [18:07:03] AndyRussG: I don't really know much about the EL schema -> mysql stuff [18:07:34] ottomata: ah K thx... anyone else u think I should disturb about it? [18:08:03] mforns might know, but i think he's out already [18:08:05] From the table structure and the SQL it looks like the intention would be just to insert the nested part as a string [18:08:23] And that it just forgot to put quotes around it [18:08:28] Ah k [18:08:55] https://tools.wmflabs.org/paste/view/241014f8 [18:09:16] ("event_l" would be the array of objects) [18:19:46] Analytics-Tech-community-metrics: Maniphest backend for Metrics Grimoire - https://phabricator.wikimedia.org/T96238#1584921 (Aklapper) >>! In T96238#1399448, @Dicortazar wrote: > at some point, Bugzilla information would be deprecated due to that all of the info is in Maniphest. Now covered in {T106037}. [18:37:51] Analytics-Tech-community-metrics, Phabricator, ECT-August-2015: Metrics for Maniphest - https://phabricator.wikimedia.org/T28#1584949 (Aklapper) [18:41:21] Analytics-Tech-community-metrics, Phabricator, ECT-August-2015: Metrics for Maniphest - https://phabricator.wikimedia.org/T28#1584976 (Aklapper) Updated the task summary to reflect currently available data. The "wanted items" listed are from April 2014 and is old. It should be shortened a lot to identi... [18:42:46] Analytics-Tech-community-metrics: Checking code review metrics for a specific repository may take dozens of clicks - https://phabricator.wikimedia.org/T110520#1584985 (Aklapper) p:Triage>Low [18:43:11] Analytics-Tech-community-metrics, Phabricator, ECT-August-2015: Metrics for Maniphest - https://phabricator.wikimedia.org/T28#1584987 (Aklapper) a:Aklapper>None [18:56:15] ottomata: there was no room assigned to the meeting, since a few people are here, I added one [18:56:22] in case you want to let anyone know [18:56:51] oh! thanks [18:56:52] sorry about that [18:56:59] we are not all remotees? :p [18:57:22] he he some remotees are in town [18:57:48] no call either! [18:57:49] geez [18:58:09] there we go [18:58:17] madhuvishy: in case you need [18:58:17] https://plus.google.com/hangouts/_/wikimedia.org/scalable-events [19:31:16] Analytics-Tech-community-metrics: Graph waiting time for shell access requests - https://phabricator.wikimedia.org/T66702#1585248 (scfc) Open>Invalid a:scfc In #Labs, shell access is now effectively only given out when a user joins a Labs project (but implicitly in that case), so the waiting time fo... [20:23:43] madhuvishy: weird, I'm running perf tests with balanced consumer [20:23:54] and i'm seeing better performance with more processors than partitions for a topic? [20:23:58] that don't make no sense. [20:27:00] maybe its just a fluke, dunno! [20:28:58] Analytics-Cluster, hardware-requests, operations: Hadoop worker node procurement - 2015 - https://phabricator.wikimedia.org/T100442#1585462 (Cmjohnson) [20:29:01] Analytics-Cluster, Analytics-Kanban: {mule} Hadoop Cluster Expansion - https://phabricator.wikimedia.org/T99952#1585463 (Cmjohnson) [20:29:03] Analytics-Cluster, operations, ops-eqiad, Patch-For-Review: rack new hadoop worker nodes - https://phabricator.wikimedia.org/T104463#1585460 (Cmjohnson) Open>Resolved All have been racked and setup...the replacements 1053 and 1057 have not been installed yet. I will leave that up to @ottomata [20:31:26] Analytics-EventLogging, Analytics-Kanban: Load test parallel eventlogging-processor {stag} [5 pts] - https://phabricator.wikimedia.org/T104229#1585485 (Ottomata) Using a the 12 partition `eventlogging-client-side` raw events topic, I consumed from the beginning of a stream and benchmarked how many messag... [21:05:44] Analytics-EventLogging, Analytics-Kanban: Load test parallel eventlogging-processor {stag} [5 pts] - https://phabricator.wikimedia.org/T104229#1585597 (madhuvishy) a:madhuvishy>Ottomata [21:06:14] ottomata: just saw the load test results [21:06:20] aye! [21:06:24] that's awesome! :) [21:14:54] :) ja! but also strange is that i got more throughput by launching more processors than there were partittions for that topic [21:14:57] which doesn't make any sense [21:15:01] so i'd like to vet that some more [21:17:08] madhuvishy: i'm making this phab ticket to summarize what we said in the meeting [21:17:20] do you think I should keep with the term 'scalable events system' or use something else [21:17:20] ? [21:17:31] maybe stream data platform (that's what the confluent blog post calls it) [21:17:52] naww, stream is a loaded word. hm [21:18:29] but scalable event system is a dumb name. [21:24:50] ottomata: ha ha [21:25:24] yeah it needs to be a smaller name [21:27:16] ottomata: I thought you can only have as many consumers as partitions [21:27:21] yeah me too [21:27:24] dunno what's happening there [21:27:32] yeah, doesn't make sense [21:27:34] will try with a 1 partitions topic and see what logs say [21:27:41] i wonder if it is double consuming? [21:27:47] yeah may be [21:28:58] Analytics-Kanban, RESTBase, Patch-For-Review: Create a metric for overall RESTBase request rates from Varnish logs {hawk} [13 pts] - https://phabricator.wikimedia.org/T109547#1585657 (GWicke) @Madhuvishy: Did you see any RESTBase requests in the current request logs? I'm not 100% certain that our Varni... [21:33:00] Analytics-Kanban, RESTBase, Patch-For-Review: Create a metric for overall RESTBase request rates from Varnish logs {hawk} [13 pts] - https://phabricator.wikimedia.org/T109547#1585663 (madhuvishy) @Gwicke Yes! I'm actually plotting a graph on graphite for today. Will post that in a bit [21:35:10] Analytics-Kanban, RESTBase, Patch-For-Review: Create a metric for overall RESTBase request rates from Varnish logs {hawk} [13 pts] - https://phabricator.wikimedia.org/T109547#1585672 (GWicke) @madhuvishy: Oh, awesome! Thanks a bunch. [21:37:54] ottomata: http://kafka.apache.org/documentation.html Look for Consumer Rebalancing algorithm [21:38:22] Says they dont allow more than 1 consumer to consume from a partition at a time [21:56:30] Analytics-Kanban, RESTBase, Patch-For-Review: Create a metric for overall RESTBase request rates from Varnish logs {hawk} [13 pts] - https://phabricator.wikimedia.org/T109547#1585713 (madhuvishy) @GWicke - Check out graphite.wikimedia.org - test.restbase.requests. I plotted the first 12 hours of today.... [21:57:47] madhuvishy: aye, within a given consumer group [21:57:48] right? [21:59:12] ottomata: really? i'm not sure - the wording is not clear [21:59:30] it says, 1 consumer per partition at a time [22:01:08] hmmm may be within the group [22:03:20] yeah, def can have multiple consumers, otherwise kafka would suck! [22:11:41] ottomata: right [22:11:52] but you tried same group no? [22:13:46] yes same group [22:40:40] Analytics, Discovery, MediaWiki-General-or-Unknown, Services, and 5 others: Reliable publish / subscribe event bus - https://phabricator.wikimedia.org/T84923#933968 (Ottomata) [23:48:36] Analytics-Kanban, RESTBase, Patch-For-Review: Create a metric for overall RESTBase request rates from Varnish logs {hawk} [13 pts] - https://phabricator.wikimedia.org/T109547#1586055 (GWicke) Very nice! I just verified the request rates, and found out that our main third-party consumers (Kiwix and Goog...