[01:28:48] HaeB: Thanks for the heads up on the nice queue. I'll use it from now on. [08:07:57] Hi a-team [09:13:45] (03PS1) 10Joal: Correct typos in endpoint descriptions [analytics/aqs] - 10https://gerrit.wikimedia.org/r/384468 [09:28:04] (03PS2) 10Fdans: Maintain active breakdowns when time range is changed [analytics/wikistats2] - 10https://gerrit.wikimedia.org/r/383589 (https://phabricator.wikimedia.org/T177646) [09:29:19] (03CR) 10Fdans: [V: 032 C: 032] "@Milimetric applied your suggested change :)" [analytics/wikistats2] - 10https://gerrit.wikimedia.org/r/383589 (https://phabricator.wikimedia.org/T177646) (owner: 10Fdans) [09:30:48] Hi fdans - I'm sad, deployment failed on friday, no metric yet :( [09:31:23] yeah I saw it joal, I was heartbroken! [09:31:24] ;) [09:31:32] :D [09:31:33] we're getting there joal [09:31:46] I know, I kinda now just want to BE there :) [09:32:02] yea me too!! [10:11:03] milimetric: for when you're here, there's a minor caveat in the new way we do deployments with gerrit [10:12:27] which is that we're pushing new build dists and bumping the package.json version in the release branch [10:12:39] but that change is not pushed to the master branch [10:13:39] so unless we push two gerrit changes, one for master and another one for release, we're stuck with outdated dists and version numbers in the master branch [10:14:10] (should have probably written an email with this, but let's discuss in standup today) [11:50:34] hellooooo [12:01:16] Hey, does anyone know when will the 2017-10 snapshot of the wmf.mediawiki_history be ready? Thanks! [12:03:04] GoranSM, it should be ready one week into November, because it needs data for the whole month of October, and a couple days to import and process it [12:04:03] mforns: Thanks! [12:04:14] GoranSM, np! :] [12:24:58] 10Analytics-Kanban, 10Patch-For-Review: Remove AppInstallIId from EventLogging purging white-list - https://phabricator.wikimedia.org/T178174#3687120 (10mforns) >>! In T178174#3684430, @Tbayer wrote: >>>! In T178174#3684227, @Nuria wrote: >> Also, what about raw userAgents? > See T164125#3284763 , it seems we... [12:27:15] (03CR) 10Joal: "Thanks a lot Shilad for this patch !" (0316 comments) [analytics/refinery/source] (nav-vectors) - 10https://gerrit.wikimedia.org/r/383761 (https://phabricator.wikimedia.org/T174796) (owner: 10Shilad Sen) [12:30:42] taking a break a-team - later [14:05:42] (03CR) 10Mforns: [C: 032] "LGTM! :]" [analytics/refinery] - 10https://gerrit.wikimedia.org/r/379000 (https://phabricator.wikimedia.org/T174174) (owner: 10Joal) [14:23:08] oof, late start for me, hi everyone [14:25:32] fdans: we can just give up on squashing before release and just pushing the latest from master to release whenever we want to release. [14:26:01] it'll make a series of gerrit changes, that could be annoying [14:26:03] hm... [14:30:36] mforns: hiiiii [14:30:43] is the popups refine working? :D [14:30:44] ottomata, helooooo [14:30:49] ottomata, yes! [14:30:53] yeehaw! [14:30:56] it works fine [14:31:12] now, I checked and there's very few events for Popups [14:31:24] like 5, 2, 4 per hour [14:31:30] and some hours don't have any... [14:31:41] I thought that they had started the experiment no? [14:32:31] dunno [14:46:56] 10Analytics-Kanban: Fix banner activity success file cleaner to allow for email alerts - https://phabricator.wikimedia.org/T178302#3687617 (10mforns) [14:48:01] (03PS1) 10Mforns: Fix refinery banner activity cleaner to allow for email alerts [analytics/refinery] - 10https://gerrit.wikimedia.org/r/384530 (https://phabricator.wikimedia.org/T178302) [14:58:53] 10Analytics-Kanban, 10Analytics-Wikistats, 10Patch-For-Review: Alpha Release: Breakdown selection disapears when you change timespam - https://phabricator.wikimedia.org/T177646#3665552 (10fdans) [14:59:04] mforns: am fine with ^^ but not sure I understand why it is needed [15:00:15] ping fdans [15:06:24] 10Analytics-EventLogging, 10Analytics-Kanban, 10Patch-For-Review: Eventlogging refine popups, temporary cron - https://phabricator.wikimedia.org/T177783#3687753 (10Nuria) [15:33:45] 10Analytics-Kanban: Upgrade AQS restbase-modules - https://phabricator.wikimedia.org/T178312#3687878 (10JAllemandou) [15:34:01] 10Analytics-Kanban: Upgrade AQS restbase-modules - https://phabricator.wikimedia.org/T178312#3687891 (10JAllemandou) a:03JAllemandou [15:43:49] (03CR) 10Milimetric: [V: 032 C: 032] Correct typos in endpoint descriptions [analytics/aqs] - 10https://gerrit.wikimedia.org/r/384468 (owner: 10Joal) [15:51:50] mforns: fixed issues with gerrit blacklisting of popups: https://gerrit.wikimedia.org/r/#/c/384542/ [15:52:07] thx nuria_ [15:52:28] nuria_: shall I merge ^^ ? [15:52:46] ottomata: yes, let's ping tilman and max on ticket cc mforns [15:52:59] ottomata: that tehy can start a new test at their convenience [15:53:00] will do [15:53:32] nuria_: i will run puppet, can you restart EL to apply change after? [15:56:05] nuria_: merged and applied [15:56:29] ottomata: many thanks, [15:56:59] sorry, merged, and puppet run * [15:58:56] milimetric: moving forward with aqs [16:02:05] (03PS1) 10Joal: Update aqs to 5beeea6 [analytics/aqs/deploy] - 10https://gerrit.wikimedia.org/r/384546 [16:03:28] milimetric: --^ Looks like the sha is correct for source [16:09:37] 10Analytics-EventLogging, 10Analytics-Kanban, 10Patch-For-Review: Eventlogging refine popups, temporary cron - https://phabricator.wikimedia.org/T177783#3688009 (10Tbayer) [16:11:57] joal: ah, sorry, irc died [16:12:04] np milimetric :) [16:12:17] listening to QR, gently waiting :) [16:13:37] (03CR) 10Milimetric: [V: 032 C: 032] Update aqs to 5beeea6 [analytics/aqs/deploy] - 10https://gerrit.wikimedia.org/r/384546 (owner: 10Joal) [16:13:52] k, verified and merged [16:14:01] great, thanks milimetric [16:14:35] milimetric: moving forward with deploy [16:14:56] !log Deploy AQS with new code [16:14:58] Logged the message at https://www.mediawiki.org/wiki/Analytics/Server_Admin_Log [16:15:28] sweet [16:22:35] milimetric: We have an error due to monitoring, but the thing actually work :) [16:22:50] I'll take it! :) [16:23:05] milimetric: rollbacking, pushing new patch, then redeploying - right? [16:23:06] nice joal [16:23:19] yes, joal, sounds like a plan [16:23:23] k [16:23:29] joal: wait [16:23:33] yes [16:23:35] ? [16:23:36] you can just leave the monitoring to fail and push a new patch [16:23:41] no need to roll back, right? [16:23:51] correct, better to do it this way [16:23:56] k [16:24:11] nope sorry - monitoring fails means deploy error [16:24:15] So I roobacked [16:24:23] * joal had misread [16:25:29] (03PS1) 10Joal: Fix edits monitoring [analytics/aqs] - 10https://gerrit.wikimedia.org/r/384552 [16:25:33] milimetric: --^ [16:26:22] (03CR) 10Milimetric: [V: 032 C: 032] "ah, I should've looked at the schema before my previous +2, sorry" [analytics/aqs] - 10https://gerrit.wikimedia.org/r/384552 (owner: 10Joal) [16:26:37] np milimetric - I should have known it myself [16:27:39] !log Re-Deploy AQS after monitoring fix [16:27:40] Logged the message at https://www.mediawiki.org/wiki/Analytics/Server_Admin_Log [16:31:10] (03PS1) 10Joal: Update aqs to fc4abc4 [analytics/aqs/deploy] - 10https://gerrit.wikimedia.org/r/384556 [16:32:37] milimetric: --^ again - Thanks :) [16:33:17] (03CR) 10Milimetric: [V: 032 C: 032] Update aqs to fc4abc4 [analytics/aqs/deploy] - 10https://gerrit.wikimedia.org/r/384556 (owner: 10Joal) [16:41:21] milimetric: We're live in AQS :) [16:44:38] milimetric: for you to review before I ask serices team to merge: https://github.com/jobar/restbase/blob/add_mediawiki_history_metrics_endpoints/v1/metrics.yaml [16:45:25] milimetric: new endpoints (except per-page and per-editor ones), plus removal of empty endpoints (/pageviews/, /legacy/ etc as asked by marko) [16:53:57] great pres nuria_ ! [17:03:56] 10Analytics-Kanban, 10Analytics-Wikistats, 10Patch-For-Review: Create Druid public cluster such AQS can query druid public data - https://phabricator.wikimedia.org/T176223#3688125 (10Ottomata) Alright! curl http://druid-public-broker.svc.eqiad.wmnet:8082/status https://config-master.wikimedia.org/pybal/eqi... [17:04:16] 10Analytics-Kanban, 10Analytics-Wikistats, 10Patch-For-Review: Create Druid public cluster such AQS can query druid public data - https://phabricator.wikimedia.org/T176223#3688128 (10Ottomata) [17:04:20] 10Analytics-Kanban, 10Analytics-Wikistats: Fonts from fonts.googleapis.com on wikistats - https://phabricator.wikimedia.org/T178317#3688129 (10Nuria) [17:04:28] thanks fdans [17:06:31] 10Analytics, 10Analytics-Wikistats: Fonts from fonts.googleapis.com on wikistats - https://phabricator.wikimedia.org/T178317#3688146 (10Nuria) [17:10:30] fdans: You can test aqs backend by tunnelling to aqs1004 :) [17:10:43] thank youuuuuuu joal! [17:11:08] fdans: We should have it live (real endpoints) tomorrow mid-day [17:12:16] joal: I'm gonna go over the front-end endpoint change very slowly, after the meetings [17:12:18] is that ok? [17:12:54] milimetric: Very ok, I have submitted the PR, I can get it back waiting for your approval (or wai for approval, and only withdraw if issue) [17:12:57] I know it's largely a formality and a copy of the other work, but I just wanna make sure we don't miss anything before we go live [17:13:08] milimetric: makes complete sense [17:13:33] joal: no, that's ok, I'll comment on it if I see an issue [17:13:38] Great [17:13:39] you don't have to withdraw [17:14:14] I'm not worried about it being out for a couple of days even if I see anything wrong, we're not publicizing it yet [17:14:42] I've monitored aqs endpoints, no metric change since deploy looks like we have a success in not breaking exisitng stuff :) [17:25:16] 10Analytics-Kanban: Unique Devices on Pivot, initial screen should not add values by default, is this configurable? - https://phabricator.wikimedia.org/T164194#3688191 (10JAllemandou) Declinig since we're moving away from pivot because of it being non open-source. We'll be using supset instead, which will allow... [17:25:28] 10Analytics-Kanban: Unique Devices on Pivot, initial screen should not add values by default, is this configurable? - https://phabricator.wikimedia.org/T164194#3688193 (10JAllemandou) 05Open>03declined [17:26:48] ping fdans milimetric filed : https://phabricator.wikimedia.org/T178317 [17:27:27] yep, saw that [17:27:34] Good catch nuria_ --^ [17:27:36] !! [17:27:50] joal: ahem it was faidon [17:27:54] :) [17:28:00] arh [17:28:34] ottomata, should I restart EventLogging? [17:30:28] mforns: start? [17:30:37] mforns: for blacklist? [17:30:46] ya [17:30:48] nuria_, yes [17:30:54] will do [17:31:02] Gone for diner a-team, back after [17:32:16] !log restarted EventLogging for changes in blacklist to take effect [17:32:18] Logged the message at https://www.mediawiki.org/wiki/Analytics/Server_Admin_Log [18:20:24] mforns: question if you may [18:25:24] 10Analytics-EventLogging, 10Analytics-Kanban, 10Patch-For-Review, 10Readers-Web-Backlog (Tracking): Schema:Popups suddenly stopped logging events in MariaDB, but they are still being sent according to Grafana - https://phabricator.wikimedia.org/T174815#3688367 (10Nuria) Ping @Tbayer , does my explanation m... [19:03:46] nuria_, yes? [19:04:23] mforns: on the drop partitions script , was not there before the python trick to log to stdout only errors? [19:04:29] mforns: am i dreaming that? [19:05:36] nuria_, the mediawiki snapshot cleaner had the logging split implemented since the start, but it failed for other reasons. But the banner activity cleaner script did NOT have the logging split [19:05:54] mforns: OK [19:06:43] nuria_, we could also change the puppet cron job to not alert on banner activity cleaner? but I thought that it would be nicer to have alerts and changed that in the script [19:07:16] https://gerrit.wikimedia.org/r/#/c/384530/ [19:09:28] 10Analytics-EventLogging, 10Analytics-Kanban, 10Patch-For-Review, 10Readers-Web-Backlog (Tracking): Schema:Popups suddenly stopped logging events in MariaDB, but they are still being sent according to Grafana - https://phabricator.wikimedia.org/T174815#3688560 (10Tbayer) >>! In T174815#3688367, @Nuria wrot... [19:11:39] mforns: If I dont mistake, banner_activity cleaner send email, no? [19:13:26] joal, yes, banner activity cleaner sent an email, because the cron job was configured to do so. But it sent the email when there was no error. The banner script was outputing INFO logs to stderr, and made cron (or whoever it is that sends alert emails) think there was an error! [19:13:44] That's my opinion as well :) [19:13:47] Thanks mforns :) [19:14:17] in the above patch, I changed the logging of the script to split INFO+DEBUG+WARN logs to stdout and only ERROR to stderr [19:14:57] hm mforns - cron sends e,ail only on stderr - I never quite remember [19:17:21] joal, ok cool, so the patch should avoid further false alarms theoretically [19:17:48] mforns: Ah, forgot question mark: cron sends email on ly in stderr? [19:24:14] joal, yes, I think so, if stderr is different from empty, it send an alert email, AFAIK that is the condition [19:24:42] ok [19:24:46] (and includes the stderr text) [19:25:58] mforns: Just double checked: ron sends any output or error to email [19:26:06] So, not only stderr, but also stdout [19:26:47] joal, I see, but if stdout is redirected to a file, then the effect is the desired one no? [19:26:56] Correct ! [19:27:29] ok ok [19:29:02] mforns: I double checked because I never remember if it's only stderr or both that get sent [19:29:21] joal, aha, where did you see that? [19:29:49] is that cron's default? or is it wmf-puppet specific? [19:29:54] mforns: multiple checks across google results [19:30:00] ah ok ok [19:31:09] thanks for looking into this, now I have it a lot clearer :] [19:32:26] mforns: so do I:) [19:51:45] (03PS1) 10Joal: [WIP] Upgrade restbase-modules to latest [analytics/aqs] - 10https://gerrit.wikimedia.org/r/384590 (https://phabricator.wikimedia.org/T178312) [19:52:14] milimetric: --^ This patch works in term of code validity, I'll continue modify for linting tomorrow [19:52:55] * milimetric looks [19:53:09] Gone for tonight a-team :) [19:53:16] byeeeee joal [19:53:23] nite [19:57:46] laters [23:06:35] If I wanted to get access to the analytics cluster to build a database compiled based on database dumps, how would I apply? I have a volunteer-NDA by dint of being on the Toolforge Standards Committee.