[00:00:57] <bearloga>	 (repo, IDEA, plugins are all up-to-date)
[01:35:29] <wikibugs>	 10Analytics, 10Analytics-EventLogging, 10Performance-Team, 10Regression: Beta Cluster: Unable to obtain lock via objectcache (memcached) - https://phabricator.wikimedia.org/T198280#4320871 (10Krinkle)
[01:35:53] <wikibugs>	 10Analytics, 10Analytics-EventLogging, 10Performance-Team, 10Regression: Beta Cluster: Unable to obtain lock via objectcache (memcached add() fails) - https://phabricator.wikimedia.org/T198280#4318032 (10Krinkle)
[01:49:50] <Krinkle>	 Hi - as part of T195314, I've been looking at various services in Beta Cluster to verify they are working well to support the navtiming pipeline. It seems that the kafka-jumbo brokers are currently not working. Both via python/rdkafka and with kafkacat, both jumbo-1 and -2 are refusing connections. 
[01:49:51] <stashbot>	 T195314: Set up webperf node in Beta Cluster - https://phabricator.wikimedia.org/T195314
[01:50:19] <Krinkle>	 The syslog of deployment-kafka-jumbo-2 says "Connection to node -2/-1 could not be established. Broker may not be available"
[01:50:49] <Krinkle>	 Looking at https://tools.wmflabs.org/nagf/?project=deployment-prep#h_deployment-kafka-jumbo-1_disk-bytes
[01:50:53] <Krinkle>	 It seems disk space is 0
[02:37:20] <bearloga>	 Krinkle: are you by any chance referring to deployment-eventlog05.eqiad.wmflabs? if so that explains why I wasn't seeing any events in any of the eventlogging logs (locations at https://wikitech.wikimedia.org/wiki/Analytics/Systems/EventLogging/TestingOnBetaCluster#How_to_verify_events) I thought maybe something was wrong on my end and events weren't getting sent
[02:38:18] <Krinkle>	 bearloga: I don't know of anything wrong with eventlog05, however as I understand it EventLogging both consumes and produces  with Kafka (consumers from the raw varnishkafka topic, produces to the eventlogging_<schema> topics).
[02:38:33] <Krinkle>	 So with the kafka-browser host down/broken, I would imagine eventlog05 doing nothing.
[02:38:45] <Krinkle>	 I'm experiencing the same with webperf11 (processes navtiming beacons)
[02:38:50] <bearloga>	 nuria_ elukey: ^
[04:01:36] <nuria_>	 Krinkle: yeah, this is a known issue with beta cluster, machines are small and disk fills in, they normally need a reboot a  removal of data
[04:22:41] <nuria_>	 *and removal of data
[04:36:59] <fdans>	 helloooo a-team, starting super early today to leave in the afternoon for Madrid
[04:48:01] <nuria_>	  wow fdans OVERLAP!
[04:48:23] <fdans>	 nuria_: hell yeaaa HELLO FROM TOMORROW
[04:48:25] <nuria_>	 Krinkle: i am not on kafka labs project , will wait for EU team to reboot
[04:48:37] <nuria_>	 Krinkle: and will get permits so i ca help next time
[04:48:54] <nuria_>	 fdans: jajaja
[05:08:56] <wikibugs>	 (03CR) 10Nuria: [C: 032] Add oozie jobs loading druid daily uniques monthly (031 comment) [analytics/refinery] - 10https://gerrit.wikimedia.org/r/436826 (https://phabricator.wikimedia.org/T197885) (owner: 10Joal)
[05:34:59] <elukey>	 morning!
[06:10:11] <elukey>	 !log move /srv/kafka to a dedicated 60G partition on deployment-jumbo hosts in deployment-prep
[06:10:12] <stashbot>	 Logged the message at https://www.mediawiki.org/wiki/Analytics/Server_Admin_Log
[06:13:36] <elukey>	 ok so kafka in deployment prep + eventlogging should be fine now
[06:42:15] <elukey>	 in theory we have retention policies for kafka logs that should avoid filling up the disk
[06:43:02] <elukey>	 but up to this morning we were running 20G partitions for kafka, that may be too short to see deletion kicking it
[06:43:05] <elukey>	 *in
[06:44:30] <elukey>	 maximum size for a log is log.segment.bytes=134217728 (~134M)
[06:44:55] <elukey>	 log.retention.hours=168 -> (1w)
[06:45:16] <elukey>	 and also
[06:45:17] <elukey>	 # A size-based retention policy for logs. Segments are pruned from the log as long as the remaining
[06:45:20] <elukey>	 # segments don't drop below log.retention.bytes. Functions independently of log.retention.hours.
[06:45:23] <elukey>	 log.retention.bytes=134217728
[06:48:49] <elukey>	 so let's drop the retention to say 3 days
[06:48:53] <elukey>	 in labs it should be fine
[06:49:22] <elukey>	 even if I'd wait a bit during the next days to see if with 60G the cleanup policies stabilize
[06:49:47] <elukey>	 I'll send an email to Krinkle/bearloga/nuria --^
[06:54:01] <joal>	 Hi folks :)
[06:58:42] <wikibugs>	 (03CR) 10Joal: Add oozie jobs loading druid daily uniques monthly (031 comment) [analytics/refinery] - 10https://gerrit.wikimedia.org/r/436826 (https://phabricator.wikimedia.org/T197885) (owner: 10Joal)
[07:02:43] <elukey>	 hello joal :)
[07:03:16] <joal>	 elukey: I'm preparing a small puppet patch for Sqoop commands-change, then we could do a cluster deploy?
[07:03:22] <elukey>	 +1
[07:03:54] <elukey>	 joal: I was wondering if it was worth to take a course in Spark, do you happen to know any experts in the field that can help? :P
[07:04:24] <joal>	 elukey: I don't - But I may have some hints here and there if you want
[07:04:57] <elukey>	 you don't? I am reading a link and I am pretty sure that you know one :)
[07:05:09] <joal>	 elukey: I feel so ashamed of that email nuria_ sent !! I told you lot, just did not advertise :)
[07:05:27] <elukey>	 :D :D :D
[07:05:40] <elukey>	 congrats man, really great to see a colleague invited to a conf :)
[07:05:58] <elukey>	 why ashamed!!! 
[07:06:01] <joal>	 elukey: was very interesting to look at our stack from a different usage perspective
[07:06:18] <joal>	 the part I'm ashamed of is "without telling us" :)
[07:06:38] <elukey>	 ah yes this is definitely true then! :P :P
[07:09:10] <joal>	 :)
[07:11:13] <joal>	 fdans: I'm going to cluster-deploy today - Shall we go and merge the interval thing?
[07:11:29] <fdans>	 joal: yessss
[07:11:32] <joal>	 okey :)
[07:12:01] <joal>	 fdans: anything else?
[07:12:08] <fdans>	 joal: the aqs thing goes first right?
[07:12:14] <joal>	 fdans: It should yes
[07:12:26] <joal>	 fdans: in term of feature release I mean
[07:12:36] <joal>	 fdans: We can deploy loading change but not restart the job
[07:12:52] <fdans>	 ok then don't merge the stuff in refinery yet, I want to triple check the oozie job
[07:13:04] <joal>	 fdans: works for me
[07:13:27] <elukey>	 has anybody checked the last pageview whitelist emails?
[07:13:29] <wikibugs>	 (03CR) 10Fdans: [V: 032 C: 032] Add glue code to turn "ceiled" pageview values into intervals (032 comments) [analytics/aqs] - 10https://gerrit.wikimedia.org/r/440136 (https://phabricator.wikimedia.org/T188928) (owner: 10Fdans)
[07:13:44] <elukey>	 would be great to add new values to the whitelist before deploying in case
[07:13:49] <joal>	 elukey: I have not - I'll do
[07:14:01] <elukey>	 I can do it while you prep the deploy joal 
[07:14:07] <joal>	 ok elukey 
[07:14:18] <fdans>	 sorry elukey I totally overlooked the email at 9pm
[07:14:19] <joal>	 elukey: currently triple checking the list of stuff to deploy :)
[07:15:11] <wikibugs>	 (03CR) 10Joal: [V: 032 C: 032] "Merging for deploy" [analytics/refinery] - 10https://gerrit.wikimedia.org/r/436826 (https://phabricator.wikimedia.org/T197885) (owner: 10Joal)
[07:16:14] <elukey>	 fdans: np! It is a minor thing, I was just checking as well :)
[07:16:46] <elukey>	 project wikimedia 1 2018 6 27 18
[07:17:06] <joal>	 WAT?
[07:17:13] <elukey>	 yeah it is a bit weird
[07:17:26] <elukey>	 it happened two times
[07:17:37] <joal>	 Let's look for those lines
[07:21:34] <elukey>	 "And you can configure Matomo to connect to your database over SSL. "
[07:21:37] <elukey>	 https://matomo.org/changelog/matomo-3-5-0/
[07:21:39] <elukey>	 yesssss
[07:21:44] <elukey>	 this is great
[07:22:06] <fdans>	 joal: should I oozie load a couple months in a test cassandra keyspace in production?
[07:26:43] <joal>	 fdans: That would be great, yes - le's say 2 months for instane?
[07:29:04] <fdans>	 joal: cool, I need you or elukey to create local_group_default_T_top_bycountry_test since I don't have prod cassandra access
[07:29:27] <fdans>	 if you're not dealing with something urgent, that is :)
[07:30:08] <joal>	 fdans: will do, except for the name: will put test at the beginning if you agree :)
[07:30:22] <fdans>	 joal: sounds good to me
[07:31:54] <joal>	 fdans: I create this new keyspace with the same exact settings as local_group_default_T_top_bycountry, right?
[07:32:09] <fdans>	 joal: that's right
[07:32:21] <fdans>	 only the content of the countries json changes
[07:32:27] <joal>	 fdans: done
[07:32:35] <joal>	 test_local_group_default_T_top_bycountry
[07:32:38] <joal>	 fdans: --^
[07:32:43] <joal>	 this is the exact keyspace name
[07:32:50] <fdans>	 thank youuuu so much joal 
[07:33:10] <fdans>	 changing name in job in my home dir
[07:33:12] <joal>	 fdans: When you have exectuted some loading, let me know, we can query cassandra to check
[07:33:23] <fdans>	 gotcha
[07:33:52] <joal>	 fdans: Shall I deploy AQS now (while we prep cluster)?
[07:33:53] <elukey>	 joal: analytics1003 updated
[07:33:58] <joal>	 \o/
[07:34:00] <joal>	 Thanks elukey :)
[07:34:10] <joal>	 elukey: now I REALLY need to deploy the cluster :)
[07:34:42] <fdans>	 joal: that would be awesome, but it's my ops week! you really don't have to :)
[07:35:15] <joal>	 fdans: no worries, deploy day :)
[07:35:30] <fdans>	 all yours then joal 
[07:41:31] <fdans>	 !log testing load of 2 months of per country pageviews with the new ceiled value
[07:41:32] <stashbot>	 Logged the message at https://www.mediawiki.org/wiki/Analytics/Server_Admin_Log
[07:52:30] <wikibugs>	 (03PS1) 10Elukey: Add 'wikimedia' to the pageview whitelist [analytics/refinery] - 10https://gerrit.wikimedia.org/r/442787
[07:52:45] <elukey>	 there --^
[08:01:11] <wikibugs>	 (03CR) 10Joal: [V: 032 C: 032] "Good for me :) Merging" [analytics/refinery] - 10https://gerrit.wikimedia.org/r/442787 (owner: 10Elukey)
[08:08:30] <wikibugs>	 (03CR) 10Sahil505: "@Nuria : Just to confirm naming should be "legacy pageviews" OR "legacy pagecounts"?" (032 comments) [analytics/wikistats2] - 10https://gerrit.wikimedia.org/r/442257 (https://phabricator.wikimedia.org/T189619) (owner: 10Sahil505)
[08:08:51] <fdans>	 joal: feel free to check in cassandra
[08:12:27] <joal>	 fdans: doing
[08:13:28] <joal>	 fdans: looks like you loaded interval values, not ceiled ones
[08:14:16] <joal>	 also fdans - I have just re-checked the test for AQS before deploying, andf they dail :(
[08:14:22] * joal doesn't underdstand
[08:14:33] <fdans>	 ayyy
[08:14:55] <fdans>	 joal: is there any particular historical reason why we don't have CI in aqs?
[08:15:09] <joal>	 fdans: I don't know
[08:15:16] <joal>	 I don't think so
[08:16:52] <fdans>	 joal: all right, will correct all
[08:18:58] <joal>	 fdans: I get it now - it's because you mix result-types in your test
[08:19:53] <joal>	 fdans: You should have 2 tests, one for nuerical values, one for string ones, since we only check the type of the 1st value before either converting or returning as is
[08:24:14] <fdans>	 joal:  I'm more confused by the cassandra loading
[08:24:25] <joal>	 :(
[08:25:10] <fdans>	 both queries in hdfs and local have the up to date query, I've no idea why it's storing intervals...
[08:26:21] <fdans>	 any idea on where would oozie be pulling that hql from?
[08:26:30] <fdans>	 joal: ^^ sorry
[08:26:40] <joal>	 fdans: Have you updated oozie_directory in your oozie job launch?
[08:27:59] <joal>	 fdans: Can't find your oozie coord in hue - Do you have an ID?
[08:28:29] <fdans>	 joal: 0065484-180510140726946-oozie-oozi-C
[08:28:30] <joal>	 ok found it
[08:28:46] <joal>	 fdans: Inded, you have not updated the path for oozie to load the new code
[08:29:14] <joal>	 fdans: See in coordinator.properties - We use ${oozie_directory} to reference files path
[08:29:37] <fdans>	 joal: that's the hdfs oozie directory right?
[08:29:46] <joal>	 fdans: When you test, you want to override oozie_directory} to your HDFS instanciation of oozie folder
[08:30:00] <fdans>	 oook
[08:30:25] <joal>	 -Doozie_directory=hdfs:analytics-hadoop/user/fdans/oozie...
[08:32:53] <wikibugs>	 10Analytics, 10Analytics-EventLogging, 10Performance-Team, 10Regression: Beta Cluster: Unable to obtain lock via objectcache (memcached add() fails) - https://phabricator.wikimedia.org/T198280#4321094 (10aaron) I get:  ```  > $s = new RemoteSchema('NavigationTiming', 18156125);  > var_dump( $s->cache->lock...
[08:33:34] <fdans>	 k, resending, will correct tests now
[08:44:18] <wikibugs>	 10Analytics, 10Analytics-Kanban, 10User-Elukey: Update piwik to latest stable - https://phabricator.wikimedia.org/T192298#4321105 (10elukey) The last version of Matomo (the new Piwik name) contains a super interesting feature, namely use TLS for connections to the database. This is not important now that we...
[08:44:35] <wikibugs>	 (03PS1) 10Fdans: Correct per country tests [analytics/aqs] - 10https://gerrit.wikimedia.org/r/442796 (https://phabricator.wikimedia.org/T188928)
[08:45:20] <wikibugs>	 (03PS2) 10Fdans: Correct per country tests [analytics/aqs] - 10https://gerrit.wikimedia.org/r/442796 (https://phabricator.wikimedia.org/T188928)
[08:53:30] <elukey>	 fdans: do we have the piwik tracking js code somewhere handy?
[08:53:42] <elukey>	 I want to check if anything changes from piwik and matomo
[08:53:55] <elukey>	 like for wikistats2 etc..
[08:54:25] <fdans>	 elukey: looking
[08:54:35] <fdans>	 joal: the data should be loaded now in cassandra :)
[08:54:44] <joal>	 fdans: checking fdans 
[08:55:09] * joal checks fdans for fdans  ... Autoreference for the win
[08:55:23] <fdans>	 https://www.irccloud.com/pastebin/uaLoyBS6/
[08:55:26] <fdans>	 elukey: ^
[08:56:16] <joal>	 fdans: Have you loaded the same previous month and all, or have you changed?
[08:56:31] <fdans>	 joal: same
[08:56:46] <joal>	 fdans: new data is there with views, however old data is here as well - Not goog
[08:57:02] <elukey>	 fdans: <3
[08:57:19] <fdans>	 joal: wait
[08:57:31] <fdans>	 i didn't load may this time
[08:57:42] <fdans>	 joal: that's why you may see both
[08:57:43] <wikibugs>	 10Analytics, 10Analytics-Kanban, 10User-Elukey: Update piwik to latest stable - https://phabricator.wikimedia.org/T192298#4321127 (10elukey) Just to be super sure, triple checked that the matomo's tracking JS code didn't change:  ``` <!-- Matomo --> <script type="text/javascript">   var _paq = _paq || [];...
[08:59:52] <joal>	 fdans: This seems good :)
[09:00:06] * fdans danses
[09:01:09] <joal>	 :)
[09:01:28] <wikibugs>	 (03CR) 10Joal: [V: 032 C: 032] "Merging for deploy" [analytics/aqs] - 10https://gerrit.wikimedia.org/r/442796 (https://phabricator.wikimedia.org/T188928) (owner: 10Fdans)
[09:01:57] <joal>	 Thanks fdans for the patches and test :)
[09:02:23] <joal>	 elukey: deploying AQS?
[09:02:28] <fdans>	 joal:  I have to go out for about an hour to the courthouse to get marriage papers, shall we start backfilling once aqs is deployed?
[09:02:40] <fdans>	 thank you for your infinite patience joal :)
[09:02:48] <elukey>	 joal: sure
[09:02:52] <joal>	 fdans: I'll deploy stuff now, we'll start backfilling and all when you're back :)
[09:02:57] <joal>	 Thanks elukey
[09:03:20] <joal>	 !log deploying AQS pageviews-bycountry ceiled value glue code
[09:03:22] <stashbot>	 Logged the message at https://www.mediawiki.org/wiki/Analytics/Server_Admin_Log
[09:11:28] <wikibugs>	 (03PS1) 10Joal: Update aqs to e4d6610 [analytics/aqs/deploy] - 10https://gerrit.wikimedia.org/r/442804
[09:14:36] <elukey>	 joal: did you see https://gerrit.wikimedia.org/r/#/c/analytics/aqs/deploy/+/441237/ by any chance in your local repo?
[09:15:11] <elukey>	 nothing super important but I don't see it among the changes
[09:16:41] <joal>	 elukey: I have it in my aqs-deploy repo
[09:16:47] <joal>	 elukey: will check
[09:17:58] <joal>	 elukey: I think it's normal - The patch is on aqs/deploy forlder, has been merged already, so it;s actually there
[09:18:48] <joal>	 elukey: makes sense:
[09:18:49] <joal>	 ?
[09:19:18] <elukey>	 yep sounds fine, just wanted to double check
[09:20:23] <joal>	 ok
[09:20:29] <joal>	 elukey: ok for me to move forward then?>
[09:23:10] <wikibugs>	 (03CR) 10Joal: [V: 032 C: 032] "Merging for deploy." [analytics/refinery] - 10https://gerrit.wikimedia.org/r/440145 (https://phabricator.wikimedia.org/T188928) (owner: 10Fdans)
[09:23:20] <joal>	 elukey: I thake your silence as a yes :)
[09:23:40] <wikibugs>	 (03CR) 10Joal: [V: 032 C: 032] "Merging for deploy." [analytics/aqs/deploy] - 10https://gerrit.wikimedia.org/r/442804 (owner: 10Joal)
[09:25:23] <elukey>	 joal: yes please! I was checking a patch :)
[09:27:26] <joal>	 elukey: I confirm your patch is in the deploy
[09:28:05] <wikibugs>	 10Analytics, 10Beta-Cluster-Infrastructure, 10User-Elukey: Disk usage on deployment-kafa-jumbo-* causing alerts - https://phabricator.wikimedia.org/T198262#4321228 (10elukey)
[09:29:05] <joal>	 elukey: failed deploy - Forgot about auto-test :(
[09:29:52] <wikibugs>	 10Analytics, 10Beta-Cluster-Infrastructure, 10User-Elukey: Disk usage on deployment-kafa-jumbo-* causing alerts - https://phabricator.wikimedia.org/T198262#4317436 (10elukey) This happens periodically and affects people testing on deployment-eventlog05 (that pulls from jumbo hosts). I just moved /srv/kafka t...
[09:32:54] <elukey>	 joal: what did fail?
[09:33:19] <joal>	 elukey: the check for endpoints being up - due to new data process
[09:33:30] <joal>	 elukey: currently updating the code
[09:36:39] <elukey>	 ahh okok
[09:37:46] <wikibugs>	 (03PS1) 10Joal: Correct pageviews-per-country enpoint [analytics/aqs] - 10https://gerrit.wikimedia.org/r/442810
[09:37:49] <joal>	 elukey: --^
[09:37:53] <joal>	 if you have aminute
[09:38:05] <wikibugs>	 10Analytics, 10Analytics-Kanban, 10User-Elukey: Move piwik's database to db1108 (eventlogging slave) - https://phabricator.wikimedia.org/T198217#4321253 (10elukey) I would definitely like to work on making the multi instance puppet code available for Analytics, so if this solution would be a compromise I can...
[09:39:10] <elukey>	 joal: looks good!
[09:39:57] <wikibugs>	 (03CR) 10Joal: [V: 032 C: 032] "Self merging for deploy" [analytics/aqs] - 10https://gerrit.wikimedia.org/r/442810 (owner: 10Joal)
[09:43:22] <wikibugs>	 (03PS1) 10Joal: Update aqs to e2fa77a [analytics/aqs/deploy] - 10https://gerrit.wikimedia.org/r/442812
[09:44:23] <wikibugs>	 (03CR) 10Joal: [V: 032 C: 032] "Self-deploy for merging" [analytics/aqs/deploy] - 10https://gerrit.wikimedia.org/r/442812 (owner: 10Joal)
[09:46:26] <joal>	 success elukey :)
[09:47:32] <elukey>	 \o/
[09:47:43] <joal>	 ok - now moving to cluster :)
[09:52:10] * fdans back
[09:52:51] <joal>	 Hi fdans - Needed to add a little trik for the deploy to work - We forgot of endpoint auto-tests :S
[09:53:57] <fdans>	 joal: ohhh the ones that take data from the endpoint spec
[09:54:02] <joal>	 correct
[09:54:16] <mforns>	 hey teaaam
[09:54:36] <wikibugs>	 (03CR) 10Addshore: [C: 04-1] "Other than the 1 comment this looks good to go" (031 comment) [analytics/wmde/scripts] - 10https://gerrit.wikimedia.org/r/441838 (https://phabricator.wikimedia.org/T196868) (owner: 10Jonas Kress (WMDE))
[09:55:12] <joal>	 Hi mforns 
[09:55:18] <mforns>	 :]
[09:57:14] <joal>	 mforns: Shall I deploy refinery-source for the whitelist patch, or can it wait for a bigger deploy round?
[09:59:02] <mforns>	 joal, that would be nice :], although it isn't merged yet
[09:59:08] <mforns>	 oh!
[09:59:20] <mforns>	 joal, I misunderstood
[10:00:05] <mforns>	 joal, all refinery-source changes concerning EventLoggingSanitization are deployed as far as I'm concerned
[10:00:21] <joal>	 mforns: "Add inline comments to WhitelistSanitization" ?
[10:00:24] <mforns>	 too much concernments :P
[10:00:33] <joal>	 :)
[10:00:34] <mforns>	 joal, oh, that's only comments
[10:00:49] <mforns>	 can wait no problem at all
[10:00:54] <joal>	 Ok cool :)
[10:00:58] <joal>	 Thanks for confirmation mforns :)
[10:01:00] <mforns>	 are you going to deploy refinery?
[10:01:04] <joal>	 yessir
[10:01:19] <joal>	 mforns: Shall I wait for something from you?
[10:01:32] <mforns>	 mmm, can you do me a favor then, and quickly review: https://gerrit.wikimedia.org/r/#/c/analytics/refinery/+/442125/
[10:01:43] <mforns>	 the contents of the whitelist are already super checked
[10:01:49] <mforns>	 it's more about the path
[10:01:56] <mforns>	 location
[10:02:06] <mforns>	 and file name
[10:02:23] <joal>	 mforns: path and filename makes sense for me :)
[10:02:25] <mforns>	 if you could deploy this it would be great
[10:02:30] <mforns>	 ok
[10:02:44] <joal>	 mforns: that file is sooooooo long !!! (i should have put more 'o's
[10:02:54] <joal>	 mforns: Yessir - Doing now :)
[10:03:10] <mforns>	 joal, yea... and it will become longer... I was thinking about this the other day...
[10:03:17] <joal>	 :(
[10:03:38] <joal>	 mforns: is there any kind of external referencement/inclusion with yaml?
[10:04:01] <mforns>	 joal, not sure
[10:04:03] <mforns>	 looking
[10:04:51] <joal>	 also mforns, triple checking before merging: this file is about eventlogging only, not other event types we are refining, right?
[10:04:54] <mforns>	 joal, yaml does not provide that, but we could have an internal convention
[10:05:03] <mforns>	 yes, EL only
[10:05:09] <joal>	 mforns: sounds god
[10:05:16] <joal>	 ALELUIAH
[10:05:17] <joal>	 :)
[10:05:18] <mforns>	 xD
[10:05:21] <mforns>	 hahahaha
[10:05:45] <joal>	 ok - merging :)
[10:05:54] <mforns>	 I'm glad my whitelist sounds like God!
[10:06:13] <joal>	 I think we can wait and discuss a nice solution for the big file issue
[10:06:35] <joal>	 mforns: looking at it showed me infinity ;)
[10:07:01] <wikibugs>	 (03CR) 10Joal: [V: 032 C: 032] "Merging before deploy" [analytics/refinery] - 10https://gerrit.wikimedia.org/r/442125 (https://phabricator.wikimedia.org/T193176) (owner: 10Mforns)
[10:07:47] <joal>	 ok folks, nothing more to deploy?
[10:07:56] <mforns>	 thaaaanks joal :]
[10:08:48] <joal>	 deploy - 1 time
[10:09:13] <joal>	 deploy - 2 times - 3 times - too slow :D
[10:09:59] <joal>	 !log Deploying refinery using scap
[10:10:00] <stashbot>	 Logged the message at https://www.mediawiki.org/wiki/Analytics/Server_Admin_Log
[10:20:08] <joal>	 !log Deploying refinery to HDFS
[10:20:09] <stashbot>	 Logged the message at https://www.mediawiki.org/wiki/Analytics/Server_Admin_Log
[10:26:49] <elukey>	 joal: I am going afk in ~10m, good from the deployment side?
[10:26:56] <joal>	 so far so good :)
[10:26:59] <joal>	 thanks elukey :)
[10:27:01] <elukey>	 super
[10:27:20] <joal>	 elukey: I'm going to apply deployed patches now, and then will take a break
[10:27:32] <elukey>	 +1
[10:27:36] <elukey>	 aqs looks good
[10:33:08] <elukey>	 after lunch I'll upgrade piwik again to matomo's last version
[10:36:59] <elukey>	 I am also prepping to reimage the aqs nodes joal 
[10:37:13] <joal>	 ack elukey u
[10:37:15] <elukey>	 there are a couple of things to check in case something doesn't work as expected (like drain nodes etc..)
[10:37:21] <elukey>	 but I think that we are almost ready
[10:37:36] <elukey>	 what do you think about monday?
[10:37:42] <elukey>	 (for the first node)
[10:38:43] <elukey>	 all right going afk for lunch + errand, see you laterzz
[10:50:10] <joal>	 fdans: I think we're good to start backfilling when you want :)
[10:50:30] <fdans>	 joal: I'm ready when you are :)
[10:50:33] <joal>	 :)
[10:50:45] <joal>	 Then I'm waiting for me to be ready ... L'ets go :)
[10:50:53] <fdans>	 joal: bc?
[10:50:55] <joal>	 sure
[10:51:00] <fdans>	 I think I know all the steps
[10:51:31] <addshore>	 joal: tiny question @ https://phabricator.wikimedia.org/T193641#4321435 if you have time
[10:51:42] <addshore>	 the QU is, where can one find the ID of the latest snapshot for the mediawiki history table ?
[10:54:04] <joal>	 addshore: By convention, it's YYYY-MM, but there is no automated place to get it except asking hive for partitions (or look in folder availability)
[10:54:13] <addshore>	 ack
[10:54:25] <addshore>	 so generally can one assume that each month there will be a new one?
[10:54:34] <joal>	 addshore: That's what we do yes
[10:54:36] <addshore>	 thanks!
[10:54:54] <joal>	 But it arrives in thew middle of the month addshore, about the 10th
[10:57:06] <addshore>	 joal: thanks
[10:57:11] <joal>	 np addshore 
[10:57:18] <addshore>	 and remind me again how to snapshot links to the data that is in the tables?
[10:57:36] <addshore>	 2018-02 will only have data up to january? or ?
[10:59:57] <addshore>	 and potentially half of feb
[11:00:44] <addshore>	 at least that is how i read the docs on wikitech
[11:01:25] <wikibugs>	 (03PS7) 10Jonas Kress (WMDE): Track new API reported maxlag for wikidata on grafana dashboard [analytics/wmde/scripts] - 10https://gerrit.wikimedia.org/r/441838 (https://phabricator.wikimedia.org/T196868)
[11:01:34] <wikibugs>	 (03CR) 10jerkins-bot: [V: 04-1] Track new API reported maxlag for wikidata on grafana dashboard [analytics/wmde/scripts] - 10https://gerrit.wikimedia.org/r/441838 (https://phabricator.wikimedia.org/T196868) (owner: 10Jonas Kress (WMDE))
[11:02:01] <wikibugs>	 (03CR) 10Jonas Kress (WMDE): "recheck" [analytics/wmde/scripts] - 10https://gerrit.wikimedia.org/r/441838 (https://phabricator.wikimedia.org/T196868) (owner: 10Jonas Kress (WMDE))
[11:02:13] <wikibugs>	 (03CR) 10Addshore: "recheck" [analytics/wmde/scripts] - 10https://gerrit.wikimedia.org/r/441838 (https://phabricator.wikimedia.org/T196868) (owner: 10Jonas Kress (WMDE))
[11:02:20] <wikibugs>	 (03CR) 10Addshore: [C: 032] Track new API reported maxlag for wikidata on grafana dashboard [analytics/wmde/scripts] - 10https://gerrit.wikimedia.org/r/441838 (https://phabricator.wikimedia.org/T196868) (owner: 10Jonas Kress (WMDE))
[11:02:28] <wikibugs>	 (03PS1) 10Addshore: Track new API reported maxlag for wikidata on grafana dashboard [analytics/wmde/scripts] - 10https://gerrit.wikimedia.org/r/442827 (https://phabricator.wikimedia.org/T196868)
[11:02:30] <wikibugs>	 (03Merged) 10jenkins-bot: Track new API reported maxlag for wikidata on grafana dashboard [analytics/wmde/scripts] - 10https://gerrit.wikimedia.org/r/441838 (https://phabricator.wikimedia.org/T196868) (owner: 10Jonas Kress (WMDE))
[11:02:32] <wikibugs>	 (03CR) 10Addshore: [C: 032] Track new API reported maxlag for wikidata on grafana dashboard [analytics/wmde/scripts] - 10https://gerrit.wikimedia.org/r/442827 (https://phabricator.wikimedia.org/T196868) (owner: 10Addshore)
[11:02:41] <wikibugs>	 (03Merged) 10jenkins-bot: Track new API reported maxlag for wikidata on grafana dashboard [analytics/wmde/scripts] - 10https://gerrit.wikimedia.org/r/442827 (https://phabricator.wikimedia.org/T196868) (owner: 10Addshore)
[11:03:50] <joal>	 addshore: 2018-02 contains data for feb, with some states up to midlle march
[11:04:03] <addshore>	 okay!
[11:04:34] <addshore>	 hmm, I wonder if I could word that wikipage better
[11:04:39] <addshore>	 or just provide that example there
[11:05:35] <addshore>	 where rev_timestamp <= <<snapshot-date>> makes it sound unclear, as if the 2018-02 snapshot is created on the 10th feb? or is the 2018-01 created on the 10th feb?
[11:06:05] <addshore>	 Jonas_WMDE: ^^ :)
[11:06:33] <joal>	 addshore: 2018-02 snapshot is created in march, and contains data for feb
[11:06:39] <addshore>	 gotcha!
[11:07:13] <joal>	 addshore: We use the same semantic in every dataset (or at least I think we do) - For isntance pagevew_hourly hour 10 contains hour 10
[11:07:43] <joal>	 Also addshore, never use multiple snapshots - The are all full :)
[11:08:23] <addshore>	 yup yup :)
[11:08:40] <addshore>	 We are looking at 'productionizing' that wikidata editors query from a few weeks back
[11:08:52] <joal>	 right addshore 
[11:09:35] <joal>	 addshore: since you'll be in oozie, You an take advantage of datasets dependencies to make your job start when new data is available
[11:09:54] <addshore>	 Jonas_WMDE: ^^ (Jonas will be taking a stab at it) :)
[11:11:04] <addshore>	 and joal you're right as always, we were thinking we might need some sort of cron, but just waiting for the snapshot and running then would be fine...
[11:11:12] <addshore>	  / better
[11:12:47] <joal>	 addshore: ooie is great for that (even if not really nice on any user-oriented means)
[11:13:07] <joal>	 fdans: Success :)
[11:16:36] <joal>	 fdans: https://wikimedia.org/api/rest_v1/metrics/pageviews/top-by-country/en.wikipedia/all-access/2015/05
[11:19:20] <joal>	 !log Start backfilling job cassandra pageviews-top-countries ceiled-values
[11:19:21] <stashbot>	 Logged the message at https://www.mediawiki.org/wiki/Analytics/Server_Admin_Log
[11:19:48] <joal>	 !log Restart druid uniques daily-monthly-aggregated indexation jobs
[11:19:49] <stashbot>	 Logged the message at https://www.mediawiki.org/wiki/Analytics/Server_Admin_Log
[11:27:16] <fdans>	 joal: awyisssss
[11:27:35] <joal>	 !log Change mediawiki-reduced table format to be parquet and restart mediawiki-reduced oozie job
[11:27:36] <stashbot>	 Logged the message at https://www.mediawiki.org/wiki/Analytics/Server_Admin_Log
[12:05:29] <wikibugs>	 10Analytics, 10Operations, 10ops-eqiad, 10User-Elukey: Degraded RAID on dbstore1002 - https://phabricator.wikimedia.org/T197707 (10Cmjohnson) The disk has been swapped with a 2TB disk.
[12:14:07] <joal>	 Taking a break a-team
[12:14:13] <mforns>	 seyaa
[12:23:00] <wikibugs>	 (03CR) 10Mforns: "> - Time ranges should not have a different meaning for this metric" (031 comment) [analytics/wikistats2] - 10https://gerrit.wikimedia.org/r/442257 (https://phabricator.wikimedia.org/T189619) (owner: 10Sahil505)
[12:24:45] <wikibugs>	 (03CR) 10Mforns: "BTW, sorry Sahil for guiding you towards this endTimestamp idea." [analytics/wikistats2] - 10https://gerrit.wikimedia.org/r/442257 (https://phabricator.wikimedia.org/T189619) (owner: 10Sahil505)
[12:55:48] <elukey>	 as FYI an1032 is shutdown to swap the BBU
[13:07:59] <wikibugs>	 10Analytics, 10Operations, 10ops-eqiad, 10User-Elukey: Degraded RAID on dbstore1002 - https://phabricator.wikimedia.org/T197707 (10Marostegui) ``` root@dbstore1002:~# megacli -PDRbld -ShowProg -PhysDrv [32:5] -aALL  Rebuild Progress on Device at Enclosure 32, Slot 5 Completed 1% in 63 Minutes. ```
[13:08:31] <wikibugs>	 10Analytics, 10Operations, 10ops-eqiad, 10User-Elukey: Degraded RAID on dbstore1002 - https://phabricator.wikimedia.org/T197707 (10elukey) Thanks @Marostegui !
[13:23:58] <elukey>	 ottomata: o/
[13:24:11] <wikibugs>	 10Analytics-Cluster, 10Analytics-Kanban, 10Operations, 10Traffic, and 2 others: TLS security review of the Kafka stack - https://phabricator.wikimedia.org/T182993 (10Ottomata) Woo hoo!  Annnnd soon we disable IPSec?! :D
[13:24:25] <elukey>	 I asked to Valentin if it was possible to roll out the vk TLS changes in misc first, then upload and finally text
[13:24:34] <elukey>	 misc was done this morning, all good, upload is in progress
[13:24:55] <ottomata>	  hiyaa
[13:25:01] <ottomata>	 ok great
[13:25:10] <ottomata>	 i'm just excited to finally have that done :)
[13:26:54] <elukey>	 :)
[13:49:49] <wikibugs>	 10Analytics, 10Analytics-Kanban, 10Patch-For-Review, 10User-Elukey: Upgrade Cassandra on AQS to 2.2.6-wmf5 - https://phabricator.wikimedia.org/T197062 (10elukey)
[14:06:30] <wikibugs>	 10Analytics-Cluster, 10Analytics-Kanban, 10Operations, 10Traffic, and 2 others: TLS security review of the Kafka stack - https://phabricator.wikimedia.org/T182993 (10Vgutierrez) >>! In T182993#4321845, @Ottomata wrote: > Woo hoo! >  > Annnnd soon we disable IPSec?! :D  As soon as we rollout this on cache::...
[14:14:30] <elukey>	 I was about to upgrade piwik but then.. I found again the archiver running
[14:14:38] <elukey>	 it usualy runs for 8 hours
[14:14:42] <elukey>	 uffffff
[14:22:24] <wikibugs>	 (03PS1) 10Amire80: WIP: Measure articles published using CX2 [analytics/limn-language-data] - 10https://gerrit.wikimedia.org/r/442860 (https://phabricator.wikimedia.org/T196435)
[14:24:06] <wikibugs>	 10Analytics, 10Analytics-Kanban, 10Beta-Cluster-Infrastructure, 10User-Elukey: Disk usage on deployment-kafa-jumbo-* causing alerts - https://phabricator.wikimedia.org/T198262 (10elukey)
[14:26:14] <wikibugs>	 10Analytics, 10Analytics-Kanban, 10Patch-For-Review, 10User-Elukey: Update piwik to latest stable - https://phabricator.wikimedia.org/T192298 (10elukey) Piwik is currently archiving tables, so I am going to postpone the maintenance until it finishes.
[14:39:04] <elukey>	 archiving finished, going to upgrade piwik!
[14:46:47] <elukey>	 !log upgrade piwik 3.2.1 to matomo (new name/package) 3.5.1
[14:46:49] <stashbot>	 Logged the message at https://www.mediawiki.org/wiki/Analytics/Server_Admin_Log
[14:46:56] <elukey>	 aaaaand we have matomo 3.5.1!
[14:46:59] <elukey>	 last upstream :)
[14:47:48] * joal claps for elukey
[14:48:04] <elukey>	 if anybody wants to check piwik.w.o now to see if anything looks weird
[14:48:07] <elukey>	 it would be awesome :)
[14:49:34] <joal>	 elukey: works like a charm for me (looking at wks2 stats)
[14:50:44] <nuria_>	 elukey: checking toosuper thanks
[14:53:36] <elukey>	 nuria_: with the new version we can use TLS to connect to the db, so no more privacy concerns \o/
[14:53:46] <nuria_>	 elukey: nice
[14:53:46] <elukey>	 (if we want to use a db on another host)
[14:54:06] <nuria_>	 elukey: it is also obviously faster
[14:54:16] <nuria_>	 elukey: as in the queries the Ui does
[14:56:52] <elukey>	 nice :)
[14:57:05] <elukey>	 yesterday it took 8hrs for the alters to run
[14:59:44] <elukey>	 just updated https://wikitech.wikimedia.org/wiki/Analytics/Systems/Piwik
[15:00:05] <wikibugs>	 10Analytics, 10Analytics-Kanban, 10Patch-For-Review, 10User-Elukey: Update piwik to latest stable - https://phabricator.wikimedia.org/T192298 (10elukey) Also updated https://wikitech.wikimedia.org/wiki/Analytics/Systems/Piwik with the downtimes
[15:06:00] <nuria_>	 milimetric, mforns : want to talk in batcave about pagecounts changes?
[15:06:21] <mforns>	 nuria_, sure! I just dropped from a meeting with Sahil, that would be great
[15:06:29] <nuria_>	 milimetric: yt?
[15:15:23] <wikibugs>	 (03CR) 10Nuria: [V: 032 C: 032] Partition keys containing ints can be strings [analytics/refinery] - 10https://gerrit.wikimedia.org/r/442369 (owner: 10EBernhardson)
[16:00:10] <elukey>	 I might be a little late to standup (in another meeting sorry)
[16:01:34] <nuria_>	 ping milimetric ottomata joal 
[16:01:43] <nuria_>	 ping ANYBODY
[16:03:00] <ottomata>	 haha
[16:36:24] <nuria_>	 ping ottomata 
[16:39:10] <bearloga>	 morning folks! I was wondering if I could please get some help resolving an issue with working on the Refinery Source in IntelliJ IDEA. nuria_ started helping yesterday (thank you nuria_!) but I had terrible timing because it was end of day. I imported the project like I have previously but there is a single problem: org.wikimedia.analytics.schemas cannot resolve in TestAvroSchemaTimestamps (the only test to have an issue).
[16:39:54] <bearloga>	 I tried adding the directory where TestTimestampSchema is https://usercontent.irccloud-cdn.com/file/VboypP3C/Screen%20Shot%202018-06-27%20at%204.57.51%20PM.png but no go :\
[16:41:58] <bearloga>	 And I'm not sure if that's the correct approach or what. Any recommendations would be greatly appreciated! (Especially since I'll be teaching my co-analysts how to contribute to analytics/refinery/source later today, so having things work in IDEA would be lovely :D)
[16:43:38] <wikibugs>	 10Analytics: Measure traffic for new wikimedia foundation site - https://phabricator.wikimedia.org/T188419 (10Nuria) @Varnent confirming that we can accommodate site. Let us know when you are ready to include the piwik snipet
[16:57:15] <wikibugs>	 10Analytics: Prductionize MediaWiki content processing - https://phabricator.wikimedia.org/T190858 (10Nuria)
[16:57:31] <wikibugs>	 10Analytics: Prductionize MediaWiki content processing - https://phabricator.wikimedia.org/T190858 (10Nuria) * We need for example to know when a new dump becomes available
[16:58:58] <wikibugs>	 10Analytics: Prductionize MediaWiki content processing - https://phabricator.wikimedia.org/T190858 (10Nuria)
[17:00:43] <wikibugs>	 10Analytics: Prototype  in labs new security measures for cluster - https://phabricator.wikimedia.org/T198227 (10Nuria)
[17:29:37] * elukey off!
[17:33:09] <Krinkle>	 elukey: nuria_ : Thanks all. Looks great now :) (RE: kafka in beta)
[17:48:12] <nuria_>	 Krinkle: thanks to elukey cause /me was all operator error
[17:48:29] <Krinkle>	 nuria_: did you get ssh to deployment-prep?
[17:48:47] <nuria_>	 Krinkle: ahem.. i HAD ssh
[17:49:03] <nuria_>	 Krinkle:  my best is not the nitetimes , unlike OTHER people
[17:50:49] <wikibugs>	 10Analytics: Productionize MediaWiki content processing - https://phabricator.wikimedia.org/T190858 (10Nuria)
[17:51:08] <Krinkle>	 Aye, well, I'm already logged-on to nova admin now. And yeah, you're already there. if not, I could add you now :)
[17:51:32] <Krinkle>	 I'll close this tab now, so many channels. Cya later!
[17:59:33] <nuria_>	 bearloga: you need to add test directories as source directories rather than dependencies
[18:07:52] <wikibugs>	 10Analytics: Measure traffic for new wikimedia foundation site - https://phabricator.wikimedia.org/T188419 (10Nuria) We will need to know the url of the new site
[18:20:52] <wikibugs>	 10Analytics: Design Work - Wikistats2 - https://phabricator.wikimedia.org/T198415 (10Nuria)
[18:21:29] <nuria_>	 milimetric, mforns , fdans : created ticket to keep track of issues on wikistats that need design
[18:21:43] <mforns>	 k
[18:25:54] <bearloga>	 nuria_: am I picking the wrong dir or the wrong type? https://usercontent.irccloud-cdn.com/file/pr3bTFm1/idea_no_resolve.png
[18:26:46] <nuria_>	 bearloga: you need to mark you test folder as a source folder too
[18:32:42] <nuria_>	 bearloga: but this error should not prevent you working in any way, right? at least i building on cmd line should work w/o issues
[18:34:59] <bearloga>	 nuria_: right, I can still build from cli. also that seems to have made matters worse https://usercontent.irccloud-cdn.com/file/5GKKcolF/idea_no_resolve-2.png
[18:37:11] <nuria_>	 bearloga: ya, sorry, it is hard to do this on irc, but anyways i recommend cmd line for  building so you know that what you are going to commit actually has all deps  needed
[18:37:49] <bearloga>	 nuria_: would it be okay to schedule a 1:1 with you about this?
[18:38:08] <bearloga>	 I agree it is super difficult to debug over irc
[18:38:21] <bearloga>	 nuria_: thank you anyway! :)
[18:41:24] <wikibugs>	 (03CR) 10Ottomata: [V: 032 C: 032] Partition keys containing ints can be strings [analytics/refinery] - 10https://gerrit.wikimedia.org/r/442369 (owner: 10EBernhardson)
[18:41:28] <nuria_>	 bearloga: let me look at my setup
[18:41:44] <nuria_>	 bearloga: ya, i get the same redlining from intelij on avro schema 
[18:42:11] <nuria_>	 bearloga: yet tests work fine on cmd line (which where they need to run to make sure dep tree is correctly setup)
[18:42:47] <bearloga>	 nuria_: you can see why I was *very* confused yesterday (and still am :P)
[18:43:50] <bearloga>	 this might actually be a bug with intellij idea for all we know
[18:44:54] <nuria_>	 bearloga: no, it is a lack of  aplugin to load avro schemas 
[18:44:59] <bearloga>	 or maybe they just haven't yet added support for how the avro schema
[18:45:18] <nuria_>	 bearloga: sorry i misslead you with test resources, that is the culprit most of the time
[18:45:18] <bearloga>	 ah yeah we're on the same wavelength
[18:46:15] <nuria_>	 bearloga: but such a plugin is not of need unless you do any avro development , if you wish to install it go ahead, i have done avro development in couple years so my version of intelij no longer has it 
[18:52:00] <bearloga>	 nuria_: installing https://plugins.jetbrains.com/plugin/7971-apache-avro-support did fix it!
[18:54:01] <bearloga>	 er, maybe I spoke too soon
[18:55:26] <bearloga>	 yeah nope that didn't do anything after all
[18:56:24] <bearloga>	 nuria_: alright, back to square one :( I'll let you know if I somehow figure out the fix. Please let me know if you do
[18:56:50] <bearloga>	 nuria_: (eventually, as you say cli works so that's all that matters)
[19:48:49] <ottomata>	 bearloga:  it is probably too late for jo al, but he always fixes my intellij problems
[20:04:18] <joal>	 Hi bearloga - What's up with intellij?
[20:16:49] <joal>	 bearloga: From backscrolling, I think your problem might come from generated classes from schemas not being available
[20:17:23] <joal>	 bearloga: those java files are to be generated by avro, and are ignored by git
[20:18:02] <joal>	 bearloga: on my camus subproject, under src folder, I have 3 subfolders: main, test and generated
[20:18:07] <joal>	 I think you're missing generated
[20:50:22] <wikibugs>	 (03CR) 10Milimetric: [C: 04-1] "Reportupdater handles SQL queries better than Hive queries, it has a templating system and the config can make it do great things.  You ca" [analytics/limn-language-data] - 10https://gerrit.wikimedia.org/r/442860 (https://phabricator.wikimedia.org/T196435) (owner: 10Amire80)
[21:06:02] <wikibugs>	 10Analytics: Order Data Lake Hardware - https://phabricator.wikimedia.org/T198424 (10Nuria)
[21:13:05] <wikibugs>	 10Analytics, 10Analytics-Wikistats: Article count metric - https://phabricator.wikimedia.org/T198425 (10Nuria) p:05Triage>03High
[21:13:45] <wikibugs>	 10Analytics, 10Analytics-Wikistats: "Total Article Count" Wikistats  metric (per project and overall) - https://phabricator.wikimedia.org/T198425 (10Nuria)
[21:21:01] <wikibugs>	 10Analytics, 10Analytics-Kanban: Ability to salt and hash in hadoop eventlogging sanitization backend - https://phabricator.wikimedia.org/T198426 (10Nuria)
[21:34:00] <wikibugs>	 10Analytics, 10Analytics-EventLogging, 10Performance-Team, 10Patch-For-Review, 10Regression: Beta Cluster: Unable to obtain lock via objectcache (memcached add() fails) - https://phabricator.wikimedia.org/T198280 (10Krinkle)
[21:34:24] <nuria_>	 milimetric: yt?
[21:34:33] <wikibugs>	 10Analytics, 10Analytics-EventLogging, 10Performance-Team, 10Patch-For-Review, 10Regression: Beta Cluster: Unable to obtain lock via objectcache (memcached add() fails) - https://phabricator.wikimedia.org/T198280 (10Krinkle)
[21:37:10] <nuria_>	 milimetric: ok, let's talk about "label non obvious concepts task" when you are in, from our goal talk I think  we should drop it entirely from Q2
[21:45:45] <wikibugs>	 10Analytics, 10Analytics-EventLogging, 10Page-Previews, 10Readers-Web-Backlog, 10Readers-Web-Kanbanana-Board: Some VirtualPageView are too long and fail EventLogging processing - https://phabricator.wikimedia.org/T196904 (10Jdlrobson)
[21:49:46] <wikibugs>	 10Analytics, 10Analytics-EventLogging, 10Page-Previews, 10Readers-Web-Backlog, 10Readers-Web-Kanbanana-Board: Some VirtualPageView are too long and fail EventLogging processing - https://phabricator.wikimedia.org/T196904 (10Jdlrobson) a:05Jdrewniak>03ABorbaWMF https://gerrit.wikimedia.org/r/442740 ha...
[22:22:46] <milimetric>	 nuria_: I’m ok with dropping it if you think we have enough work.  We can make it a stretch goal if you’re not sure.  But I do think it’s important for Beta, and I think it’s a medium sized project
[22:23:42] <nuria_>	 milimetric: ya, i think is not small and that is why i woudl prefer to tackle it after we have couple new metrics since the anotations/bookmarks and teh many UI improvements we have done have focused on the UI this quarter 
[22:24:37] <milimetric>	 That makes sense nuria_, and we can also do more metrics if we have time
[23:02:39] <wikibugs>	 (03PS1) 10GoranSMilovanovic: EngineGeo rework [analytics/wmde/WDCM] - 10https://gerrit.wikimedia.org/r/443000
[23:02:55] <wikibugs>	 (03CR) 10GoranSMilovanovic: [V: 032 C: 032] EngineGeo rework [analytics/wmde/WDCM] - 10https://gerrit.wikimedia.org/r/443000 (owner: 10GoranSMilovanovic)
[23:03:03] <wikibugs>	 (03Merged) 10jenkins-bot: EngineGeo rework [analytics/wmde/WDCM] - 10https://gerrit.wikimedia.org/r/443000 (owner: 10GoranSMilovanovic)