[08:22:23] <wikibugs>	 10Analytics-Cluster, 10Analytics-Kanban: Install Java 7 in Debian Stretch (to fix sqoop (and possibly other things) on stat1005) - https://phabricator.wikimedia.org/T171072#3459481 (10MoritzMuehlenhoff) We should really avoid a one off openjdk-7 build for stretch, these really need to kept up-to-date with ever...
[09:43:02] <wikibugs>	 10Analytics-Cluster, 10Analytics-Kanban: Install Java 7 in Debian Stretch (to fix sqoop (and possibly other things) on stat1005) - https://phabricator.wikimedia.org/T171072#3459670 (10elukey) >>! In T171072#3459481, @MoritzMuehlenhoff wrote: > My recommendation would to run those components which are tied to o...
[09:56:55] <wikibugs>	 10Analytics, 10EventBus, 10Operations, 10Patch-For-Review, 10User-Elukey: Eventbus does not handle gracefully changes in DNS recursors - https://phabricator.wikimedia.org/T171048#3459727 (10elukey) Opened an issue with upstream: https://github.com/sprockets/sprockets.clients.statsd/issues/7
[10:25:31] <wikibugs>	 10Analytics-Kanban: Piwik improvements - https://phabricator.wikimedia.org/T163000#3459855 (10elukey) 05Open>03Resolved
[10:25:42] <elukey>	 finally tracking task closed --^ \o/
[10:46:31] <wikibugs>	 10Analytics-Tech-community-metrics, 10Developer-Relations: Adjust to Grimoirelab / Bitergia moving to GitLab - https://phabricator.wikimedia.org/T171290#3459901 (10Aklapper)
[10:46:50] * elukey lunch!
[10:49:16] <wikibugs>	 10Analytics-Tech-community-metrics, 10Developer-Relations: Adjust to Grimoirelab / Bitergia moving to GitLab - https://phabricator.wikimedia.org/T171290#3459918 (10Aklapper)
[10:50:16] <wikibugs>	 10Analytics-Tech-community-metrics: "Patchsets Statistics Per Review" widget on "Gerrit" is incomprehensible (due to missing units and misleading custom label) - https://phabricator.wikimedia.org/T151218#3459920 (10Aklapper) So I overwrote `Patchsets-per-review__gerrit_enrich` as described above. But I'd still l...
[10:51:24] <wikibugs>	 10Analytics-Tech-community-metrics, 10Developer-Relations (Jul-Sep 2017): Missing time units for percentile values in "Changesets Statistics (Open Time)" (Time-per-review__gerrit_enrich) widget - https://phabricator.wikimedia.org/T145425#3459924 (10Aklapper)
[10:53:27] <wikibugs>	 10Analytics-Tech-community-metrics, 10Developer-Relations (Jul-Sep 2017): Missing time units for percentile values in "Changesets Statistics (Open Time)" (Time-per-review__gerrit_enrich) widget - https://phabricator.wikimedia.org/T145425#3459927 (10Aklapper) >>! In T145425#3415725, @Dicortazar wrote: > This is...
[10:59:02] <wikibugs>	 10Analytics-Tech-community-metrics, 10Developer-Relations (Jul-Sep 2017): Explain slightly different Git commit numbers for some authors between "git_top_authors" and "Authors" - https://phabricator.wikimedia.org/T160557#3459974 (10Aklapper) a:03Aklapper
[10:59:42] <wikibugs>	 10Analytics-Tech-community-metrics: Clarify differences between similar widgets - https://phabricator.wikimedia.org/T160576#3459979 (10Aklapper)
[10:59:44] <wikibugs>	 10Analytics-Tech-community-metrics, 10Developer-Relations (Jul-Sep 2017): Explain slightly different Git commit numbers for some authors between "git_top_authors" and "Authors" - https://phabricator.wikimedia.org/T160557#3103352 (10Aklapper) 05Open>03Resolved My understanding nowadays is that the diff come...
[11:00:21] <wikibugs>	 10Analytics-Tech-community-metrics, 10Developer-Relations (Jul-Sep 2017): Explain slightly different Git commit numbers between "git_top_authors" and "Authors" (=local commit timestamp vs push/merge in UTC) - https://phabricator.wikimedia.org/T160557#3459980 (10Aklapper)
[12:59:34] <wikibugs>	 10Analytics-Cluster, 10Analytics-Kanban, 10Patch-For-Review: Replacement of stat1002 and stat1003 - https://phabricator.wikimedia.org/T152712#3460247 (10Ottomata)
[12:59:36] <wikibugs>	 10Analytics-Cluster, 10Analytics-Kanban: Install Java 7 in Debian Stretch (to fix sqoop (and possibly other things) on stat1005) - https://phabricator.wikimedia.org/T171072#3460245 (10Ottomata) 05Open>03declined +1.  You know @elukey..DUH stat1004 is Jessie and is a Hadoop client and has Java 7.  We don't...
[13:08:57] <wikibugs>	 10Analytics-Cluster, 10Analytics-Kanban: Install Java 7 in Debian Stretch (to fix sqoop (and possibly other things) on stat1005) - https://phabricator.wikimedia.org/T171072#3460269 (10elukey) Ah right! Even better then! We focused only on the brand new nodes, forgot the old glories :)
[13:53:25] <wikibugs>	 10Analytics-Kanban, 10WMF-Legal, 10Services (watching): License for pageview data - https://phabricator.wikimedia.org/T170602#3460360 (10mforns) @GWicke Thanks for the explanations! @ZhouZ and @GWicke I made a mock of the spec with a couple added phrases (enclosed in red square). Please, let me know if it ma...
[14:10:12] <wikibugs>	 10Analytics-Kanban, 10WMF-Legal, 10Patch-For-Review, 10Services (watching): License for pageview data - https://phabricator.wikimedia.org/T170602#3460440 (10mforns) And the related Gerrit patch ^. Thanks!
[14:20:00] <fdans>	 elukey: https://i.redd.it/7vwgjvcvrwaz.jpg
[14:20:10] <fdans>	 sorry
[14:21:07] <elukey>	 :D
[14:24:01] <harej>	 Hahahahaha
[14:29:28] * elukey feels mistreated by his colleagues
[14:30:16] <mforns>	 hehehehehe
[15:01:27] <nuria_>	 i cannot connect....
[15:05:40] <ottomata>	 hahaha
[15:17:55] <wikibugs>	 10Analytics-Kanban, 10Patch-For-Review: Mediawiki History Druid indexing failed - https://phabricator.wikimedia.org/T170493#3460747 (10Nuria)
[15:33:55] <ottomata>	 elukey:  logster has same problem?
[15:34:08] <elukey>	 yep! :)
[15:34:19] <elukey>	 I am hacking cp4007
[15:41:16] <wikibugs>	 10Analytics-Kanban, 10Patch-For-Review: Mediawiki History Druid indexing failed - https://phabricator.wikimedia.org/T170493#3460825 (10Nuria) Filed issue with druid folks: https://groups.google.com/forum/#!topic/druid-user/NYs3c5hxHnA  Will look at source code od druiid 9.2
[15:42:22] <wikibugs>	 10Analytics-Kanban, 10WMF-Legal, 10Patch-For-Review, 10Services (watching): License for pageview data - https://phabricator.wikimedia.org/T170602#3460830 (10Nuria) Ping @ZhouZ:Can you OK the text?
[15:56:00] <elukey>	 ottomata: https://github.com/etsy/logster/issues/103
[15:56:56] <ottomata>	 aye
[15:56:57] <ottomata>	 nice 
[15:58:52] <elukey>	 ottomata: maybe we could take inspiration from https://gerrit.wikimedia.org/r/#/c/366564/ and add an environment variable called STATSD_HOST_DNS_CACHE=300 or something to force a DNS query every 300 seconds
[16:00:32] <ottomata>	 +1 elukey
[16:21:53] <elukey>	 ottomata: https://issues.apache.org/jira/browse/KAFKA-3532
[16:22:00] * elukey flips the table
[16:24:21] <wikibugs>	 10Analytics, 10User-Elukey: Refactor puppet code for the Hadoop Analytics cluster to roles/profiles - https://phabricator.wikimedia.org/T167790#3460950 (10elukey)
[16:25:02] <wikibugs>	 10Analytics, 10Operations, 10ops-eqiad, 10User-Elukey: SATA errors for stat1004 in the dmesg - https://phabricator.wikimedia.org/T162770#3460952 (10elukey)
[16:27:42] <wikibugs>	 10Analytics-Cluster, 10Analytics-Kanban, 10User-Elukey: Understand Kafka ACLs and figure out what ACLs we want for production topics - https://phabricator.wikimedia.org/T167304#3460973 (10elukey) So judging from https://issues.apache.org/jira/browse/KAFKA-3532 it seems that the following sentence in the docs...
[16:29:27] <ottomata>	 elukey:  you mean: (╯°□°）╯︵ ┻━┻ ?
[16:30:18] <ottomata>	 so elukey the principle is the whole thing?
[16:30:34] <ottomata>	 elukey:  makng some lunch, then let's do kafka 0.11 in labs, ya?
[16:33:58] <elukey>	 ottomata: if you don't want to rush lunch we can sync on monday your morning
[16:34:31] <elukey>	 so yeah I think that the username is the whole thig
[16:34:33] <elukey>	 *thing
[16:34:36] <elukey>	 pretty horrible
[16:38:14] <ottomata>	 elukey:  i think nows a good time
[16:38:38] <ottomata>	 don't have cowork guests today like i thought i would, so i can do batcave too
[16:39:22] <elukey>	 okok, I'll be around for ~1h though
[16:39:32] <elukey>	 (kinda getting late in here :)
[16:39:35] <ottomata>	 ayyyeee ok
[16:39:36] <ottomata>	 :)
[16:39:42] <ottomata>	 what did we want to do?
[16:39:51] <ottomata>	 just go through the steps of installing 0.11 with puppet together?
[16:39:57] <elukey>	 yeppa
[16:40:01] <elukey>	 but please do lunch first
[16:40:04] <elukey>	 :)
[16:40:29] <ottomata>	 oh lunch is made :)
[16:40:30] <ottomata>	 i'm chowin
[16:41:42] <elukey>	 ahahha okok let me know when you are done :)
[16:42:52] <ottomata>	 elukey:  i'm working through it, might leave a little bit early today so its fine, i'm reading over my puppet code to see what to do...
[16:51:34] <ottomata>	 hmm, ok elukey it gets trickey with roles and profiles in labs
[16:52:13] <ottomata>	 kafkatest02 was set up using my new role::kafka::simple::broker and self hosted puppetmaster
[16:52:16] <ottomata>	 with my new patch
[16:52:17] <ottomata>	 but
[16:52:24] <ottomata>	 kafka3-* were all manually configured
[16:52:31] <ottomata>	 i installed confluent kafka 0.10.x
[16:52:37] <ottomata>	 and then manually edited server.properties, etc.
[16:52:42] <ottomata>	 and generated TLS keys
[16:52:52] <ottomata>	 ssl.keystore.location=/home/otto/kafka-certs/kafka3-1/kafka3-1.kst etc.
[16:53:06] <ottomata>	 i think i need to finish up the certpy stuff before i can totally nail down how this is going to be puppetized
[16:53:13] <ottomata>	 but, for the time being for the ACL stuff you are figuring out
[16:53:19] <ottomata>	 i think the kafka3-* stuff will be good enough for you
[16:53:22] <ottomata>	 we can upgrade it to 0.11 if you want
[16:53:27] <ottomata>	 probably just dpkg -i the .deb
[16:55:46] <ottomata>	 kafka version is sorta configurable in profile::kafka::broker
[16:55:47] <ottomata>	 https://gerrit.wikimedia.org/r/#/c/356232/7/modules/profile/manifests/kafka/broker.pp
[16:55:51] <ottomata>	 line 135
[16:55:53] <elukey>	 nah it is probably ok for the moment! How can I generate client certs?
[16:55:59] <ottomata>	 but i thin i plan on removing that 
[16:55:59] <ottomata>	 not sure
[16:56:38] <ottomata>	 elukey:  see in my  homedir on kafka3-1
[16:56:41] <ottomata>	 ca-config.yaml
[16:56:43] <ottomata>	 and ca-manager.py
[16:56:55] <ottomata>	 (these were the adapted cassandra-ca-manager code, not the new certpy stuff)
[16:57:01] <ottomata>	 you can add certs to ca-config.yaml
[16:57:04] <ottomata>	 and then generate like
[16:57:18] <ottomata>	 python ca-manager.py ca-config.yaml
[16:57:25] <ottomata>	 feel free to copy all to your homedir, or whatever
[16:57:42] <elukey>	 ahhh nice
[16:58:22] <ottomata>	 elukey:  also, been thinking more, and I am totally fine with just installing new brokers with raid
[16:58:27] <ottomata>	 and skipping perf test
[16:58:49] <ottomata>	 should I  update the ticket to say to install them that way?
[16:59:29] <elukey>	 will send an email on monday to the ops team and see what they say first, wdyt?
[16:59:40] <ottomata>	 hm, ok
[17:06:38] <elukey>	 ottomata: is it ok then if I leave now? 0.10 is fine for the moment, will test acls on monday with the code in your home dir for certs
[17:06:45] <elukey>	 if I can create them + ACLs I am fine
[17:11:02] <ottomata>	 a elukey
[17:11:02] <ottomata>	 cool
[17:11:03] <ottomata>	 laters!
[17:12:53] <elukey>	 o/
[17:13:01] * elukey off!
[17:33:57] <wikibugs>	 10Analytics: Break down "Other" a little more? - https://phabricator.wikimedia.org/T131127#3461322 (10Nuria) An easier approach to fix this issue per @mforns suggestion.  Let's create two tables one OS based and one browser family based, that way we can use our current anonymization thresholds but the number of...
[19:22:09] <leila>	 halfak: do you remember in which metrics you presented the result of the VE experiment and its impact on retention?
[19:22:33] * halfak thinks
[19:22:49] <leila>	 I want to include a link to that presentation in the response to Kerry as she has made a few comments about VE which are not aligned with what you found in that research
[19:26:24] <halfak>	 Relevant: https://meta.wikimedia.org/wiki/Research:VisualEditor%27s_effect_on_newly_registered_editors/May_2015_study
[19:26:45] <leila>	 this is perfect. thanks halfak
[19:27:34] <halfak>	 https://meta.wikimedia.org/wiki/Wikimedia_Foundation_metrics_and_activities_meetings/2015-08
[19:27:44] <halfak>	 :)  Looks like that one is the right one 
[19:27:49] <halfak>	 leila, ^
[19:27:55] <leila>	 thanks.
[19:29:03] <halfak>	 leila, sorry to spam, but this video is probably more informative: https://www.mediawiki.org/wiki/Wikimedia_Research/Showcase#July_2015
[19:29:13] * halfak stops searching now :D 
[19:29:24] <leila>	 haha. thanks, halfak
[22:14:05] <kaldari>	 Does anyone know why Wikipedia seems to have rediculously high usage rates from IE7?? https://analytics.wikimedia.org/dashboards/browsers/#all-sites-by-browser/browser-family-and-major-hierarchical-view
[22:15:04] <kaldari>	 i.e. 2.5%
[22:15:51] <kaldari>	 If that's true we have just as many people using Wikipedia with IE7 as all versions of Safari
[22:16:06] <kaldari>	 which is absurd
[22:19:53] <kaldari>	 nuria_: ^ Asking because if those stats are right, it will probably be a blocker for https://phabricator.wikimedia.org/T152540 (and may be a blocker for lots of other features).
[22:24:22] <kaldari>	 leila: Here are the relavent conclusions...
[22:24:29] <kaldari>	 "When studying new editors for 60 days after their registration, the visual editor: Had no impact on the editors' productivity or survival"[1]
[22:24:29] <kaldari>	 "In no case does the test show a significant difference between conditions. Given the breadth of measures, this suggests that enabling VE had no effect on productivity or survival in newly registered users' first week of editing."[2]
[22:24:29] <kaldari>	 1. https://meta.wikimedia.org/wiki/Research:VisualEditor%27s_effect_on_newly_registered_editors/November_2015_follow-up
[22:24:29] <kaldari>	 2. https://meta.wikimedia.org/wiki/Research:VisualEditor%27s_effect_on_newly_registered_editors/May_2015_study#Short-term_survival
[22:25:47] <kaldari>	 leila: Also, you know anything about these weird browser stats? ^
[22:29:37] <wikibugs>	 10Analytics-Dashiki, 10Analytics-Kanban, 10MW-1.30-release-notes (WMF-deploy-2017-07-25_(1.30.0-wmf.11)), 10Patch-For-Review, 10Wikimedia-log-errors: Warning: JsonConfig: Invalid $wgJsonConfigModels['JsonConfig.Dashiki'] array value, 'class' not found - https://phabricator.wikimedia.org/T166335#3462150 (1...
[23:35:53] <wikibugs>	 10Analytics-Dashiki, 10Analytics-Kanban, 10MW-1.30-release-notes (WMF-deploy-2017-07-25_(1.30.0-wmf.11)), 10Patch-For-Review, 10Wikimedia-log-errors: Warning: JsonConfig: Invalid $wgJsonConfigModels['JsonConfig.Dashiki'] array value, 'class' not found - https://phabricator.wikimedia.org/T166335#3462309 (1...