[01:02:16] <wikibugs_>	 10Analytics, 06Performance-Team, 06Reading-Web-Backlog: Consider disabling certain extensions on closed wikis - https://phabricator.wikimedia.org/T158721#3045226 (10Krinkle)
[01:02:32] <wikibugs_>	 10Analytics, 06Performance-Team, 06Reading-Web-Backlog, 10Wikimedia-Site-requests: Disable WikimediaEvents extension on closed wikis - https://phabricator.wikimedia.org/T158721#3045238 (10Krinkle)
[03:58:46] <wikibugs_>	 (03PS2) 10Milimetric: Move datasets to analytics.wikimedia.org [analytics/dashiki] - 10https://gerrit.wikimedia.org/r/337642 (https://phabricator.wikimedia.org/T125854)
[04:24:38] <wikibugs_>	 (03PS1) 10Milimetric: Fix style on worldmap [analytics/dashiki] - 10https://gerrit.wikimedia.org/r/339114
[04:25:46] <wikibugs_>	 (03CR) 10Milimetric: "Fran, take a look at this and let's talk about the build and excluding lib/data" [analytics/dashiki] - 10https://gerrit.wikimedia.org/r/339114 (owner: 10Milimetric)
[04:34:01] <wikibugs_>	 (03PS2) 10Milimetric: Fix style on worldmap [analytics/dashiki] - 10https://gerrit.wikimedia.org/r/339114
[08:06:02] <elukey>	 !log restart Hue on an1027 for openssl upgrades
[08:06:03] <stashbot>	 Logged the message at https://www.mediawiki.org/wiki/Analytics/Server_Admin_Log
[08:28:41] <wikibugs_>	 10Analytics, 06Operations: sync bohrium and apt.wikimedia.org piwik versions - https://phabricator.wikimedia.org/T149993#2771280 (10MoritzMuehlenhoff) That's still the case. Since piwik 2.16 is up and running on bohrium already, we could also simply use "dpkg-repack" to generate the deb from the installation o...
[08:31:19] <wikibugs_>	 10Analytics, 06Operations: sync bohrium and apt.wikimedia.org piwik versions - https://phabricator.wikimedia.org/T149993#3045761 (10elukey) We have also opened https://phabricator.wikimedia.org/T158322 to upgrade piwik to a more recent version, should we set up another component like we did for thirdparty/cdh?
[08:35:13] <wikibugs_>	 10Analytics, 06Operations: sync bohrium and apt.wikimedia.org piwik versions - https://phabricator.wikimedia.org/T149993#3045766 (10MoritzMuehlenhoff) Let's wait with adding new components until we have a plan how to move forward with the repository. piwik is a single package, so there's no risk of it overshad...
[09:52:56] <wikibugs_>	 06Analytics-Kanban, 06Operations, 10Traffic, 06Wikipedia-iOS-App-Backlog, and 2 others: Periodic 500s from piwik.wikimedia.org - https://phabricator.wikimedia.org/T154558#3046056 (10elukey) Today I tried to do the following:  * Bump the maximum Apache connections allowed (hence the number of processes due...
[12:58:05] <joal>	 Taking a break a-team, sse you later
[14:02:41] <wikibugs_>	 (03PS2) 10Fdans: Add secondary sys endpoint to populate Cassandra with correct timestamps [analytics/aqs] - 10https://gerrit.wikimedia.org/r/338898 (https://phabricator.wikimedia.org/T156312)
[14:03:25] <wikibugs_>	 (03CR) 10Fdans: Add secondary sys endpoint to populate Cassandra with correct timestamps (034 comments) [analytics/aqs] - 10https://gerrit.wikimedia.org/r/338898 (https://phabricator.wikimedia.org/T156312) (owner: 10Fdans)
[14:15:51] <wikibugs_>	 (03CR) 10Fdans: [C: 032] "The problem with including these two data files in the project, apart from the lint issue, is that they become a pain when bundling and mi" (031 comment) [analytics/dashiki] - 10https://gerrit.wikimedia.org/r/339114 (owner: 10Milimetric)
[14:37:48] <wikibugs_>	 10Analytics, 15User-Elukey: Bump replication factor of system.auth table in cassandra when new nodes have finished bootstrap - https://phabricator.wikimedia.org/T157354#3046752 (10elukey)
[14:44:11] <wikibugs_>	 10Analytics, 10Datasets-Webstatscollector, 06Language-Team, 07Bengali-Sites, and 4 others: Investigate anomalous views to pages with replacement characters - https://phabricator.wikimedia.org/T117945#3046762 (10Arthur2e5) Liuxinyu970226, this problem seems to affect all sites independent of language settin...
[14:47:34] <wikibugs_>	 10Analytics, 10Datasets-Webstatscollector, 06Language-Team, 07Bengali-Sites, and 4 others: Investigate anomalous views to pages with replacement characters - https://phabricator.wikimedia.org/T117945#3046773 (10Liuxinyu970226) >>! In T117945#3046762, @Arthur2e5 wrote: > Liuxinyu970226, this problem seems t...
[15:27:44] <elukey>	 joal: shall we do the meeting or skip since Andrew is not working?
[15:28:56] <joal>	 elukey: as you wish :)
[15:29:11] <joal>	 elukey: anything special to discuss?
[15:30:01] <joal>	 elukey: I assume you have bumpes the replifactor factor of the system.auth table?
[15:31:53] <elukey>	 nope still in my backlog
[15:32:00] <elukey>	 a bit swamped with ops
[15:32:08] <elukey>	 I don't have anything to talk about today
[15:32:11] <elukey>	 we can skip imo
[15:32:14] <joal>	 np elukey, just saw it flying on the chan, so asked ;)
[15:32:21] <joal>	 all good elukey :)
[15:32:34] <joal>	 Ah, elukey, actually (can be done on IRC)
[15:32:54] <joal>	 How did CDH 5.10 upgrade on loabs go?
[15:32:57] <joal>	 elukey: --^
[15:36:15] <elukey>	 joal: it was super fine, in the end is just a bit more complicated from a normal cluster reboot (since everything needs to be stopped and packages upgraded)
[15:36:36] <joal>	 elukey: awesome :)
[15:36:41] <elukey>	 fingers crossed :)
[15:36:53] <joal>	 elukey: have you and or ottomata had a look at Spark 2.0 ?
[15:37:37] <elukey>	 I don't have any idea about that :(
[15:38:12] <elukey>	 the only thing "spark-related" in https://etherpad.wikimedia.org/p/analytics-cdh5.10 is 
[15:38:19] <elukey>	 Put new spark-assembly.jar in HDFS:  (https://www.cloudera.com/documentation/enterprise/latest/topics/cdh_ig_running_spark_on_yarn.html#spark_on_yarn_unmanaged) sudo -u spark hdfs dfs -rm /user/spark/share/lib/spark-assembly.jar sudo -u spark hdfs dfs -put /usr/lib/spark/lib/spark-assembly.jar /user/spark/share/lib/spark-assembly.jar
[15:49:16] <joal>	 HaeB: Hi !
[15:49:30] <joal>	 HaeB: What's the status on the non-public task fially?
[15:52:01] <wikibugs_>	 (03CR) 10Joal: "One very small nit in commit message, then if tested in beta (no failure on existing endpoints and creation of the new one, let's go :)" (031 comment) [analytics/aqs] - 10https://gerrit.wikimedia.org/r/338898 (https://phabricator.wikimedia.org/T156312) (owner: 10Fdans)
[15:52:35] <fdans>	 merci joal!!
[15:52:47] <joal>	 De nada fdans :)
[15:53:05] <joal>	 fdans: everything I have said made sense without explanation ?
[15:53:33] <joal>	 fdans: You're fluent in joalang !
[15:54:16] <fdans>	 yes! It just hadn't occurred to me to use a table endpoint instead of a sys one
[15:54:35] <fdans>	 definitely less repeating of code for the same result :)
[15:55:04] <joal>	 fdans: Actually I had that in mind, but stated differently when we discussed it - no wonder you did it the sys way !
[15:55:36] <joal>	 fdans: do you mind trying batcave with me, testing if the thing works now?
[15:55:45] <fdans>	 I think it was the drawing that led me to add the sys endpoint :)
[15:55:47] <fdans>	 omw
[15:56:23] <joal>	 fdans: we definitely were talking about sys level, not table - my bad
[15:56:32] <joal>	 Are you there fdans ?
[15:56:35] <elukey>	 can you guys give me an overview of what you are planning to do in aqs and when? :)
[15:56:41] <elukey>	 even later on
[15:56:45] <fdans>	 I'm in joal 
[15:57:10] <joal>	 elukey: WE'RE GONNA BREAK IT ALL !
[15:57:17] * joal runs fast FAST FASTTTTT !
[16:59:46] <joal>	 milimetric: I assume you need one of to cover for your SoS today?
[17:21:23] <mforns>	 oh yes joal, do you want to cover him? I can do it as well
[17:21:38] <joal>	 mforns: as you prefer :)
[17:22:59] <mforns>	 joal, how about 5 min batcave for collecting the points we're going to mention, and then I don't care who presents them, I can do it :]
[17:23:17] <joal>	 mforns: Let's do that !
[17:23:23] <joal>	 mforns: OmW !
[17:23:26] <mforns>	 omw!
[18:18:14] <elukey>	 joal: qq - I ran some queries for https://phabricator.wikimedia.org/T158599 getting a list of UAs, domains and number of hits 
[18:18:35] <elukey>	 is it safe to publish some of the data or do we need restrictions on that?
[18:18:45] <elukey>	 I don't see any major problem but I want to ask first
[18:21:47] <elukey>	 (anybody else is also fine :)
[18:23:03] <elukey>	 mforns: --^
[18:26:50] <mforns>	 elukey, looking
[18:28:41] <elukey>	 mforns: just added https://phabricator.wikimedia.org/T158599#3047490
[18:28:51] <elukey>	 that is super conservative and safe 
[18:28:57] <elukey>	 (I think)
[18:29:19] <mforns>	 reading
[18:31:57] <mforns>	 elukey, I need more time to truly understand the task, but scrum of scrums is starting and have to attend, will continue with the task after the meeting
[18:32:08] <joal>	 elukey: It indeed seems super conservative (no count number, no IP, no geo)
[18:32:37] <joal>	 elukey: I have no real clue from the context, but it seems fine from a privacy perspective (at least in my opinion)
[18:33:11] <elukey>	 super thanks! :)
[18:33:21] <mforns>	 elukey, I trust joal :]
[18:33:23] <elukey>	 mforns: sorry just wanted an opinion on the privacy side!
[18:33:40] <elukey>	  I am always paranoid of that kind of data
[18:33:49] <joal>	 elukey: Good to be :)
[18:34:33] <joal>	 elukey: you see my analysis: no IP, no count numbers, nothing more that the fact a (known) user agent used one of our end-point
[18:34:38] <joal>	 elukey: sounds fine
[18:35:28] <elukey>	 super :)
[19:10:00] <wikibugs_>	 06Analytics-Kanban, 06Operations, 10Traffic, 06Wikipedia-iOS-App-Backlog, and 2 others: Periodic 500s from piwik.wikimedia.org - https://phabricator.wikimedia.org/T154558#3047643 (10elukey) After the changes done this morning, something *seems* to have changed, namely I don't see anymore `FetchError     no...
[19:10:24] * elukey afk! byyeee
[19:45:33] <wikibugs_>	 10Analytics, 10Datasets-Webstatscollector, 06Language-Team, 07Bengali-Sites, and 4 others: Investigate anomalous views to pages with replacement characters - https://phabricator.wikimedia.org/T117945#3047743 (10Arthur2e5) >>! In T117945#3046773, @Liuxinyu970226 wrote: >  > At least this isn't happened on e...
[19:55:32] <joal>	 Bye a-team, see you tomorrow
[20:00:17] <mforns>	 bye joal !
[20:08:24] <wikibugs_>	 10Analytics, 06Research-and-Data: geowiki data for Global Innovation Index - https://phabricator.wikimedia.org/T131889#3047839 (10leila) @Milimetric @ezachte (Erik, if you need some background, please ping. I'm happy to chat about it.) I need your feedback here, please. Here is where we are with this task:  *...
[22:45:36] <wikibugs_>	 10Analytics, 10Datasets-Webstatscollector, 06Language-Team, 07Bengali-Sites, and 4 others: Investigate anomalous views to pages with replacement characters - https://phabricator.wikimedia.org/T117945#3048463 (10Liuxinyu970226) >>! In T117945#3047743, @Arthur2e5 wrote: >>>! In T117945#3046773, @Liuxinyu9702...