[00:40:51] <wikibugs>	 10Analytics, 10Research, 10Services (designing): Storage of data for recommendation API - https://phabricator.wikimedia.org/T203039 (10Pchelolo) The new storage component that's being designed now (the successor of RESTBase) will be the perfect place for that, but while it's being built, we can simply put it...
[01:59:42] <wikibugs>	 (03CR) 10Joal: Correct mediawiki-history-reduced checker (031 comment) [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/455825 (owner: 10Joal)
[06:13:14] <elukey>	 morning :)
[06:13:20] <elukey>	 new archiva up and running https://archiva.wikimedia.org/
[06:13:21] <elukey>	 \o/
[06:16:28] <elukey>	 before doing the switch I did a final round of rsync to make sure that all the artifacts were there
[06:41:02] <wikibugs>	 (03PS1) 10Elukey: util.py: replace urllib2 with urllib.request and urllib.error [analytics/refinery] - 10https://gerrit.wikimedia.org/r/456079
[06:42:40] <elukey>	 oh noes, we have scripts running with /usr/bin/python and /usr/bin/python3..
[06:42:43] <elukey>	 sigh
[06:45:38] <wikibugs>	 (03Abandoned) 10Elukey: util.py: replace urllib2 with urllib.request and urllib.error [analytics/refinery] - 10https://gerrit.wikimedia.org/r/456079 (owner: 10Elukey)
[06:52:44] <wikibugs>	 (03PS1) 10Elukey: util.py: add python3 support for urllib functions/errors [analytics/refinery] - 10https://gerrit.wikimedia.org/r/456081
[07:30:34] <wikibugs>	 10Analytics, 10Research, 10Services (designing): Storage of data for recommendation API - https://phabricator.wikimedia.org/T203039 (10mobrovac) >>! In T203039#4540767, @Pchelolo wrote: > However, we didn't plan for this increase in the storage volume, ven though 2.2 Gigs doesn't sound too bad.  That's actua...
[07:47:53] <joal>	 Morning elukey 
[07:48:00] <joal>	 Are you ready ?
[07:48:04] <joal>	 :)
[07:57:52] <elukey>	 morningggg
[07:57:58] <elukey>	 archiva is ready to go :)
[07:58:13] <joal>	 ok elukey - proceeding then :)
[07:58:34] <elukey>	 joal: did you see my email about util.py? 
[07:59:11] <joal>	 elukey: I have - my only concern about py2 is that we just started to use snakebite that is only available for py2 ...
[07:59:26] <elukey>	 lovely :(
[07:59:44] <joal>	 But as Andrew said yesterday - seems not maintained anymore, so maybe we should just rely on our good ol' utility?
[08:00:27] <elukey>	 I think that we should seriously think about moving our entire codebase to py3 and then forget about py2
[08:00:30] <elukey>	 the sooner the better
[08:00:49] <joal>	 +1 for that elukey - I'm gonna remove snakebite from my new patch
[08:01:49] <elukey>	 my main concern now though is the saltrotate failure.. 
[08:01:59] <elukey>	 should we fix it before deploying today?
[08:03:58] <joal>	 elukey: concern is, most our scripts use py2 - Hopefully conversion is not too difficult, but I'd rather take time
[08:04:27] <joal>	 elukey: Shall I move forward with refinery-source while we discuss refinery?
[08:04:37] <elukey>	 sure sure, but in theory https://gerrit.wikimedia.org/r/456081 should work fine with py2/3 no?
[08:04:41] <elukey>	 +1 for source
[08:04:45] <elukey>	 so we can test archiva
[08:05:01] <wikibugs>	 (03CR) 10Joal: [V: 032 C: 032] "Merging for deploy." [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/455825 (owner: 10Joal)
[08:06:30] <wikibugs>	 (03PS1) 10Joal: Update changelog.md for v0.0.72 [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/456086
[08:06:35] <joal>	 elukey: --^ please :)
[08:08:25] <wikibugs>	 (03CR) 10Elukey: [C: 032] Update changelog.md for v0.0.72 [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/456086 (owner: 10Joal)
[08:10:13] <joal>	 elukey: found that as well: http://python-future.org/compatible_idioms.html#urllib-module
[08:11:25] <elukey>	 nice!
[08:12:04] <elukey>	 one of the alternatives is my patch basically
[08:12:08] <elukey>	 what a mess
[08:12:14] * elukey wants python3 only
[08:12:33] <wikibugs>	 (03CR) 10Elukey: [V: 032 C: 032] Update changelog.md for v0.0.72 [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/456086 (owner: 10Joal)
[08:12:43] <elukey>	 (also merged --^)
[08:12:51] <joal>	 Thanks elukey :)
[08:13:11] <joal>	 Was waiting for jenkins, but no need :)
[08:30:51] <joal>	 !log Deploying refinery using jenkins
[08:30:55] <stashbot>	 Logged the message at https://www.mediawiki.org/wiki/Analytics/Server_Admin_Log
[08:34:01] <elukey>	 joal: all proceeding good?
[08:34:18] <joal>	 so far so good - first build job succeeded, now releasing
[08:43:22] <joal>	 elukey: last build job adding the jars to refinery - everything good so far :)
[08:43:30] <joal>	 This is a success elukey :)
[08:43:33] <joal>	 cd ..
[08:43:35] <joal>	 oops
[08:44:17] <wikibugs>	 (03PS1) 10Joal: Correct mediawiki-history-reduced job [analytics/refinery] - 10https://gerrit.wikimedia.org/r/456091
[08:46:23] <wikibugs>	 (03CR) 10Joal: [V: 032 C: 032] "Merging for deploy." [analytics/refinery] - 10https://gerrit.wikimedia.org/r/456091 (owner: 10Joal)
[08:46:32] <joal>	 elukey: shall I merge your python patch?
[08:47:26] <wikibugs>	 10Analytics, 10EventBus, 10MediaWiki-General-or-Unknown, 10Multi-Content-Revisions, and 2 others: It should be possible to understand the reason of revision creation from RevisionRecordInserted hook - https://phabricator.wikimedia.org/T188396 (10mobrovac)
[08:50:51] <elukey>	 joal: oh yes if it makes sense for you yes
[08:51:16] <joal>	 elukey: it does - the pattern you follow was already there - I'm assuming who've tested some?
[08:51:34] <elukey>	 I only tested the imports, not the code itself
[08:51:46] <joal>	 elukey: hm
[08:52:06] <joal>	 elukey: Let's make it happen and monitor cron possible errors
[08:52:10] <joal>	 ok ?
[08:52:12] <elukey>	 sure
[08:52:45] <wikibugs>	 (03CR) 10Joal: [V: 032 C: 032] "Merging for deploy" [analytics/refinery] - 10https://gerrit.wikimedia.org/r/456081 (owner: 10Elukey)
[08:53:27] <joal>	 !log Deploying refinery using scap
[08:53:30] <stashbot>	 Logged the message at https://www.mediawiki.org/wiki/Analytics/Server_Admin_Log
[08:55:46] <joal>	 elukey: I'm assuming the old archiva will die soon, will it?
[08:58:11] <elukey>	 yep, as soon as we are good with the new one
[08:58:13] <elukey>	 why?
[08:58:42] <joal>	 the way it is, the new one is default :)
[08:59:07] <elukey>	 and this is expected no?
[08:59:46] <elukey>	 (I have a change to nuke it in https://gerrit.wikimedia.org/r/456090)
[08:59:56] <joal>	 :)
[09:00:14] <joal>	 completely expected - I'm assuming we'll be waiting for other teams to confirm?
[09:00:41] <elukey>	 most of them have confirmed, I was waiting for my favourite french colleague for the green light :)
[09:00:56] <joal>	 :D
[09:01:15] <joal>	 Ahhhh, that one - the slow one ;)
[09:02:07] <elukey>	 the patient one! :)
[09:03:36] <joal>	 Ah ! At least an error :)
[09:03:53] <joal>	 elukey: scap deploy-log on deployement.eqiad.wmnet
[09:04:44] <joal>	 elukey: rsync: failed to connect to archiva.wikimedia.org (2620:0:861:1:208:80:154:16): Connection timed out (110)
[09:05:08] <elukey>	 ahhhh ipv6
[09:05:31] <joal>	 elukey: ok to rollback canary?
[09:05:41] <elukey>	 yep yep, gimme 10 mins to fix this
[09:05:50] <joal>	 sure !
[09:06:11] <joal>	 elukey: may I let you ping ops-chan about the failed deploy?
[09:06:38] <elukey>	 no need for the moment :)
[09:06:52] <joal>	 ok
[09:07:33] <elukey>	 ah wait the ipv6 address is right
[09:07:46] <elukey>	 but of course the firewall rules are not
[09:07:52] <elukey>	 ufff
[09:14:23] <elukey>	 and it seems that there was no rule for archiva ipv6 ?
[09:15:21] <elukey>	 ahhh now I got what happened
[09:15:49] <elukey>	 there was only the PTR record (so from meitnerium's ipv6 to meitnerium.wikimedia.org)
[09:15:52] <elukey>	 not the AAAA
[09:16:02] <elukey>	 meanwhile for archiva1001 we have the AAAA
[09:16:05] <elukey>	 and scap decided to use it
[09:16:53] <elukey>	 all right fixing it
[09:37:33] <elukey>	 so I pushed the new rules but from stat1005 I cannot access archiva's ipv6 with telnet
[09:45:07] <elukey>	 sorry joal usual networking rabbithole
[09:45:14] <joal>	 np elukey 
[09:45:21] <elukey>	 ipv4 works fine now
[09:45:25] <elukey>	 but not ipv6
[09:46:27] <elukey>	 ah but it doesn't work also from say deploy1001
[09:46:36] <elukey>	 so it shouldn't be our vlan
[09:47:03] <joal>	 hm - I think git-fat is executed only in our vlan, no?
[09:48:17] <elukey>	 yes yes, but I tried to one host outside the vlan to see if my new firewall rules were the culprit
[09:50:39] <elukey>	 ping -6 works
[09:50:57] <elukey>	 and iptable rules on archiva1001 are not showing anything weird
[09:53:49] <joal>	 :(
[09:56:58] <elukey>	 mistery solve thanks to some help from our opsens
[09:57:07] <elukey>	 nginx and rsync are not listening on ipv6
[09:57:25] <elukey>	 so joal, can you try another time the deployment to see if it picks up the ipv4 address?
[09:58:33] <elukey>	 or better, lemme try one nginx config
[09:59:37] <elukey>	 now it works :)
[09:59:44] <elukey>	 joal: you can deploy
[10:02:53] <elukey>	 nope, seems not working fine
[10:02:54] <elukey>	 ufff
[10:10:18] <elukey>	 and there is also the issue of rsync not accepting ipv6
[10:21:32] <joal>	 elukey: Deploying again !
[10:21:50] <elukey>	 joal: it might fail again, I only fixed 443/80 ports 
[10:21:53] <elukey>	 let's see if it works
[10:21:56] <joal>	 sure
[10:25:06] <joal>	 elukey: success on canary, moving woth the rest
[10:25:13] <elukey>	 ah nice!
[10:31:01] <elukey>	 10:30:46 [deploy1001] Finished deploy [analytics/refinery@1c6423f] (duration: 08m 28s)
[10:31:04] <elukey>	 \o/
[10:31:16] <joal>	 will double check on stat1005 and 4 (in case)
[10:32:43] <joal>	 also elukey - We should clean refinery's artifacts folder
[10:32:50] <joal>	 elukey: seems wrong on an1005
[10:33:12] <joal>	 elukey: But it's canary, and git-fat errors always messes up canary
[10:34:04] <joal>	 elukey: indeed looks better on stat1004
[10:34:21] <joal>	 I'll deploy onto HDFS using stat1004, but jars are missing on stat1005
[10:34:25] <joal>	 elukey: --^
[10:34:33] <joal>	 !log Deploying refinery onto HDFS
[10:34:38] <stashbot>	 Logged the message at https://www.mediawiki.org/wiki/Analytics/Server_Admin_Log
[10:35:02] <elukey>	 mmm can we force another deploy on stat1005 only?
[10:35:12] <elukey>	 IIRC we did a similar thing another time
[10:35:43] <elukey>	 even though we should have already re-deployed on it
[10:36:06] <joal>	 elukey: nuke the existing, and redeploy only onto stat1005?
[10:36:42] <elukey>	 sure.. all of the refinery deployment?
[10:36:45] <elukey>	 err directory
[10:36:46] <elukey>	 ?
[10:37:03] <joal>	 elukey: I think so, cause we can't really rollback, can we?
[10:39:36] <elukey>	 (doing the deployment now)
[10:41:27] <elukey>	 joal: done! can you re-check now?
[10:41:46] <joal>	 sure !
[10:41:55] <elukey>	 !log nuked /srv/deployment/analytics/refinery on stat1005 after errors with archiva/git-fat (stat1005 is the canary)
[10:41:58] <stashbot>	 Logged the message at https://www.mediawiki.org/wiki/Analytics/Server_Admin_Log
[10:42:33] <joal>	 Success \o/ !!
[10:42:39] <joal>	 Many thanks elukey :)
[10:42:45] <elukey>	 \o/
[10:42:58] <elukey>	 joal: if you are ok I'd go for lunch + errand now (brb in ~1.5h)
[10:43:13] <joal>	 please elukey - Everything good for me on ops side :
[10:43:18] <elukey>	 super :)
[10:43:19] <joal>	 See you later :)
[10:43:20] <elukey>	 ttl! 
[11:39:37] <joal>	 !log Restart mediwiki-history-reduced oozie job after deploy
[11:39:39] <stashbot>	 Logged the message at https://www.mediawiki.org/wiki/Analytics/Server_Admin_Log
[11:59:56] <wikibugs>	 (03PS1) 10Addshore: Always submit priorities, even when the count is 0 [analytics/wmde/scripts] - 10https://gerrit.wikimedia.org/r/456119
[12:01:31] <wikibugs>	 (03CR) 10Addshore: [C: 032] Always submit priorities, even when the count is 0 [analytics/wmde/scripts] - 10https://gerrit.wikimedia.org/r/456119 (owner: 10Addshore)
[12:01:36] <wikibugs>	 (03PS1) 10Addshore: Always submit priorities, even when the count is 0 [analytics/wmde/scripts] - 10https://gerrit.wikimedia.org/r/456120
[12:01:39] <wikibugs>	 (03CR) 10Addshore: [C: 032] Always submit priorities, even when the count is 0 [analytics/wmde/scripts] - 10https://gerrit.wikimedia.org/r/456120 (owner: 10Addshore)
[12:01:42] <wikibugs>	 (03Merged) 10jenkins-bot: Always submit priorities, even when the count is 0 [analytics/wmde/scripts] - 10https://gerrit.wikimedia.org/r/456119 (owner: 10Addshore)
[12:01:48] <wikibugs>	 (03Merged) 10jenkins-bot: Always submit priorities, even when the count is 0 [analytics/wmde/scripts] - 10https://gerrit.wikimedia.org/r/456120 (owner: 10Addshore)
[13:53:57] <wikibugs>	 10Analytics, 10Operations: Decommission Ganeti vm meitnerium.wikimedia.org (old Archiva host) - https://phabricator.wikimedia.org/T203087 (10elukey) p:05Triage>03Normal
[13:59:05] <ottomata>	 !log upgrading spark2 package with pyarrow dependency and default pyspark to python3
[13:59:08] <stashbot>	 Logged the message at https://www.mediawiki.org/wiki/Analytics/Server_Admin_Log
[14:06:14] <wikibugs>	 10Analytics, 10Analytics-Kanban, 10Patch-For-Review: Install pyArrow in Cluster - https://phabricator.wikimedia.org/T202812 (10Ottomata) @diego I GOT IT!  Try it out, lemme know if it works.
[14:18:52] <wikibugs>	 10Analytics, 10Analytics-EventLogging, 10Analytics-Kanban, 10EventBus, and 2 others: RFC: Modern Event Platform: Scalable Event Intake Service - https://phabricator.wikimedia.org/T201963 (10Ottomata)
[14:38:07] <elukey>	 ottomata: hiiii
[14:38:19] <elukey>	 https://wikitech.wikimedia.org/wiki/Puppet_coding#Modules -> "Any class, define or resource in a module must not  use classes from other modules, and avoid, wherever possible, to use defines from other modules as well."
[14:38:51] <elukey>	 this seems very strict, I guess that the goal is to force people to collect things in profiles?
[14:39:04] <joal>	 heya elukey - Can we deploy AQS with the new datasource? (both datasource change and code change)
[14:40:13] <elukey>	 joal: sure!
[14:40:20] <joal>	 ok - prepari
[14:40:30] <joal>	 preparing the patch for config
[14:40:33] <ottomata>	 elu 	hiii
[14:40:55] <ottomata>	 elukey:  it seems like it will just make people use profile like modules, and then we'll have all manifests in the same module again p
[14:40:56] <ottomata>	 :p
[14:41:02] <elukey>	 yeh
[14:41:05] <elukey>	 yeah
[14:47:27] <joal>	 elukey: the other patch has already been merged by Dan
[14:47:34] <joal>	 elukey: Shall I start the deploy process?
[14:49:42] <elukey>	 joal: so first deploy the code change (one restart of aqs by scap), then puppet change to switch the datasource + manual rolling restart ?
[14:49:57] <elukey>	 (trying to understand)
[14:51:08] <joal>	 elukey: that should do yes
[14:51:37] <elukey>	 super, let's start then!
[14:51:48] <joal>	 elukey: the code patch doesn't affect end-points in use, so we're safe to first deploy the code, then the config change
[14:51:54] <joal>	 ok I start :P)
[14:56:20] <wikibugs>	 (03PS1) 10Joal: Update aqs to 838b646 [analytics/aqs/deploy] - 10https://gerrit.wikimedia.org/r/456159
[14:59:35] <joal>	 elukey: shall I merge --^
[14:59:36] <joal>	 ?
[14:59:46] <elukey>	 yep looks good
[14:59:53] <wikibugs>	 (03CR) 10Joal: [V: 032 C: 032] "Merging for deploy" [analytics/aqs/deploy] - 10https://gerrit.wikimedia.org/r/456159 (owner: 10Joal)
[14:59:55] <elukey>	 I mean, a ton of nodejs deps as always
[14:59:58] <elukey>	 :(
[15:00:02] <joal>	 yeah :(
[15:00:14] <joal>	 I wish we had better ways of doing that...
[15:00:22] <joal>	 At leas hide them, as in a jar :D
[15:00:35] <elukey>	 this is way nicer than using npm update in production
[15:00:57] <nuria>	 ping milimetric  joal elukey fdans 
[15:01:26] <elukey>	 my IRC clock is not the same as my laptop clock
[15:01:28] <elukey>	 grrr
[15:02:20] <nuria>	 ping fdans 
[15:02:22] <joal>	 ok elukey - ready when we want - after standup seems safer :)
[15:05:08] <fdans>	 nuria: sent e-scrum :)
[15:10:00] <joal>	 At the bottomn
[15:10:03] <joal>	 oops
[15:26:36] <ottomata>	 oh hey a-team btw better-use-of-data working group is at same time as retro :D
[15:26:38] <ottomata>	 sorryyyy
[15:27:01] <wikibugs>	 10Analytics, 10Analytics-Kanban, 10Patch-For-Review: Install pyArrow in Cluster - https://phabricator.wikimedia.org/T202812 (10diego) Yeah! it works! Thanks @Ottomata
[15:27:22] <joal>	 !log Deploy AQS with scap
[15:27:23] <stashbot>	 Logged the message at https://www.mediawiki.org/wiki/Analytics/Server_Admin_Log
[15:27:39] <joal>	 elukey: canary successfull
[15:28:13] <elukey>	 good!
[15:28:37] <elukey>	 I don't see anything on fire
[15:30:21] <joal>	 elukey: ran queries on aqs1004 - I have results
[15:31:22] <joal>	 elukey: and new endpoints give coherent null results as the datasource has not been swapeed
[15:31:30] <joal>	 elukey: Shall I finalize the dpeloy?
[15:32:55] <elukey>	 sure!
[15:37:56] <joal>	 done elukey :)
[15:38:11] <elukey>	 nice!
[15:38:16] <elukey>	 merging the puppet change
[15:39:50] <wikibugs>	 10Analytics, 10Analytics-Wikistats: Reasons for decline and deletion on Wikinews - https://phabricator.wikimedia.org/T203090 (10DavidMCEddy)
[15:42:17] <elukey>	 joal: config deployed
[15:42:29] <elukey>	 going to restart aqs1004 (depooled) so we can test
[15:42:35] <elukey>	 then repool and do the same with the rest ok?
[15:42:40] <joal>	 yes !
[15:43:10] <elukey>	 aqs1004 ready
[15:43:24] <joal>	 elukey: I confirm :)
[15:43:34] <joal>	 elukey: I HAZ DATAZ
[15:44:45] <wikibugs>	 (03CR) 10Nuria: "Looks good, provided we tested this runs in python3 w/o errors" [analytics/refinery] - 10https://gerrit.wikimedia.org/r/456079 (owner: 10Elukey)
[15:45:18] <wikibugs>	 (03CR) 10Nuria: "Ah, sorry, i missed that this one is abandoned." [analytics/refinery] - 10https://gerrit.wikimedia.org/r/456079 (owner: 10Elukey)
[15:45:59] <elukey>	 joal: goooood!
[15:46:30] <joal>	 elukey: I confirm on another metric - I say it's good :)
[15:47:37] <elukey>	 yep rolling restart aqs now
[15:48:14] <joal>	 elukey: https://grafana.wikimedia.org/dashboard/db/druid?refresh=1m&orgId=1&from=now-1h&to=now&panelId=43&fullscreen
[15:48:28] <joal>	 on druid-public :)
[15:48:29] <wikibugs>	 10Analytics, 10MediaWiki-extensions-JsonConfig, 10Release-Engineering-Team, 10MW-1.32-release-notes (WMF-deploy-2018-08-28 (1.32.0-wmf.19)), and 2 others: Config:Dashiki:* on Meta can't be opened - https://phabricator.wikimedia.org/T203029 (10Nuria) Some sample urls that are still broken:  https://meta.wik...
[15:49:42] * fdans back
[15:50:12] <wikibugs>	 (03CR) 10Elukey: "Yep sorry! We merged https://gerrit.wikimedia.org/r/#/c/analytics/refinery/+/456081/" [analytics/refinery] - 10https://gerrit.wikimedia.org/r/456079 (owner: 10Elukey)
[15:50:18] <wikibugs>	 10Analytics, 10MediaWiki-extensions-JsonConfig, 10Release-Engineering-Team, 10MW-1.32-release-notes (WMF-deploy-2018-08-28 (1.32.0-wmf.19)), and 2 others: Config:Dashiki:* on Meta can't be opened - https://phabricator.wikimedia.org/T203029 (10Nuria) Note that dashiki just consumes these json files on meta...
[15:50:51] <elukey>	 joal: aqs restart completed
[15:51:31] <joal>	 awesome elukey :)
[15:51:54] <joal>	 I'm gonna triple check the new endpoints, and make a patch for restbase :)
[15:52:02] <elukey>	 super
[15:52:27] <joal>	 Thanks a lot elukey for this deploy-beginning of week
[15:55:37] <wikibugs>	 (03CR) 10Nuria: util.py: add python3 support for urllib functions/errors (031 comment) [analytics/refinery] - 10https://gerrit.wikimedia.org/r/456081 (owner: 10Elukey)
[15:59:19] <nuria>	 ottomata: can you merge https://gerrit.wikimedia.org/r/#/c/operations/puppet/+/455892/ if you do not see any problems with it?
[16:00:37] <ottomata>	 nuria:  done
[16:00:46] <ottomata>	 want me to run puppet somewhere?
[16:03:45] <nuria>	 ottomata: no need, it can wait for next run  on teh new ganeti instance that hosts wikistats right?
[16:06:34] <ottomata>	 yup can wait
[16:06:39] <ottomata>	 its not ganeit though
[16:06:40] <ottomata>	 for wikistats
[16:06:41] <ottomata>	 its thorium
[16:09:33] <nuria>	 ottomata: k
[16:18:49] <elukey>	 ottomata: https://phabricator.wikimedia.org/T201939#4542782 - analyticsmaster ?
[16:19:19] <elukey>	 I am not a fan of battle for names but without the hypen is kinda horrible :D
[16:21:17] <ottomata>	 woah i thoguht we had hyphen
[16:21:19] <ottomata>	 dunno where that went
[16:21:45] <ottomata>	 from the irc discussion i thought we kept the hyphen
[16:21:46] <ottomata>	 and from rob's comment
[16:22:16] <elukey>	 ahahhahah
[16:22:26] <wikibugs>	 10Analytics, 10Operations, 10ops-eqiad, 10Patch-For-Review: rack/setup/install analyticsmaster100[12].eqiad.wmnet - https://phabricator.wikimedia.org/T201939 (10Ottomata) @Cmjohnson Rob's latest comment is what I thought we agreed to:  >  The solution is we'll order newer, longer hostname labels for those...
[16:24:05] <wikibugs>	 10Analytics-Kanban, 10Patch-For-Review: Deploy wikistats from master branch - https://phabricator.wikimedia.org/T203017 (10Nuria)
[16:24:58] <elukey>	 ottomata: had a chat with Rob, they'll add the hyphen before handing them over to us
[16:25:20] <wikibugs>	 10Analytics, 10Operations, 10ops-eqiad, 10Patch-For-Review: rack/setup/install analyticsmaster100[12].eqiad.wmnet - https://phabricator.wikimedia.org/T201939 (10RobH) I'll handle the dns changes to change the hostname, the label won't change for now since the longer name won't fit.  Chris: Go ahead and fin...
[16:26:19] <wikibugs>	 10Analytics, 10MediaWiki-extensions-ORES, 10Scoring-platform-team, 10Services (designing): ORES hook integration with EventBus - https://phabricator.wikimedia.org/T201869 (10awight)
[16:28:35] <wikibugs>	 10Analytics: Wikistats should not show private wikis in drop downwiki selection menu - https://phabricator.wikimedia.org/T203103 (10Nuria)
[16:28:47] <wikibugs>	 10Analytics, 10Analytics-Wikistats: Wikistats should not show private wikis in drop downwiki selection menu - https://phabricator.wikimedia.org/T203103 (10Nuria)
[16:29:41] <elukey>	 all right folks logging off for today
[16:29:43] <elukey>	 o/
[16:31:35] <nuria>	 ciaoo elukey 
[16:43:53] <joal>	 Bye elukey :)
[16:44:38] <joal>	 Same for me - gone for tonight - see tomorrow folks
[16:48:26] <wikibugs>	 10Analytics, 10Operations, 10ops-eqiad, 10Patch-For-Review: rack/setup/install analyticsmaster100[12].eqiad.wmnet - https://phabricator.wikimedia.org/T201939 (10Cmjohnson)
[16:49:51] <wikibugs>	 10Analytics, 10Operations, 10ops-eqiad, 10Patch-For-Review: rack/setup/install analyticsmaster100[12].eqiad.wmnet - https://phabricator.wikimedia.org/T201939 (10Cmjohnson) @robh network ports are setup and in analytics vlan   A6 ge-6/0/15       up    up   analytics-master1001 B8 ge-8/0/21       up    up...
[16:55:43] <wikibugs>	 10Analytics, 10Analytics-Wikistats: Use the "private" and "closed" sitematrix keys instead of "INVALID" - https://phabricator.wikimedia.org/T203105 (10fdans)
[18:15:50] <nuria>	 ottomata: what was the bit to purge things from varnish when  looking at a website , something like purge=1?
[18:17:05] <ottomata>	 hm, that i don't know nuria
[18:17:10] <ottomata>	 didn't know you could do that (or i have forgotten)
[18:17:24] <nuria>	 ottomata: i seem to remember.. well, no worries
[18:41:02] <nuria>	 ottomata: wikistats2 is also in thorium?
[18:42:54] <ottomata>	 yes
[18:52:12] <wikibugs>	 (03PS2) 10Fdans: Fix strategy and usability sites not being counted as pageviews [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/456022 (https://phabricator.wikimedia.org/T187414)
[18:54:41] <wikibugs>	 (03CR) 10jerkins-bot: [V: 04-1] Fix strategy and usability sites not being counted as pageviews [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/456022 (https://phabricator.wikimedia.org/T187414) (owner: 10Fdans)
[19:03:23] <nuria>	 ottomata: i still see things unchanged in thorium
[19:03:30] <nuria>	 https://www.irccloud.com/pastebin/BC8Eo61q/
[19:06:47] <wikibugs>	 (03CR) 10Nuria: [V: 032 C: 032] "Looks good , remember that to enact these changes cluster needs to be reployed and jobs restarted" [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/456022 (https://phabricator.wikimedia.org/T187414) (owner: 10Fdans)
[19:06:56] <wikibugs>	 (03PS3) 10Nuria: Fix strategy and usability sites not being counted as pageviews [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/456022 (https://phabricator.wikimedia.org/T187414) (owner: 10Fdans)
[19:07:00] <ottomata>	 nuria:  i guess the git clone doesn't switch branches
[19:07:05] <ottomata>	 but only checks out the one the first time it clones
[19:07:15] <nuria>	 ottomata: which kind of makes sense
[19:07:25] <ottomata>	 ya
[19:07:28] <ottomata>	 will fix manually...
[19:08:08] <wikibugs>	 (03CR) 10Fdans: [V: 04-1] "just one second, it's breaking the build right now and I'm fixing my local java testing :)" [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/456022 (https://phabricator.wikimedia.org/T187414) (owner: 10Fdans)
[19:08:20] <ottomata>	 nuria:  i'm going to blast the working master and check out from origin, ok?
[19:08:37] <nuria>	 ottomata: ya, it is all cached
[19:09:05] <wikibugs>	 (03CR) 10jerkins-bot: [V: 04-1] Fix strategy and usability sites not being counted as pageviews [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/456022 (https://phabricator.wikimedia.org/T187414) (owner: 10Fdans)
[19:10:52] <wikibugs>	 (03CR) 10Nuria: [C: 032] "Please take a look at tests." [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/456022 (https://phabricator.wikimedia.org/T187414) (owner: 10Fdans)
[19:12:32] <wikibugs>	 (03CR) 10jerkins-bot: [V: 04-1] Fix strategy and usability sites not being counted as pageviews [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/456022 (https://phabricator.wikimedia.org/T187414) (owner: 10Fdans)
[19:14:16] <nuria>	 ottomata: ok, all good
[19:14:50] <ottomata>	 cooooo
[19:15:01] <ottomata>	 ya done sorry, meant to say so :)
[19:31:12] <wikibugs>	 10Analytics, 10MediaWiki-extensions-JsonConfig, 10Release-Engineering-Team, 10MW-1.32-release-notes (WMF-deploy-2018-08-28 (1.32.0-wmf.19)), and 2 others: Config:Dashiki:* on Meta can't be opened - https://phabricator.wikimedia.org/T203029 (10Mholloway) This seems to have been fixed by today's deployment o...
[19:51:11] <wikibugs>	 10Analytics, 10Analytics-EventLogging, 10Analytics-Kanban, 10EventBus, and 2 others: RFC: Modern Event Platform: Schema Registry / Metadata Service - https://phabricator.wikimedia.org/T201643 (10daniel) There will be a discussion about this RFC on #wikimedia-office at 21:00 UTC today, that's in an hour and...
[20:15:26] <wikibugs>	 10Analytics, 10Analytics-EventLogging, 10Analytics-Kanban, 10EventBus, 10Services (watching): Modern Event Platform: Schema Registry - https://phabricator.wikimedia.org/T201063 (10Tbayer) > - As an **analyst**, I want clear analytics schema guidelines and conventions for schema design so that schemas are...
[20:18:30] <wikibugs>	 10Analytics, 10MediaWiki-extensions-JsonConfig, 10Release-Engineering-Team, 10MW-1.32-release-notes (WMF-deploy-2018-08-28 (1.32.0-wmf.19)), and 2 others: Config:Dashiki:* on Meta can't be opened - https://phabricator.wikimedia.org/T203029 (10Nuria) yay! Resolving.
[20:18:37] <wikibugs>	 10Analytics, 10MediaWiki-extensions-JsonConfig, 10Release-Engineering-Team, 10MW-1.32-release-notes (WMF-deploy-2018-08-28 (1.32.0-wmf.19)), and 2 others: Config:Dashiki:* on Meta can't be opened - https://phabricator.wikimedia.org/T203029 (10Nuria) 05Open>03Resolved
[20:22:56] <wikibugs>	 10Analytics, 10Analytics-EventLogging, 10Analytics-Kanban, 10EventBus, 10Services (watching): Modern Event Platform: Schema Registry - https://phabricator.wikimedia.org/T201063 (10JMinor) @Ottomata I've taken a first pass look, but will be doing a more thorough comment based on the Better Use of Data sto...
[20:23:25] <wikibugs>	 10Analytics, 10Analytics-EventLogging, 10Analytics-Kanban, 10EventBus, 10Services (watching): Modern Event Platform: Schema Registry - https://phabricator.wikimedia.org/T201063 (10Ottomata) > How is this blocked on implementing a (new) schema registry?   It isn't totally blocked, but there may be new imp...
[20:25:33] <wikibugs>	 10Analytics, 10MediaWiki-extensions-JsonConfig, 10MW-1.32-release-notes (WMF-deploy-2018-08-28 (1.32.0-wmf.19)), 10Patch-For-Review, 10Wikimedia-log-errors: Config:Dashiki:* on Meta can't be opened - https://phabricator.wikimedia.org/T203029 (10greg)
[20:32:09] <wikibugs>	 10Analytics, 10Analytics-Kanban: Create .deb package for Presto - https://phabricator.wikimedia.org/T203115 (10Ottomata)
[20:36:36] <wikibugs>	 (03PS4) 10Fdans: Fix strategy and usability sites not being counted as pageviews [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/456022 (https://phabricator.wikimedia.org/T187414)
[20:39:27] <wikibugs>	 (03CR) 10Nuria: Fix strategy and usability sites not being counted as pageviews (031 comment) [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/456022 (https://phabricator.wikimedia.org/T187414) (owner: 10Fdans)
[20:40:57] <fdans>	 nuria: don't understand the comment, sorry
[20:41:01] <fdans>	 you mean in the docs?
[20:41:15] <nuria>	 fdans: just commit-message-rewording
[20:41:22] <nuria>	 fdans: makes sense?
[20:41:30] <fdans>	 ahh gotcha
[20:41:32] <wikibugs>	 10Analytics, 10Analytics-Wikistats: Reasons for decline and deletion on Wikinews - https://phabricator.wikimedia.org/T203090 (10Gryllida) Thanks for this request DavidMCEddy   However in my opinion this issue tracker is for tasks which relate to software developed by the WMF. This is a content task and as the...
[20:42:44] <wikibugs>	 (03PS5) 10Fdans: Add strategy.wikimedia and usability.wikimedia to pageview definition so its pageviews are counted [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/456022 (https://phabricator.wikimedia.org/T187414)
[20:44:49] <wikibugs>	 10Analytics, 10Analytics-EventLogging, 10Analytics-Kanban, 10EventBus, 10Services (watching): Modern Event Platform: Schema Registry - https://phabricator.wikimedia.org/T201063 (10Tbayer) On a general note:   The future schema registry (or currently the schema pages system on Meta-wiki) is a very importa...
[20:49:21] <wikibugs>	 10Analytics, 10Analytics-EventLogging, 10Analytics-Kanban, 10EventBus, and 2 others: RFC: Modern Event Platform: Schema Registry / Metadata Service - https://phabricator.wikimedia.org/T201643 (10Ottomata) Copy/pasting [[ https://phabricator.wikimedia.org/T201063#4515886 | this comment ]] for visibility:  >...
[20:52:58] <wikibugs>	 10Analytics, 10Analytics-EventLogging, 10Analytics-Kanban, 10EventBus, and 2 others: RFC: Modern Event Platform: Scalable Event Intake Service - https://phabricator.wikimedia.org/T201963 (10Ottomata)
[20:55:14] <wikibugs>	 10Analytics, 10Analytics-EventLogging, 10Analytics-Kanban, 10EventBus, and 2 others: RFC: Modern Event Platform: Scalable Event Intake Service - https://phabricator.wikimedia.org/T201963 (10Ottomata)
[20:58:44] <wikibugs>	 10Analytics, 10MediaWiki-extensions-JsonConfig, 10MW-1.32-release-notes (WMF-deploy-2018-08-28 (1.32.0-wmf.19)), 10Patch-For-Review, 10Wikimedia-log-errors: Config:Dashiki:* on Meta can't be opened - https://phabricator.wikimedia.org/T203029 (10Jdforrester-WMF) Note that it's not fully fixed; the edit pa...
[21:48:16] <wikibugs>	 10Analytics, 10MediaWiki-extensions-JsonConfig, 10MW-1.32-release-notes (WMF-deploy-2018-08-28 (1.32.0-wmf.19)), 10Patch-For-Review, 10Wikimedia-log-errors: Config:Dashiki:* on Meta can't be opened - https://phabricator.wikimedia.org/T203029 (10Nuria) @Jdforrester-WMF totally missed that, reopening ticket
[21:48:23] <wikibugs>	 10Analytics, 10MediaWiki-extensions-JsonConfig, 10MW-1.32-release-notes (WMF-deploy-2018-08-28 (1.32.0-wmf.19)), 10Patch-For-Review, 10Wikimedia-log-errors: Config:Dashiki:* on Meta can't be opened - https://phabricator.wikimedia.org/T203029 (10Nuria) 05Resolved>03Open
[21:59:28] <wikibugs>	 (03PS6) 10Nuria: Add strategy.wikimedia and usability.wikimedia to pageview definition [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/456022 (https://phabricator.wikimedia.org/T187414) (owner: 10Fdans)
[22:03:23] <wikibugs>	 10Analytics, 10Analytics-EventLogging, 10Analytics-Kanban, 10EventBus, and 2 others: RFC: Modern Event Platform: Schema Registry / Metadata Service - https://phabricator.wikimedia.org/T201643 (10kchapman) TechCom hosted an IRC meeting today on this RFC:  Minutes: https://tools.wmflabs.org/meetbot/wikimedia...
[22:26:38] <wikibugs>	 10Analytics: Deprecate reportcard: https://analytics.wikimedia.org/dashboards/reportcard/ - https://phabricator.wikimedia.org/T203128 (10Nuria)
[22:27:12] <wikibugs>	 10Analytics: Deprecate reportcard: https://analytics.wikimedia.org/dashboards/reportcard/ - https://phabricator.wikimedia.org/T203128 (10Nuria) Url domain should redirect to wikistats gdashboard so probably we need some config in apache too
[22:27:42] <wikibugs>	 10Analytics, 10Analytics-General-or-Unknown, 10Browser-Support-Opera: Count X-CS=502-16 only if it came through an Opera Mini PROXY - https://phabricator.wikimedia.org/T58118 (10Nuria) 05Open>03declined
[22:28:48] <wikibugs>	 10Analytics, 10Maps: Switch maps metrics from hourly to daily - https://phabricator.wikimedia.org/T150708 (10Nuria) 05Open>03declined
[22:53:19] <wikibugs>	 10Analytics, 10Analytics-Kanban, 10Patch-For-Review, 10User-Elukey: Upgrade Archiva (meitnerium) to Debian Stretch - https://phabricator.wikimedia.org/T192639 (10Smalyshev) archiva.wikimedia.org works fine for me now.
[23:21:45] <wikibugs>	 10Analytics, 10Contributors-Analysis, 10Product-Analytics: Streamline Superset signup and authentication - https://phabricator.wikimedia.org/T203132 (10Neil_P._Quinn_WMF)
[23:25:28] <wikibugs>	 10Analytics, 10Contributors-Analysis, 10Product-Analytics: Streamline Superset signup and authentication - https://phabricator.wikimedia.org/T203132 (10Nuria) >Ask the Analytics team to create a new Superset account. This should no longer be the case with our newest install, please try  (with a new user that...