[00:17:30] <wikibugs>	 10Analytics, 10Product-Analytics, 10Research, 10WMDE-Analytics-Engineering, and 2 others: Replace the current multisource analytics-store setup - https://phabricator.wikimedia.org/T172410 (10Tbayer) Yup, thank you DBA crew! Your work is very much appreciated.
[02:23:26] <wikibugs>	 10Quarry, 10Browser-Support-Google-Chrome, 10Patch-For-Review: Letter g cut off at bottom in #title in Chrome based browsers - https://phabricator.wikimedia.org/T216581 (10Aklapper)
[03:57:21] <wikibugs>	 10Analytics, 10Analytics-Kanban, 10Analytics-Wikimetrics: Sunset Wikimetrics - https://phabricator.wikimedia.org/T211835 (10Nuria) >@MaxSem Noted, still, is the best replacement that exists for a tool that sees very few use if any.  Quantifying this a bit. Wikimetrics has about 100 unique visits every month,...
[04:30:48] <wikibugs>	 10Analytics, 10Discovery, 10Operations, 10Research: Workflow to be able to move data files computed in jobs from analytics cluster to production - https://phabricator.wikimedia.org/T213976 (10Nuria) >but we might be able to hack together an rsync pipeline for that in the short term if we have to I rather k...
[04:33:06] <wikibugs>	 10Analytics-EventLogging, 10Analytics-Kanban, 10EventBus, 10Product-Analytics, and 5 others: Modern Event Platform: Schema Guidelines and Conventions - https://phabricator.wikimedia.org/T214093 (10Nuria) Should be has_cookie(s): true/false (PLURAL)
[04:33:53] <wikibugs>	 10Analytics, 10User-Elukey: Staging environment for upgrades of superset - https://phabricator.wikimedia.org/T212243 (10Nuria) +1 to this plan
[04:48:38] <wikibugs>	 (03CR) 10Nuria: "Is this code still WIP?" [analytics/refinery] - 10https://gerrit.wikimedia.org/r/489313 (https://phabricator.wikimedia.org/T215655) (owner: 10Milimetric)
[04:52:13] <wikibugs>	 10Analytics: Coarse alarm on data quality for refined data based on entrophy calculations - https://phabricator.wikimedia.org/T215863 (10Nuria)
[05:38:06] <wikibugs>	 10Analytics, 10Operations, 10ops-eqiad, 10Patch-For-Review, 10User-Elukey: rack/setup/install labsdb1012.eqiad.wmnet - https://phabricator.wikimedia.org/T215231 (10ayounsi) a:05ayounsi→03Cmjohnson Talked to Chris, the server is actually in B8
[06:53:08] <wikibugs>	 10Analytics, 10Product-Analytics, 10Research, 10WMDE-Analytics-Engineering, and 3 others: Provide tools for querying MediaWiki replica databases without having to specify the shard - https://phabricator.wikimedia.org/T212386 (10elukey) All good if we close this task? Or is there anything else pending?
[06:56:15] <wikibugs>	 10Analytics, 10Analytics-Kanban, 10DBA, 10Patch-For-Review, 10User-Banyek: Migrate dbstore1002 to a multi instance setup on dbstore100[3-5] - https://phabricator.wikimedia.org/T210478 (10Marostegui)
[06:59:52] <elukey>	 Amir1,addshore o/ - Did you see my email about sunsetting dbstore1002 on March 4th/5th? Would it be acceptable for you guys?
[07:10:44] <wikibugs>	 10Analytics, 10Operations, 10ops-eqiad, 10Patch-For-Review, 10User-Elukey: rack/setup/install labsdb1012.eqiad.wmnet - https://phabricator.wikimedia.org/T215231 (10ayounsi) Talking to @elukey about that. In eqiad only rows A and C have the cloud-support vlan: https://netbox.wikimedia.org/ipam/vlans/?q=cl...
[07:16:15] <wikibugs>	 10Analytics, 10Operations, 10ops-eqiad, 10Patch-For-Review, 10User-Elukey: rack/setup/install labsdb1012.eqiad.wmnet - https://phabricator.wikimedia.org/T215231 (10elukey) Had a chat with Manuel, if possible let's move the host in row A so we have 2 labsdb hosts in there and 2 in row C :)
[07:37:17] * joal feels good in those days of deprecation :)
[07:39:59] <elukey>	 :)
[07:40:14] <joal>	 morning elukey :)
[07:45:49] <elukey>	 bonjour!
[07:48:19] <wikibugs>	 (03CR) 10Joal: [C: 03+1] "Nice :)" [analytics/refinery] - 10https://gerrit.wikimedia.org/r/492208 (owner: 10Milimetric)
[08:09:54] <wikibugs>	 (03CR) 10Joal: [C: 04-1] "2 comments inline (1 mandatory) and some more here:" (032 comments) [analytics/refinery] - 10https://gerrit.wikimedia.org/r/492209 (https://phabricator.wikimedia.org/T215290) (owner: 10Milimetric)
[08:10:26] <wikibugs>	 10Analytics, 10Analytics-Kanban, 10Patch-For-Review: Move AQS to nodejs 10 - https://phabricator.wikimedia.org/T210706 (10elukey) >>! In T210706#4973758, @Milimetric wrote: > Started trying to help on this, ran into two problems: >  > 1. keyspaces aren't created yet on deployment-aqs01.  That means aqs didn'...
[08:13:59] <wikibugs>	 10Analytics, 10Analytics-Kanban, 10Patch-For-Review: Move AQS to nodejs 10 - https://phabricator.wikimedia.org/T210706 (10JAllemandou) > I created the user aqs in cassandra, this was surely missing. IIRC the keyspaces needed to be created by hand and then some data can be added to them via https://wikitech.w...
[08:18:18] <wikibugs>	 10Analytics, 10Analytics-Kanban, 10Patch-For-Review: Move AQS to nodejs 10 - https://phabricator.wikimedia.org/T210706 (10elukey) So something is not working, I don't see the aqs keyspaces:  ` aqs@cqlsh> describe keyspaces;  system_traces  system_auth  system  system_distributed `
[08:27:47] <joal>	 elukey: have you by any chance tested the oozie job_tracker property removal?
[08:28:13] <elukey>	 joal: nope
[08:28:18] <joal>	 ok :)
[08:34:24] <elukey>	 joal: I am wondering if the aqs keyspaces are created when data is inserted
[08:34:28] <elukey>	 could it be possible?
[08:37:30] <elukey>	 (inserted in the sense that lands to the aqs endpoint)
[08:39:00] <elukey>	 mmmm no probably it is an issue with aqs, don't even see the port bound
[08:40:45] <joal>	 elukey: maybe we need actual interaction with AQS for the keyspaces to be created, but I actually don't think so
[08:44:46] <elukey>	 joal: yep I think you are right, there is something deeper, the aqs daemon does not reach the step to bind the 7232 port
[08:44:55] <elukey>	 in the logs I don't see any error though
[08:44:55] <joal>	 :(
[08:45:17] <elukey>	 it connects to cassandra etc..
[08:48:54] <joal>	 elukey: no cassandra keyspace
[08:49:09] <joal>	 elukey: I also couldn't connect with aqs user to cassandra
[08:49:39] <elukey>	 joal: what do you mean?
[08:50:08] <joal>	 elukey: I actually had the wrong passwd
[08:50:22] <joal>	 elukey: connection to cassandra with aqs user has worked for me
[08:50:37] <elukey>	 ah ok :)
[08:50:42] <elukey>	 I am fixing the deploy repo
[08:50:45] <elukey>	 it was a bit stale
[08:50:48] <elukey>	 maybe this is the issue
[08:50:49] <joal>	 k
[08:57:07] <elukey>	 ahhh dear cassandra
[08:57:09] <elukey>	 I missed you
[08:57:14] <addshore>	 elukey: yes, :)
[08:57:29] <addshore>	 We havnt finished migrating things yet (obviously) but that deadline should be fine
[08:57:36] <elukey>	 nice!!!
[09:49:50] <elukey>	 I haven't still figure out what's wrong with AQS
[09:49:51] <elukey>	 sigh
[09:49:58] <joal>	 :S
[09:50:03] <joal>	 elukey: can I help
[09:50:03] <joal>	 ?
[09:50:31] <elukey>	 joal: feel free if you want, I am checking configs etc.., I might miss something obvious
[09:50:39] <joal>	 hm
[09:50:43] <elukey>	 from what I can see the aqs service runner doesn't get to bind the port
[09:51:13] <joal>	 elukey: are logs in syslog?
[09:51:26] <joal>	 Seems so :)
[09:51:42] <joal>	 deployment-aqs01 systemd[1]: aqs.service: Main process exited, code=exited, status=1/FAILURE
[09:52:06] <elukey>	 yes I disabled the gelf config
[09:52:19] <elukey>	 they are also in /srv/log/aqs/syslog.log
[09:52:45] <joal>	 Connection to 172.16.1.5:9042 could not be created: Error: connect ECONNREFUSED 172.16.1.5:9042
[09:52:54] <joal>	 AQS doesn't manage to connect to cassandra
[09:53:15] <elukey>	 joal: I restarted cassandra this is why
[09:53:20] <joal>	 Ah ok
[09:54:39] <wikibugs>	 (03PS3) 10Fdans: [wip] Refactor dashboard metric widget [analytics/wikistats2] - 10https://gerrit.wikimedia.org/r/492060 (https://phabricator.wikimedia.org/T187806)
[09:55:41] <elukey>	 tried to check with strace etc.. but nothing really stands out 
[09:56:23] <elukey>	 tried to run it manually without firejail, with ferm disabled, etc..
[09:56:48] <elukey>	 the impression that I have is that service runner gets stuck somewhre
[09:56:51] <elukey>	 *somewhere
[09:56:59] <elukey>	 and it doesn't end up binding the port
[09:57:12] <elukey>	 (that should be 7323)
[09:57:46] <elukey>	 also tried to remove the druid config
[09:58:01] <joal>	 hm
[09:58:17] <elukey>	 joal: just set log to trace
[09:58:34] <joal>	 reading logs
[09:58:47] <elukey>	 seems using the cassandra drivers
[09:58:49] <elukey>	 but that's it
[09:58:52] <joal>	 up
[10:01:37] <wikibugs>	 (03CR) 10jerkins-bot: [V: 04-1] [wip] Refactor dashboard metric widget [analytics/wikistats2] - 10https://gerrit.wikimedia.org/r/492060 (https://phabricator.wikimedia.org/T187806) (owner: 10Fdans)
[10:02:15] <joal>	 This is super weird luca :(
[10:02:40] <joal>	 possibly aqs user restriction over cassandra?
[10:02:50] <joal>	 like not allowed to create/update keyspaces?
[10:02:59] <joal>	 elukey: --^
[10:03:54] <elukey>	 this is a very good point
[10:03:57] <elukey>	 lemme check the perms 
[10:03:59] <elukey>	 in prod
[10:06:08] <elukey>	 {"name":"aqs","hostname":"deployment-aqs01","pid":23,"level":40,"levelPath":"warn/startup","msg":"listening on *:7232","time":"2019-02-22T10:05:36.641Z","v":0}
[10:06:14] <elukey>	 magic Joseph is magic
[10:06:23] <joal>	 \o/ !
[10:06:44] <elukey>	 thanks!
[10:07:14] <joal>	 No prob :) Thanks for setting up the playground ;)
[10:07:14] <elukey>	 I am going to follow up with Marko on this
[10:07:17] <joal>	 Sure
[10:07:43] <elukey>	 also going to update our docs
[10:09:31] <joal>	 elukey: I confirm endpoints work (no data, obviously, but I get an answer)
[10:10:25] <joal>	 elukey: And cassandra have keyspaces :)
[10:11:28] <wikibugs>	 10Analytics, 10Analytics-Kanban, 10Patch-For-Review: Move AQS to nodejs 10 - https://phabricator.wikimedia.org/T210706 (10elukey) Joseph found the answer, I missed to add the GRANTs for the aqs user, now I can see:  ` aqs@cqlsh> describe keyspaces;  "local_group_default_T_pageviews_per_project_v2" "local_gro...
[10:12:41] <elukey>	 yeah :(
[10:12:45] <elukey>	 what a waste of time
[10:16:38] <wikibugs>	 10Analytics, 10Analytics-Kanban, 10Patch-For-Review: Move AQS to nodejs 10 - https://phabricator.wikimedia.org/T210706 (10elukey) @mobrovac hello! Today I had an interesting debugging session on the AQS deployment-prep hosts. I was bootstrapping the cluster with Stretch instances, cassandra configured, etc.....
[10:29:48] <icinga-wm>	 PROBLEM - eventbus grafana alert on icinga2001 is CRITICAL: CRITICAL: EventBus ( https://grafana.wikimedia.org/d/000000201/eventbus ) is alerting: EventBus POST Response Status alert.
[10:34:44] <icinga-wm>	 RECOVERY - eventbus grafana alert on icinga2001 is OK: OK: EventBus ( https://grafana.wikimedia.org/d/000000201/eventbus ) is not alerting.
[10:48:25] <elukey>	 this is an ongoing issue with elastic search restarts --^
[10:51:52] <elukey>	 all right march 4th is the deadline for dbstore1002!
[10:52:31] <elukey>	 joal: report updater and sqoop should be migrated before then, but it shouldn't be a big deal IIUC. I can work on them if you guys don't have time..
[10:52:35] <moritzm>	 \o/
[10:53:14] <joal>	 elukey: milimetric has provided a patch for sqoop already, and I have not followed RU side
[10:55:51] <elukey>	 nice!
[10:56:24] <elukey>	 joal: labsdb1012 needs to be racked on a different row, and then configured..
[10:56:38] <elukey>	 hopefully Chris will be able to do it early next week
[10:56:51] <elukey>	 if not, the march snapshot might not come from the new host :(
[10:57:16] <joal>	 elukey: no big deal on my side - If we can make it so that april will, I'll be happy :)
[11:02:28] <wikibugs>	 10Analytics, 10Analytics-Kanban, 10DBA, 10Patch-For-Review, 10User-Banyek: Migrate dbstore1002 to a multi instance setup on dbstore100[3-5] - https://phabricator.wikimedia.org/T210478 (10Marostegui)
[11:02:37] <wikibugs>	 10Analytics, 10Analytics-Kanban, 10Operations, 10Product-Analytics, 10Patch-For-Review: dbstore1002 Mysql errors - https://phabricator.wikimedia.org/T213670 (10Marostegui) 05Open→03Resolved MySQL will be stopped the 4th of March as a final part of the deprecation of this host.  It has been on read on...
[11:07:17] <wikibugs>	 10Analytics, 10Analytics-Kanban, 10User-Marostegui: Migrate users to dbstore100[3-5] - https://phabricator.wikimedia.org/T215589 (10elukey)
[11:08:51] <wikibugs>	 10Analytics, 10Analytics-Kanban, 10User-Marostegui: Migrate users to dbstore100[3-5] - https://phabricator.wikimedia.org/T215589 (10Marostegui)
[11:09:01] <wikibugs>	 10Analytics, 10Analytics-Kanban, 10User-Marostegui: Migrate users to dbstore100[3-5] - https://phabricator.wikimedia.org/T215589 (10Marostegui)
[11:33:51] <elukey>	 joal: do we have scripts to bootstrap the hive wmf/wmf_raw tables or was it all done by hand?
[11:34:09] <joal>	 elukey: all done by hand
[11:34:27] <joal>	 elukey: sorry :(
[11:34:57] <elukey>	 ah! nono just seeing errors now in the coordinators, will fix them :)
[11:35:05] <elukey>	 I guess that I have to create all the tables etc..
[11:35:16] <elukey>	 for both wmf_raw and wmf
[11:36:20] <joal>	 correct elukey, table definitions in refinery/hive/webrequest are needed (scripts beginning by create_ , and not the subset ones)
[11:54:23] <wikibugs>	 10Analytics, 10Product-Analytics, 10Research, 10WMDE-Analytics-Engineering, and 2 others: Replace the current multisource analytics-store setup - https://phabricator.wikimedia.org/T172410 (10Marostegui)
[11:55:09] <wikibugs>	 10Analytics, 10Analytics-Kanban, 10DBA, 10Patch-For-Review, 10User-Banyek: Migrate dbstore1002 to a multi instance setup on dbstore100[3-5] - https://phabricator.wikimedia.org/T210478 (10Marostegui)
[11:57:14] <joal>	 git st
[11:57:17] <joal>	 oops
[11:57:57] <wikibugs>	 (03PS6) 10Joal: Refactor mediawiki-history core data gathering [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/491494 (https://phabricator.wikimedia.org/T216603)
[12:13:07] <elukey>	 ok refine works now, but the the data loss errors make the coordinators to fail
[12:13:17] <elukey>	 I wondering if it is due to the low amount of reqs
[12:14:30] <joal>	 Interesting !
[12:14:40] <joal>	 elukey: what type of dataloss do we get?
[12:16:10] <elukey>	 0 requests (0.0% of total) have incomplete records. 307236923 requests (99.996% of valid ones) were lost.
[12:17:08] <joal>	 WAT ?
[12:17:58] <elukey>	 I am pretty sure it is one of the regular holes that with very few reqs triggers this
[12:18:12] <joal>	 OOOOH !
[12:18:50] <joal>	 elukey: We check data validity using sequence numbers continuity - This by conmstruction fails when sampling input data :)
[12:19:17] <joal>	 elukey: sorry for not thinking of that earlier
[12:19:20] <elukey>	 ah snap you are right!
[12:19:28] <elukey>	 I didn't think about it either
[12:19:30] <elukey>	 yes
[12:19:32] <elukey>	 :)
[12:19:47] <joal>	 error_data_loss_threshold and warning_data_loss_threshold should be set to 1
[12:19:54] <elukey>	 yep
[12:21:10] <elukey>	 ok now refine fails
[12:21:10] <elukey>	 :D
[12:21:27] <joal>	 MWAHAHA :)
[12:21:43] <joal>	 Moving from one failure to the next
[12:22:52] <elukey>	 exactly :D
[12:44:44] <elukey>	 FAILED: Class org.wikimedia.analytics.refinery.hive.IsPageviewUDF not found
[12:44:47] <elukey>	 FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.FunctionTask
[12:44:50] <elukey>	 strange..
[12:44:51] <elukey>	 will do it after lunch :)
[12:45:17] <joal>	 hm
[12:49:13] * elukey lunch!
[12:57:33] <wikibugs>	 10Analytics, 10EventBus, 10MediaWiki-Core-Testing, 10Quibble, and 4 others: Flaky quibble-vendor-mysql-hhvm-docker test in Jenkins - https://phabricator.wikimedia.org/T216069 (10hashar) 05Open→03Resolved a:03hashar Root cause figured out. I will fill another task to cover the weird webdriver.io repor...
[13:02:33] <wikibugs>	 (03PS1) 10Joal: Add revision_hidden_parts to mediawiki-history [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/492304 (https://phabricator.wikimedia.org/T178587)
[13:21:44] <wikibugs>	 10Analytics, 10Discovery, 10Operations, 10Research: Workflow to be able to move data files computed in jobs from analytics cluster to production - https://phabricator.wikimedia.org/T213976 (10fgiunchedi) >>! In T213976#4974604, @Nuria wrote: >>but we might be able to hack together an rsync pipeline for tha...
[13:41:18] <wikibugs>	 10Analytics: Provide edit tags in the Data Lake edit data - https://phabricator.wikimedia.org/T161149 (10JAllemandou) p:05Triage→03High
[13:42:08] <wikibugs>	 10Analytics, 10Analytics-Kanban: Provide edit tags in the Data Lake edit data - https://phabricator.wikimedia.org/T161149 (10JAllemandou) a:03JAllemandou
[13:49:45] <wikibugs>	 (03PS1) 10Joal: Add change_tags to mediawiki_history [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/492320
[13:54:51] <wikibugs>	 10Analytics, 10Analytics-Data-Quality, 10Analytics-Kanban, 10Contributors-Analysis, 10Product-Analytics: mediawiki_history missing page events - https://phabricator.wikimedia.org/T205594 (10JAllemandou) a:03JAllemandou
[13:55:38] <wikibugs>	 10Analytics, 10Analytics-Data-Quality, 10Product-Analytics: page_creation_timestamp not always correct in mediawiki_history - https://phabricator.wikimedia.org/T214490 (10JAllemandou) a:03JAllemandou
[13:55:56] <wikibugs>	 10Analytics, 10Analytics-Data-Quality, 10Analytics-Kanban, 10Product-Analytics: page_creation_timestamp not always correct in mediawiki_history - https://phabricator.wikimedia.org/T214490 (10JAllemandou)
[13:56:27] <wikibugs>	 10Analytics, 10Analytics-Kanban, 10Patch-For-Review: Update wikimedia-history revision data with deleted field (and find it a new name?) - https://phabricator.wikimedia.org/T178587 (10JAllemandou) a:03JAllemandou
[14:25:59] <wikibugs>	 10Analytics, 10Analytics-Cluster, 10User-EBernhardson: Setup ivysettings.xml for sourcing spark job dependencies from archiva - https://phabricator.wikimedia.org/T216093 (10Ottomata) Ya we can!  We can find a spot in puppet for it.
[14:26:53] <wikibugs>	 10Analytics, 10Product-Analytics, 10Research, 10WMDE-Analytics-Engineering, and 2 others: Replace the current multisource analytics-store setup - https://phabricator.wikimedia.org/T172410 (10Ottomata) Indeed many many thanks yall!
[14:28:07] <wikibugs>	 10Analytics, 10Discovery, 10Operations, 10Research: Workflow to be able to move data files computed in jobs from analytics cluster to production - https://phabricator.wikimedia.org/T213976 (10Ottomata) Ok!   @bmansurov it sounds like we might be blocking you for a bit more while we solve this problem.  I'm...
[14:46:03] <wikibugs>	 10Analytics, 10Community-Tech, 10EventBus, 10Internet-Archive, and 3 others: Edits to Flow pages result in a page-links-change event with no performer - https://phabricator.wikimedia.org/T216726 (10bmansurov) The [[ https://www.mediawiki.org/wiki/Extension:StructuredDiscussions | wiki page ]] doesn't seem...
[14:47:23] <wikibugs>	 10Analytics, 10Discovery, 10Operations, 10Research: Workflow to be able to move data files computed in jobs from analytics cluster to production - https://phabricator.wikimedia.org/T213976 (10bmansurov) @Ottomata OK, thank you!
[14:48:08] <elukey>	 all right refine seems working on the testing cluster \o/
[14:48:24] <elukey>	 just launched the bundle, will let it go for some hours to catch up
[14:48:27] <elukey>	 should be quick
[14:49:00] <elukey>	 brb
[15:16:40] <icinga-wm>	 PROBLEM - eventbus grafana alert on icinga2001 is CRITICAL: CRITICAL: EventBus ( https://grafana.wikimedia.org/d/000000201/eventbus ) is alerting: EventBus POST Response Status alert.
[15:19:08] <icinga-wm>	 RECOVERY - eventbus grafana alert on icinga2001 is OK: OK: EventBus ( https://grafana.wikimedia.org/d/000000201/eventbus ) is not alerting.
[15:25:03] <elukey>	 bringing my cat to the vet, brb!
[15:59:22] <wikibugs>	 10Analytics, 10Analytics-Kanban, 10Wikimedia-Stream, 10Patch-For-Review: EventStreams returns 502 errors from outside the WMF network - https://phabricator.wikimedia.org/T215013 (10Ottomata) We believe this happened on purpose!  Look at the past me doing a great job: {T196553}  We just need better monitori...
[15:59:35] <wikibugs>	 10Analytics, 10Product-Analytics, 10Readers-Web-Backlog (Tracking): Whitelist sample flags and page/rev ID fields for ReadingDepth schema - https://phabricator.wikimedia.org/T216096 (10mforns) @Tbayer event_sanitized.readingdepth is backfilled using the new whitelist. I have vetted the resulting data and it...
[15:59:54] <wikibugs>	 10Analytics, 10Analytics-Kanban, 10Product-Analytics, 10Readers-Web-Backlog (Tracking): Whitelist sample flags and page/rev ID fields for ReadingDepth schema - https://phabricator.wikimedia.org/T216096 (10mforns) a:03mforns
[16:00:05] <wikibugs>	 10Analytics, 10Knowledge-Integrity, 10Research, 10Epic, 10Patch-For-Review: Citation Usage: run third round of data collection - https://phabricator.wikimedia.org/T213969 (10bmansurov) Data collection at 1% will happen from 02/25, 14:30 EST til 02/27, 12:30 EST.
[16:07:11] <wikibugs>	 10Analytics, 10Product-Analytics, 10Reading-analysis, 10Patch-For-Review: [EventLogging Sanitization] Update EL sanitization white-list for field renames in EL schemas - https://phabricator.wikimedia.org/T209087 (10mforns) @chelsyx @mpopov @Neil_P._Quinn_WMF  (cc @nuria) I backfilled both schemas since the...
[16:07:33] <wikibugs>	 10Analytics, 10Analytics-Kanban, 10Product-Analytics, 10Reading-analysis, 10Patch-For-Review: [EventLogging Sanitization] Update EL sanitization white-list for field renames in EL schemas - https://phabricator.wikimedia.org/T209087 (10mforns) a:05mpopov→03mforns
[16:12:15] <ottomata>	 gotta run an errand, back in a few...
[16:15:33] <wikibugs>	 10Analytics-EventLogging, 10Analytics-Kanban, 10Patch-For-Review: [EventLogging Sanitization] Enable older-than-90-day purging of unsanitized EL database (event) in Hive - https://phabricator.wikimedia.org/T209503 (10mforns) @Tbayer @Neil_P._Quinn_WMF @Miriam @leila @mpopov @bmansurov @nettrom_WMF @chelsyx @...
[16:19:43] <wikibugs>	 10Analytics-EventLogging, 10Analytics-Kanban, 10Patch-For-Review: [EventLogging Sanitization] Enable older-than-90-day purging of unsanitized EL database (event) in Hive - https://phabricator.wikimedia.org/T209503 (10leila) @mforns I may have missed this: where is the list of whitelisted event databases? I'l...
[16:23:28] <wikibugs>	 10Analytics-EventLogging, 10Analytics-Kanban, 10Patch-For-Review: [EventLogging Sanitization] Enable older-than-90-day purging of unsanitized EL database (event) in Hive - https://phabricator.wikimedia.org/T209503 (10mforns) @leila, it's this one: https://github.com/wikimedia/analytics-refinery/blob/master/s...
[16:41:04] <wikibugs>	 10Analytics, 10EventBus, 10Internet-Archive, 10MediaWiki-extensions-WikimediaEvents, and 2 others: Edits to Flow pages result in a page-links-change event with no performer - https://phabricator.wikimedia.org/T216726 (10MusikAnimal) According to https://www.mediawiki.org/wiki/Developers/Maintainers it belo...
[16:48:50] <wikibugs>	 10Analytics, 10EventBus, 10Internet-Archive, 10MediaWiki-extensions-WikimediaEvents, and 2 others: Edits to Flow pages result in a page-links-change event with no performer - https://phabricator.wikimedia.org/T216726 (10bmansurov) Thanks. Wasn't Growth dismantled at some point? Apparently, it's back!
[16:49:10] <wikibugs>	 10Analytics, 10EventBus, 10Growth-Team, 10Internet-Archive, and 3 others: Edits to Flow pages result in a page-links-change event with no performer - https://phabricator.wikimedia.org/T216726 (10bmansurov)
[16:49:58] <fdans>	 milimetric: I'm feeling things I haven't felt in years:
[16:50:06] <fdans>	 https://usercontent.irccloud-cdn.com/file/Mf0mt4Cm/groups.gif
[16:53:22] <harej>	 (I am not sure what I should be looking at?)
[16:53:30] <fdans>	 next in wikistats: TRANSITIONS EVERYWHERE
[16:53:44] <milimetric>	 fdans: I'd do a sliding transition instead of a fade, give it some feeling of space and solidity
[16:54:04] <fdans>	 harej: we're trying to improve the visibility/discoverability of metrics that aren't in the dashboard
[16:54:24] <milimetric>	 I'm also curious if it should be the rightmost widget instead of the leftmost
[16:54:39] <milimetric>	 eyes theoretically go right top left middle, right?
[16:54:42] <harej>	 fdans: through like a rotating carousel feature?
[16:55:29] <fdans>	 milimetric: it can be anything
[16:55:43] <fdans>	 basically now you can assign slots of the dashboard to metric groups
[16:56:03] <fdans>	 which are defined in the metric config by specifying which metric group the metric belongs to
[16:56:41] <milimetric>	 fdans: sorry, I should've said: this is awesome, I like it, and here are more thoughts
[16:56:57] <milimetric>	 (not to be nice, but because it's what I thought)
[16:57:37] <fdans>	 milimetric: naa it's the subtext that matters, I knew you would like it and I expected feedback :)
[17:03:16] <ottomata>	 trying tio join...
[17:03:57] <fdans>	 a-team whatsuuup standuuup
[17:30:38] * elukey off!
[17:30:58] <wikibugs>	 10Analytics, 10Analytics-Kanban, 10Wikimedia-Stream, 10Patch-For-Review: EventStreams returns 502 errors from outside the WMF network - https://phabricator.wikimedia.org/T215013 (10Ottomata) Done! https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=icinga2001&service=Check+if+active+EventSt...
[18:01:18] <ottomata>	 ?
[18:31:48] <wikibugs>	 10Analytics, 10Analytics-Cluster, 10Analytics-Kanban, 10Patch-For-Review, 10User-EBernhardson: Setup ivysettings.xml for sourcing spark job dependencies from archiva - https://phabricator.wikimedia.org/T216093 (10Ottomata)
[18:32:03] <wikibugs>	 10Analytics, 10Analytics-Cluster, 10Analytics-Kanban, 10Patch-For-Review, 10User-EBernhardson: Setup ivysettings.xml for sourcing spark job dependencies from archiva - https://phabricator.wikimedia.org/T216093 (10Ottomata) p:05Triage→03High
[18:32:20] <wikibugs>	 10Analytics, 10Analytics-Cluster, 10Analytics-Kanban, 10Patch-For-Review, 10User-EBernhardson: Setup ivysettings.xml for sourcing spark job dependencies from archiva - https://phabricator.wikimedia.org/T216093 (10Ottomata) a:03Ottomata
[18:42:34] <wikibugs>	 10Analytics, 10Analytics-Kanban, 10Analytics-Wikimetrics: Sunset Wikimetrics - https://phabricator.wikimedia.org/T211835 (10mforns)
[19:54:29] <wikibugs>	 10Analytics, 10Product-Analytics: Metrics request on portal namespace usage - https://phabricator.wikimedia.org/T205681 (10Tbayer) I'm going to set aside some time again on Monday (Feb 25) to wrap this up, including documenting what we now know about the data issue with the referrers (and whether/how it might...
[20:08:37] <wikibugs>	 (03CR) 10Milimetric: [V: 03+2 C: 03+2] "What's all this +1 stuff, let's +2 if there are no objections." [analytics/refinery] - 10https://gerrit.wikimedia.org/r/492208 (owner: 10Milimetric)
[20:25:36] <wikibugs>	 (03CR) 10Milimetric: "> Changes in util.py are part of another patch" (032 comments) [analytics/refinery] - 10https://gerrit.wikimedia.org/r/492209 (https://phabricator.wikimedia.org/T215290) (owner: 10Milimetric)
[20:26:15] <wikibugs>	 (03PS2) 10Milimetric: Use db_mapping to find the hostname [analytics/refinery] - 10https://gerrit.wikimedia.org/r/492209 (https://phabricator.wikimedia.org/T215290)
[20:50:44] <wikibugs>	 10Analytics, 10Analytics-Kanban, 10Patch-For-Review: Move AQS to nodejs 10 - https://phabricator.wikimedia.org/T210706 (10mobrovac) >>! In T210706#4975164, @elukey wrote: > @mobrovac hello! Today I had an interesting debugging session on the AQS deployment-prep hosts. I was bootstrapping the cluster with Str...
[21:55:46] <wikibugs>	 (03PS1) 10Ottomata: [POC] Event(Logging) schema loader [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/492399
[21:55:59] <wikibugs>	 (03CR) 10Ottomata: "Totally untested" [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/492399 (owner: 10Ottomata)
[21:59:23] <wikibugs>	 (03PS2) 10Ottomata: [POC] Event(Logging) schema loader [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/492399
[22:00:11] <wikibugs>	 (03CR) 10jerkins-bot: [V: 04-1] [POC] Event(Logging) schema loader [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/492399 (owner: 10Ottomata)
[22:23:02] <wikibugs>	 10Analytics: Clean up home dirs for user mkroetzsch - https://phabricator.wikimedia.org/T214501 (10Smalyshev) Yes I think so.
[22:38:49] <wikibugs>	 10Analytics-EventLogging, 10Analytics-Kanban, 10Patch-For-Review: [EventLogging Sanitization] Enable older-than-90-day purging of unsanitized EL database (event) in Hive - https://phabricator.wikimedia.org/T209503 (10Nuria) @leila it is not a whitelist of databases but rather schema fields per schema, every...